gimi9 Pandas Profiling

Dataset statistics

Number of variables	10
Number of observations	10000
Missing cells	2
Missing cells (%)	< 0.1%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	947.3 KiB
Average record size in memory	97.0 B

Variable types

DateTime	1
Numeric	9

Dataset

Description	한국동서발전에서 제주지역 태양광 발전량 예측을 위해 1시간 주기 기상청의 종관기상관측, 전력거래소의 시장참여 태양광 설비 및 발전량 데이터를 연계하여 가공한 데이터 입니다.일시, 기온, 강수량, 일사량, 태양광 설비용량, 태양광 발전량 등의 항목으로 구성됩니다.
Author	한국동서발전(주)
URL	https://www.data.go.kr/data/15126430/fileData.do

Alerts

`일조(hr)` is highly overall correlated with `일사량` and 1 other fields	High correlation
`일사량` is highly overall correlated with `일조(hr)` and 1 other fields	High correlation
`태양광 발전량(MWh)` is highly overall correlated with `일조(hr)` and 1 other fields	High correlation
`적설(cm)` is highly skewed (γ1 = 21.47697729)	Skewed
`일시` has unique values	Unique
`강수량(mm)` has 9365 (93.7%) zeros	Zeros
`적설(cm)` has 9914 (99.1%) zeros	Zeros
`전운량(10분위)` has 1415 (14.1%) zeros	Zeros
`일조(hr)` has 6824 (68.2%) zeros	Zeros
`일사량` has 4986 (49.9%) zeros	Zeros
`태양광 발전량(MWh)` has 1135 (11.3%) zeros	Zeros

Reproduction

Analysis started	2024-03-14 21:21:47.759974
Analysis finished	2024-03-14 21:22:09.427723
Duration	21.67 seconds
Software version	ydata-profiling vv4.5.1
Download configuration	config.json

일시
Date

UNIQUE

Distinct	10000
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Memory size	156.2 KiB

Minimum	2020-01-01 01:00:00
Maximum	2022-12-31 21:00:00

Histogram

Histogram with fixed size bins (bins=50)

기온
Real number (ℝ)

Distinct	363
Distinct (%)	3.6%
Missing	2
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	16.986627

Minimum	-2.7
Maximum	36.2
Zeros	0
Zeros (%)	0.0%
Negative	14
Negative (%)	0.1%
Memory size	166.0 KiB

Quantile statistics

Minimum	-2.7
5-th percentile	4.285
Q1	10.5
median	17.1
Q3	23.5
95-th percentile	29.5
Maximum	36.2
Range	38.9
Interquartile range (IQR)	13

Descriptive statistics

Standard deviation	8.0153559
Coefficient of variation (CV)	0.4718627
Kurtosis	-0.98513155
Mean	16.986627
Median Absolute Deviation (MAD)	6.5
Skewness	-0.0073865721
Sum	169832.3
Variance	64.24593
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
22.7	58	0.6%
12.2	57	0.6%
19.4	54	0.5%
27.0	52	0.5%
11.6	52	0.5%
11.7	51	0.5%
20.5	51	0.5%
23.5	50	0.5%
22.6	50	0.5%
19.1	50	0.5%
Other values (353)	9473	94.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-2.7	1	< 0.1%
-1.9	2	< 0.1%
-1.5	1	< 0.1%
-1.4	1	< 0.1%
-1.1	2	< 0.1%
-1.0	1	< 0.1%
-0.8	1	< 0.1%
-0.6	2	< 0.1%
-0.5	1	< 0.1%
-0.3	2	< 0.1%

Value	Count	Frequency (%)
36.2	1	< 0.1%
35.7	1	< 0.1%
35.6	1	< 0.1%
35.5	1	< 0.1%
35.2	2	< 0.1%
35.1	3	< 0.1%
34.9	4	< 0.1%
34.8	2	< 0.1%
34.7	1	< 0.1%
34.6	2	< 0.1%

강수량(mm)
Real number (ℝ)

ZEROS

Distinct	104
Distinct (%)	1.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.14466

Minimum	0
Maximum	37
Zeros	9365
Zeros (%)	93.7%
Negative	0
Negative (%)	0.0%
Memory size	166.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0.2
Maximum	37
Range	37
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	1.0950632
Coefficient of variation (CV)	7.5699101
Kurtosis	317.46389
Mean	0.14466
Median Absolute Deviation (MAD)	0
Skewness	14.926148
Sum	1446.6
Variance	1.1991634
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.0	9365	93.7%
0.1	93	0.9%
0.2	57	0.6%
0.3	34	0.3%
0.5	33	0.3%
0.7	29	0.3%
0.4	27	0.3%
0.8	26	0.3%
1.0	20	0.2%
0.9	17	0.2%
Other values (94)	299	3.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.0	9365	93.7%
0.1	93	0.9%
0.2	57	0.6%
0.3	34	0.3%
0.4	27	0.3%
0.5	33	0.3%
0.6	12	0.1%
0.7	29	0.3%
0.8	26	0.3%
0.9	17	0.2%

Value	Count	Frequency (%)
37.0	1	< 0.1%
30.7	1	< 0.1%
24.2	1	< 0.1%
22.9	1	< 0.1%
21.7	1	< 0.1%
20.9	1	< 0.1%
20.5	1	< 0.1%
17.1	1	< 0.1%
15.3	1	< 0.1%
15.1	1	< 0.1%

습도
Real number (ℝ)

Distinct	83
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	70.0419

Minimum	14
Maximum	100
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	166.0 KiB

Quantile statistics

Minimum	14
5-th percentile	46
Q1	60
median	70
Q3	81
95-th percentile	94
Maximum	100
Range	86
Interquartile range (IQR)	21

Descriptive statistics

Standard deviation	14.767408
Coefficient of variation (CV)	0.21083678
Kurtosis	-0.3280668
Mean	70.0419
Median Absolute Deviation (MAD)	11
Skewness	-0.16567766
Sum	700419
Variance	218.07635
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
72	289	2.9%
64	274	2.7%
73	262	2.6%
67	262	2.6%
66	257	2.6%
70	247	2.5%
65	244	2.4%
76	242	2.4%
63	241	2.4%
71	238	2.4%
Other values (73)	7444	74.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
14	2	< 0.1%
18	1	< 0.1%
20	1	< 0.1%
21	2	< 0.1%
22	1	< 0.1%
23	4	< 0.1%
24	5	0.1%
25	10	0.1%
26	4	< 0.1%
27	7	0.1%

Value	Count	Frequency (%)
100	36	0.4%
99	51	0.5%
98	65	0.7%
97	91	0.9%
96	101	1.0%
95	114	1.1%
94	127	1.3%
93	141	1.4%
92	120	1.2%
91	126	1.3%

적설(cm)
Real number (ℝ)

SKEWED ZEROS

Distinct	35
Distinct (%)	0.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.01841

Minimum	0
Maximum	9.2
Zeros	9914
Zeros (%)	99.1%
Negative	0
Negative (%)	0.0%
Memory size	166.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0
Maximum	9.2
Range	9.2
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.29797139
Coefficient of variation (CV)	16.185301
Kurtosis	515.53282
Mean	0.01841
Median Absolute Deviation (MAD)	0
Skewness	21.476977
Sum	184.1
Variance	0.088786951
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=35)

Value	Count	Frequency (%)
0.0	9914	99.1%
0.5	12	0.1%
1.0	6	0.1%
0.4	5	0.1%
0.7	5	0.1%
0.3	5	0.1%
0.2	4	< 0.1%
5.0	4	< 0.1%
0.1	3	< 0.1%
1.2	3	< 0.1%
Other values (25)	39	0.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.0	9914	99.1%
0.1	3	< 0.1%
0.2	4	< 0.1%
0.3	5	0.1%
0.4	5	0.1%
0.5	12	0.1%
0.6	1	< 0.1%
0.7	5	0.1%
0.8	3	< 0.1%
0.9	1	< 0.1%

Value	Count	Frequency (%)
9.2	1	< 0.1%
8.8	2	< 0.1%
8.5	1	< 0.1%
7.7	1	< 0.1%
7.0	1	< 0.1%
6.5	1	< 0.1%
6.1	1	< 0.1%
5.6	1	< 0.1%
5.4	1	< 0.1%
5.0	4	< 0.1%

전운량(10분위)
Real number (ℝ)

ZEROS

Distinct	11
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	6.1659

Minimum	0
Maximum	10
Zeros	1415
Zeros (%)	14.1%
Negative	0
Negative (%)	0.0%
Memory size	166.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	3
median	7
Q3	9
95-th percentile	10
Maximum	10
Range	10
Interquartile range (IQR)	6

Descriptive statistics

Standard deviation	3.6132925
Coefficient of variation (CV)	0.58601218
Kurtosis	-1.1584372
Mean	6.1659
Median Absolute Deviation (MAD)	3
Skewness	-0.55771438
Sum	61659
Variance	13.055883
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=11)

Value	Count	Frequency (%)
10	2423	24.2%
0	1415	14.1%
9	1393	13.9%
8	1030	10.3%
7	853	8.5%
6	598	6.0%
3	498	5.0%
5	490	4.9%
2	463	4.6%
4	462	4.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1415	14.1%
1	375	3.8%
2	463	4.6%
3	498	5.0%
4	462	4.6%
5	490	4.9%
6	598	6.0%
7	853	8.5%
8	1030	10.3%
9	1393	13.9%

Value	Count	Frequency (%)
10	2423	24.2%
9	1393	13.9%
8	1030	10.3%
7	853	8.5%
6	598	6.0%
5	490	4.9%
4	462	4.6%
3	498	5.0%
2	463	4.6%
1	375	3.8%

일조(hr)
Real number (ℝ)

HIGH CORRELATION ZEROS

Distinct	11
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.22393

Minimum	0
Maximum	1
Zeros	6824
Zeros (%)	68.2%
Negative	0
Negative (%)	0.0%
Memory size	166.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.3
95-th percentile	1
Maximum	1
Range	1
Interquartile range (IQR)	0.3

Descriptive statistics

Standard deviation	0.37760113
Coefficient of variation (CV)	1.6862463
Kurtosis	-0.061978611
Mean	0.22393
Median Absolute Deviation (MAD)	0
Skewness	1.3084025
Sum	2239.3
Variance	0.14258261
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=11)

Value	Count	Frequency (%)
0.0	6824	68.2%
1.0	1355	13.6%
0.1	308	3.1%
0.9	263	2.6%
0.3	198	2.0%
0.2	190	1.9%
0.7	186	1.9%
0.8	178	1.8%
0.5	174	1.7%
0.4	173	1.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.0	6824	68.2%
0.1	308	3.1%
0.2	190	1.9%
0.3	198	2.0%
0.4	173	1.7%
0.5	174	1.7%
0.6	151	1.5%
0.7	186	1.9%
0.8	178	1.8%
0.9	263	2.6%

Value	Count	Frequency (%)
1.0	1355	13.6%
0.9	263	2.6%
0.8	178	1.8%
0.7	186	1.9%
0.6	151	1.5%
0.5	174	1.7%
0.4	173	1.7%
0.3	198	2.0%
0.2	190	1.9%
0.1	308	3.1%

일사량
Real number (ℝ)

HIGH CORRELATION ZEROS

Distinct	365
Distinct (%)	3.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.585019

Minimum	0
Maximum	3.7
Zeros	4986
Zeros (%)	49.9%
Negative	0
Negative (%)	0.0%
Memory size	166.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0.01
Q3	0.88
95-th percentile	2.78
Maximum	3.7
Range	3.7
Interquartile range (IQR)	0.88

Descriptive statistics

Standard deviation	0.92414795
Coefficient of variation (CV)	1.5796888
Kurtosis	1.3015921
Mean	0.585019
Median Absolute Deviation (MAD)	0.01
Skewness	1.5728849
Sum	5850.19
Variance	0.85404942
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.0	4986	49.9%
0.01	139	1.4%
0.02	97	1.0%
0.03	94	0.9%
0.04	67	0.7%
0.09	53	0.5%
0.05	52	0.5%
0.06	51	0.5%
0.07	49	0.5%
0.12	47	0.5%
Other values (355)	4365	43.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.0	4986	49.9%
0.01	139	1.4%
0.02	97	1.0%
0.03	94	0.9%
0.04	67	0.7%
0.05	52	0.5%
0.06	51	0.5%
0.07	49	0.5%
0.08	41	0.4%
0.09	53	0.5%

Value	Count	Frequency (%)
3.7	1	< 0.1%
3.69	1	< 0.1%
3.65	1	< 0.1%
3.63	3	< 0.1%
3.61	1	< 0.1%
3.6	2	< 0.1%
3.59	1	< 0.1%
3.58	1	< 0.1%
3.57	2	< 0.1%
3.55	1	< 0.1%

태양광 설비용량(MW)
Real number (ℝ)

Distinct	36
Distinct (%)	0.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	302.04081

Minimum	263.225
Maximum	368.121
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	166.0 KiB

Quantile statistics

Minimum	263.225
5-th percentile	266.195
Q1	284.907
median	297.708
Q3	312.984
95-th percentile	362.465
Maximum	368.121
Range	104.896
Interquartile range (IQR)	28.077

Descriptive statistics

Standard deviation	24.390247
Coefficient of variation (CV)	0.080751494
Kurtosis	0.86677368
Mean	302.04081
Median Absolute Deviation (MAD)	13.22
Skewness	0.96592038
Sum	3020408.1
Variance	594.88413
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=36)

Value	Count	Frequency (%)
318.531	306	3.1%
269.815	305	3.0%
289.459	303	3.0%
308.959	301	3.0%
288.53	297	3.0%
263.225	295	2.9%
278.569	294	2.9%
289.532	294	2.9%
302.092	292	2.9%
318.119	283	2.8%
Other values (26)	7030	70.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
263.225	295	2.9%
266.195	248	2.5%
269.815	305	3.0%
272.061	267	2.7%
277.87	274	2.7%
278.569	294	2.9%
282.355	281	2.8%
284.069	279	2.8%
284.907	281	2.8%
288.53	297	3.0%

Value	Count	Frequency (%)
368.121	281	2.8%
362.465	270	2.7%
354.942	282	2.8%
338.319	269	2.7%
323.159	258	2.6%
318.531	306	3.1%
318.119	283	2.8%
314.758	261	2.6%
313.437	268	2.7%
312.984	279	2.8%

태양광 발전량(MWh)
Real number (ℝ)

HIGH CORRELATION ZEROS

Distinct	4741
Distinct (%)	47.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	42.682091

Minimum	0
Maximum	257.39
Zeros	1135
Zeros (%)	11.3%
Negative	0
Negative (%)	0.0%
Memory size	166.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0.2
median	6.32
Q3	67.8925
95-th percentile	185.575
Maximum	257.39
Range	257.39
Interquartile range (IQR)	67.6925

Descriptive statistics

Standard deviation	63.080578
Coefficient of variation (CV)	1.4779168
Kurtosis	0.90663736
Mean	42.682091
Median Absolute Deviation (MAD)	6.32
Skewness	1.4575685
Sum	426820.91
Variance	3979.1594
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.0	1135	11.3%
0.01	181	1.8%
0.06	153	1.5%
0.19	150	1.5%
0.25	128	1.3%
0.02	116	1.2%
0.05	99	1.0%
0.18	93	0.9%
0.03	82	0.8%
0.24	74	0.7%
Other values (4731)	7789	77.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.0	1135	11.3%
0.01	181	1.8%
0.02	116	1.2%
0.03	82	0.8%
0.04	52	0.5%
0.05	99	1.0%
0.06	153	1.5%
0.07	42	0.4%
0.08	38	0.4%
0.09	35	0.4%

Value	Count	Frequency (%)
257.39	1	< 0.1%
257.35	1	< 0.1%
257.19	1	< 0.1%
255.55	1	< 0.1%
255.31	1	< 0.1%
254.13	1	< 0.1%
254.04	1	< 0.1%
252.22	1	< 0.1%
250.89	1	< 0.1%
247.56	1	< 0.1%

Phik (φk)
Auto

Heatmap
Table

	기온	강수량(mm)	습도	적설(cm)	전운량(10분위)	일조(hr)	일사량	태양광 설비용량(MW)	태양광 발전량(MWh)
기온	1.000	0.043	0.505	0.501	0.297	0.346	0.392	0.524	0.290
강수량(mm)	0.043	1.000	0.197	0.000	0.128	0.000	0.000	0.035	0.000
습도	0.505	0.197	1.000	0.000	0.479	0.410	0.365	0.258	0.375
적설(cm)	0.501	0.000	0.000	1.000	0.068	0.000	0.000	0.078	0.000
전운량(10분위)	0.297	0.128	0.479	0.068	1.000	0.518	0.349	0.172	0.379
일조(hr)	0.346	0.000	0.410	0.000	0.518	1.000	0.749	0.095	0.684
일사량	0.392	0.000	0.365	0.000	0.349	0.749	1.000	0.100	0.777
태양광 설비용량(MW)	0.524	0.035	0.258	0.078	0.172	0.095	0.100	1.000	0.116
태양광 발전량(MWh)	0.290	0.000	0.375	0.000	0.379	0.684	0.777	0.116	1.000

Heatmap
Table

	기온	강수량(mm)	습도	적설(cm)	전운량(10분위)	일조(hr)	일사량	태양광 설비용량(MW)	태양광 발전량(MWh)
기온	1.000	0.073	0.345	-0.158	0.002	0.243	0.299	0.136	0.222
강수량(mm)	0.073	1.000	0.341	0.089	0.319	-0.157	-0.086	-0.003	-0.100
습도	0.345	0.341	1.000	0.014	0.382	-0.365	-0.269	0.089	-0.277
적설(cm)	-0.158	0.089	0.014	1.000	0.045	-0.054	-0.043	0.009	-0.065
전운량(10분위)	0.002	0.319	0.382	0.045	1.000	-0.431	-0.171	-0.019	-0.201
일조(hr)	0.243	-0.157	-0.365	-0.054	-0.431	1.000	0.825	0.019	0.719
일사량	0.299	-0.086	-0.269	-0.043	-0.171	0.825	1.000	-0.015	0.889
태양광 설비용량(MW)	0.136	-0.003	0.089	0.009	-0.019	0.019	-0.015	1.000	0.052
태양광 발전량(MWh)	0.222	-0.100	-0.277	-0.065	-0.201	0.719	0.889	0.052	1.000

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows
Last rows

	일시	기온	강수량(mm)	습도	전운량(10분위)	일조(hr)	일사량	태양광 설비용량(MW)	태양광 발전량(MWh)
23679	2022-09-14 15:00	25.1	0.0	92	10	0.0	0.15	338.319	75.07
8658	2020-12-27 18:00	11.3	0.0	90	10	0.0	0.01	292.555	1.24
21639	2022-06-21 15:00	27.1	0.0	75	2	0.9	2.79	314.758	158.51
6947	2020-10-17 11:00	19.9	0.0	43	0	1.0	2.22	295.678	199.83
14815	2021-09-10 07:00	21.8	1.6	93	10	0.0	0.0	303.685	2.17
1447	2020-03-02 07:00	7.8	0.0	64	8	0.0	0.0	269.815	9.44
1497	2020-03-04 09:00	9.3	0.0	67	9	0.0	0.26	269.815	60.15
3710	2020-06-04 14:00	22.3	0.0	76	9	0.8	2.3	284.907	144.32
14644	2021-09-03 04:00	23.4	0.0	99	10	0.0	0.0	303.685	0.06
1939	2020-03-22 19:00	12.9	0.0	63	3	0.1	0.09	269.815	7.48

	일시	기온	강수량(mm)	습도	전운량(10분위)	일조(hr)	일사량	태양광 설비용량(MW)	태양광 발전량(MWh)
25104	2022-11-13 00:00	19.6	0.0	92	7	0.0	0.0	362.465	0.0
7994	2020-11-30 02:00	8.4	0.0	72	10	0.0	0.0	289.532	0.0
20029	2022-04-15 13:00	16.3	0.0	65	5	1.0	3.33	308.874	203.89
19280	2022-03-15 08:00	7.5	0.0	88	1	0.5	0.25	308.959	96.82
12716	2021-06-14 20:00	21.3	0.0	90	6	0.0	0.06	299.697	7.67
9269	2021-01-22 05:00	13.1	0.0	95	10	0.0	0.0	289.459	0.03
23400	2022-09-03 00:00	23.7	1.4	98	10	0.0	0.0	338.319	0.0
11626	2021-04-30 10:00	18.3	0.0	58	0	1.0	2.51	296.447	209.65
14252	2021-08-17 20:00	25.6	0.0	70	2	0.0	0.01	302.092	4.74
5444	2020-08-15 20:00	30.2	0.0	71	3	0.1	0.02	278.569	5.09

Overview

Variables

Interactions

Correlations

Missing values

Sample