gimi9 Pandas Profiling

Dataset statistics

Number of variables	10
Number of observations	54
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	18
Duplicate rows (%)	33.3%
Total size in memory	4.8 KiB
Average record size in memory	91.4 B

Variable types

Categorical	2
Numeric	8

Dataset

Description	샘플 데이터
Author	환경부산하기관
URL	https://www.bigdata-environment.kr/user/data_market/detail.do?id=dd921680-38bb-11ea-be28-4fa0eb812a46

Alerts

`생성일시` has constant value ""	Constant
Dataset has 18 (33.3%) duplicate rows	Duplicates
`CO (ton)` is highly overall correlated with `NOx (ton)` and 7 other fields	High correlation
`NOx (ton)` is highly overall correlated with `CO (ton)` and 7 other fields	High correlation
`SOx (ton)` is highly overall correlated with `CO (ton)` and 7 other fields	High correlation
`TSP (ton)` is highly overall correlated with `CO (ton)` and 7 other fields	High correlation
`PM10 (ton)` is highly overall correlated with `CO (ton)` and 7 other fields	High correlation
`VOC (ton)` is highly overall correlated with `CO (ton)` and 7 other fields	High correlation
`PM2.5 (ton)` is highly overall correlated with `CO (ton)` and 7 other fields	High correlation
`NH3 (ton)` is highly overall correlated with `CO (ton)` and 7 other fields	High correlation
`시도명` is highly overall correlated with `CO (ton)` and 7 other fields	High correlation

Reproduction

Analysis started	2024-04-22 00:24:14.041914
Analysis finished	2024-04-22 00:24:21.786905
Duration	7.74 seconds
Software version	ydata-profiling vv4.5.1
Download configuration	config.json

시도명
Categorical

HIGH CORRELATION

Distinct	18
Distinct (%)	33.3%
Missing	0
Missing (%)	0.0%
Memory size	564.0 B

전국	3
강원도	3
경기도	3
제주도	3
경상남도	3
Other values (13)	39

Length

Max length	7
Median length	5
Mean length	4.2777778
Min length	2

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	전국
2nd row	전국
3rd row	전국
4th row	강원도
5th row	강원도

Common Values

Value	Count	Frequency (%)
전국	3	5.6%
강원도	3	5.6%
경기도	3	5.6%
제주도	3	5.6%
경상남도	3	5.6%
경상북도	3	5.6%
전라남도	3	5.6%
전라북도	3	5.6%
충청남도	3	5.6%
충청북도	3	5.6%
Other values (8)	24	44.4%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
전국	3	5.6%
강원도	3	5.6%
인천광역시	3	5.6%
울산광역시	3	5.6%
서울특별시	3	5.6%
부산광역시	3	5.6%
대전광역시	3	5.6%
대구광역시	3	5.6%
광주광역시	3	5.6%
충청북도	3	5.6%
Other values (8)	24	44.4%

CO (ton)
Real number (ℝ)

HIGH CORRELATION

Distinct	18
Distinct (%)	33.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	6508.7778

Minimum	45
Maximum	58579
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	618.0 B

Quantile statistics

Minimum	45
5-th percentile	85.3
Q1	771
median	1079.5
Q3	5747
95-th percentile	29120.35
Maximum	58579
Range	58534
Interquartile range (IQR)	4976

Descriptive statistics

Standard deviation	13417.26
Coefficient of variation (CV)	2.06141
Kurtosis	11.232465
Mean	6508.7778
Median Absolute Deviation (MAD)	969
Skewness	3.3952175
Sum	351474
Variance	1.8002286 × 10⁸
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=18)

Value	Count	Frequency (%)
58579	3	5.6%
107	3	5.6%
771	3	5.6%
11023	3	5.6%
3310	3	5.6%
363	3	5.6%
1977	3	5.6%
114	3	5.6%
862	3	5.6%
45	3	5.6%
Other values (8)	24	44.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
45	3	5.6%
107	3	5.6%
114	3	5.6%
363	3	5.6%
771	3	5.6%
862	3	5.6%
879	3	5.6%
1072	3	5.6%
1077	3	5.6%
1082	3	5.6%

Value	Count	Frequency (%)
58579	3	5.6%
13258	3	5.6%
11435	3	5.6%
11023	3	5.6%
5747	3	5.6%
5457	3	5.6%
3310	3	5.6%
1977	3	5.6%
1082	3	5.6%
1077	3	5.6%

NOx (ton)
Real number (ℝ)

HIGH CORRELATION

Distinct	18
Distinct (%)	33.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	16160.667

Minimum	271
Maximum	145445
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	618.0 B

Quantile statistics

Minimum	271
5-th percentile	271.65
Q1	417
median	1890.5
Q3	10156
95-th percentile	84691.45
Maximum	145445
Range	145174
Interquartile range (IQR)	9739

Descriptive statistics

Standard deviation	34376.991
Coefficient of variation (CV)	2.1272013
Kurtosis	9.6072394
Mean	16160.667
Median Absolute Deviation (MAD)	1619
Skewness	3.145934
Sum	872676
Variance	1.1817775 × 10⁹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=18)

Value	Count	Frequency (%)
145445	3	5.6%
417	3	5.6%
272	3	5.6%
8125	3	5.6%
9430	3	5.6%
304	3	5.6%
1179	3	5.6%
331	3	5.6%
1569	3	5.6%
271	3	5.6%
Other values (8)	24	44.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
271	3	5.6%
272	3	5.6%
304	3	5.6%
331	3	5.6%
417	3	5.6%
1179	3	5.6%
1501	3	5.6%
1569	3	5.6%
1603	3	5.6%
2178	3	5.6%

Value	Count	Frequency (%)
145445	3	5.6%
51978	3	5.6%
33392	3	5.6%
17595	3	5.6%
10156	3	5.6%
9430	3	5.6%
8125	3	5.6%
5146	3	5.6%
2178	3	5.6%
1603	3	5.6%

SOx (ton)
Real number (ℝ)

HIGH CORRELATION

Distinct	18
Distinct (%)	33.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	10188.389

Minimum	1
Maximum	91696
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	618.0 B

Quantile statistics

Minimum	1
5-th percentile	1.65
Q1	277
median	1307
Q3	8379
95-th percentile	51407.05
Maximum	91696
Range	91695
Interquartile range (IQR)	8102

Descriptive statistics

Standard deviation	21620.68
Coefficient of variation (CV)	2.1220902
Kurtosis	9.7064242
Mean	10188.389
Median Absolute Deviation (MAD)	1305.5
Skewness	3.1508343
Sum	550173
Variance	4.6745382 × 10⁸
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=18)

Value	Count	Frequency (%)
91696	3	5.6%
1	3	5.6%
6	3	5.6%
6118	3	5.6%
8379	3	5.6%
2	3	5.6%
277	3	5.6%
459	3	5.6%
1267	3	5.6%
118	3	5.6%
Other values (8)	24	44.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	3	5.6%
2	3	5.6%
6	3	5.6%
118	3	5.6%
277	3	5.6%
431	3	5.6%
459	3	5.6%
660	3	5.6%
1267	3	5.6%
1347	3	5.6%

Value	Count	Frequency (%)
91696	3	5.6%
29713	3	5.6%
24003	3	5.6%
10437	3	5.6%
8379	3	5.6%
6118	3	5.6%
5423	3	5.6%
3054	3	5.6%
1347	3	5.6%
1267	3	5.6%

TSP (ton)
Real number (ℝ)

HIGH CORRELATION

Distinct	16
Distinct (%)	29.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	474.72222

Minimum	2
Maximum	4273
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	618.0 B

Quantile statistics

Minimum	2
5-th percentile	4.6
Q1	18
median	80
Q3	320
95-th percentile	2587.55
Maximum	4273
Range	4271
Interquartile range (IQR)	302

Descriptive statistics

Standard deviation	1015.5156
Coefficient of variation (CV)	2.1391786
Kurtosis	9.3798328
Mean	474.72222
Median Absolute Deviation (MAD)	74
Skewness	3.1241523
Sum	25635
Variance	1031271.9
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=16)

Value	Count	Frequency (%)
36	6	11.1%
6	6	11.1%
4273	3	5.6%
11	3	5.6%
18	3	5.6%
426	3	5.6%
211	3	5.6%
60	3	5.6%
2	3	5.6%
1680	3	5.6%
Other values (6)	18	33.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2	3	5.6%
6	6	11.1%
11	3	5.6%
18	3	5.6%
36	6	11.1%
44	3	5.6%
60	3	5.6%
100	3	5.6%
148	3	5.6%
211	3	5.6%

Value	Count	Frequency (%)
4273	3	5.6%
1680	3	5.6%
852	3	5.6%
426	3	5.6%
320	3	5.6%
316	3	5.6%
211	3	5.6%
148	3	5.6%
100	3	5.6%
60	3	5.6%

PM10 (ton)
Real number (ℝ)

HIGH CORRELATION

Distinct	16
Distinct (%)	29.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	438.88889

Minimum	2
Maximum	3951
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	618.0 B

Quantile statistics

Minimum	2
5-th percentile	3.3
Q1	18
median	59
Q3	312
95-th percentile	2417
Maximum	3951
Range	3949
Interquartile range (IQR)	294

Descriptive statistics

Standard deviation	944.68113
Coefficient of variation (CV)	2.152438
Kurtosis	9.1002671
Mean	438.88889
Median Absolute Deviation (MAD)	56
Skewness	3.0772459
Sum	23700
Variance	892422.44
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=16)

Value	Count	Frequency (%)
6	6	11.1%
59	6	11.1%
3951	3	5.6%
18	3	5.6%
420	3	5.6%
164	3	5.6%
4	3	5.6%
35	3	5.6%
2	3	5.6%
1591	3	5.6%
Other values (6)	18	33.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2	3	5.6%
4	3	5.6%
6	6	11.1%
18	3	5.6%
23	3	5.6%
30	3	5.6%
35	3	5.6%
59	6	11.1%
123	3	5.6%
164	3	5.6%

Value	Count	Frequency (%)
3951	3	5.6%
1591	3	5.6%
835	3	5.6%
420	3	5.6%
312	3	5.6%
262	3	5.6%
164	3	5.6%
123	3	5.6%
59	6	11.1%
35	3	5.6%

VOC (ton)
Real number (ℝ)

HIGH CORRELATION

Distinct	18
Distinct (%)	33.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	888.88889

Minimum	10
Maximum	8001
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	618.0 B

Quantile statistics

Minimum	10
5-th percentile	12.6
Q1	104
median	202
Q3	693
95-th percentile	4001.55
Maximum	8001
Range	7991
Interquartile range (IQR)	589

Descriptive statistics

Standard deviation	1828.3546
Coefficient of variation (CV)	2.0568989
Kurtosis	11.366654
Mean	888.88889
Median Absolute Deviation (MAD)	184.5
Skewness	3.4203358
Sum	48000
Variance	3342880.4
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=18)

Value	Count	Frequency (%)
8001	3	5.6%
14	3	5.6%
104	3	5.6%
1438	3	5.6%
596	3	5.6%
49	3	5.6%
267	3	5.6%
21	3	5.6%
120	3	5.6%
10	3	5.6%
Other values (8)	24	44.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
10	3	5.6%
14	3	5.6%
21	3	5.6%
49	3	5.6%
104	3	5.6%
117	3	5.6%
120	3	5.6%
128	3	5.6%
139	3	5.6%
265	3	5.6%

Value	Count	Frequency (%)
8001	3	5.6%
1848	3	5.6%
1500	3	5.6%
1438	3	5.6%
693	3	5.6%
690	3	5.6%
596	3	5.6%
267	3	5.6%
265	3	5.6%
139	3	5.6%

PM2.5 (ton)
Real number (ℝ)

HIGH CORRELATION

Distinct	17
Distinct (%)	31.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	361.38889

Minimum	2
Maximum	3253
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	618.0 B

Quantile statistics

Minimum	2
5-th percentile	2
Q1	11
median	51.5
Q3	302
95-th percentile	1973.15
Maximum	3253
Range	3251
Interquartile range (IQR)	291

Descriptive statistics

Standard deviation	775.95483
Coefficient of variation (CV)	2.1471463
Kurtosis	9.2013358
Mean	361.38889
Median Absolute Deviation (MAD)	49
Skewness	3.089348
Sum	19515
Variance	602105.9
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=17)

Value	Count	Frequency (%)
2	6	11.1%
92	3	5.6%
18	3	5.6%
370	3	5.6%
111	3	5.6%
6	3	5.6%
57	3	5.6%
3	3	5.6%
31	3	5.6%
3253	3	5.6%
Other values (7)	21	38.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2	6	11.1%
3	3	5.6%
6	3	5.6%
11	3	5.6%
18	3	5.6%
27	3	5.6%
31	3	5.6%
46	3	5.6%
57	3	5.6%
92	3	5.6%

Value	Count	Frequency (%)
3253	3	5.6%
1284	3	5.6%
674	3	5.6%
370	3	5.6%
302	3	5.6%
216	3	5.6%
111	3	5.6%
92	3	5.6%
57	3	5.6%
46	3	5.6%

NH3 (ton)
Real number (ℝ)

HIGH CORRELATION

Distinct	17
Distinct (%)	31.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	173.27778

Minimum	4
Maximum	1559
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	618.0 B

Quantile statistics

Minimum	4
5-th percentile	5.3
Q1	12
median	27
Q3	145
95-th percentile	887.55
Maximum	1559
Range	1555
Interquartile range (IQR)	133

Descriptive statistics

Standard deviation	365.22293
Coefficient of variation (CV)	2.1077309
Kurtosis	10.040395
Mean	173.27778
Median Absolute Deviation (MAD)	19.5
Skewness	3.2128993
Sum	9357
Variance	133387.79
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=17)

Value	Count	Frequency (%)
25	6	11.1%
1559	3	5.6%
4	3	5.6%
250	3	5.6%
300	3	5.6%
12	3	5.6%
65	3	5.6%
10	3	5.6%
30	3	5.6%
6	3	5.6%
Other values (7)	21	38.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
4	3	5.6%
6	3	5.6%
9	3	5.6%
10	3	5.6%
12	3	5.6%
14	3	5.6%
20	3	5.6%
25	6	11.1%
29	3	5.6%
30	3	5.6%

Value	Count	Frequency (%)
1559	3	5.6%
526	3	5.6%
300	3	5.6%
250	3	5.6%
145	3	5.6%
90	3	5.6%
65	3	5.6%
30	3	5.6%
29	3	5.6%
25	6	11.1%

생성일시
Categorical

CONSTANT

Distinct	1
Distinct (%)	1.9%
Missing	0
Missing (%)	0.0%
Memory size	564.0 B

20191217	54

Length

Max length	8
Median length	8
Mean length	8
Min length	8

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	20191217
2nd row	20191217
3rd row	20191217
4th row	20191217
5th row	20191217

Common Values

Value	Count	Frequency (%)
20191217	54	100.0%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
20191217	54	100.0%

Phik (φk)
Auto

Heatmap
Table

	시도명	CO (ton)	NOx (ton)	SOx (ton)	TSP (ton)	PM10 (ton)	VOC (ton)	PM2.5 (ton)	NH3 (ton)
시도명	1.000	1.000	1.000	1.000	1.000	1.000	1.000	1.000	1.000
CO (ton)	1.000	1.000	0.731	0.732	0.942	0.831	1.000	0.831	0.987
NOx (ton)	1.000	0.731	1.000	1.000	1.000	0.990	0.731	0.990	0.616
SOx (ton)	1.000	0.732	1.000	1.000	1.000	0.990	0.732	0.990	0.616
TSP (ton)	1.000	0.942	1.000	1.000	1.000	1.000	0.942	1.000	0.880
PM10 (ton)	1.000	0.831	0.990	0.990	1.000	1.000	0.831	1.000	0.732
VOC (ton)	1.000	1.000	0.731	0.732	0.942	0.831	1.000	0.831	0.987
PM2.5 (ton)	1.000	0.831	0.990	0.990	1.000	1.000	0.831	1.000	0.732
NH3 (ton)	1.000	0.987	0.616	0.616	0.880	0.732	0.987	0.732	1.000

Heatmap
Table

	CO (ton)	NOx (ton)	SOx (ton)	TSP (ton)	PM10 (ton)	VOC (ton)	PM2.5 (ton)	NH3 (ton)	시도명
CO (ton)	1.000	0.915	0.853	0.964	0.962	0.996	0.964	0.811	0.849
NOx (ton)	0.915	1.000	0.946	0.935	0.927	0.920	0.920	0.661	0.857
SOx (ton)	0.853	0.946	1.000	0.929	0.917	0.864	0.902	0.622	0.857
TSP (ton)	0.964	0.935	0.929	1.000	0.991	0.966	0.976	0.714	0.849
PM10 (ton)	0.962	0.927	0.917	0.991	1.000	0.967	0.992	0.725	0.857
VOC (ton)	0.996	0.920	0.864	0.966	0.967	1.000	0.971	0.807	0.849
PM2.5 (ton)	0.964	0.920	0.902	0.976	0.992	0.971	1.000	0.732	0.857
NH3 (ton)	0.811	0.661	0.622	0.714	0.725	0.807	0.732	1.000	0.849
시도명	0.849	0.857	0.857	0.849	0.857	0.849	0.857	0.849	1.000

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows
Last rows

	시도명	CO (ton)	NOx (ton)	SOx (ton)	TSP (ton)	PM10 (ton)	VOC (ton)	PM2.5 (ton)	NH3 (ton)	생성일시
0	전국	58579	145445	91696	4273	3951	8001	3253	1559	20191217
1	전국	58579	145445	91696	4273	3951	8001	3253	1559	20191217
2	전국	58579	145445	91696	4273	3951	8001	3253	1559	20191217
3	강원도	1077	5146	5423	148	123	265	92	9	20191217
4	강원도	1077	5146	5423	148	123	265	92	9	20191217
5	강원도	1077	5146	5423	148	123	265	92	9	20191217
6	경기도	13258	10156	3054	320	312	1848	302	526	20191217
7	경기도	13258	10156	3054	320	312	1848	302	526	20191217
8	경기도	13258	10156	3054	320	312	1848	302	526	20191217
9	제주도	1072	1603	660	44	23	128	11	29	20191217

	시도명	CO (ton)	NOx (ton)	SOx (ton)	TSP (ton)	PM10 (ton)	VOC (ton)	PM2.5 (ton)	NH3 (ton)	생성일시
44	서울특별시	363	304	2	6	6	49	6	12	20191217
45	울산광역시	3310	9430	8379	211	164	596	111	300	20191217
46	울산광역시	3310	9430	8379	211	164	596	111	300	20191217
47	울산광역시	3310	9430	8379	211	164	596	111	300	20191217
48	인천광역시	11023	8125	6118	426	420	1438	370	250	20191217
49	인천광역시	11023	8125	6118	426	420	1438	370	250	20191217
50	인천광역시	11023	8125	6118	426	420	1438	370	250	20191217
51	세종특별자치시	771	272	6	18	18	104	18	25	20191217
52	세종특별자치시	771	272	6	18	18	104	18	25	20191217
53	세종특별자치시	771	272	6	18	18	104	18	25	20191217

Most frequently occurring

	시도명	CO (ton)	NOx (ton)	SOx (ton)	TSP (ton)	PM10 (ton)	VOC (ton)	PM2.5 (ton)	NH3 (ton)	생성일시	# duplicates
0	강원도	1077	5146	5423	148	123	265	92	9	20191217	3
1	경기도	13258	10156	3054	320	312	1848	302	526	20191217	3
2	경상남도	5747	33392	24003	852	835	693	674	14	20191217	3
3	경상북도	879	1501	431	36	30	117	27	25	20191217	3
4	광주광역시	107	417	1	2	2	14	2	4	20191217	3
5	대구광역시	862	1569	1267	36	35	120	31	30	20191217	3
6	대전광역시	114	331	459	6	4	21	3	10	20191217	3
7	부산광역시	1977	1179	277	60	59	267	57	65	20191217	3
8	서울특별시	363	304	2	6	6	49	6	12	20191217	3
9	세종특별자치시	771	272	6	18	18	104	18	25	20191217	3

Overview

Variables

Common Values

Length

Common Values

Length

Common Values (Plot)

Interactions

Correlations

Missing values

Sample

Duplicate rows

Most frequently occurring