gimi9 Pandas Profiling

Dataset statistics

Number of variables	13
Number of observations	10000
Missing cells	1091
Missing cells (%)	0.8%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	1.1 MiB
Average record size in memory	112.0 B

Variable types

Numeric	8
Categorical	5

Dataset

Description	중국농산물 가격정보
Author	농림수산식품교육문화정보원
URL	https://data.mafra.go.kr/opendata/data/indexOpenDataDetail.do?data_id=20220210000000001818

Alerts

`df_index` is highly correlated with `DATES`	High correlation
`DATES` is highly correlated with `df_index`	High correlation
`MCLASSCODE` is highly correlated with `SCLASSCODE`	High correlation
`SCLASSCODE` is highly correlated with `MCLASSCODE`	High correlation
`MINPRICE` is highly correlated with `AVGPRICE` and 1 other fields	High correlation
`AVGPRICE` is highly correlated with `MINPRICE` and 1 other fields	High correlation
`MAXPRICE` is highly correlated with `MINPRICE` and 1 other fields	High correlation
`GRADECODE` is highly correlated with `GRADENAME` and 2 other fields	High correlation
`GRADENAME` is highly correlated with `GRADECODE` and 2 other fields	High correlation
`SCLASSNAME` is highly correlated with `GRADECODE` and 2 other fields	High correlation
`MCLASSNAME` is highly correlated with `GRADECODE` and 2 other fields	High correlation
`MINPRICE` has 545 (5.5%) missing values	Missing
`MAXPRICE` has 546 (5.5%) missing values	Missing
`df_index` has unique values	Unique

Reproduction

Analysis started	2022-08-12 15:26:19.482702
Analysis finished	2022-08-12 15:26:33.269617
Duration	13.79 seconds
Software version	pandas-profiling v3.2.0
Download configuration	config.json

df_index
Real number (ℝ_≥0)

HIGH CORRELATION
UNIQUE

Distinct	10000
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	25373.0856

Minimum	2
Maximum	50653
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	78.2 KiB

Quantile statistics

Minimum	2
5-th percentile	2500.8
Q1	12622.75
median	25438
Q3	37956.25
95-th percentile	48228.1
Maximum	50653
Range	50651
Interquartile range (IQR)	25333.5

Descriptive statistics

Standard deviation	14663.83478
Coefficient of variation (CV)	0.5779287161
Kurtosis	-1.202224244
Mean	25373.0856
Median Absolute Deviation (MAD)	12648.5
Skewness	-0.00378208083
Sum	253730856
Variance	215028050.6
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
9197	1	< 0.1%
31017	1	< 0.1%
28185	1	< 0.1%
30758	1	< 0.1%
49079	1	< 0.1%
33861	1	< 0.1%
26730	1	< 0.1%
16180	1	< 0.1%
5222	1	< 0.1%
5706	1	< 0.1%
Other values (9990)	9990	99.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2	1	< 0.1%
13	1	< 0.1%
15	1	< 0.1%
26	1	< 0.1%
27	1	< 0.1%
29	1	< 0.1%
35	1	< 0.1%
41	1	< 0.1%
43	1	< 0.1%
50	1	< 0.1%

Value	Count	Frequency (%)
50653	1	< 0.1%
50649	1	< 0.1%
50634	1	< 0.1%
50631	1	< 0.1%
50629	1	< 0.1%
50625	1	< 0.1%
50614	1	< 0.1%
50610	1	< 0.1%
50595	1	< 0.1%
50586	1	< 0.1%

DATES
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	219
Distinct (%)	2.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	20190567.28

Minimum	20190101
Maximum	20191223
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	88.0 KiB

Quantile statistics

Minimum	20190101
5-th percentile	20190115
Q1	20190318
median	20190529
Q3	20190813
95-th percentile	20191018
Maximum	20191223
Range	1122
Interquartile range (IQR)	495

Descriptive statistics

Standard deviation	293.7274318
Coefficient of variation (CV)	1.454775528 × 10^-5
Kurtosis	-1.024916437
Mean	20190567.28
Median Absolute Deviation (MAD)	224
Skewness	0.1031900595
Sum	2.019056728 × 10¹¹
Variance	86275.80417
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
20190722	68	0.7%
20190410	66	0.7%
20190419	65	0.7%
20190418	64	0.6%
20191223	62	0.6%
20191014	61	0.6%
20190403	60	0.6%
20190807	60	0.6%
20190128	60	0.6%
20191022	59	0.6%
Other values (209)	9375	93.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
20190101	31	0.3%
20190102	35	0.4%
20190103	57	0.6%
20190104	36	0.4%
20190107	43	0.4%
20190108	57	0.6%
20190109	50	0.5%
20190110	40	0.4%
20190111	55	0.5%
20190114	50	0.5%

Value	Count	Frequency (%)
20191223	62	0.6%
20191216	44	0.4%
20191209	52	0.5%
20191114	56	0.6%
20191025	35	0.4%
20191024	51	0.5%
20191023	58	0.6%
20191022	59	0.6%
20191021	47	0.5%
20191018	47	0.5%

MARKETCO
Real number (ℝ_≥0)

Distinct	25
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2527163.529

Minimum	1100002
Maximum	5107001
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	88.0 KiB

Quantile statistics

Minimum	1100002
5-th percentile	1100002
Q1	1102221
median	2310001
Q3	3701005
95-th percentile	5101006
Maximum	5107001
Range	4006999
Interquartile range (IQR)	2598784

Descriptive statistics

Standard deviation	1353457.642
Coefficient of variation (CV)	0.5355639343
Kurtosis	-1.433828295
Mean	2527163.529
Median Absolute Deviation (MAD)	1209996
Skewness	0.2570646287
Sum	2.527163528 × 10¹⁰
Variance	1.831847589 × 10¹²
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=25)

Value	Count	Frequency (%)
1100003	961	9.6%
1100002	771	7.7%
1100005	687	6.9%
3401002	650	6.5%
1102221	620	6.2%
1501001	538	5.4%
3702006	526	5.3%
3205001	526	5.3%
1404001	523	5.2%
3509821	462	4.6%
Other values (15)	3736	37.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1100002	771	7.7%
1100003	961	9.6%
1100005	687	6.9%
1102221	620	6.2%
1200001	110	1.1%
1200010	429	4.3%
1310821	60	0.6%
1404001	523	5.2%
1501001	538	5.4%
2301006	168	1.7%

Value	Count	Frequency (%)
5107001	332	3.3%
5101006	209	2.1%
4405001	325	3.2%
4305001	118	1.2%
4201005	373	3.7%
4114001	199	2.0%
3702006	526	5.3%
3701221	110	1.1%
3701005	344	3.4%
3604001	400	4.0%

MARKETNM
Categorical

Distinct	25
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Memory size	78.2 KiB

북경신발지농부산물도매시장	961
북경화간악각장도매시장	771
북경팔리교농산물중심도매시장	687
안휘합비주곡퇴농산물도매시장	650
북경순의석문채소도매시장	620
Other values (20)	6311

Length

Max length	19
Median length	17
Mean length	13.4086
Min length	8

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	안휘합비주곡퇴농산물도매시장
2nd row	안휘합비주곡퇴농산물도매시장
3rd row	산동청도성양채소도매시장
4th row	흑룡강성할빈하달과채도매시장유한공사
5th row	산동청도성양채소도매시장

Common Values

Value	Count	Frequency (%)
북경신발지농부산물도매시장	961	9.6%
북경화간악각장도매시장	771	7.7%
북경팔리교농산물중심도매시장	687	6.9%
안휘합비주곡퇴농산물도매시장	650	6.5%
북경순의석문채소도매시장	620	6.2%
호화호특시동와요도매시장	538	5.4%
산동청도성양채소도매시장	526	5.3%
강소소주남환교농부산물도매시장	526	5.3%
산서장치시자방농부산물종합교역시장	523	5.2%
복건복정민절변계농무중심시장	462	4.6%
Other values (15)	3736	37.4%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
북경신발지농부산물도매시장	961	9.6%
북경화간악각장도매시장	771	7.7%
북경팔리교농산물중심도매시장	687	6.9%
안휘합비주곡퇴농산물도매시장	650	6.5%
북경순의석문채소도매시장	620	6.2%
호화호특시동와요도매시장	538	5.4%
산동청도성양채소도매시장	526	5.3%
강소소주남환교농부산물도매시장	526	5.3%
산서장치시자방농부산물종합교역시장	523	5.2%
복건복정민절변계농무중심시장	462	4.6%
Other values (15)	3736	37.4%

MCLASSCODE
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	17
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1886.8069

Minimum	1112
Maximum	2099
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	88.0 KiB

Quantile statistics

Minimum	1112
5-th percentile	1714
Q1	1813
median	1912
Q3	1999
95-th percentile	2015
Maximum	2099
Range	987
Interquartile range (IQR)	186

Descriptive statistics

Standard deviation	113.7608428
Coefficient of variation (CV)	0.06029278505
Kurtosis	6.85895972
Mean	1886.8069
Median Absolute Deviation (MAD)	87
Skewness	-1.543842236
Sum	18868069
Variance	12941.52937
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=17)

Value	Count	Frequency (%)
1912	2923	29.2%
1911	1474	14.7%
1999	1021	10.2%
1813	976	9.8%
2014	557	5.6%
1716	462	4.6%
1711	420	4.2%
1714	365	3.6%
1717	333	3.3%
2015	308	3.1%
Other values (7)	1161	11.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1112	39	0.4%
1711	420	4.2%
1714	365	3.6%
1715	308	3.1%
1716	462	4.6%
1717	333	3.3%
1812	91	0.9%
1813	976	9.8%
1911	1474	14.7%
1912	2923	29.2%

Value	Count	Frequency (%)
2099	94	0.9%
2017	283	2.8%
2015	308	3.1%
2014	557	5.6%
2013	204	2.0%
2011	142	1.4%
1999	1021	10.2%
1912	2923	29.2%
1911	1474	14.7%
1813	976	9.8%

MCLASSNAME
Categorical

HIGH CORRELATION

Distinct	15
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	78.2 KiB

엽채류	2923
과채류	1474
기타	1115
어류	1067
사과류	557
Other values (10)	2864

Length

Max length	4
Median length	3
Mean length	2.7436
Min length	1

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	과채류
2nd row	기타
3rd row	감류
4th row	엽채류
5th row	사과류

Common Values

Value	Count	Frequency (%)
엽채류	2923	29.2%
과채류	1474	14.7%
기타	1115	11.2%
어류	1067	10.7%
사과류	557	5.6%
돼지고기	462	4.6%
알류	420	4.2%
소고기	365	3.6%
양고기	333	3.3%
닭고기	308	3.1%
Other values (5)	976	9.8%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
엽채류	2923	29.2%
과채류	1474	14.7%
기타	1115	11.2%
어류	1067	10.7%
사과류	557	5.6%
돼지고기	462	4.6%
알류	420	4.2%
소고기	365	3.6%
양고기	333	3.3%
닭고기	308	3.1%
Other values (5)	976	9.8%

SCLASSCODE
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	31
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	188701.9655

Minimum	111221
Maximum	209918
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	88.0 KiB

Quantile statistics

Minimum	111221
5-th percentile	171415
Q1	181322
median	191214
Q3	199913
95-th percentile	201511
Maximum	209918
Range	98697
Interquartile range (IQR)	18591

Descriptive statistics

Standard deviation	11375.59665
Coefficient of variation (CV)	0.06028340309
Kurtosis	6.860832408
Mean	188701.9655
Median Absolute Deviation (MAD)	8700
Skewness	-1.545085267
Sum	1887019655
Variance	129404199.1
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=31)

Value	Count	Frequency (%)
191214	870	8.7%
191232	828	8.3%
191148	796	8.0%
191111	678	6.8%
191226	666	6.7%
199913	602	6.0%
191231	559	5.6%
171629	462	4.6%
181322	437	4.4%
201413	427	4.3%
Other values (21)	3675	36.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
111221	39	0.4%
171111	420	4.2%
171415	365	3.6%
171512	308	3.1%
171629	462	4.6%
171716	333	3.3%
181212	91	0.9%
181320	193	1.9%
181322	437	4.4%
181326	195	1.9%

Value	Count	Frequency (%)
209918	94	0.9%
201715	124	1.2%
201711	159	1.6%
201513	92	0.9%
201511	216	2.2%
201418	115	1.1%
201414	15	0.1%
201413	427	4.3%
201321	98	1.0%
201313	106	1.1%

SCLASSNAME
Categorical

HIGH CORRELATION

Distinct	31
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Memory size	78.2 KiB

배추	870
양상추	828
토마토	796
백무우	678
상추	666
Other values (26)	6162

Length

Max length	5
Median length	4
Mean length	2.7569
Min length	2

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	백무우
2nd row	버섯
3rd row	밀감
4th row	배추
5th row	부시사과

Common Values

Value	Count	Frequency (%)
배추	870	8.7%
양상추	828	8.3%
토마토	796	8.0%
백무우	678	6.8%
상추	666	6.7%
버섯	602	6.0%
쪽파	559	5.6%
돼지고기	462	4.6%
붕어	437	4.4%
부시사과	427	4.3%
Other values (21)	3675	36.8%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
배추	870	8.7%
양상추	828	8.3%
토마토	796	8.0%
백무우	678	6.8%
상추	666	6.7%
버섯	602	6.0%
쪽파	559	5.6%
돼지고기	462	4.6%
붕어	437	4.4%
부시사과	427	4.3%
Other values (21)	3675	36.8%

GRADECODE
Categorical

HIGH CORRELATION

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	78.2 KiB

0	9538
1	462

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0
2nd row	0
3rd row	0
4th row	0
5th row	0

Common Values

Value	Count	Frequency (%)
0	9538	95.4%
1	462	4.6%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
0	9538	95.4%
1	462	4.6%

GRADENAME
Categorical

HIGH CORRELATION

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	78.2 KiB

무규격	9538
1급	462

Length

Max length	3
Median length	3
Mean length	2.9538
Min length	2

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	무규격
2nd row	무규격
3rd row	무규격
4th row	무규격
5th row	무규격

Common Values

Value	Count	Frequency (%)
무규격	9538	95.4%
1급	462	4.6%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
무규격	9538	95.4%
1급	462	4.6%

MINPRICE
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	309
Distinct (%)	3.3%
Missing	545
Missing (%)	5.5%
Infinite	0
Infinite (%)	0.0%
Mean	14.36478054

Minimum	0.2
Maximum	490
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	88.0 KiB

Quantile statistics

Minimum	0.2
5-th percentile	0.7
Q1	2
median	5.2
Q3	12.15
95-th percentile	60
Maximum	490
Range	489.8
Interquartile range (IQR)	10.15

Descriptive statistics

Standard deviation	32.27315284
Coefficient of variation (CV)	2.246686105
Kurtosis	64.79662389
Mean	14.36478054
Median Absolute Deviation (MAD)	3.8
Skewness	7.115229715
Sum	135819
Variance	1041.556394
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	399	4.0%
5	395	4.0%
4	373	3.7%
2	323	3.2%
6	323	3.2%
3	276	2.8%
1.6	269	2.7%
8	268	2.7%
0.8	265	2.6%
7	245	2.5%
Other values (299)	6319	63.2%
(Missing)	545	5.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.2	5	0.1%
0.3	24	0.2%
0.4	123	1.2%
0.5	85	0.9%
0.6	223	2.2%
0.7	121	1.2%
0.8	265	2.6%
0.9	95	0.9%
1	399	4.0%
1.1	33	0.3%

Value	Count	Frequency (%)
490	1	< 0.1%
440	1	< 0.1%
410	1	< 0.1%
400	3	< 0.1%
380	2	< 0.1%
350	1	< 0.1%
330	3	< 0.1%
320	8	0.1%
310	1	< 0.1%
300	51	0.5%

AVGPRICE
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	453
Distinct (%)	4.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	15.09213

Minimum	0.3
Maximum	510
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	88.0 KiB

Quantile statistics

Minimum	0.3
5-th percentile	0.9
Q1	2.4
median	6
Q3	13.5
95-th percentile	62
Maximum	510
Range	509.7
Interquartile range (IQR)	11.1

Descriptive statistics

Standard deviation	32.71584735
Coefficient of variation (CV)	2.167742217
Kurtosis	68.76745895
Mean	15.09213
Median Absolute Deviation (MAD)	4.2
Skewness	7.269230236
Sum	150921.3
Variance	1070.326668
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
6	265	2.6%
7	241	2.4%
1	231	2.3%
1.2	211	2.1%
1.4	185	1.8%
0.9	171	1.7%
9	167	1.7%
0.8	167	1.7%
5	167	1.7%
2	153	1.5%
Other values (443)	8042	80.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.3	1	< 0.1%
0.4	11	0.1%
0.5	40	0.4%
0.6	66	0.7%
0.7	129	1.3%
0.8	167	1.7%
0.9	171	1.7%
1	231	2.3%
1.1	124	1.2%
1.2	211	2.1%

Value	Count	Frequency (%)
510	1	< 0.1%
500	1	< 0.1%
460	1	< 0.1%
420	3	< 0.1%
400	2	< 0.1%
360	1	< 0.1%
350	1	< 0.1%
340	4	< 0.1%
336	1	< 0.1%
330	6	0.1%

MAXPRICE
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	358
Distinct (%)	3.8%
Missing	546
Missing (%)	5.5%
Infinite	0
Infinite (%)	0.0%
Mean	17.05921303

Minimum	0.4
Maximum	560
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	88.0 KiB

Quantile statistics

Minimum	0.4
5-th percentile	1.1
Q1	3.1
median	7.5
Q3	16
95-th percentile	66
Maximum	560
Range	559.6
Interquartile range (IQR)	12.9

Descriptive statistics

Standard deviation	35.3204558
Coefficient of variation (CV)	2.070462203
Kurtosis	67.27348167
Mean	17.05921303
Median Absolute Deviation (MAD)	5.3
Skewness	7.161155213
Sum	161277.8
Variance	1247.534598
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
8	304	3.0%
7	280	2.8%
9	275	2.8%
6	244	2.4%
1.6	239	2.4%
5	232	2.3%
14	230	2.3%
12	229	2.3%
4	224	2.2%
10	224	2.2%
Other values (348)	6973	69.7%
(Missing)	546	5.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.4	1	< 0.1%
0.5	9	0.1%
0.6	31	0.3%
0.7	43	0.4%
0.8	105	1.1%
0.9	47	0.5%
1	208	2.1%
1.1	56	0.6%
1.2	216	2.2%
1.3	44	0.4%

Value	Count	Frequency (%)
560	1	< 0.1%
510	1	< 0.1%
490	1	< 0.1%
480	1	< 0.1%
460	1	< 0.1%
440	3	< 0.1%
420	2	< 0.1%
390	1	< 0.1%
370	5	0.1%
360	2	< 0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	df_index	DATES	MARKETCO	MARKETNM	MCLASSCODE	MCLASSNAME	SCLASSCODE	SCLASSNAME	GRADENAME	MINPRICE	AVGPRICE	MAXPRICE
0	9197	20190226	3401002	안휘합비주곡퇴농산물도매시장	1911	과채류	191111	백무우	무규격	1.0	1.4	1.8
1	21139	20190506	3401002	안휘합비주곡퇴농산물도매시장	1999	기타	199913	버섯	무규격	6.0	6.5	7.0
2	9025	20190225	3702006	산동청도성양채소도매시장	2011	감류	201114	밀감	무규격	2.2	2.6	3.0
3	44118	20190923	2301006	흑룡강성할빈하달과채도매시장유한공사	1912	엽채류	191214	배추	무규격	0.9	1.0	1.0
4	30537	20190628	3702006	산동청도성양채소도매시장	2014	사과류	201413	부시사과	무규격	9.0	14.0	15.0
5	122	20190101	3604001	강서구강채소도매시장	1912	엽채류	191226	상추	무규격	3.0	4.6	5.0
6	12863	20190319	3401002	안휘합비주곡퇴농산물도매시장	1911	과채류	191148	토마토	무규격	6.4	7.2	8.0
7	43068	20190916	1200010	천진서청구당성무공해농수산물도매시장	1911	과채류	191111	백무우	무규격	<NA>	1.1	<NA>
8	48130	20191017	3702006	산동청도성양채소도매시장	1911	과채류	191111	백무우	무규격	1.6	2.4	2.6
9	48930	20191022	4405001	광동산두농부산물도매중심	2017	복숭아	201711	복숭아	무규격	6.0	9.0	12.0

Last rows

	df_index	DATES	MARKETCO	MARKETNM	MCLASSCODE	MCLASSNAME	SCLASSCODE	SCLASSNAME	GRADENAME	MINPRICE	AVGPRICE	MAXPRICE
9990	15434	20190403	1100003	북경신발지농부산물도매시장	1911	과채류	191148	토마토	무규격	3.6	4.6	5.6
9991	34549	20190724	1100002	북경화간악각장도매시장	1813	어류	181320	장어	무규격	40.0	50.0	70.0
9992	19973	20190429	1200010	천진서청구당성무공해농수산물도매시장	1911	과채류	191111	백무우	무규격	<NA>	2.0	<NA>
9993	47122	20191011	4405001	광동산두농부산물도매중심	2014	사과류	201413	부시사과	무규격	6.0	9.0	12.0
9994	11888	20190313	3205001	강소소주남환교농부산물도매시장	1813	어류	181326	농어	무규격	15.6	19.8	24.0
9995	8475	20190222	1100005	북경팔리교농산물중심도매시장	2015	포도류	201511	거봉포도	무규격	11.0	11.5	12.0
9996	11192	20190308	3401002	안휘합비주곡퇴농산물도매시장	1912	엽채류	191214	배추	무규격	0.6	0.8	1.0
9997	13779	20190325	1102221	북경순의석문채소도매시장	1912	엽채류	191232	양상추	무규격	1.6	2.0	2.4
9998	28221	20190614	1100003	북경신발지농부산물도매시장	1715	닭고기	171512	닭고기	무규격	13.0	13.3	13.6
9999	5441	20190131	3509821	복건복정민절변계농무중심시장	1999	기타	199914	팽이버섯	무규격	9.2	9.3	10.4

Overview

Variables

Common Values

Length

Common Values

Length

Common Values

Length

Common Values

Length

Category Frequency Plot

Common Values

Length

Category Frequency Plot

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows