gimi9 Pandas Profiling

Dataset statistics

Number of variables	10
Number of observations	407
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	34.7 KiB
Average record size in memory	87.3 B

Variable types

Numeric	7
Categorical	3

Dataset

Description	산지조합에서 생산하는 과실류(사과, 배, 단감, 감귤)의 약정 사업실적 현황 요약정보 입니다.
Author	농림축산식품부
URL	https://data.mafra.go.kr/opendata/data/indexOpenDataDetail.do?data_id=20220215000000001921

Alerts

`CNTRCT_ACMSLT_VOLM_TON` is highly correlated with `SHIPMNT_ACMSLT_VOLM_TON` and 1 other fields	High correlation
`CNTRCT_ACMSLT_AMOUNT` is highly correlated with `SHIPMNT_ACMSLT_AMOUNT`	High correlation
`SHIPMNT_ACMSLT_VOLM_TON` is highly correlated with `CNTRCT_ACMSLT_VOLM_TON` and 1 other fields	High correlation
`SHIPMNT_ACMSLT_AMOUNT` is highly correlated with `CNTRCT_ACMSLT_VOLM_TON` and 2 other fields	High correlation
`CNTRCT_ACMSLT_VOLM_TON` has 28 (6.9%) zeros	Zeros
`CNTRCT_ACMSLT_AMOUNT` has 28 (6.9%) zeros	Zeros
`SHIPMNT_ACMSLT_VOLM_TON` has 33 (8.1%) zeros	Zeros
`SHIPMNT_ACMSLT_VOLM_PT` has 33 (8.1%) zeros	Zeros
`SHIPMNT_ACMSLT_AMOUNT` has 33 (8.1%) zeros	Zeros
`SHIPMNT_ACMSLT_AMOUNT_PT` has 33 (8.1%) zeros	Zeros

Reproduction

Analysis started	2022-08-12 14:45:49.749938
Analysis finished	2022-08-12 14:45:59.450272
Duration	9.7 seconds
Software version	pandas-profiling v3.2.0
Download configuration	config.json

BSNS_YEAR
Real number (ℝ_≥0)

Distinct	14
Distinct (%)	3.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2009.597052

Minimum	2003
Maximum	2016
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	3.7 KiB

Quantile statistics

Minimum	2003
5-th percentile	2003
Q1	2006.5
median	2010
Q3	2013
95-th percentile	2016
Maximum	2016
Range	13
Interquartile range (IQR)	6.5

Descriptive statistics

Standard deviation	3.917221187
Coefficient of variation (CV)	0.001949257033
Kurtosis	-1.061463099
Mean	2009.597052
Median Absolute Deviation (MAD)	3
Skewness	0.001055546074
Sum	817906
Variance	15.34462183
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=14)

Value	Count	Frequency (%)
2008	44	10.8%
2011	37	9.1%
2010	36	8.8%
2016	33	8.1%
2009	32	7.9%
2004	28	6.9%
2014	27	6.6%
2015	26	6.4%
2003	26	6.4%
2005	24	5.9%
Other values (4)	94	23.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2003	26	6.4%
2004	28	6.9%
2005	24	5.9%
2006	24	5.9%
2007	23	5.7%
2008	44	10.8%
2009	32	7.9%
2010	36	8.8%
2011	37	9.1%
2012	23	5.7%

Value	Count	Frequency (%)
2016	33	8.1%
2015	26	6.4%
2014	27	6.6%
2013	24	5.9%
2012	23	5.7%
2011	37	9.1%
2010	36	8.8%
2009	32	7.9%
2008	44	10.8%
2007	23	5.7%

AREA_HDQRTRS_NM
Categorical

Distinct	20
Distinct (%)	4.9%
Missing	0
Missing (%)	0.0%
Memory size	3.3 KiB

경남지역본부	54
경북지역본부	47
충남지역본부	46
전남지역본부	44
충북지역본부	39
Other values (15)	177

Length

Max length	10
Median length	6
Mean length	6.776412776
Min length	6

Unique

Unique	1 ?
Unique (%)	0.2%

Sample

1st row	전북지역본부
2nd row	충남지역본부
3rd row	강원지역본부
4th row	제주지역본부
5th row	경북지역본부

Common Values

Value	Count	Frequency (%)
경남지역본부	54	13.3%
경북지역본부	47	11.5%
충남지역본부	46	11.3%
전남지역본부	44	10.8%
충북지역본부	39	9.6%
전북지역본부	33	8.1%
경기지역본부	20	4.9%
전북지역본부(대표)	19	4.7%
울산지역본부	18	4.4%
경북지역본부(대표)	16	3.9%
Other values (10)	71	17.4%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
경남지역본부	54	13.3%
경북지역본부	47	11.5%
충남지역본부	46	11.3%
전남지역본부	44	10.8%
충북지역본부	39	9.6%
전북지역본부	33	8.1%
경기지역본부	20	4.9%
전북지역본부(대표	19	4.7%
울산지역본부	18	4.4%
경북지역본부(대표	16	3.9%
Other values (10)	71	17.4%

BSNS_MTHD
Categorical

Distinct	2
Distinct (%)	0.5%
Missing	0
Missing (%)	0.0%
Memory size	3.3 KiB

수탁	290
매취	117

Length

Max length	2
Median length	2
Mean length	2
Min length	2

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	수탁
2nd row	수탁
3rd row	수탁
4th row	수탁
5th row	수탁

Common Values

Value	Count	Frequency (%)
수탁	290	71.3%
매취	117	28.7%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
수탁	290	71.3%
매취	117	28.7%

PRDLST_NM
Categorical

Distinct	4
Distinct (%)	1.0%
Missing	0
Missing (%)	0.0%
Memory size	3.3 KiB

배	189
사과	159
단감	38
감귤	21

Length

Max length	2
Median length	2
Mean length	1.535626536
Min length	1

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	사과
2nd row	배
3rd row	배
4th row	감귤
5th row	사과

Common Values

Value	Count	Frequency (%)
배	189	46.4%
사과	159	39.1%
단감	38	9.3%
감귤	21	5.2%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
배	189	46.4%
사과	159	39.1%
단감	38	9.3%
감귤	21	5.2%

CNTRCT_ACMSLT_VOLM_TON
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	369
Distinct (%)	90.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5162.054054

Minimum	0
Maximum	81705
Zeros	28
Zeros (%)	6.9%
Negative	0
Negative (%)	0.0%
Memory size	3.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	397.5
median	1326
Q3	5940
95-th percentile	17594.7
Maximum	81705
Range	81705
Interquartile range (IQR)	5542.5

Descriptive statistics

Standard deviation	10118.36084
Coefficient of variation (CV)	1.960142364
Kurtosis	26.3794946
Mean	5162.054054
Median Absolute Deviation (MAD)	1248
Skewness	4.665298741
Sum	2100956
Variance	102381226.1
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	28	6.9%
402	2	0.5%
972	2	0.5%
540	2	0.5%
284	2	0.5%
467	2	0.5%
266	2	0.5%
935	2	0.5%
2201	2	0.5%
1104	2	0.5%
Other values (359)	361	88.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	28	6.9%
5	1	0.2%
15	1	0.2%
33	1	0.2%
46	1	0.2%
50	1	0.2%
68	1	0.2%
75	1	0.2%
76	1	0.2%
78	1	0.2%

Value	Count	Frequency (%)
81705	1	0.2%
74131	1	0.2%
69660	1	0.2%
68582	1	0.2%
67290	1	0.2%
55104	1	0.2%
53806	1	0.2%
46959	1	0.2%
42808	1	0.2%
25575	1	0.2%

CNTRCT_ACMSLT_AMOUNT
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	380
Distinct (%)	93.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	7112456.391

Minimum	0
Maximum	57323848
Zeros	28
Zeros (%)	6.9%
Negative	0
Negative (%)	0.0%
Memory size	3.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	540852.5
median	2290000
Q3	11065321
95-th percentile	26578493.6
Maximum	57323848
Range	57323848
Interquartile range (IQR)	10524468.5

Descriptive statistics

Standard deviation	9589044.834
Coefficient of variation (CV)	1.348204377
Kurtosis	4.922259692
Mean	7112456.391
Median Absolute Deviation (MAD)	2175720
Skewness	1.997234882
Sum	2894769751
Variance	9.194978082 × 10¹³
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	28	6.9%
12044510	1	0.2%
443750	1	0.2%
25540204	1	0.2%
19647585	1	0.2%
795000	1	0.2%
16838338	1	0.2%
14576422	1	0.2%
2265200	1	0.2%
4364698	1	0.2%
Other values (370)	370	90.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	28	6.9%
6000	1	0.2%
31296	1	0.2%
61600	1	0.2%
87750	1	0.2%
95201	1	0.2%
96080	1	0.2%
96200	1	0.2%
101100	1	0.2%
114280	1	0.2%

Value	Count	Frequency (%)
57323848	1	0.2%
56048491	1	0.2%
53496216	1	0.2%
44083371	1	0.2%
37743015	1	0.2%
34633591	1	0.2%
34410122	1	0.2%
33234636	1	0.2%
32977190	1	0.2%
32132199	1	0.2%

SHIPMNT_ACMSLT_VOLM_TON
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	362
Distinct (%)	88.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	4453.542998

Minimum	0
Maximum	77067
Zeros	33
Zeros (%)	8.1%
Negative	0
Negative (%)	0.0%
Memory size	3.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	299
median	1093
Q3	5009.5
95-th percentile	14938.1
Maximum	77067
Range	77067
Interquartile range (IQR)	4710.5

Descriptive statistics

Standard deviation	9112.974175
Coefficient of variation (CV)	2.046230199
Kurtosis	28.73163671
Mean	4453.542998
Median Absolute Deviation (MAD)	1068
Skewness	4.848614598
Sum	1812592
Variance	83046298.31
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	33	8.1%
289	3	0.7%
228	3	0.7%
806	2	0.5%
411	2	0.5%
306	2	0.5%
427	2	0.5%
467	2	0.5%
181	2	0.5%
382	2	0.5%
Other values (352)	354	87.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	33	8.1%
8	1	0.2%
14	1	0.2%
17	1	0.2%
19	1	0.2%
20	1	0.2%
24	1	0.2%
25	1	0.2%
33	1	0.2%
34	1	0.2%

Value	Count	Frequency (%)
77067	1	0.2%
73704	1	0.2%
59753	1	0.2%
59103	1	0.2%
57405	1	0.2%
46378	1	0.2%
45707	1	0.2%
43647	1	0.2%
39122	1	0.2%
25909	1	0.2%

SHIPMNT_ACMSLT_VOLM_PT
Real number (ℝ_≥0)

ZEROS

Distinct	85
Distinct (%)	20.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	77.00737101

Minimum	0
Maximum	117
Zeros	33
Zeros (%)	8.1%
Negative	0
Negative (%)	0.0%
Memory size	3.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	67
median	88
Q3	100
95-th percentile	107
Maximum	117
Range	117
Interquartile range (IQR)	33

Descriptive statistics

Standard deviation	31.87626083
Coefficient of variation (CV)	0.4139377882
Kurtosis	0.6698445615
Mean	77.00737101
Median Absolute Deviation (MAD)	13
Skewness	-1.323192812
Sum	31342
Variance	1016.096005
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	33	8.1%
101	20	4.9%
100	19	4.7%
102	14	3.4%
88	13	3.2%
103	13	3.2%
98	12	2.9%
99	11	2.7%
97	10	2.5%
105	9	2.2%
Other values (75)	253	62.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	33	8.1%
1	1	0.2%
7	2	0.5%
9	2	0.5%
11	1	0.2%
13	1	0.2%
14	1	0.2%
18	1	0.2%
21	1	0.2%
23	2	0.5%

Value	Count	Frequency (%)
117	1	0.2%
113	1	0.2%
112	2	0.5%
111	3	0.7%
110	2	0.5%
109	5	1.2%
108	5	1.2%
107	5	1.2%
106	7	1.7%
105	9	2.2%

SHIPMNT_ACMSLT_AMOUNT
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	375
Distinct (%)	92.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	7171254.732

Minimum	0
Maximum	68919581
Zeros	33
Zeros (%)	8.1%
Negative	0
Negative (%)	0.0%
Memory size	3.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	472396
median	1718350
Q3	10557350
95-th percentile	26118292.4
Maximum	68919581
Range	68919581
Interquartile range (IQR)	10084954

Descriptive statistics

Standard deviation	10874548.75
Coefficient of variation (CV)	1.516408098
Kurtosis	9.221635877
Mean	7171254.732
Median Absolute Deviation (MAD)	1718350
Skewness	2.666254612
Sum	2918700676
Variance	1.182558105 × 10¹⁴
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	33	8.1%
208578	1	0.2%
67133526	1	0.2%
25486897	1	0.2%
1221101	1	0.2%
18881398	1	0.2%
17168563	1	0.2%
2166524	1	0.2%
3126681	1	0.2%
78250	1	0.2%
Other values (365)	365	89.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	33	8.1%
5571	1	0.2%
16653	1	0.2%
23578	1	0.2%
35427	1	0.2%
35725	1	0.2%
46467	1	0.2%
48152	1	0.2%
53916	1	0.2%
55036	1	0.2%

Value	Count	Frequency (%)
68919581	1	0.2%
67133526	1	0.2%
65190024	1	0.2%
56138667	1	0.2%
55130984	1	0.2%
53672686	1	0.2%
49304753	1	0.2%
48153674	1	0.2%
46304132	1	0.2%
35297747	1	0.2%

SHIPMNT_ACMSLT_AMOUNT_PT
Real number (ℝ_≥0)

ZEROS

Distinct	129
Distinct (%)	31.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	86.08845209

Minimum	0
Maximum	263
Zeros	33
Zeros (%)	8.1%
Negative	0
Negative (%)	0.0%
Memory size	3.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	69
median	92
Q3	107
95-th percentile	144.7
Maximum	263
Range	263
Interquartile range (IQR)	38

Descriptive statistics

Standard deviation	40.21533221
Coefficient of variation (CV)	0.467139683
Kurtosis	1.036697433
Mean	86.08845209
Median Absolute Deviation (MAD)	19
Skewness	-0.3264922995
Sum	35038
Variance	1617.272945
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	33	8.1%
95	11	2.7%
100	11	2.7%
90	10	2.5%
85	9	2.2%
115	8	2.0%
89	8	2.0%
92	8	2.0%
94	8	2.0%
106	7	1.7%
Other values (119)	294	72.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	33	8.1%
1	1	0.2%
7	1	0.2%
8	1	0.2%
10	1	0.2%
11	1	0.2%
14	2	0.5%
19	1	0.2%
20	3	0.7%
23	1	0.2%

Value	Count	Frequency (%)
263	1	0.2%
209	1	0.2%
185	1	0.2%
170	1	0.2%
167	1	0.2%
165	1	0.2%
163	2	0.5%
161	1	0.2%
156	1	0.2%
155	1	0.2%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	BSNS_YEAR	AREA_HDQRTRS_NM	BSNS_MTHD	PRDLST_NM	CNTRCT_ACMSLT_VOLM_TON	CNTRCT_ACMSLT_AMOUNT	SHIPMNT_ACMSLT_VOLM_TON	SHIPMNT_ACMSLT_VOLM_PT	SHIPMNT_ACMSLT_AMOUNT	SHIPMNT_ACMSLT_AMOUNT_PT
0	2004	전북지역본부	수탁	사과	972	3112366	1056	109	3362879	108
1	2004	충남지역본부	수탁	배	12009	15742010	12429	103	18139250	115
2	2004	강원지역본부	수탁	배	266	443750	228	86	423792	96
3	2004	제주지역본부	수탁	감귤	67290	25540204	59753	89	67133526	263
4	2004	경북지역본부	수탁	사과	15312	19647585	12063	79	25486897	130
5	2004	충남지역본부	수탁	사과	570	795000	586	103	1221101	154
6	2004	전남지역본부	수탁	배	11982	16838338	10184	85	18881398	112
7	2004	경기지역본부	수탁	배	10640	14576422	9822	92	17168563	118
8	2004	경북지역본부	수탁	배	1838	2265200	1311	71	2166524	96
9	2005	경북지역본부	매취	사과	2468	4364698	1650	67	3126681	72

Last rows

	BSNS_YEAR	AREA_HDQRTRS_NM	BSNS_MTHD	PRDLST_NM	CNTRCT_ACMSLT_VOLM_TON	CNTRCT_ACMSLT_AMOUNT	SHIPMNT_ACMSLT_VOLM_TON	SHIPMNT_ACMSLT_VOLM_PT	SHIPMNT_ACMSLT_AMOUNT	SHIPMNT_ACMSLT_AMOUNT_PT
397	2004	경북지역본부	수탁	단감	219	175320	104	47	183397	105
398	2004	경남지역본부	수탁	단감	8923	9443504	5426	61	7768325	82
399	2004	충북지역본부	수탁	배	853	947723	815	96	1085648	115
400	2004	충북지역본부	수탁	사과	10038	13258369	10173	101	18969861	143
401	2004	전북지역본부	수탁	배	3995	4166561	3261	82	4213426	101
402	2004	경남지역본부	수탁	배	892	1026246	719	81	982698	96
403	2004	경남지역본부	수탁	사과	7019	9960984	6465	92	12343183	124
404	2004	울산지역본부	수탁	배	1978	2664240	943	48	1646090	62
405	2004	경기지역본부	수탁	사과	266	233692	239	90	295758	127
406	2004	울산지역본부	수탁	단감	371	539140	34	9	55036	10

Overview

Variables

Common Values

Length

Common Values

Length

Category Frequency Plot

Common Values

Length

Category Frequency Plot

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows