BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	829	7656	3516	9.77	19.08	10.83
Span-level detection	1711	6778	3470	20.16	33.02	21.86
Token-level detection	4303	9397	4089	31.41	51.28	34.05

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	281	313	721	47.31	28.04	41.59
R	427	6429	2476	6.23	14.71	7.04
U	121	914	319	11.69	27.50	13.21

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	177	33	2.75	13.16	3.26
ADJ:FORM	2	1	4	66.67	33.33	55.56
ADV	9	67	37	11.84	19.57	12.86
CONJ	1	31	18	3.12	5.26	3.40
CONTR	3	4	5	42.86	37.50	41.67
DET	82	237	417	25.71	16.43	23.10
MORPH	17	13	114	56.67	12.98	33.86
NOUN	10	1526	95	0.65	9.52	0.80
NOUN:INFL	0	0	18	100.00	0.00	0.00
NOUN:NUM	48	47	163	50.53	22.75	40.61
NOUN:POSS	3	7	44	30.00	6.38	17.24
ORTH	92	20	245	82.14	27.30	58.60
OTHER	27	4420	681	0.61	3.81	0.73
PART	5	6	16	45.45	23.81	38.46
PREP	53	163	293	24.54	15.32	21.90
PRON	17	47	99	26.56	14.66	22.85
PUNCT	281	252	327	52.72	46.22	51.28
SPELL	4	11	291	26.67	1.36	5.63
VERB	17	475	165	3.46	9.34	3.95
VERB:FORM	52	41	109	55.91	32.30	48.78
VERB:INFL	2	0	7	100.00	22.22	58.82
VERB:SVA	41	24	86	63.08	32.28	52.97
VERB:TENSE	47	76	188	38.21	20.00	32.32
WO	11	11	61	50.00	15.28	34.38

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	4	4	0.00	0.00	0.00
M:ADV	1	8	13	11.11	7.14	10.00
M:CONJ	0	9	12	0.00	0.00	0.00
M:DET	35	102	198	25.55	15.02	22.41
M:NOUN	0	11	11	0.00	0.00	0.00
M:NOUN:POSS	1	3	12	25.00	7.69	17.24
M:OTHER	1	26	43	3.70	2.27	3.29
M:PART	0	0	3	100.00	0.00	0.00
M:PREP	4	26	77	13.33	4.94	9.95
M:PRON	10	17	51	37.04	16.39	29.59
M:PUNCT	220	81	228	73.09	49.11	66.59
M:VERB	3	12	30	20.00	9.09	16.13
M:VERB:FORM	4	2	6	66.67	40.00	58.82
M:VERB:TENSE	2	12	33	14.29	5.71	10.99
R:ADJ	4	79	24	4.82	14.29	5.56
R:ADJ:FORM	2	1	4	66.67	33.33	55.56
R:ADV	4	15	14	21.05	22.22	21.28
R:CONJ	1	4	3	20.00	25.00	20.83
R:CONTR	1	4	2	20.00	33.33	21.74
R:DET	4	35	90	10.26	4.26	8.00
R:MORPH	17	13	114	56.67	12.98	33.86
R:NOUN	8	1310	72	0.61	10.00	0.75
R:NOUN:INFL	0	0	18	100.00	0.00	0.00
R:NOUN:NUM	48	47	163	50.53	22.75	40.61
R:NOUN:POSS	2	4	23	33.33	8.00	20.41
R:ORTH	92	20	245	82.14	27.30	58.60
R:OTHER	21	4222	618	0.49	3.29	0.60
R:PART	4	5	9	44.44	30.77	40.82
R:PREP	35	87	168	28.69	17.24	25.33
R:PRON	0	21	35	0.00	0.00	0.00
R:PUNCT	33	72	71	31.43	31.73	31.49
R:SPELL	4	11	291	26.67	1.36	5.63
R:VERB	6	346	121	1.70	4.72	1.95
R:VERB:FORM	46	38	100	54.76	31.51	47.72
R:VERB:INFL	2	0	7	100.00	22.22	58.82
R:VERB:SVA	41	24	86	63.08	32.28	52.97
R:VERB:TENSE	41	60	137	40.59	23.03	35.22
R:WO	11	11	61	50.00	15.28	34.38
U:ADJ	1	94	5	1.05	16.67	1.30
U:ADV	4	44	10	8.33	28.57	9.71
U:CONJ	0	18	3	0.00	0.00	0.00
U:CONTR	2	0	3	100.00	40.00	76.92
U:DET	43	100	129	30.07	25.00	28.90
U:NOUN	2	205	12	0.97	14.29	1.19
U:NOUN:POSS	0	0	9	100.00	0.00	0.00
U:OTHER	5	172	20	2.82	20.00	3.41
U:PART	1	1	4	50.00	20.00	38.46
U:PREP	14	50	48	21.88	22.58	22.01
U:PRON	7	9	13	43.75	35.00	41.67
U:PUNCT	28	99	28	22.05	50.00	24.82
U:VERB	8	117	14	6.40	36.36	7.66
U:VERB:FORM	2	1	3	66.67	40.00	58.82
U:VERB:TENSE	4	4	18	50.00	18.18	37.04

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	328	272	782	54.67	29.55	46.72
R	1190	5717	2295	17.23	34.15	19.12
U	160	789	334	16.86	32.39	18.65
UNK	33	0	59	100.00	35.87	73.66

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	18	142	36	11.25	33.33	12.97
ADJ:FORM	3	1	6	75.00	33.33	60.00
ADV	18	53	46	25.35	28.12	25.86
CONJ	3	28	20	9.68	13.04	10.20
CONTR	2	5	5	28.57	28.57	28.57
DET	105	216	433	32.71	19.52	28.81
MORPH	54	10	88	84.38	38.03	67.84
NOUN	56	1279	94	4.19	37.33	5.10
NOUN:INFL	6	0	14	100.00	30.00	68.18
NOUN:NUM	105	43	143	70.95	42.34	62.50
NOUN:POSS	9	5	40	64.29	18.37	42.86
ORTH	248	16	230	93.94	51.88	80.83
OTHER	187	4083	654	4.38	22.24	5.22
PART	5	3	20	62.50	20.00	43.86
PREP	87	130	310	40.09	21.91	34.39
PRON	27	38	96	41.54	21.95	35.25
PUNCT	306	239	388	56.15	44.09	53.24
SPELL	124	6	188	95.38	39.74	74.52
UNK	33	0	59	100.00	35.87	73.66
VERB	92	358	174	20.44	34.59	22.27
VERB:FORM	78	32	92	70.91	45.88	63.93
VERB:INFL	3	0	5	100.00	37.50	75.00
VERB:SVA	52	19	83	73.24	38.52	62.05
VERB:TENSE	75	62	189	54.74	28.41	46.18
WO	15	10	57	60.00	20.83	43.60

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	3	6	0.00	0.00	0.00
M:ADV	2	7	16	22.22	11.11	18.52
M:CONJ	1	8	14	11.11	6.67	9.80
M:DET	45	88	204	33.83	18.07	28.81
M:NOUN	0	11	13	0.00	0.00	0.00
M:NOUN:POSS	1	3	12	25.00	7.69	17.24
M:OTHER	9	19	45	32.14	16.67	27.11
M:PART	0	0	4	100.00	0.00	0.00
M:PREP	11	21	79	34.38	12.22	25.23
M:PRON	15	14	49	51.72	23.44	41.67
M:PUNCT	226	78	269	74.34	45.66	66.04
M:VERB	4	9	35	30.77	10.26	21.98
M:VERB:FORM	6	2	4	75.00	60.00	71.43
M:VERB:TENSE	8	9	32	47.06	20.00	37.04
R:ADJ	17	68	25	20.00	40.48	22.25
R:ADJ:FORM	3	1	6	75.00	33.33	60.00
R:ADV	11	14	21	44.00	34.38	41.67
R:CONJ	2	4	3	33.33	40.00	34.48
R:CONTR	1	4	2	20.00	33.33	21.74
R:DET	12	31	93	27.91	11.43	21.66
R:MORPH	54	10	88	84.38	38.03	67.84
R:NOUN	45	1096	70	3.94	39.13	4.81
R:NOUN:INFL	6	0	14	100.00	30.00	68.18
R:NOUN:NUM	105	43	143	70.95	42.34	62.50
R:NOUN:POSS	8	2	18	80.00	30.77	60.61
R:ORTH	248	16	230	93.94	51.88	80.83
R:OTHER	165	3900	589	4.06	21.88	4.85
R:PART	5	1	11	83.33	31.25	62.50
R:PREP	58	68	184	46.03	23.97	38.87
R:PRON	3	16	34	15.79	8.11	13.27
R:PUNCT	49	68	86	41.88	36.30	40.63
R:SPELL	124	6	188	95.38	39.74	74.52
R:VERB	78	259	122	23.15	39.00	25.19
R:VERB:FORM	70	29	85	70.71	45.16	63.52
R:VERB:INFL	3	0	5	100.00	37.50	75.00
R:VERB:SVA	52	19	83	73.24	38.52	62.05
R:VERB:TENSE	56	52	138	51.85	28.87	44.73
R:WO	15	10	57	60.00	20.83	43.60
U:ADJ	1	71	5	1.39	16.67	1.70
U:ADV	5	32	9	13.51	35.71	15.43
U:CONJ	0	16	3	0.00	0.00	0.00
U:CONTR	1	1	3	50.00	25.00	41.67
U:DET	48	97	136	33.10	26.09	31.41
U:NOUN	11	172	11	6.01	50.00	7.29
U:NOUN:POSS	0	0	10	100.00	0.00	0.00
U:OTHER	13	164	20	7.34	39.39	8.77
U:PART	0	2	5	0.00	0.00	0.00
U:PREP	18	41	47	30.51	27.69	29.90
U:PRON	9	8	13	52.94	40.91	50.00
U:PUNCT	31	93	33	25.00	48.44	27.68
U:VERB	10	90	17	10.00	37.04	11.71
U:VERB:FORM	2	1	3	66.67	40.00	58.82
U:VERB:TENSE	11	1	19	91.67	36.67	70.51
UNK	33	0	59	100.00	35.87	73.66

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	837	211	789	79.87	51.48	71.93
R	3050	7974	2717	27.67	52.89	30.58
U	292	1212	467	19.41	38.47	21.55
UNK	124	0	116	100.00	51.67	84.24

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	46	133	35	25.70	56.79	28.86
ADJ:FORM	8	1	10	88.89	44.44	74.07
ADV	29	44	49	39.73	37.18	39.19
CONJ	22	22	22	50.00	50.00	50.00
CONTR	4	4	14	50.00	22.22	40.00
DET	225	181	425	55.42	34.62	49.47
MORPH	117	10	56	92.13	67.63	85.90
NOUN	155	1315	99	10.54	61.02	12.63
NOUN:INFL	16	0	2	100.00	88.89	97.56
NOUN:NUM	196	31	103	86.34	65.55	81.19
NOUN:POSS	40	4	33	90.91	54.79	80.32
ORTH	543	11	167	98.01	76.48	92.79
OTHER	903	6820	1219	11.69	42.55	13.68
PART	12	1	18	92.31	40.00	73.17
PREP	179	114	334	61.09	34.89	53.12
PRON	46	22	101	67.65	31.29	54.89
PUNCT	678	209	453	76.44	59.95	72.45
SPELL	323	5	3	98.48	99.08	98.60
UNK	124	0	116	100.00	51.67	84.24
VERB	166	355	202	31.86	45.11	33.85
VERB:FORM	105	26	105	80.15	50.00	71.53
VERB:INFL	8	1	1	88.89	88.89	88.89
VERB:SVA	77	17	79	81.91	49.36	72.37
VERB:TENSE	157	59	235	72.69	40.05	62.50
WO	124	12	208	91.18	37.35	70.78

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	2	5	60.00	37.50	53.57
M:ADV	8	7	18	53.33	30.77	46.51
M:CONJ	17	5	14	77.27	54.84	71.43
M:DET	147	68	167	68.37	46.82	62.61
M:NOUN	6	9	19	40.00	24.00	35.29
M:NOUN:POSS	9	3	10	75.00	47.37	67.16
M:OTHER	38	16	45	70.37	45.78	63.55
M:PART	1	0	6	100.00	14.29	45.45
M:PREP	40	14	75	74.07	34.78	60.42
M:PRON	28	5	47	84.85	37.33	67.63
M:PUNCT	491	66	298	88.15	62.23	81.37
M:VERB	13	8	41	61.90	24.07	47.10
M:VERB:FORM	11	2	8	84.62	57.89	77.46
M:VERB:TENSE	25	6	36	80.65	40.98	67.57
R:ADJ	40	73	26	35.40	60.61	38.61
R:ADJ:FORM	8	1	10	88.89	44.44	74.07
R:ADV	14	12	19	53.85	42.42	51.09
R:CONJ	4	3	3	57.14	57.14	57.14
R:CONTR	1	4	7	20.00	12.50	17.86
R:DET	18	29	99	38.30	15.38	29.51
R:MORPH	117	10	56	92.13	67.63	85.90
R:NOUN	133	1167	64	10.23	67.51	12.32
R:NOUN:INFL	16	0	2	100.00	88.89	97.56
R:NOUN:NUM	196	31	103	86.34	65.55	81.19
R:NOUN:POSS	28	1	11	96.55	71.79	90.32
R:ORTH	543	11	167	98.01	76.48	92.79
R:OTHER	814	6121	1082	11.74	42.93	13.73
R:PART	9	0	8	100.00	52.94	84.91
R:PREP	108	61	205	63.91	34.50	54.60
R:PRON	8	11	40	42.11	16.67	32.26
R:PUNCT	110	60	104	64.71	51.40	61.52
R:SPELL	323	5	3	98.48	99.08	98.60
R:VERB	139	269	139	34.07	50.00	36.39
R:VERB:FORM	91	23	95	79.82	48.92	70.87
R:VERB:INFL	8	1	1	88.89	88.89	88.89
R:VERB:SVA	77	17	79	81.91	49.36	72.37
R:VERB:TENSE	121	52	186	69.94	39.41	60.56
R:WO	124	12	208	91.18	37.35	70.78
U:ADJ	3	58	4	4.92	42.86	5.98
U:ADV	7	25	12	21.88	36.84	23.81
U:CONJ	1	14	5	6.67	16.67	7.58
U:CONTR	3	0	7	100.00	30.00	68.18
U:DET	60	84	159	41.67	27.40	37.74
U:NOUN	16	139	16	10.32	50.00	12.27
U:NOUN:POSS	3	0	12	100.00	20.00	55.56
U:OTHER	51	683	92	6.95	35.66	8.28
U:PART	2	1	4	66.67	33.33	55.56
U:PREP	31	39	54	44.29	36.47	42.47
U:PRON	10	6	14	62.50	41.67	56.82
U:PUNCT	77	83	51	48.13	60.16	50.13
U:VERB	14	78	22	15.22	38.89	17.33
U:VERB:FORM	3	1	2	75.00	60.00	71.43
U:VERB:TENSE	11	1	13	91.67	45.83	76.39
UNK	124	0	116	100.00	51.67	84.24

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	371	1643	1625	18.42	18.59	18.45
Span-level detection	724	1292	1577	35.91	31.46	34.93
Token-level detection	1651	1342	1769	55.16	48.27	53.63

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	105	101	328	50.97	24.25	41.77
R	211	1347	1147	13.54	15.54	13.90
U	55	195	150	22.00	26.83	22.82

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	27	11	3.57	8.33	4.03
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	3	27	19	10.00	13.64	10.56
CONJ	0	4	5	0.00	0.00	0.00
CONTR	3	1	0	75.00	100.00	78.95
DET	48	65	187	42.48	20.43	34.93
MORPH	7	4	65	63.64	9.72	30.17
NOUN	3	344	45	0.86	6.25	1.04
NOUN:INFL	0	0	6	100.00	0.00	0.00
NOUN:NUM	26	13	84	66.67	23.64	48.87
NOUN:POSS	0	2	10	0.00	0.00	0.00
ORTH	65	9	124	87.84	34.39	67.01
OTHER	15	871	355	1.69	4.05	1.92
PART	4	0	7	100.00	36.36	74.07
PREP	23	35	123	39.66	15.75	30.42
PRON	7	17	56	29.17	11.11	22.01
PUNCT	92	72	135	56.10	40.53	52.10
SPELL	2	7	102	22.22	1.92	7.14
VERB	8	101	80	7.34	9.09	7.63
VERB:FORM	26	12	56	68.42	31.71	55.56
VERB:INFL	2	0	2	100.00	50.00	83.33
VERB:SVA	18	11	48	62.07	27.27	49.45
VERB:TENSE	16	19	85	45.71	15.84	33.20
WO	2	2	18	50.00	10.00	27.78

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	1	0.00	0.00	0.00
M:ADV	0	5	5	0.00	0.00	0.00
M:CONJ	0	1	2	0.00	0.00	0.00
M:DET	19	32	81	37.25	19.00	31.25
M:NOUN	0	1	4	0.00	0.00	0.00
M:NOUN:POSS	0	1	3	0.00	0.00	0.00
M:OTHER	1	10	23	9.09	4.17	7.35
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	2	9	38	18.18	5.00	11.90
M:PRON	5	8	27	38.46	15.62	29.76
M:PUNCT	73	27	105	73.00	41.01	63.15
M:VERB	1	2	17	33.33	5.56	16.67
M:VERB:FORM	3	0	5	100.00	37.50	75.00
M:VERB:TENSE	1	4	16	20.00	5.88	13.51
R:ADJ	0	12	8	0.00	0.00	0.00
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	2	7	8	22.22	20.00	21.74
R:CONJ	0	2	0	0.00	100.00	0.00
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	3	11	38	21.43	7.32	15.46
R:MORPH	7	4	65	63.64	9.72	30.17
R:NOUN	1	288	33	0.35	2.94	0.42
R:NOUN:INFL	0	0	6	100.00	0.00	0.00
R:NOUN:NUM	26	13	84	66.67	23.64	48.87
R:NOUN:POSS	0	1	4	0.00	0.00	0.00
R:ORTH	65	9	124	87.84	34.39	67.01
R:OTHER	13	831	323	1.54	3.87	1.75
R:PART	4	0	4	100.00	50.00	83.33
R:PREP	14	20	66	41.18	17.50	32.41
R:PRON	0	7	20	0.00	0.00	0.00
R:PUNCT	11	23	21	32.35	34.38	32.74
R:SPELL	2	7	102	22.22	1.92	7.14
R:VERB	4	73	57	5.19	6.56	5.42
R:VERB:FORM	23	12	50	65.71	31.51	53.99
R:VERB:INFL	2	0	2	100.00	50.00	83.33
R:VERB:SVA	18	11	48	62.07	27.27	49.45
R:VERB:TENSE	13	13	64	50.00	16.88	35.91
R:WO	2	2	18	50.00	10.00	27.78
U:ADJ	1	14	2	6.67	33.33	7.94
U:ADV	1	15	6	6.25	14.29	7.04
U:CONJ	0	1	3	0.00	0.00	0.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	26	22	68	54.17	27.66	45.45
U:NOUN	2	55	8	3.51	20.00	4.20
U:NOUN:POSS	0	0	3	100.00	0.00	0.00
U:OTHER	1	30	9	3.23	10.00	3.73
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	7	6	19	53.85	26.92	44.87
U:PRON	2	2	9	50.00	18.18	37.04
U:PUNCT	8	22	9	26.67	47.06	29.20
U:VERB	3	26	6	10.34	33.33	12.00
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	2	2	5	50.00	28.57	43.48

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	126	83	341	60.29	26.98	48.35
R	511	1062	1038	32.49	32.99	32.59
U	72	147	151	32.88	32.29	32.76
UNK	15	0	47	100.00	24.19	61.48

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	18	13	5.26	7.14	5.56
ADJ:FORM	1	0	2	100.00	33.33	71.43
ADV	7	18	26	28.00	21.21	26.32
CONJ	0	3	8	0.00	0.00	0.00
CONTR	2	2	0	50.00	100.00	55.56
DET	60	53	188	53.10	24.19	42.86
MORPH	25	2	54	92.59	31.65	66.84
NOUN	20	258	41	7.19	32.79	8.53
NOUN:INFL	0	0	6	100.00	0.00	0.00
NOUN:NUM	58	12	70	82.86	45.31	71.08
NOUN:POSS	1	1	10	50.00	9.09	26.32
ORTH	117	7	94	94.35	55.45	82.74
OTHER	92	731	328	11.18	21.90	12.39
PART	4	0	7	100.00	36.36	74.07
PREP	36	20	131	64.29	21.56	46.04
PRON	12	12	53	50.00	18.46	37.27
PUNCT	99	71	148	58.24	40.08	53.40
SPELL	51	3	60	94.44	45.95	77.98
UNK	15	0	47	100.00	24.19	61.48
VERB	32	55	90	36.78	26.23	34.04
VERB:FORM	34	6	46	85.00	42.50	70.83
VERB:INFL	2	0	1	100.00	66.67	90.91
VERB:SVA	24	7	47	77.42	33.80	61.54
VERB:TENSE	27	12	91	69.23	22.88	49.27
WO	4	1	16	80.00	20.00	50.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	2	0.00	0.00	0.00
M:ADV	0	4	9	0.00	0.00	0.00
M:CONJ	0	1	5	0.00	0.00	0.00
M:DET	24	24	80	50.00	23.08	40.54
M:NOUN	0	1	4	0.00	0.00	0.00
M:NOUN:POSS	0	1	3	0.00	0.00	0.00
M:OTHER	4	7	23	36.36	14.81	28.17
M:PREP	6	6	38	50.00	13.64	32.61
M:PRON	6	7	27	46.15	18.18	35.29
M:PUNCT	76	28	110	73.08	40.86	63.12
M:VERB	2	1	19	66.67	9.52	30.30
M:VERB:FORM	4	0	3	100.00	57.14	86.96
M:VERB:TENSE	4	2	18	66.67	18.18	43.48
R:ADJ	0	8	9	0.00	0.00	0.00
R:ADJ:FORM	1	0	2	100.00	33.33	71.43
R:ADV	4	7	12	36.36	25.00	33.33
R:CONJ	0	2	0	0.00	100.00	0.00
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	8	9	39	47.06	17.02	34.78
R:MORPH	25	2	54	92.59	31.65	66.84
R:NOUN	15	212	31	6.61	32.61	7.86
R:NOUN:INFL	0	0	6	100.00	0.00	0.00
R:NOUN:NUM	58	12	70	82.86	45.31	71.08
R:NOUN:POSS	1	0	3	100.00	25.00	62.50
R:ORTH	117	7	94	94.35	55.45	82.74
R:OTHER	84	699	297	10.73	22.05	11.96
R:PART	4	0	4	100.00	50.00	83.33
R:PREP	21	12	76	63.64	21.65	45.85
R:PRON	3	4	18	42.86	14.29	30.61
R:PUNCT	15	21	26	41.67	36.59	40.54
R:SPELL	51	3	60	94.44	45.95	77.98
R:VERB	26	39	63	40.00	29.21	37.25
R:VERB:FORM	30	6	42	83.33	41.67	69.44
R:VERB:INFL	2	0	1	100.00	66.67	90.91
R:VERB:SVA	24	7	47	77.42	33.80	61.54
R:VERB:TENSE	17	10	68	62.96	20.00	44.04
R:WO	4	1	16	80.00	20.00	50.00
U:ADJ	1	9	2	10.00	33.33	11.63
U:ADV	3	7	5	30.00	37.50	31.25
U:CONJ	0	0	3	100.00	0.00	0.00
U:CONTR	1	1	0	50.00	100.00	55.56
U:DET	28	20	69	58.33	28.87	48.44
U:NOUN	5	45	6	10.00	45.45	11.85
U:NOUN:POSS	0	0	4	100.00	0.00	0.00
U:OTHER	4	25	8	13.79	33.33	15.62
U:PART	0	0	3	100.00	0.00	0.00
U:PREP	9	2	17	81.82	34.62	64.29
U:PRON	3	1	8	75.00	27.27	55.56
U:PUNCT	8	22	12	26.67	40.00	28.57
U:VERB	4	15	8	21.05	33.33	22.73
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	6	0	5	100.00	54.55	85.71
UNK	15	0	47	100.00	24.19	61.48

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	287	54	337	84.16	45.99	72.18
R	1177	1140	1145	50.80	50.69	50.78
U	133	148	210	47.33	38.78	45.33
UNK	54	0	77	100.00	41.22	77.81

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	9	12	15	42.86	37.50	41.67
ADJ:FORM	3	0	3	100.00	50.00	83.33
ADV	13	15	27	46.43	32.50	42.76
CONJ	6	2	10	75.00	37.50	62.50
CONTR	4	1	3	80.00	57.14	74.07
DET	113	36	193	75.84	36.93	62.64
MORPH	56	2	31	96.55	64.37	87.77
NOUN	54	230	48	19.01	52.94	21.81
NOUN:INFL	4	0	2	100.00	66.67	90.91
NOUN:NUM	94	6	45	94.00	67.63	87.20
NOUN:POSS	9	1	11	90.00	45.00	75.00
ORTH	200	4	47	98.04	80.97	94.07
OTHER	390	896	551	30.33	41.45	32.05
PART	4	0	10	100.00	28.57	66.67
PREP	68	14	134	82.93	33.66	64.15
PRON	21	4	56	84.00	27.27	59.32
PUNCT	188	53	167	78.01	52.96	71.27
SPELL	111	3	2	97.37	98.23	97.54
UNK	54	0	77	100.00	41.22	77.81
VERB	64	44	104	59.26	38.10	53.33
VERB:FORM	47	4	43	92.16	52.22	79.93
VERB:INFL	4	1	0	80.00	100.00	83.33
VERB:SVA	43	5	37	89.58	53.75	79.04
VERB:TENSE	56	9	112	86.15	33.33	65.42
WO	36	0	41	100.00	46.75	81.45

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	0	1	100.00	66.67	90.91
M:ADV	4	5	9	44.44	30.77	40.82
M:CONJ	5	0	5	100.00	50.00	83.33
M:DET	67	16	69	80.72	49.26	71.58
M:NOUN	4	1	7	80.00	36.36	64.52
M:NOUN:POSS	1	1	2	50.00	33.33	45.45
M:OTHER	18	5	21	78.26	46.15	68.70
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	17	1	34	94.44	33.33	69.11
M:PRON	11	2	27	84.62	28.95	61.11
M:PUNCT	133	21	114	86.36	53.85	77.06
M:VERB	6	1	25	85.71	19.35	50.85
M:VERB:FORM	7	0	7	100.00	50.00	83.33
M:VERB:TENSE	12	1	14	92.31	46.15	76.92
R:ADJ	5	7	12	41.67	29.41	38.46
R:ADJ:FORM	3	0	3	100.00	50.00	83.33
R:ADV	5	5	10	50.00	33.33	45.45
R:CONJ	1	2	1	33.33	50.00	35.71
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	10	7	41	58.82	19.61	42.02
R:MORPH	56	2	31	96.55	64.37	87.77
R:NOUN	42	200	31	17.36	57.53	20.17
R:NOUN:INFL	4	0	2	100.00	66.67	90.91
R:NOUN:NUM	94	6	45	94.00	67.63	87.20
R:NOUN:POSS	6	0	3	100.00	66.67	90.91
R:ORTH	200	4	47	98.04	80.97	94.07
R:OTHER	351	822	490	29.92	41.74	31.72
R:PART	4	0	5	100.00	44.44	80.00
R:PREP	35	11	81	76.09	30.17	58.33
R:PRON	4	2	21	66.67	16.00	40.82
R:PUNCT	31	16	42	65.96	42.47	59.39
R:SPELL	111	3	2	97.37	98.23	97.54
R:VERB	52	34	70	60.47	42.62	55.79
R:VERB:FORM	40	4	35	90.91	53.33	79.68
R:VERB:INFL	4	1	0	80.00	100.00	83.33
R:VERB:SVA	43	5	37	89.58	53.75	79.04
R:VERB:TENSE	39	8	95	82.98	29.10	60.56
R:WO	36	0	41	100.00	46.75	81.45
U:ADJ	2	5	2	28.57	50.00	31.25
U:ADV	4	5	8	44.44	33.33	41.67
U:CONJ	0	0	4	100.00	0.00	0.00
U:CONTR	3	0	3	100.00	50.00	83.33
U:DET	36	13	83	73.47	30.25	57.14
U:NOUN	8	29	10	21.62	44.44	24.10
U:NOUN:POSS	2	0	6	100.00	25.00	62.50
U:OTHER	21	69	40	23.33	34.43	24.94
U:PART	0	0	3	100.00	0.00	0.00
U:PREP	16	2	19	88.89	45.71	74.77
U:PRON	6	0	8	100.00	42.86	78.95
U:PUNCT	24	16	11	60.00	68.57	61.54
U:VERB	6	9	9	40.00	40.00	40.00
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	5	0	3	100.00	62.50	89.29
UNK	54	0	77	100.00	41.22	77.81

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	256	2041	1121	11.14	18.59	12.12
Span-level detection	507	1791	1136	22.06	30.86	23.40
Token-level detection	1278	2430	1417	34.47	47.42	36.46

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	89	95	244	48.37	26.73	41.63
R	130	1677	771	7.19	14.43	8.00
U	37	269	106	12.09	25.87	13.53

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	49	11	5.77	21.43	6.76
ADJ:FORM	2	0	0	100.00	100.00	100.00
ADV	4	14	14	22.22	22.22	22.22
CONJ	1	11	8	8.33	11.11	8.77
CONTR	0	1	2	0.00	0.00	0.00
DET	17	71	153	19.32	10.00	16.28
MORPH	3	2	32	60.00	8.57	27.27
NOUN	5	430	31	1.15	13.89	1.41
NOUN:NUM	13	15	44	46.43	22.81	38.46
NOUN:POSS	1	1	13	50.00	7.14	22.73
ORTH	11	6	51	64.71	17.74	42.31
OTHER	5	1097	233	0.45	2.10	0.54
PART	0	3	6	0.00	0.00	0.00
PREP	20	50	108	28.57	15.62	24.51
PRON	8	11	31	42.11	20.51	34.78
PUNCT	89	83	91	51.74	49.44	51.27
SPELL	1	3	64	25.00	1.54	6.17
VERB	5	143	64	3.38	7.25	3.78
VERB:FORM	20	13	41	60.61	32.79	51.81
VERB:SVA	20	5	24	80.00	45.45	69.44
VERB:TENSE	23	29	70	44.23	24.73	38.21
WO	5	4	30	55.56	14.29	35.21

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	2	0.00	0.00	0.00
M:ADV	0	1	7	0.00	0.00	0.00
M:CONJ	0	3	6	0.00	0.00	0.00
M:DET	7	29	83	19.44	7.78	14.96
M:NOUN	0	6	2	0.00	0.00	0.00
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:OTHER	0	8	14	0.00	0.00	0.00
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	1	5	24	16.67	4.00	10.20
M:PRON	4	4	19	50.00	17.39	36.36
M:PUNCT	74	28	58	72.55	56.06	68.52
M:VERB	1	5	9	16.67	10.00	14.71
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	1	5	13	16.67	7.14	13.16
R:ADJ	3	18	7	14.29	30.00	15.96
R:ADJ:FORM	2	0	0	100.00	100.00	100.00
R:ADV	2	3	4	40.00	33.33	38.46
R:CONJ	1	0	2	100.00	33.33	71.43
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	1	11	37	8.33	2.63	5.81
R:MORPH	3	2	32	60.00	8.57	27.27
R:NOUN	5	366	26	1.35	16.13	1.65
R:NOUN:NUM	13	15	44	46.43	22.81	38.46
R:NOUN:POSS	1	1	3	50.00	25.00	41.67
R:ORTH	11	6	51	64.71	17.74	42.31
R:OTHER	1	1029	208	0.10	0.48	0.12
R:PART	0	3	3	0.00	0.00	0.00
R:PREP	13	33	63	28.26	17.11	25.00
R:PRON	0	6	9	0.00	0.00	0.00
R:PUNCT	9	23	26	28.12	25.71	27.61
R:SPELL	1	3	64	25.00	1.54	6.17
R:VERB	2	111	48	1.77	4.00	1.99
R:VERB:FORM	17	13	39	56.67	30.36	48.30
R:VERB:SVA	20	5	24	80.00	45.45	69.44
R:VERB:TENSE	20	24	50	45.45	28.57	40.65
R:WO	5	4	30	55.56	14.29	35.21
U:ADJ	0	30	2	0.00	0.00	0.00
U:ADV	2	10	3	16.67	40.00	18.87
U:CONJ	0	8	0	0.00	100.00	0.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	9	31	33	22.50	21.43	22.28
U:NOUN	0	58	3	0.00	0.00	0.00
U:NOUN:POSS	0	0	5	100.00	0.00	0.00
U:OTHER	4	60	11	6.25	26.67	7.38
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	6	12	21	33.33	22.22	30.30
U:PRON	4	1	3	80.00	57.14	74.07
U:PUNCT	6	32	7	15.79	46.15	18.18
U:VERB	2	27	7	6.90	22.22	8.00
U:VERB:FORM	2	0	2	100.00	50.00	83.33
U:VERB:TENSE	2	0	7	100.00	22.22	58.82

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	103	82	272	55.68	27.47	46.19
R	345	1475	739	18.96	31.83	20.62
U	54	234	115	18.75	31.95	20.44
UNK	5	0	10	100.00	33.33	71.43

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	8	44	11	15.38	42.11	17.62
ADJ:FORM	2	0	1	100.00	66.67	90.91
ADV	7	11	16	38.89	30.43	36.84
CONJ	2	11	7	15.38	22.22	16.39
CONTR	0	1	2	0.00	0.00	0.00
DET	22	65	164	25.29	11.83	20.60
MORPH	12	1	21	92.31	36.36	70.59
NOUN	25	365	33	6.41	43.10	7.73
NOUN:NUM	23	13	42	63.89	35.38	55.02
NOUN:POSS	2	0	11	100.00	15.38	47.62
ORTH	51	4	63	92.73	44.74	76.35
OTHER	48	1006	224	4.55	17.65	5.35
PART	1	1	6	50.00	14.29	33.33
PREP	35	39	117	47.30	23.03	39.06
PRON	12	8	32	60.00	27.27	48.39
PUNCT	99	72	117	57.89	45.83	55.00
SPELL	25	2	42	92.59	37.31	71.43
UNK	5	0	10	100.00	33.33	71.43
VERB	36	106	67	25.35	34.95	26.83
VERB:FORM	28	11	35	71.79	44.44	63.93
VERB:SVA	23	5	23	82.14	50.00	72.78
VERB:TENSE	33	23	64	58.93	34.02	51.40
WO	8	3	28	72.73	22.22	50.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	2	0.00	0.00	0.00
M:ADV	1	1	6	50.00	14.29	33.33
M:CONJ	1	3	5	25.00	16.67	22.73
M:DET	10	25	88	28.57	10.20	21.01
M:NOUN	0	6	4	0.00	0.00	0.00
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:OTHER	3	6	13	33.33	18.75	28.85
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	3	5	27	37.50	10.00	24.19
M:PRON	7	3	18	70.00	28.00	53.85
M:PUNCT	73	24	81	75.26	47.40	67.34
M:VERB	1	4	12	20.00	7.69	15.15
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	3	4	9	42.86	25.00	37.50
R:ADJ	8	17	7	32.00	53.33	34.78
R:ADJ:FORM	2	0	1	100.00	66.67	90.91
R:ADV	5	3	7	62.50	41.67	56.82
R:CONJ	1	0	2	100.00	33.33	71.43
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	2	10	38	16.67	5.00	11.36
R:MORPH	12	1	21	92.31	36.36	70.59
R:NOUN	21	310	25	6.34	45.65	7.66
R:NOUN:NUM	23	13	42	63.89	35.38	55.02
R:NOUN:POSS	2	0	2	100.00	50.00	83.33
R:ORTH	51	4	63	92.73	44.74	76.35
R:OTHER	36	940	201	3.69	15.19	4.35
R:PART	1	1	3	50.00	25.00	41.67
R:PREP	24	25	68	48.98	26.09	41.67
R:PRON	0	4	10	0.00	0.00	0.00
R:PUNCT	18	21	28	46.15	39.13	44.55
R:SPELL	25	2	42	92.59	37.31	71.43
R:VERB	32	85	47	27.35	40.51	29.25
R:VERB:FORM	25	11	33	69.44	43.10	61.88
R:VERB:SVA	23	5	23	82.14	50.00	72.78
R:VERB:TENSE	26	19	47	57.78	35.62	51.38
R:WO	8	3	28	72.73	22.22	50.00
U:ADJ	0	26	2	0.00	0.00	0.00
U:ADV	1	7	3	12.50	25.00	13.89
U:CONJ	0	8	0	0.00	100.00	0.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	10	30	38	25.00	20.83	24.04
U:NOUN	4	49	4	7.55	50.00	9.09
U:NOUN:POSS	0	0	4	100.00	0.00	0.00
U:OTHER	9	60	10	13.04	47.37	15.25
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	8	9	22	47.06	26.67	40.82
U:PRON	5	1	4	83.33	55.56	75.76
U:PUNCT	8	27	8	22.86	50.00	25.64
U:VERB	3	17	8	15.00	27.27	16.48
U:VERB:FORM	2	0	2	100.00	50.00	83.33
U:VERB:TENSE	4	0	8	100.00	33.33	71.43
UNK	5	0	10	100.00	33.33	71.43

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	251	57	253	81.49	49.80	72.29
R	912	1975	987	31.59	48.03	33.91
U	83	398	151	17.26	35.47	19.23
UNK	32	0	26	100.00	55.17	86.02

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	18	36	11	33.33	62.07	36.73
ADJ:FORM	2	0	1	100.00	66.67	90.91
ADV	8	7	12	53.33	40.00	50.00
CONJ	10	7	7	58.82	58.82	58.82
CONTR	0	1	3	0.00	0.00	0.00
DET	65	53	151	55.08	30.09	47.24
MORPH	24	1	15	96.00	61.54	86.33
NOUN	53	358	32	12.90	62.35	15.33
NOUN:NUM	45	9	38	83.33	54.22	75.25
NOUN:POSS	10	0	11	100.00	47.62	81.97
ORTH	131	2	45	98.50	74.43	92.51
OTHER	296	1720	461	14.68	39.10	16.78
PART	7	0	4	100.00	63.64	89.74
PREP	64	31	123	67.37	34.22	56.44
PRON	17	3	36	85.00	32.08	63.91
PUNCT	187	62	125	75.10	59.94	71.48
SPELL	73	1	1	98.65	98.65	98.65
UNK	32	0	26	100.00	55.17	86.02
VERB	60	100	68	37.50	46.88	39.06
VERB:FORM	33	8	42	80.49	44.00	69.04
VERB:SVA	27	5	24	84.38	52.94	75.42
VERB:TENSE	64	22	75	74.42	46.04	66.25
WO	52	4	106	92.86	32.91	68.06

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	2	50.00	33.33	45.45
M:ADV	1	0	6	100.00	14.29	45.45
M:CONJ	8	1	5	88.89	61.54	81.63
M:DET	47	17	68	73.44	40.87	63.34
M:NOUN	1	4	6	20.00	14.29	18.52
M:NOUN:POSS	4	0	4	100.00	50.00	83.33
M:OTHER	12	5	12	70.59	50.00	65.22
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	14	4	24	77.78	36.84	63.64
M:PRON	11	1	17	91.67	39.29	72.37
M:PUNCT	139	19	80	87.97	63.47	81.67
M:VERB	3	3	12	50.00	20.00	38.46
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	8	2	15	80.00	34.78	63.49
R:ADJ	17	16	9	51.52	65.38	53.80
R:ADJ:FORM	2	0	1	100.00	66.67	90.91
R:ADV	6	2	5	75.00	54.55	69.77
R:CONJ	2	0	2	100.00	50.00	83.33
R:CONTR	0	1	2	0.00	0.00	0.00
R:DET	6	10	40	37.50	13.04	27.27
R:MORPH	24	1	15	96.00	61.54	86.33
R:NOUN	48	316	21	13.19	69.57	15.74
R:NOUN:NUM	45	9	38	83.33	54.22	75.25
R:NOUN:POSS	5	0	3	100.00	62.50	89.29
R:ORTH	131	2	45	98.50	74.43	92.51
R:OTHER	261	1455	411	15.21	38.84	17.32
R:PART	5	0	1	100.00	83.33	96.15
R:PREP	39	20	75	66.10	34.21	55.71
R:PRON	3	2	14	60.00	17.65	40.54
R:PUNCT	33	18	30	64.71	52.38	61.80
R:SPELL	73	1	1	98.65	98.65	98.65
R:VERB	53	85	48	38.41	52.48	40.58
R:VERB:FORM	29	8	41	78.38	41.43	66.51
R:VERB:SVA	27	5	24	84.38	52.94	75.42
R:VERB:TENSE	51	20	55	71.83	48.11	65.38
R:WO	52	4	106	92.86	32.91	68.06
U:ADJ	0	19	0	0.00	100.00	0.00
U:ADV	1	5	1	16.67	50.00	19.23
U:CONJ	0	6	0	0.00	100.00	0.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	12	26	43	31.58	21.82	28.99
U:NOUN	4	38	5	9.52	44.44	11.30
U:NOUN:POSS	1	0	4	100.00	20.00	55.56
U:OTHER	23	260	38	8.13	37.70	9.64
U:PART	2	0	1	100.00	66.67	90.91
U:PREP	11	7	24	61.11	31.43	51.40
U:PRON	3	0	5	100.00	37.50	75.00
U:PUNCT	15	25	15	37.50	50.00	39.47
U:VERB	4	12	8	25.00	33.33	26.32
U:VERB:FORM	2	0	1	100.00	66.67	90.91
U:VERB:TENSE	5	0	5	100.00	50.00	83.33
UNK	32	0	26	100.00	55.17	86.02

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	140	1595	425	8.07	24.78	9.33
Span-level detection	266	1470	417	15.32	38.95	17.44
Token-level detection	662	2090	516	24.06	56.20	27.16

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	56	59	103	48.70	35.22	45.23
R	63	1334	275	4.51	18.64	5.32
U	21	202	47	9.42	30.88	10.94

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	50	7	0.00	0.00	0.00
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	2	11	4	15.38	33.33	17.24
CONJ	0	9	4	0.00	0.00	0.00
CONTR	0	2	3	0.00	0.00	0.00
DET	14	39	69	26.42	16.87	23.73
MORPH	5	3	14	62.50	26.32	49.02
NOUN	2	330	12	0.60	14.29	0.75
NOUN:INFL	0	0	1	100.00	0.00	0.00
NOUN:NUM	6	8	23	42.86	20.69	35.29
NOUN:POSS	1	1	5	50.00	16.67	35.71
ORTH	11	2	26	84.62	29.73	61.80
OTHER	4	924	53	0.43	7.02	0.53
PART	1	0	2	100.00	33.33	71.43
PREP	7	31	50	18.42	12.28	16.75
PRON	2	11	7	15.38	22.22	16.39
PUNCT	66	54	44	55.00	60.00	55.93
SPELL	1	0	35	100.00	2.78	12.50
VERB	2	90	11	2.17	15.38	2.62
VERB:FORM	5	11	7	31.25	41.67	32.89
VERB:SVA	1	4	8	20.00	11.11	17.24
VERB:TENSE	7	13	26	35.00	21.21	30.97
WO	3	2	12	60.00	20.00	42.86

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	1	0.00	0.00	0.00
M:ADV	1	1	1	50.00	50.00	50.00
M:CONJ	0	3	3	0.00	0.00	0.00
M:DET	7	19	31	26.92	18.42	24.65
M:NOUN	0	2	3	0.00	0.00	0.00
M:NOUN:POSS	0	1	0	0.00	100.00	0.00
M:OTHER	0	4	6	0.00	0.00	0.00
M:PREP	1	4	15	20.00	6.25	13.89
M:PRON	1	2	3	33.33	25.00	31.25
M:PUNCT	46	12	33	79.31	58.23	73.95
M:VERB	0	5	2	0.00	0.00	0.00
M:VERB:FORM	0	2	1	0.00	0.00	0.00
M:VERB:TENSE	0	2	4	0.00	0.00	0.00
R:ADJ	0	26	5	0.00	0.00	0.00
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	0	4	2	0.00	0.00	0.00
R:CONJ	0	1	1	0.00	0.00	0.00
R:CONTR	0	2	1	0.00	0.00	0.00
R:DET	0	5	12	0.00	0.00	0.00
R:MORPH	5	3	14	62.50	26.32	49.02
R:NOUN	2	280	8	0.71	20.00	0.88
R:NOUN:INFL	0	0	1	100.00	0.00	0.00
R:NOUN:NUM	6	8	23	42.86	20.69	35.29
R:NOUN:POSS	1	0	4	100.00	20.00	55.56
R:ORTH	11	2	26	84.62	29.73	61.80
R:OTHER	4	882	47	0.45	7.84	0.56
R:PART	0	0	2	100.00	0.00	0.00
R:PREP	6	13	28	31.58	17.65	27.27
R:PRON	0	3	3	0.00	0.00	0.00
R:PUNCT	11	17	8	39.29	57.89	41.98
R:SPELL	1	0	35	100.00	2.78	12.50
R:VERB	0	64	9	0.00	0.00	0.00
R:VERB:FORM	5	9	6	35.71	45.45	37.31
R:VERB:SVA	1	4	8	20.00	11.11	17.24
R:VERB:TENSE	7	9	18	43.75	28.00	39.33
R:WO	3	2	12	60.00	20.00	42.86
U:ADJ	0	22	1	0.00	0.00	0.00
U:ADV	1	6	1	14.29	50.00	16.67
U:CONJ	0	5	0	0.00	100.00	0.00
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	7	15	26	31.82	21.21	28.93
U:NOUN	0	48	1	0.00	0.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	0	38	0	0.00	100.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	0	14	7	0.00	0.00	0.00
U:PRON	1	6	1	14.29	50.00	16.67
U:PUNCT	9	25	3	26.47	75.00	30.41
U:VERB	2	21	0	8.70	100.00	10.64
U:VERB:TENSE	0	2	4	0.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	63	54	104	53.85	37.72	49.61
R	171	1239	260	12.13	39.68	14.08
U	26	177	51	12.81	33.77	14.62
UNK	6	0	2	100.00	75.00	93.75

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	42	9	6.67	25.00	7.81
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	4	9	4	30.77	50.00	33.33
CONJ	1	8	4	11.11	20.00	12.20
CONTR	0	2	3	0.00	0.00	0.00
DET	19	38	70	33.33	21.35	29.97
MORPH	11	3	10	78.57	52.38	71.43
NOUN	7	287	13	2.38	35.00	2.93
NOUN:INFL	3	0	0	100.00	100.00	100.00
NOUN:NUM	18	7	21	72.00	46.15	64.75
NOUN:POSS	1	1	6	50.00	14.29	33.33
ORTH	37	2	25	94.87	59.68	84.86
OTHER	23	874	56	2.56	29.11	3.14
PART	0	1	6	0.00	0.00	0.00
PREP	10	27	47	27.03	17.54	24.39
PRON	2	11	7	15.38	22.22	16.39
PUNCT	69	54	44	56.10	61.06	57.02
SPELL	13	0	24	100.00	35.14	73.03
UNK	6	0	2	100.00	75.00	93.75
VERB	13	75	10	14.77	56.52	17.33
VERB:FORM	9	10	8	47.37	52.94	48.39
VERB:SVA	3	4	7	42.86	30.00	39.47
VERB:TENSE	12	12	27	50.00	30.77	44.44
WO	2	3	12	40.00	14.29	29.41

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	2	0.00	0.00	0.00
M:ADV	1	1	1	50.00	50.00	50.00
M:CONJ	0	3	3	0.00	0.00	0.00
M:DET	9	18	30	33.33	23.08	30.61
M:NOUN	0	2	3	0.00	0.00	0.00
M:NOUN:POSS	0	1	0	0.00	100.00	0.00
M:OTHER	1	2	9	33.33	10.00	22.73
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	2	4	13	33.33	13.33	25.64
M:PRON	1	2	3	33.33	25.00	31.25
M:PUNCT	47	12	30	79.66	61.04	75.08
M:VERB	0	4	2	0.00	0.00	0.00
M:VERB:FORM	1	2	1	33.33	50.00	35.71
M:VERB:TENSE	1	2	5	33.33	16.67	27.78
R:ADJ	3	25	6	10.71	33.33	12.40
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	2	3	2	40.00	50.00	41.67
R:CONJ	1	1	1	50.00	50.00	50.00
R:CONTR	0	2	1	0.00	0.00	0.00
R:DET	2	5	12	28.57	14.29	23.81
R:MORPH	11	3	10	78.57	52.38	71.43
R:NOUN	5	247	9	1.98	35.71	2.45
R:NOUN:INFL	3	0	0	100.00	100.00	100.00
R:NOUN:NUM	18	7	21	72.00	46.15	64.75
R:NOUN:POSS	1	0	4	100.00	20.00	55.56
R:ORTH	37	2	25	94.87	59.68	84.86
R:OTHER	22	836	46	2.56	32.35	3.14
R:PART	0	0	4	100.00	0.00	0.00
R:PREP	8	11	27	42.11	22.86	36.04
R:PRON	0	3	3	0.00	0.00	0.00
R:PUNCT	12	17	11	41.38	52.17	43.17
R:SPELL	13	0	24	100.00	35.14	73.03
R:VERB	10	53	8	15.87	55.56	18.52
R:VERB:FORM	8	8	7	50.00	53.33	50.63
R:VERB:SVA	3	4	7	42.86	30.00	39.47
R:VERB:TENSE	10	9	18	52.63	35.71	48.08
R:WO	2	3	12	40.00	14.29	29.41
U:ADJ	0	16	1	0.00	0.00	0.00
U:ADV	1	5	1	16.67	50.00	19.23
U:CONJ	0	4	0	0.00	100.00	0.00
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	8	15	28	34.78	22.22	31.25
U:NOUN	2	38	1	5.00	66.67	6.13
U:NOUN:POSS	0	0	2	100.00	0.00	0.00
U:OTHER	0	36	1	0.00	0.00	0.00
U:PART	0	1	0	0.00	100.00	0.00
U:PREP	0	12	7	0.00	0.00	0.00
U:PRON	1	6	1	14.29	50.00	16.67
U:PUNCT	10	25	3	28.57	76.92	32.68
U:VERB	3	18	0	14.29	100.00	17.24
U:VERB:TENSE	1	1	4	50.00	20.00	38.46
UNK	6	0	2	100.00	75.00	93.75

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	160	51	114	75.83	58.39	71.56
R	429	1746	313	19.72	57.82	22.72
U	50	293	77	14.58	39.37	16.68
UNK	23	0	12	100.00	65.71	90.55

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	12	42	6	22.22	66.67	25.64
ADJ:FORM	0	0	3	100.00	0.00	0.00
ADV	7	8	9	46.67	43.75	46.05
CONJ	4	8	3	33.33	57.14	36.36
CONTR	0	2	4	0.00	0.00	0.00
DET	34	34	66	50.00	34.00	45.70
MORPH	22	3	8	88.00	73.33	84.62
NOUN	28	305	12	8.41	70.00	10.20
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	33	6	14	84.62	70.21	81.28
NOUN:POSS	7	1	4	87.50	63.64	81.40
ORTH	76	2	24	97.44	76.00	92.23
OTHER	102	1483	111	6.44	47.89	7.78
PART	1	1	4	50.00	20.00	38.46
PREP	30	26	56	53.57	34.88	48.39
PRON	6	10	5	37.50	54.55	40.00
PUNCT	149	55	69	73.04	68.35	72.05
SPELL	39	0	0	100.00	100.00	100.00
UNK	23	0	12	100.00	65.71	90.55
VERB	19	77	23	19.79	45.24	22.30
VERB:FORM	15	9	14	62.50	51.72	60.00
VERB:SVA	4	4	9	50.00	30.77	44.44
VERB:TENSE	25	12	33	67.57	43.10	60.68
WO	24	2	27	92.31	47.06	77.42

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	2	0.00	0.00	0.00
M:ADV	3	1	3	75.00	50.00	68.18
M:CONJ	3	3	2	50.00	60.00	51.72
M:DET	25	15	23	62.50	52.08	60.10
M:NOUN	1	2	3	33.33	25.00	31.25
M:NOUN:POSS	2	1	0	66.67	100.00	71.43
M:OTHER	6	2	10	75.00	37.50	62.50
M:PART	1	0	2	100.00	33.33	71.43
M:PREP	7	4	14	63.64	33.33	53.85
M:PRON	4	1	2	80.00	66.67	76.92
M:PUNCT	101	13	42	88.60	70.63	84.31
M:VERB	1	4	3	20.00	25.00	20.83
M:VERB:FORM	2	2	1	50.00	66.67	52.63
M:VERB:TENSE	4	2	7	66.67	36.36	57.14
R:ADJ	11	27	3	28.95	78.57	33.13
R:ADJ:FORM	0	0	3	100.00	0.00	0.00
R:ADV	2	3	3	40.00	40.00	40.00
R:CONJ	1	1	0	50.00	100.00	55.56
R:CONTR	0	2	1	0.00	0.00	0.00
R:DET	1	5	13	16.67	7.14	13.16
R:MORPH	22	3	8	88.00	73.33	84.62
R:NOUN	24	269	8	8.19	75.00	9.97
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	33	6	14	84.62	70.21	81.28
R:NOUN:POSS	5	0	2	100.00	71.43	92.59
R:ORTH	76	2	24	97.44	76.00	92.23
R:OTHER	90	1320	95	6.38	48.65	7.73
R:PART	0	0	2	100.00	0.00	0.00
R:PREP	20	9	34	68.97	37.04	58.82
R:PRON	1	3	2	25.00	33.33	26.32
R:PUNCT	26	19	13	57.78	66.67	59.36
R:SPELL	39	0	0	100.00	100.00	100.00
R:VERB	15	55	17	21.43	46.88	24.04
R:VERB:FORM	13	7	13	65.00	50.00	61.32
R:VERB:SVA	4	4	9	50.00	30.77	44.44
R:VERB:TENSE	20	9	22	68.97	47.62	63.29
R:WO	24	2	27	92.31	47.06	77.42
U:ADJ	1	14	1	6.67	50.00	8.06
U:ADV	2	4	3	33.33	40.00	34.48
U:CONJ	0	4	1	0.00	0.00	0.00
U:CONTR	0	0	3	100.00	0.00	0.00
U:DET	8	14	30	36.36	21.05	31.75
U:NOUN	3	34	1	8.11	75.00	9.87
U:NOUN:POSS	0	0	2	100.00	0.00	0.00
U:OTHER	6	161	6	3.59	50.00	4.41
U:PART	0	1	0	0.00	100.00	0.00
U:PREP	3	13	8	18.75	27.27	20.00
U:PRON	1	6	1	14.29	50.00	16.67
U:PUNCT	22	23	14	48.89	61.11	50.93
U:VERB	3	18	3	14.29	50.00	16.67
U:VERB:TENSE	1	1	4	50.00	20.00	38.46
UNK	23	0	12	100.00	65.71	90.55

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	62	2377	345	2.54	15.23	3.05
Span-level detection	214	2225	340	8.77	38.63	10.38
Token-level detection	712	3535	387	16.76	64.79	19.68

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	31	58	46	34.83	40.26	35.80
R	23	2071	283	1.10	7.52	1.32
U	8	248	16	3.12	33.33	3.82

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	51	4	1.92	20.00	2.35
ADJ:FORM	0	1	0	0.00	100.00	0.00
ADV	0	15	0	0.00	100.00	0.00
CONJ	0	7	1	0.00	0.00	0.00
DET	3	62	8	4.62	27.27	5.54
MORPH	2	4	3	33.33	40.00	34.48
NOUN	0	422	7	0.00	0.00	0.00
NOUN:INFL	0	0	11	100.00	0.00	0.00
NOUN:NUM	3	11	12	21.43	20.00	21.13
NOUN:POSS	1	3	16	25.00	5.88	15.15
ORTH	5	3	44	62.50	10.20	30.86
OTHER	3	1528	40	0.20	6.98	0.24
PART	0	3	1	0.00	0.00	0.00
PREP	3	47	12	6.00	20.00	6.98
PRON	0	8	5	0.00	0.00	0.00
PUNCT	34	43	57	44.16	37.36	42.61
SPELL	0	1	90	0.00	0.00	0.00
VERB	2	141	10	1.40	16.67	1.71
VERB:FORM	1	5	5	16.67	16.67	16.67
VERB:INFL	0	0	5	100.00	0.00	0.00
VERB:SVA	2	4	6	33.33	25.00	31.25
VERB:TENSE	1	15	7	6.25	12.50	6.94
WO	1	3	1	25.00	50.00	27.78

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	1	0	0.00	100.00	0.00
M:CONJ	0	2	1	0.00	0.00	0.00
M:DET	2	22	3	8.33	40.00	9.90
M:NOUN	0	2	2	0.00	0.00	0.00
M:NOUN:POSS	1	1	4	50.00	20.00	38.46
M:OTHER	0	4	0	0.00	100.00	0.00
M:PREP	0	8	0	0.00	100.00	0.00
M:PRON	0	3	2	0.00	0.00	0.00
M:PUNCT	27	14	32	65.85	45.76	60.54
M:VERB	1	0	2	100.00	33.33	71.43
M:VERB:TENSE	0	1	0	0.00	100.00	0.00
R:ADJ	1	23	4	4.17	20.00	4.95
R:ADJ:FORM	0	1	0	0.00	100.00	0.00
R:ADV	0	1	0	0.00	100.00	0.00
R:CONJ	0	1	0	0.00	100.00	0.00
R:DET	0	8	3	0.00	0.00	0.00
R:MORPH	2	4	3	33.33	40.00	34.48
R:NOUN	0	376	5	0.00	0.00	0.00
R:NOUN:INFL	0	0	11	100.00	0.00	0.00
R:NOUN:NUM	3	11	12	21.43	20.00	21.13
R:NOUN:POSS	0	2	12	0.00	0.00	0.00
R:ORTH	5	3	44	62.50	10.20	30.86
R:OTHER	3	1480	40	0.20	6.98	0.25
R:PART	0	2	0	0.00	100.00	0.00
R:PREP	2	21	11	8.70	15.38	9.52
R:PRON	0	5	3	0.00	0.00	0.00
R:PUNCT	2	9	16	18.18	11.11	16.13
R:SPELL	0	1	90	0.00	0.00	0.00
R:VERB	0	98	7	0.00	0.00	0.00
R:VERB:FORM	1	4	5	20.00	16.67	19.23
R:VERB:INFL	0	0	5	100.00	0.00	0.00
R:VERB:SVA	2	4	6	33.33	25.00	31.25
R:VERB:TENSE	1	14	5	6.67	16.67	7.58
R:WO	1	3	1	25.00	50.00	27.78
U:ADJ	0	28	0	0.00	100.00	0.00
U:ADV	0	13	0	0.00	100.00	0.00
U:CONJ	0	4	0	0.00	100.00	0.00
U:DET	1	32	2	3.03	33.33	3.70
U:NOUN	0	44	0	0.00	100.00	0.00
U:OTHER	0	44	0	0.00	100.00	0.00
U:PART	0	1	1	0.00	0.00	0.00
U:PREP	1	18	1	5.26	50.00	6.41
U:PUNCT	5	20	9	20.00	35.71	21.93
U:VERB	1	43	1	2.27	50.00	2.81
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	0	0	2	100.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	36	53	65	40.45	35.64	39.39
R	163	1941	258	7.75	38.72	9.22
U	8	231	17	3.35	32.00	4.08
UNK	7	0	0	100.00	100.00	100.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	38	3	13.64	66.67	16.22
ADJ:FORM	0	1	1	0.00	0.00	0.00
ADV	0	15	0	0.00	100.00	0.00
CONJ	0	6	1	0.00	0.00	0.00
DET	4	60	11	6.25	26.67	7.38
MORPH	6	4	3	60.00	66.67	61.22
NOUN	4	369	7	1.07	36.36	1.33
NOUN:INFL	3	0	8	100.00	27.27	65.22
NOUN:NUM	6	11	10	35.29	37.50	35.71
NOUN:POSS	5	3	13	62.50	27.78	50.00
ORTH	43	3	48	93.48	47.25	78.18
OTHER	24	1472	46	1.60	34.29	1.98
PART	0	1	1	0.00	0.00	0.00
PREP	6	44	15	12.00	28.57	13.57
PRON	1	7	4	12.50	20.00	13.51
PUNCT	39	42	79	48.15	33.05	44.12
SPELL	35	1	62	97.22	36.08	72.61
UNK	7	0	0	100.00	100.00	100.00
VERB	11	122	7	8.27	61.11	10.00
VERB:FORM	7	5	3	58.33	70.00	60.34
VERB:INFL	1	0	4	100.00	20.00	55.56
VERB:SVA	2	3	6	40.00	25.00	35.71
VERB:TENSE	3	15	7	16.67	30.00	18.29
WO	1	3	1	25.00	50.00	27.78

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	1	0	0.00	100.00	0.00
M:CONJ	0	1	1	0.00	0.00	0.00
M:DET	2	21	6	8.70	25.00	10.00
M:NOUN	0	2	2	0.00	0.00	0.00
M:NOUN:POSS	1	1	4	50.00	20.00	38.46
M:OTHER	1	4	0	20.00	100.00	23.81
M:PREP	0	6	1	0.00	0.00	0.00
M:PRON	1	2	1	33.33	50.00	35.71
M:PUNCT	30	14	48	68.18	38.46	59.06
M:VERB	1	0	2	100.00	33.33	71.43
M:VERB:TENSE	0	1	0	0.00	100.00	0.00
R:ADJ	6	18	3	25.00	66.67	28.57
R:ADJ:FORM	0	1	1	0.00	0.00	0.00
R:ADV	0	1	0	0.00	100.00	0.00
R:CONJ	0	1	0	0.00	100.00	0.00
R:DET	0	7	4	0.00	0.00	0.00
R:MORPH	6	4	3	60.00	66.67	61.22
R:NOUN	4	327	5	1.21	44.44	1.50
R:NOUN:INFL	3	0	8	100.00	27.27	65.22
R:NOUN:NUM	6	11	10	35.29	37.50	35.71
R:NOUN:POSS	4	2	9	66.67	30.77	54.05
R:ORTH	43	3	48	93.48	47.25	78.18
R:OTHER	23	1425	45	1.59	33.82	1.96
R:PREP	5	20	13	20.00	27.78	21.19
R:PRON	0	5	3	0.00	0.00	0.00
R:PUNCT	4	9	21	30.77	16.00	25.97
R:SPELL	35	1	62	97.22	36.08	72.61
R:VERB	10	82	4	10.87	71.43	13.09
R:VERB:FORM	7	4	3	63.64	70.00	64.81
R:VERB:INFL	1	0	4	100.00	20.00	55.56
R:VERB:SVA	2	3	6	40.00	25.00	35.71
R:VERB:TENSE	3	14	5	17.65	37.50	19.74
R:WO	1	3	1	25.00	50.00	27.78
U:ADJ	0	20	0	0.00	100.00	0.00
U:ADV	0	13	0	0.00	100.00	0.00
U:CONJ	0	4	0	0.00	100.00	0.00
U:DET	2	32	1	5.88	66.67	7.19
U:NOUN	0	40	0	0.00	100.00	0.00
U:OTHER	0	43	1	0.00	0.00	0.00
U:PART	0	1	1	0.00	0.00	0.00
U:PREP	1	18	1	5.26	50.00	6.41
U:PUNCT	5	19	10	20.83	33.33	22.52
U:VERB	0	40	1	0.00	0.00	0.00
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	0	0	2	100.00	0.00	0.00
UNK	7	0	0	100.00	100.00	100.00

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	139	49	85	73.94	62.05	71.21
R	532	3113	272	14.60	66.17	17.29
U	26	373	29	6.52	47.27	7.87
UNK	15	0	1	100.00	93.75	98.68

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	7	43	3	14.00	70.00	16.67
ADJ:FORM	3	1	3	75.00	50.00	68.18
ADV	1	14	1	6.67	50.00	8.06
CONJ	2	5	2	28.57	50.00	31.25
CONTR	0	0	4	100.00	0.00	0.00
DET	13	58	15	18.31	46.43	20.83
MORPH	15	4	2	78.95	88.24	80.65
NOUN	20	422	7	4.52	74.07	5.57
NOUN:INFL	10	0	0	100.00	100.00	100.00
NOUN:NUM	24	10	6	70.59	80.00	72.29
NOUN:POSS	14	2	7	87.50	66.67	82.35
ORTH	136	3	51	97.84	72.73	91.52
OTHER	115	2721	96	4.06	54.50	4.98
PREP	17	43	21	28.33	44.74	30.58
PRON	2	5	4	28.57	33.33	29.41
PUNCT	154	39	92	79.79	62.60	75.64
SPELL	100	1	0	99.01	100.00	99.21
UNK	15	0	1	100.00	93.75	98.68
VERB	23	134	7	14.65	76.67	17.48
VERB:FORM	10	5	6	66.67	62.50	65.79
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	3	3	9	50.00	25.00	41.67
VERB:TENSE	12	16	15	42.86	44.44	43.17
WO	12	6	34	66.67	26.09	50.85

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	1	0	0.00	100.00	0.00
M:CONJ	1	1	2	50.00	33.33	45.45
M:DET	8	20	7	28.57	53.33	31.50
M:NOUN	0	2	3	0.00	0.00	0.00
M:NOUN:POSS	2	1	4	66.67	33.33	55.56
M:OTHER	2	4	2	33.33	50.00	35.71
M:PREP	2	5	3	28.57	40.00	30.30
M:PRON	2	1	1	66.67	66.67	66.67
M:PUNCT	118	13	62	90.08	65.56	83.81
M:VERB	3	0	1	100.00	75.00	93.75
M:VERB:TENSE	1	1	0	50.00	100.00	55.56
R:ADJ	7	23	2	23.33	77.78	27.13
R:ADJ:FORM	3	1	3	75.00	50.00	68.18
R:ADV	1	2	1	33.33	50.00	35.71
R:CONTR	0	0	4	100.00	0.00	0.00
R:DET	1	7	5	12.50	16.67	13.16
R:MORPH	15	4	2	78.95	88.24	80.65
R:NOUN	19	382	4	4.74	82.61	5.84
R:NOUN:INFL	10	0	0	100.00	100.00	100.00
R:NOUN:NUM	24	10	6	70.59	80.00	72.29
R:NOUN:POSS	12	1	3	92.31	80.00	89.55
R:ORTH	136	3	51	97.84	72.73	91.52
R:OTHER	112	2524	86	4.25	56.57	5.21
R:PREP	14	21	15	40.00	48.28	41.42
R:PRON	0	4	3	0.00	0.00	0.00
R:PUNCT	20	7	19	74.07	51.28	68.03
R:SPELL	100	1	0	99.01	100.00	99.21
R:VERB	19	95	4	16.67	82.61	19.83
R:VERB:FORM	9	4	6	69.23	60.00	67.16
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	3	3	9	50.00	25.00	41.67
R:VERB:TENSE	11	15	14	42.31	44.00	42.64
R:WO	12	6	34	66.67	26.09	50.85
U:ADJ	0	20	1	0.00	0.00	0.00
U:ADV	0	11	0	0.00	100.00	0.00
U:CONJ	1	4	0	20.00	100.00	23.81
U:DET	4	31	3	11.43	57.14	13.61
U:NOUN	1	38	0	2.56	100.00	3.18
U:OTHER	1	193	8	0.52	11.11	0.64
U:PREP	1	17	3	5.56	25.00	6.58
U:PUNCT	16	19	11	45.71	59.26	47.90
U:VERB	1	39	2	2.50	33.33	3.07
U:VERB:FORM	1	1	0	50.00	100.00	55.56
U:VERB:TENSE	0	0	1	100.00	0.00	0.00
UNK	15	0	1	100.00	93.75	98.68

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:44:18+00:00
Competition submission:	17
Competition phase:	3 - Open phase

Detailed results

Submission information

Results