BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1941	942	2867	67.33	40.37	59.39
Span-level detection	2237	654	2759	77.38	44.78	67.54
Token-level detection	2780	525	3170	84.11	46.72	72.51

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	576	235	630	71.02	47.76	64.72
R	1143	586	1969	66.11	36.73	56.99
U	222	121	268	64.72	45.31	59.61

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	10	9	29	52.63	25.64	43.48
ADJ:FORM	4	0	7	100.00	36.36	74.07
ADV	22	18	38	55.00	36.67	50.00
CONJ	4	5	21	44.44	16.00	32.79
CONTR	8	1	4	88.89	66.67	83.33
DET	283	129	307	68.69	47.97	63.23
MORPH	60	8	83	88.24	41.96	72.29
NOUN	16	37	89	30.19	15.24	25.24
NOUN:INFL	4	0	13	100.00	23.53	60.61
NOUN:NUM	100	35	129	74.07	43.67	65.02
NOUN:POSS	12	4	38	75.00	24.00	52.63
ORTH	168	19	194	89.84	46.41	75.68
OTHER	111	185	568	37.50	16.35	29.79
PART	10	7	14	58.82	41.67	54.35
PREP	191	130	236	59.50	44.73	55.82
PRON	47	23	80	67.14	37.01	57.74
PUNCT	427	144	320	74.78	57.16	70.44
SPELL	106	27	199	79.70	34.75	63.32
VERB	46	33	152	58.23	23.23	44.75
VERB:FORM	105	28	69	78.95	60.34	74.36
VERB:INFL	3	0	6	100.00	33.33	71.43
VERB:SVA	94	21	50	81.74	65.28	77.81
VERB:TENSE	87	62	162	58.39	34.94	51.48
WO	23	17	59	57.50	28.05	47.52

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	1	4	66.67	33.33	55.56
M:ADV	5	5	11	50.00	31.25	44.64
M:CONJ	3	4	12	42.86	20.00	34.88
M:CONTR	1	1	0	50.00	100.00	55.56
M:DET	121	55	148	68.75	44.98	62.18
M:NOUN	0	4	7	0.00	0.00	0.00
M:NOUN:POSS	6	2	9	75.00	40.00	63.83
M:OTHER	7	26	40	21.21	14.89	19.55
M:PART	0	0	5	100.00	0.00	0.00
M:PREP	31	22	60	58.49	34.07	51.16
M:PRON	29	10	38	74.36	43.28	65.02
M:PUNCT	340	87	230	79.63	59.65	74.63
M:VERB	9	8	28	52.94	24.32	42.86
M:VERB:FORM	9	4	6	69.23	60.00	67.16
M:VERB:TENSE	13	6	32	68.42	28.89	53.72
R:ADJ	6	5	22	54.55	21.43	41.67
R:ADJ:FORM	4	0	7	100.00	36.36	74.07
R:ADV	9	7	14	56.25	39.13	51.72
R:CONJ	0	1	5	0.00	0.00	0.00
R:CONTR	2	0	2	100.00	50.00	83.33
R:DET	42	25	71	62.69	37.17	55.12
R:MORPH	60	8	83	88.24	41.96	72.29
R:NOUN	16	24	70	40.00	18.60	32.52
R:NOUN:INFL	4	0	13	100.00	23.53	60.61
R:NOUN:NUM	100	35	129	74.07	43.67	65.02
R:NOUN:POSS	4	0	22	100.00	15.38	47.62
R:ORTH	168	19	194	89.84	46.41	75.68
R:OTHER	96	141	510	40.51	15.84	30.89
R:PART	9	7	6	56.25	60.00	56.96
R:PREP	134	99	130	57.51	50.76	56.02
R:PRON	7	8	32	46.67	17.95	35.35
R:PUNCT	67	48	53	58.26	55.83	57.76
R:SPELL	106	27	199	79.70	34.75	63.32
R:VERB	34	19	110	64.15	23.61	47.75
R:VERB:FORM	93	23	61	80.17	60.39	75.24
R:VERB:INFL	3	0	6	100.00	33.33	71.43
R:VERB:SVA	94	21	50	81.74	65.28	77.81
R:VERB:TENSE	62	52	121	54.39	33.88	48.51
R:WO	23	17	59	57.50	28.05	47.52
U:ADJ	2	3	3	40.00	40.00	40.00
U:ADV	8	6	13	57.14	38.10	51.95
U:CONJ	1	0	4	100.00	20.00	55.56
U:CONTR	5	0	2	100.00	71.43	92.59
U:DET	120	49	88	71.01	57.69	67.87
U:NOUN	0	9	12	0.00	0.00	0.00
U:NOUN:POSS	2	2	7	50.00	22.22	40.00
U:OTHER	8	18	18	30.77	30.77	30.77
U:PART	1	0	3	100.00	25.00	62.50
U:PREP	26	9	46	74.29	36.11	61.32
U:PRON	11	5	10	68.75	52.38	64.71
U:PUNCT	20	9	37	68.97	35.09	57.80
U:VERB	3	6	14	33.33	17.65	28.30
U:VERB:FORM	3	1	2	75.00	60.00	71.43
U:VERB:TENSE	12	4	9	75.00	57.14	70.59

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	634	181	595	77.79	51.59	70.62
R	1352	373	1838	78.38	42.38	67.00
U	247	100	257	71.18	49.01	65.27
UNK	4	0	69	100.00	5.48	22.47

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	15	6	29	71.43	34.09	58.59
ADJ:FORM	3	0	6	100.00	33.33	71.43
ADV	25	14	37	64.10	40.32	57.34
CONJ	7	3	21	70.00	25.00	51.47
CONTR	6	1	4	85.71	60.00	78.95
DET	314	102	284	75.48	52.51	69.41
MORPH	59	7	79	89.39	42.75	73.38
NOUN	27	25	88	51.92	23.48	41.80
NOUN:INFL	5	0	12	100.00	29.41	67.57
NOUN:NUM	97	28	122	77.60	44.29	67.45
NOUN:POSS	14	4	36	77.78	28.00	57.38
ORTH	184	9	184	95.34	50.00	80.70
OTHER	231	111	528	67.54	30.43	54.30
PART	12	6	12	66.67	50.00	62.50
PREP	219	87	223	71.57	49.55	65.73
PRON	57	16	72	78.08	44.19	67.70
PUNCT	441	129	310	77.37	58.72	72.75
SPELL	124	4	180	96.88	40.79	75.98
UNK	4	0	69	100.00	5.48	22.47
VERB	70	23	147	75.27	32.26	59.42
VERB:FORM	100	20	67	83.33	59.88	77.28
VERB:INFL	3	0	7	100.00	30.00	68.18
VERB:SVA	101	13	40	88.60	71.63	84.59
VERB:TENSE	98	35	146	73.68	40.16	63.14
WO	21	11	56	65.62	27.27	51.22

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	1	4	66.67	33.33	55.56
M:ADV	6	3	11	66.67	35.29	56.60
M:CONJ	6	2	11	75.00	35.29	61.22
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	133	40	133	76.88	50.00	69.42
M:NOUN	2	4	8	33.33	20.00	29.41
M:NOUN:POSS	6	2	9	75.00	40.00	63.83
M:OTHER	20	16	39	55.56	33.90	49.26
M:PART	0	0	5	100.00	0.00	0.00
M:PREP	35	17	62	67.31	36.08	57.38
M:PRON	33	7	34	82.50	49.25	72.69
M:PUNCT	352	74	221	82.63	61.43	77.29
M:VERB	15	7	24	68.18	38.46	59.06
M:VERB:FORM	8	5	5	61.54	61.54	61.54
M:VERB:TENSE	16	2	29	88.89	35.56	68.38
R:ADJ	11	2	21	84.62	34.38	65.48
R:ADJ:FORM	3	0	6	100.00	33.33	71.43
R:ADV	9	6	14	60.00	39.13	54.22
R:CONJ	0	1	6	0.00	0.00	0.00
R:CONTR	1	0	2	100.00	33.33	71.43
R:DET	52	20	68	72.22	43.33	63.73
R:MORPH	59	7	79	89.39	42.75	73.38
R:NOUN	25	13	67	65.79	27.17	51.23
R:NOUN:INFL	5	0	12	100.00	29.41	67.57
R:NOUN:NUM	97	28	122	77.60	44.29	67.45
R:NOUN:POSS	6	0	20	100.00	23.08	60.00
R:ORTH	184	9	184	95.34	50.00	80.70
R:OTHER	203	80	466	71.73	30.34	56.36
R:PART	11	6	4	64.71	73.33	66.27
R:PREP	154	64	121	70.64	56.00	67.13
R:PRON	10	4	30	71.43	25.00	52.08
R:PUNCT	66	48	55	57.89	54.55	57.19
R:SPELL	124	4	180	96.88	40.79	75.98
R:VERB	50	12	110	80.65	31.25	61.27
R:VERB:FORM	90	14	60	86.54	60.00	79.51
R:VERB:INFL	3	0	7	100.00	30.00	68.18
R:VERB:SVA	101	13	40	88.60	71.63	84.59
R:VERB:TENSE	67	31	108	68.37	38.29	59.08
R:WO	21	11	56	65.62	27.27	51.22
U:ADJ	2	3	4	40.00	33.33	38.46
U:ADV	10	5	12	66.67	45.45	60.98
U:CONJ	1	0	4	100.00	20.00	55.56
U:CONTR	5	0	2	100.00	71.43	92.59
U:DET	129	42	83	75.44	60.85	71.99
U:NOUN	0	8	13	0.00	0.00	0.00
U:NOUN:POSS	2	2	7	50.00	22.22	40.00
U:OTHER	8	15	23	34.78	25.81	32.52
U:PART	1	0	3	100.00	25.00	62.50
U:PREP	30	6	40	83.33	42.86	70.09
U:PRON	14	5	8	73.68	63.64	71.43
U:PUNCT	23	7	34	76.67	40.35	64.97
U:VERB	5	4	13	55.56	27.78	46.30
U:VERB:FORM	2	1	2	66.67	50.00	62.50
U:VERB:TENSE	15	2	9	88.24	62.50	81.52
UNK	4	0	69	100.00	5.48	22.47

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	729	121	614	85.76	54.28	76.85
R	1737	297	2127	85.40	44.95	72.38
U	294	107	356	73.32	45.23	65.22
UNK	20	0	73	100.00	21.51	57.80

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	17	3	33	85.00	34.00	65.38
ADJ:FORM	3	0	6	100.00	33.33	71.43
ADV	27	11	42	71.05	39.13	61.09
CONJ	9	2	19	81.82	32.14	62.50
CONTR	6	1	8	85.71	42.86	71.43
DET	338	78	297	81.25	53.23	73.51
MORPH	62	3	86	95.38	41.89	75.98
NOUN	43	14	102	75.44	29.66	57.64
NOUN:INFL	5	0	12	100.00	29.41	67.57
NOUN:NUM	105	21	124	83.33	45.85	71.62
NOUN:POSS	22	2	42	91.67	34.38	68.75
ORTH	243	7	201	97.20	54.73	84.14
OTHER	406	135	720	75.05	36.06	61.70
PART	11	2	11	84.62	50.00	74.32
PREP	226	73	233	75.59	49.24	68.28
PRON	67	12	72	84.81	48.20	73.63
PUNCT	545	88	320	86.10	63.01	80.22
SPELL	127	2	181	98.45	41.23	77.06
UNK	20	0	73	100.00	21.51	57.80
VERB	89	19	195	82.41	31.34	62.15
VERB:FORM	108	7	73	93.91	59.67	84.24
VERB:INFL	4	0	6	100.00	40.00	76.92
VERB:SVA	106	11	39	90.60	73.10	86.46
VERB:TENSE	121	25	177	82.88	40.60	68.59
WO	70	9	98	88.61	41.67	72.31

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	0	5	100.00	37.50	75.00
M:ADV	9	2	12	81.82	42.86	69.23
M:CONJ	7	1	10	87.50	41.18	71.43
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	144	23	137	86.23	51.25	75.87
M:NOUN	3	2	12	60.00	20.00	42.86
M:NOUN:POSS	6	2	9	75.00	40.00	63.83
M:OTHER	21	10	40	67.74	34.43	56.76
M:PART	1	0	4	100.00	20.00	55.56
M:PREP	43	12	67	78.18	39.09	65.15
M:PRON	39	5	31	88.64	55.71	79.27
M:PUNCT	405	54	215	88.24	65.32	82.45
M:VERB	20	6	35	76.92	36.36	62.89
M:VERB:FORM	10	2	5	83.33	66.67	79.37
M:VERB:TENSE	18	1	32	94.74	36.00	71.43
R:ADJ	11	2	23	84.62	32.35	63.95
R:ADJ:FORM	3	0	6	100.00	33.33	71.43
R:ADV	7	6	15	53.85	31.82	47.30
R:CONJ	1	1	6	50.00	14.29	33.33
R:CONTR	1	0	4	100.00	20.00	55.56
R:DET	58	17	65	77.33	47.15	68.56
R:MORPH	62	3	86	95.38	41.89	75.98
R:NOUN	39	7	69	84.78	36.11	66.78
R:NOUN:INFL	5	0	12	100.00	29.41	67.57
R:NOUN:NUM	105	21	124	83.33	45.85	71.62
R:NOUN:POSS	14	0	21	100.00	40.00	76.92
R:ORTH	243	7	201	97.20	54.73	84.14
R:OTHER	361	85	602	80.94	37.49	65.71
R:PART	9	2	4	81.82	69.23	78.95
R:PREP	153	55	127	73.56	54.64	68.79
R:PRON	13	3	32	81.25	28.89	59.63
R:PUNCT	100	28	68	78.12	59.52	73.53
R:SPELL	127	2	181	98.45	41.23	77.06
R:VERB	62	10	138	86.11	31.00	63.52
R:VERB:FORM	96	5	67	95.05	58.90	84.66
R:VERB:INFL	4	0	6	100.00	40.00	76.92
R:VERB:SVA	106	11	39	90.60	73.10	86.46
R:VERB:TENSE	87	23	133	79.09	39.55	65.91
R:WO	70	9	98	88.61	41.67	72.31
U:ADJ	3	1	5	75.00	37.50	62.50
U:ADV	11	3	15	78.57	42.31	67.07
U:CONJ	1	0	3	100.00	25.00	62.50
U:CONTR	5	0	4	100.00	55.56	86.21
U:DET	136	38	95	78.16	58.87	73.35
U:NOUN	1	5	21	16.67	4.55	10.87
U:NOUN:POSS	2	0	12	100.00	14.29	45.45
U:OTHER	24	40	78	37.50	23.53	33.52
U:PART	1	0	3	100.00	25.00	62.50
U:PREP	30	6	39	83.33	43.48	70.42
U:PRON	15	4	9	78.95	62.50	75.00
U:PUNCT	40	6	37	86.96	51.95	76.63
U:VERB	7	3	22	70.00	24.14	50.72
U:VERB:FORM	2	0	1	100.00	66.67	90.91
U:VERB:TENSE	16	1	12	94.12	57.14	83.33
UNK	20	0	73	100.00	21.51	57.80

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	907	411	1290	68.82	41.28	60.72
Span-level detection	1066	256	1219	80.64	46.65	70.38
Token-level detection	1353	149	1383	90.08	49.45	77.37

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	210	105	291	66.67	41.92	59.63
R	590	261	874	69.33	40.30	60.60
U	107	45	125	70.39	46.12	63.69

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	3	9	50.00	25.00	41.67
ADJ:FORM	1	0	5	100.00	16.67	50.00
ADV	12	4	18	75.00	40.00	63.83
CONJ	2	2	7	50.00	22.22	40.00
CONTR	5	1	2	83.33	71.43	80.65
DET	137	58	134	70.26	50.55	65.18
MORPH	34	2	43	94.44	44.16	76.92
NOUN	5	12	44	29.41	10.20	21.37
NOUN:INFL	3	0	2	100.00	60.00	88.24
NOUN:NUM	55	15	68	78.57	44.72	68.24
NOUN:POSS	4	1	7	80.00	36.36	64.52
ORTH	101	11	94	90.18	51.79	78.54
OTHER	59	93	282	38.82	17.30	31.09
PART	8	4	6	66.67	57.14	64.52
PREP	87	45	97	65.91	47.28	61.10
PRON	28	11	44	71.79	38.89	61.40
PUNCT	131	55	139	70.43	48.52	64.60
SPELL	52	18	55	74.29	48.60	67.18
VERB	21	15	72	58.33	22.58	44.30
VERB:FORM	60	16	35	78.95	63.16	75.19
VERB:INFL	2	0	2	100.00	50.00	83.33
VERB:SVA	51	12	27	80.95	65.38	77.27
VERB:TENSE	37	28	84	56.92	30.58	48.56
WO	9	5	14	64.29	39.13	56.96

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	0	50.00	100.00	55.56
M:ADV	1	2	6	33.33	14.29	26.32
M:CONJ	1	2	3	33.33	25.00	31.25
M:CONTR	1	1	0	50.00	100.00	55.56
M:DET	56	22	55	71.79	50.45	66.19
M:NOUN	0	2	3	0.00	0.00	0.00
M:NOUN:POSS	1	0	2	100.00	33.33	71.43
M:OTHER	5	12	22	29.41	18.52	26.32
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	18	12	26	60.00	40.91	54.88
M:PRON	17	5	20	77.27	45.95	68.00
M:PUNCT	93	36	113	72.09	45.15	64.40
M:VERB	4	3	16	57.14	20.00	41.67
M:VERB:FORM	8	3	5	72.73	61.54	70.18
M:VERB:TENSE	4	4	18	50.00	18.18	37.04
R:ADJ	1	0	8	100.00	11.11	38.46
R:ADJ:FORM	1	0	5	100.00	16.67	50.00
R:ADV	6	1	6	85.71	50.00	75.00
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	2	0	0	100.00	100.00	100.00
R:DET	18	12	28	60.00	39.13	54.22
R:MORPH	34	2	43	94.44	44.16	76.92
R:NOUN	5	9	32	35.71	13.51	26.88
R:NOUN:INFL	3	0	2	100.00	60.00	88.24
R:NOUN:NUM	55	15	68	78.57	44.72	68.24
R:NOUN:POSS	2	0	4	100.00	33.33	71.43
R:ORTH	101	11	94	90.18	51.79	78.54
R:OTHER	51	74	253	40.80	16.78	31.72
R:PART	8	4	2	66.67	80.00	68.97
R:PREP	55	31	54	63.95	50.46	60.71
R:PRON	5	4	18	55.56	21.74	42.37
R:PUNCT	33	17	14	66.00	70.21	66.80
R:SPELL	52	18	55	74.29	48.60	67.18
R:VERB	15	10	50	60.00	23.08	45.45
R:VERB:FORM	51	13	30	79.69	62.96	75.67
R:VERB:INFL	2	0	2	100.00	50.00	83.33
R:VERB:SVA	51	12	27	80.95	65.38	77.27
R:VERB:TENSE	30	23	64	56.60	31.91	49.02
R:WO	9	5	14	64.29	39.13	56.96
U:ADJ	1	2	1	33.33	50.00	35.71
U:ADV	5	1	6	83.33	45.45	71.43
U:CONJ	1	0	3	100.00	25.00	62.50
U:CONTR	2	0	2	100.00	50.00	83.33
U:DET	63	24	51	72.41	55.26	68.18
U:NOUN	0	1	9	0.00	0.00	0.00
U:NOUN:POSS	1	1	1	50.00	50.00	50.00
U:OTHER	3	7	7	30.00	30.00	30.00
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	14	2	17	87.50	45.16	73.68
U:PRON	6	2	6	75.00	50.00	68.18
U:PUNCT	5	2	12	71.43	29.41	55.56
U:VERB	2	2	6	50.00	25.00	41.67
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	3	1	2	75.00	60.00	71.43

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	239	75	255	76.11	48.38	68.29
R	699	146	802	82.72	46.57	71.60
U	126	35	112	78.26	52.94	71.43
UNK	2	0	50	100.00	3.85	16.67

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	4	3	11	57.14	26.67	46.51
ADJ:FORM	0	0	5	100.00	0.00	0.00
ADV	12	3	18	80.00	40.00	66.67
CONJ	4	1	5	80.00	44.44	68.97
CONTR	3	1	2	75.00	60.00	71.43
DET	155	45	117	77.50	56.99	72.29
MORPH	32	2	41	94.12	43.84	76.56
NOUN	9	7	41	56.25	18.00	39.47
NOUN:INFL	4	0	1	100.00	80.00	95.24
NOUN:NUM	54	9	63	85.71	46.15	73.17
NOUN:POSS	5	1	6	83.33	45.45	71.43
ORTH	111	5	80	95.69	58.12	84.73
OTHER	131	52	256	71.58	33.85	58.53
PART	9	3	4	75.00	69.23	73.77
PREP	102	23	87	81.60	53.97	74.02
PRON	35	7	39	83.33	47.30	72.31
PUNCT	134	46	129	74.44	50.95	68.16
SPELL	62	4	44	93.94	58.49	83.78
UNK	2	0	50	100.00	3.85	16.67
VERB	36	9	76	80.00	32.14	61.64
VERB:FORM	57	12	31	82.61	64.77	78.30
VERB:INFL	2	0	3	100.00	40.00	76.92
VERB:SVA	50	7	25	87.72	66.67	82.51
VERB:TENSE	45	13	70	77.59	39.13	64.84
WO	8	3	15	72.73	34.78	59.70

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	0	50.00	100.00	55.56
M:ADV	1	2	7	33.33	12.50	25.00
M:CONJ	3	1	0	75.00	100.00	78.95
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	64	14	47	82.05	57.66	75.65
M:NOUN	0	2	2	0.00	0.00	0.00
M:NOUN:POSS	1	0	2	100.00	33.33	71.43
M:OTHER	9	7	19	56.25	32.14	48.91
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	24	9	24	72.73	50.00	66.67
M:PRON	19	4	19	82.61	50.00	73.08
M:PUNCT	95	27	100	77.87	48.72	69.55
M:VERB	7	2	16	77.78	30.43	59.32
M:VERB:FORM	7	4	4	63.64	63.64	63.64
M:VERB:TENSE	8	1	14	88.89	36.36	68.97
R:ADJ	2	0	9	100.00	18.18	52.63
R:ADJ:FORM	0	0	5	100.00	0.00	0.00
R:ADV	6	0	6	100.00	50.00	83.33
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	21	11	26	65.62	44.68	60.00
R:MORPH	32	2	41	94.12	43.84	76.56
R:NOUN	9	4	31	69.23	22.50	48.91
R:NOUN:INFL	4	0	1	100.00	80.00	95.24
R:NOUN:NUM	54	9	63	85.71	46.15	73.17
R:NOUN:POSS	3	0	3	100.00	50.00	83.33
R:ORTH	111	5	80	95.69	58.12	84.73
R:OTHER	119	41	227	74.38	34.39	60.34
R:PART	9	3	1	75.00	90.00	77.59
R:PREP	60	14	51	81.08	54.05	73.71
R:PRON	8	1	15	88.89	34.78	67.80
R:PUNCT	32	17	18	65.31	64.00	65.04
R:SPELL	62	4	44	93.94	58.49	83.78
R:VERB	26	5	55	83.87	32.10	63.41
R:VERB:FORM	49	8	27	85.96	64.47	80.59
R:VERB:INFL	2	0	3	100.00	40.00	76.92
R:VERB:SVA	50	7	25	87.72	66.67	82.51
R:VERB:TENSE	31	12	54	72.09	36.47	60.31
R:WO	8	3	15	72.73	34.78	59.70
U:ADJ	1	2	2	33.33	33.33	33.33
U:ADV	5	1	5	83.33	50.00	73.53
U:CONJ	1	0	3	100.00	25.00	62.50
U:CONTR	2	0	2	100.00	50.00	83.33
U:DET	70	20	44	77.78	61.40	73.84
U:NOUN	0	1	8	0.00	0.00	0.00
U:NOUN:POSS	1	1	1	50.00	50.00	50.00
U:OTHER	3	4	10	42.86	23.08	36.59
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	18	0	12	100.00	60.00	88.24
U:PRON	8	2	5	80.00	61.54	75.47
U:PUNCT	7	2	11	77.78	38.89	64.81
U:VERB	3	2	5	60.00	37.50	53.57
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	6	0	2	100.00	75.00	93.75
UNK	2	0	50	100.00	3.85	16.67

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	295	40	252	88.06	53.93	78.17
R	886	82	928	91.53	48.84	77.91
U	155	27	144	85.16	51.84	75.46
UNK	17	0	59	100.00	22.37	59.03

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	7	0	11	100.00	38.89	76.09
ADJ:FORM	0	0	4	100.00	0.00	0.00
ADV	14	2	22	87.50	38.89	70.00
CONJ	3	0	7	100.00	30.00	68.18
CONTR	3	1	3	75.00	50.00	68.18
DET	171	33	123	83.82	58.16	77.03
MORPH	33	1	45	97.06	42.31	77.10
NOUN	17	2	48	89.47	26.15	60.28
NOUN:INFL	4	0	1	100.00	80.00	95.24
NOUN:NUM	59	5	64	92.19	47.97	77.84
NOUN:POSS	12	0	8	100.00	60.00	88.24
ORTH	129	3	75	97.73	63.24	88.11
OTHER	233	36	348	86.62	40.10	70.31
PART	8	0	4	100.00	66.67	90.91
PREP	104	14	92	88.14	53.06	77.84
PRON	42	4	38	91.30	52.50	79.55
PUNCT	191	24	130	88.84	59.50	80.86
SPELL	60	2	47	96.77	56.07	84.51
UNK	17	0	59	100.00	22.37	59.03
VERB	43	4	96	91.49	30.94	65.75
VERB:FORM	62	3	32	95.38	65.96	87.57
VERB:INFL	3	0	2	100.00	60.00	88.24
VERB:SVA	53	5	22	91.38	70.67	86.32
VERB:TENSE	59	8	81	88.06	42.14	72.30
WO	26	2	21	92.86	55.32	81.76

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	0	0	100.00	100.00	100.00
M:ADV	4	2	8	66.67	33.33	55.56
M:CONJ	2	0	3	100.00	40.00	76.92
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	68	7	46	90.67	59.65	82.13
M:NOUN	1	0	4	100.00	20.00	55.56
M:NOUN:POSS	1	0	2	100.00	33.33	71.43
M:OTHER	12	4	19	75.00	38.71	63.16
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	28	5	25	84.85	52.83	75.68
M:PRON	22	2	16	91.67	57.89	82.09
M:PUNCT	129	16	89	88.97	59.17	80.83
M:VERB	8	1	21	88.89	27.59	61.54
M:VERB:FORM	8	1	4	88.89	66.67	83.33
M:VERB:TENSE	10	1	14	90.91	41.67	73.53
R:ADJ	3	0	10	100.00	23.08	60.00
R:ADJ:FORM	0	0	4	100.00	0.00	0.00
R:ADV	4	0	7	100.00	36.36	74.07
R:CONJ	1	0	1	100.00	50.00	83.33
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	25	9	25	73.53	50.00	67.20
R:MORPH	33	1	45	97.06	42.31	77.10
R:NOUN	15	2	32	88.24	31.91	65.22
R:NOUN:INFL	4	0	1	100.00	80.00	95.24
R:NOUN:NUM	59	5	64	92.19	47.97	77.84
R:NOUN:POSS	10	0	1	100.00	90.91	98.04
R:ORTH	129	3	75	97.73	63.24	88.11
R:OTHER	211	26	306	89.03	40.81	72.01
R:PART	8	0	1	100.00	88.89	97.56
R:PREP	58	9	56	86.57	50.88	75.92
R:PRON	10	1	18	90.91	35.71	69.44
R:PUNCT	45	6	29	88.24	60.81	80.94
R:SPELL	60	2	47	96.77	56.07	84.51
R:VERB	32	2	67	94.12	32.32	68.09
R:VERB:FORM	53	2	28	96.36	65.43	88.04
R:VERB:INFL	3	0	2	100.00	60.00	88.24
R:VERB:SVA	53	5	22	91.38	70.67	86.32
R:VERB:TENSE	43	7	66	86.00	39.45	69.58
R:WO	26	2	21	92.86	55.32	81.76
U:ADJ	2	0	1	100.00	66.67	90.91
U:ADV	6	0	7	100.00	46.15	81.08
U:CONJ	0	0	3	100.00	0.00	0.00
U:CONTR	2	0	3	100.00	40.00	76.92
U:DET	78	17	52	82.11	60.00	76.47
U:NOUN	1	0	12	100.00	7.69	29.41
U:NOUN:POSS	1	0	5	100.00	16.67	50.00
U:OTHER	10	6	23	62.50	30.30	51.55
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	18	0	11	100.00	62.07	89.11
U:PRON	10	1	4	90.91	71.43	86.21
U:PUNCT	17	2	12	89.47	58.62	80.95
U:VERB	3	1	8	75.00	27.27	55.56
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	6	0	1	100.00	85.71	96.77
UNK	17	0	59	100.00	22.37	59.03

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	597	290	939	67.31	38.87	58.71
Span-level detection	681	209	895	76.52	43.21	66.30
Token-level detection	848	203	1068	80.69	44.26	69.28

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	197	82	219	70.61	47.36	64.30
R	330	172	633	65.74	34.27	55.54
U	70	36	87	66.04	44.59	60.24

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	3	10	62.50	33.33	53.19
ADJ:FORM	3	0	0	100.00	100.00	100.00
ADV	6	7	17	46.15	26.09	40.00
CONJ	2	0	9	100.00	18.18	52.63
CONTR	1	0	1	100.00	50.00	83.33
DET	88	38	120	69.84	42.31	61.80
MORPH	18	3	24	85.71	42.86	71.43
NOUN	10	12	26	45.45	27.78	40.32
NOUN:NUM	29	8	35	78.38	45.31	68.40
NOUN:POSS	4	2	10	66.67	28.57	52.63
ORTH	30	5	39	85.71	43.48	71.77
OTHER	24	62	199	27.91	10.76	21.16
PART	1	3	5	25.00	16.67	22.73
PREP	68	41	92	62.39	42.50	57.05
PRON	14	8	25	63.64	35.90	55.12
PUNCT	146	49	97	74.87	60.08	71.36
SPELL	31	4	39	88.57	44.29	73.81
VERB	17	8	62	68.00	21.52	47.49
VERB:FORM	33	10	27	76.74	55.00	71.12
VERB:SVA	29	2	18	93.55	61.70	84.80
VERB:TENSE	32	16	52	66.67	38.10	57.97
WO	6	9	32	40.00	15.79	30.61

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	2	100.00	33.33	71.43
M:ADV	3	2	5	60.00	37.50	53.57
M:CONJ	2	0	6	100.00	25.00	62.50
M:DET	41	20	67	67.21	37.96	58.24
M:NOUN	0	1	1	0.00	0.00	0.00
M:NOUN:POSS	2	1	3	66.67	40.00	58.82
M:OTHER	2	14	12	12.50	14.29	12.82
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	9	4	20	69.23	31.03	55.56
M:PRON	10	4	13	71.43	43.48	63.29
M:PUNCT	119	31	68	79.33	63.64	75.60
M:VERB	4	3	8	57.14	33.33	50.00
M:VERB:FORM	0	1	1	0.00	0.00	0.00
M:VERB:TENSE	4	1	11	80.00	26.67	57.14
R:ADJ	3	2	7	60.00	30.00	50.00
R:ADJ:FORM	3	0	0	100.00	100.00	100.00
R:ADV	1	3	6	25.00	14.29	21.74
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	16	8	35	66.67	31.37	54.42
R:MORPH	18	3	24	85.71	42.86	71.43
R:NOUN	10	6	23	62.50	30.30	51.55
R:NOUN:NUM	29	8	35	78.38	45.31	68.40
R:NOUN:POSS	1	0	2	100.00	33.33	71.43
R:ORTH	30	5	39	85.71	43.48	71.77
R:OTHER	18	39	179	31.58	9.14	21.18
R:PART	1	3	2	25.00	33.33	26.32
R:PREP	49	35	51	58.33	49.00	56.19
R:PRON	0	3	9	0.00	0.00	0.00
R:PUNCT	19	15	20	55.88	48.72	54.29
R:SPELL	31	4	39	88.57	44.29	73.81
R:VERB	12	4	47	75.00	20.34	48.78
R:VERB:FORM	31	9	24	77.50	56.36	72.09
R:VERB:SVA	29	2	18	93.55	61.70	84.80
R:VERB:TENSE	23	14	37	62.16	38.33	55.29
R:WO	6	9	32	40.00	15.79	30.61
U:ADJ	1	1	1	50.00	50.00	50.00
U:ADV	2	2	6	50.00	25.00	41.67
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	31	10	18	75.61	63.27	72.77
U:NOUN	0	5	2	0.00	0.00	0.00
U:NOUN:POSS	1	1	5	50.00	16.67	35.71
U:OTHER	4	9	8	30.77	33.33	31.25
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	10	2	21	83.33	32.26	63.29
U:PRON	4	1	3	80.00	57.14	74.07
U:PUNCT	8	3	9	72.73	47.06	65.57
U:VERB	1	1	7	50.00	12.50	31.25
U:VERB:FORM	2	0	2	100.00	50.00	83.33
U:VERB:TENSE	5	1	4	83.33	55.56	75.76

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	221	61	213	78.37	50.92	70.74
R	388	115	586	77.14	39.84	64.97
U	72	33	84	68.57	46.15	62.50
UNK	0	0	12	100.00	0.00	0.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	7	1	11	87.50	38.89	70.00
ADJ:FORM	3	0	0	100.00	100.00	100.00
ADV	9	6	14	60.00	39.13	54.22
CONJ	3	0	10	100.00	23.08	60.00
CONTR	1	0	1	100.00	50.00	83.33
DET	95	28	110	77.24	46.34	68.15
MORPH	18	2	21	90.00	46.15	75.63
NOUN	13	12	27	52.00	32.50	46.43
NOUN:NUM	28	7	34	80.00	45.16	69.31
NOUN:POSS	4	2	10	66.67	28.57	52.63
ORTH	33	1	39	97.06	45.83	79.33
OTHER	61	42	186	59.22	24.70	46.28
PART	1	3	5	25.00	16.67	22.73
PREP	74	29	92	71.84	44.58	64.01
PRON	17	5	21	77.27	44.74	67.46
PUNCT	155	43	95	78.28	62.00	74.38
SPELL	32	0	37	100.00	46.38	81.22
UNK	0	0	12	100.00	0.00	0.00
VERB	25	7	51	78.12	32.89	61.27
VERB:FORM	31	7	28	81.58	52.54	73.46
VERB:SVA	34	0	11	100.00	75.56	93.92
VERB:TENSE	31	9	50	77.50	38.27	64.32
WO	6	5	30	54.55	16.67	37.50

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	3	100.00	25.00	62.50
M:ADV	4	1	4	80.00	50.00	71.43
M:CONJ	3	0	7	100.00	30.00	68.18
M:DET	44	14	60	75.86	42.31	65.48
M:NOUN	1	1	1	50.00	50.00	50.00
M:NOUN:POSS	2	1	3	66.67	40.00	58.82
M:OTHER	9	9	12	50.00	42.86	48.39
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	7	3	24	70.00	22.58	49.30
M:PRON	12	2	10	85.71	54.55	76.92
M:PUNCT	128	26	71	83.12	64.32	78.53
M:VERB	7	3	4	70.00	63.64	68.63
M:VERB:FORM	0	1	1	0.00	0.00	0.00
M:VERB:TENSE	3	0	11	100.00	21.43	57.69
R:ADJ	5	0	7	100.00	41.67	78.12
R:ADJ:FORM	3	0	0	100.00	100.00	100.00
R:ADV	1	3	5	25.00	16.67	22.73
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	22	5	33	81.48	40.00	67.48
R:MORPH	18	2	21	90.00	46.15	75.63
R:NOUN	12	6	22	66.67	35.29	56.60
R:NOUN:NUM	28	7	34	80.00	45.16	69.31
R:NOUN:POSS	1	0	2	100.00	33.33	71.43
R:ORTH	33	1	39	97.06	45.83	79.33
R:OTHER	48	24	166	66.67	22.43	47.81
R:PART	1	3	2	25.00	33.33	26.32
R:PREP	57	24	47	70.37	54.81	66.59
R:PRON	0	2	9	0.00	0.00	0.00
R:PUNCT	18	15	16	54.55	52.94	54.22
R:SPELL	32	0	37	100.00	46.38	81.22
R:VERB	16	4	41	80.00	28.07	58.39
R:VERB:FORM	30	6	25	83.33	54.55	75.38
R:VERB:SVA	34	0	11	100.00	75.56	93.92
R:VERB:TENSE	23	8	35	74.19	39.66	63.19
R:WO	6	5	30	54.55	16.67	37.50
U:ADJ	1	1	1	50.00	50.00	50.00
U:ADV	4	2	5	66.67	44.44	60.61
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	29	9	17	76.32	63.04	73.23
U:NOUN	0	5	4	0.00	0.00	0.00
U:NOUN:POSS	1	1	5	50.00	16.67	35.71
U:OTHER	4	9	8	30.77	33.33	31.25
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	10	2	21	83.33	32.26	63.29
U:PRON	5	1	2	83.33	71.43	80.65
U:PUNCT	9	2	8	81.82	52.94	73.77
U:VERB	2	0	6	100.00	25.00	62.50
U:VERB:FORM	1	0	2	100.00	33.33	71.43
U:VERB:TENSE	5	1	4	83.33	55.56	75.76
UNK	0	0	12	100.00	0.00	0.00

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	245	41	222	85.66	52.46	76.04
R	517	113	693	82.06	42.73	69.30
U	85	49	145	63.43	36.96	55.48
UNK	1	0	8	100.00	11.11	38.46

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	7	1	12	87.50	36.84	68.63
ADJ:FORM	3	0	0	100.00	100.00	100.00
ADV	9	4	13	69.23	40.91	60.81
CONJ	5	0	8	100.00	38.46	75.76
CONTR	1	0	1	100.00	50.00	83.33
DET	101	20	115	83.47	46.76	72.14
MORPH	20	1	21	95.24	48.78	80.00
NOUN	21	7	34	75.00	38.18	62.87
NOUN:NUM	29	6	31	82.86	48.33	72.50
NOUN:POSS	5	1	11	83.33	31.25	62.50
ORTH	54	1	51	98.18	51.43	83.08
OTHER	116	79	261	59.49	30.77	50.13
PART	0	2	5	0.00	0.00	0.00
PREP	78	24	97	76.47	44.57	66.90
PRON	18	4	24	81.82	42.86	69.23
PUNCT	175	32	93	84.54	65.30	79.84
SPELL	33	0	37	100.00	47.14	81.68
UNK	1	0	8	100.00	11.11	38.46
VERB	37	7	75	84.09	33.04	64.24
VERB:FORM	33	4	32	89.19	50.77	77.46
VERB:SVA	36	0	12	100.00	75.00	93.75
VERB:TENSE	42	5	68	89.36	38.18	70.47
WO	24	5	59	82.76	28.92	60.30

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	2	100.00	33.33	71.43
M:ADV	5	0	3	100.00	62.50	89.29
M:CONJ	4	0	4	100.00	50.00	83.33
M:DET	48	7	64	87.27	42.86	72.29
M:NOUN	1	1	3	50.00	25.00	41.67
M:NOUN:POSS	2	1	3	66.67	40.00	58.82
M:OTHER	7	6	13	53.85	35.00	48.61
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	10	2	27	83.33	27.03	58.82
M:PRON	14	2	10	87.50	58.33	79.55
M:PUNCT	137	18	67	88.39	67.16	83.13
M:VERB	11	3	9	78.57	55.00	72.37
M:VERB:FORM	1	1	1	50.00	50.00	50.00
M:VERB:TENSE	4	0	14	100.00	22.22	58.82
R:ADJ	5	0	9	100.00	35.71	73.53
R:ADJ:FORM	3	0	0	100.00	100.00	100.00
R:ADV	1	3	4	25.00	20.00	23.81
R:CONJ	0	0	4	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	24	5	29	82.76	45.28	71.01
R:MORPH	20	1	21	95.24	48.78	80.00
R:NOUN	20	3	23	86.96	46.51	74.07
R:NOUN:NUM	29	6	31	82.86	48.33	72.50
R:NOUN:POSS	2	0	2	100.00	50.00	83.33
R:ORTH	54	1	51	98.18	51.43	83.08
R:OTHER	96	42	201	69.57	32.32	56.54
R:PART	0	2	2	0.00	0.00	0.00
R:PREP	58	20	49	74.36	54.21	69.21
R:PRON	0	1	10	0.00	0.00	0.00
R:PUNCT	27	12	17	69.23	61.36	67.50
R:SPELL	33	0	37	100.00	47.14	81.68
R:VERB	22	4	54	84.62	28.95	61.11
R:VERB:FORM	31	3	30	91.18	50.82	78.68
R:VERB:SVA	36	0	12	100.00	75.00	93.75
R:VERB:TENSE	32	5	47	86.49	40.51	70.48
R:WO	24	5	59	82.76	28.92	60.30
U:ADJ	1	1	1	50.00	50.00	50.00
U:ADV	3	1	6	75.00	33.33	60.00
U:CONJ	1	0	0	100.00	100.00	100.00
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	29	8	22	78.38	56.86	72.86
U:NOUN	0	3	8	0.00	0.00	0.00
U:NOUN:POSS	1	0	6	100.00	14.29	45.45
U:OTHER	13	31	47	29.55	21.67	27.54
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	10	2	21	83.33	32.26	63.29
U:PRON	4	1	4	80.00	50.00	71.43
U:PUNCT	11	2	9	84.62	55.00	76.39
U:VERB	4	0	12	100.00	25.00	62.50
U:VERB:FORM	1	0	1	100.00	50.00	83.33
U:VERB:TENSE	6	0	7	100.00	46.15	81.08
UNK	1	0	8	100.00	11.11	38.46

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	271	112	335	70.76	44.72	63.38
Span-level detection	299	85	343	77.86	46.57	68.64
Token-level detection	359	68	394	84.07	47.68	72.94

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	94	21	83	81.74	53.11	73.78
R	141	78	216	64.38	39.50	57.18
U	36	13	36	73.47	50.00	67.16

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	7	100.00	12.50	41.67
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	3	2	3	60.00	50.00	57.69
CONJ	0	1	3	0.00	0.00	0.00
CONTR	2	0	1	100.00	66.67	90.91
DET	48	14	48	77.42	50.00	69.77
MORPH	7	2	14	77.78	33.33	61.40
NOUN	0	5	10	0.00	0.00	0.00
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	10	4	17	71.43	37.04	60.24
NOUN:POSS	0	1	6	0.00	0.00	0.00
ORTH	20	2	21	90.91	48.78	77.52
OTHER	15	16	47	48.39	24.19	40.32
PART	0	0	3	100.00	0.00	0.00
PREP	30	22	37	57.69	44.78	54.55
PRON	4	1	6	80.00	40.00	66.67
PUNCT	78	24	34	76.47	69.64	75.00
SPELL	9	1	28	90.00	24.32	58.44
VERB	3	3	11	50.00	21.43	39.47
VERB:FORM	10	1	3	90.91	76.92	87.72
VERB:SVA	7	2	2	77.78	77.78	77.78
VERB:TENSE	17	8	20	68.00	45.95	62.04
WO	6	3	12	66.67	33.33	55.56

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	1	1	0	50.00	100.00	55.56
M:CONJ	0	1	2	0.00	0.00	0.00
M:DET	19	4	25	82.61	43.18	69.85
M:NOUN	0	0	1	100.00	0.00	0.00
M:NOUN:POSS	0	1	0	0.00	100.00	0.00
M:OTHER	0	0	6	100.00	0.00	0.00
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	4	2	14	66.67	22.22	47.62
M:PRON	2	0	3	100.00	40.00	76.92
M:PUNCT	62	11	24	84.93	72.09	82.01
M:VERB	0	0	2	100.00	0.00	0.00
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	5	1	3	83.33	62.50	78.12
R:ADJ	1	0	4	100.00	20.00	55.56
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	2	1	2	66.67	50.00	62.50
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	8	4	6	66.67	57.14	64.52
R:MORPH	7	2	14	77.78	33.33	61.40
R:NOUN	0	5	8	0.00	0.00	0.00
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	10	4	17	71.43	37.04	60.24
R:NOUN:POSS	0	0	5	100.00	0.00	0.00
R:ORTH	20	2	21	90.91	48.78	77.52
R:OTHER	14	16	39	46.67	26.42	40.46
R:PART	0	0	2	100.00	0.00	0.00
R:PREP	24	17	17	58.54	58.54	58.54
R:PRON	1	1	2	50.00	33.33	45.45
R:PUNCT	11	11	6	50.00	64.71	52.38
R:SPELL	9	1	28	90.00	24.32	58.44
R:VERB	3	2	9	60.00	25.00	46.88
R:VERB:FORM	9	1	3	90.00	75.00	86.54
R:VERB:SVA	7	2	2	77.78	77.78	77.78
R:VERB:TENSE	8	6	15	57.14	34.78	50.63
R:WO	6	3	12	66.67	33.33	55.56
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	0	1	100.00	0.00	0.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	21	6	17	77.78	55.26	71.92
U:NOUN	0	0	1	100.00	0.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	1	0	2	100.00	33.33	71.43
U:PREP	2	3	6	40.00	25.00	35.71
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	5	2	4	71.43	55.56	67.57
U:VERB	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	4	1	2	80.00	66.67	76.92

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	96	21	88	82.05	52.17	73.62
R	163	54	210	75.12	43.70	65.67
U	39	10	41	79.59	48.75	70.65
UNK	1	0	4	100.00	20.00	55.56

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	6	100.00	14.29	45.45
ADJ:FORM	0	0	1	100.00	0.00	0.00
ADV	3	1	5	75.00	37.50	62.50
CONJ	0	1	4	0.00	0.00	0.00
CONTR	2	0	1	100.00	66.67	90.91
DET	52	12	51	81.25	50.49	72.42
MORPH	7	2	15	77.78	31.82	60.34
NOUN	3	2	12	60.00	20.00	42.86
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	10	4	16	71.43	38.46	60.98
NOUN:POSS	0	1	6	0.00	0.00	0.00
ORTH	21	2	23	91.30	47.73	77.21
OTHER	20	6	49	76.92	28.99	57.80
PART	1	0	3	100.00	25.00	62.50
PREP	36	16	36	69.23	50.00	64.29
PRON	4	1	7	80.00	36.36	64.52
PUNCT	79	25	34	75.96	69.91	74.67
SPELL	11	0	26	100.00	29.73	67.90
UNK	1	0	4	100.00	20.00	55.56
VERB	4	1	11	80.00	26.67	57.14
VERB:FORM	10	0	3	100.00	76.92	94.34
VERB:SVA	10	1	1	90.91	90.91	90.91
VERB:TENSE	18	7	19	72.00	48.65	65.69
WO	5	3	10	62.50	33.33	53.19

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	1	0	0	100.00	100.00	100.00
M:CONJ	0	1	3	0.00	0.00	0.00
M:DET	20	4	25	83.33	44.44	70.92
M:NOUN	1	0	3	100.00	25.00	62.50
M:NOUN:POSS	0	1	0	0.00	100.00	0.00
M:OTHER	0	0	8	100.00	0.00	0.00
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	4	2	14	66.67	22.22	47.62
M:PRON	2	0	3	100.00	40.00	76.92
M:PUNCT	62	12	24	83.78	72.09	81.15
M:VERB	0	0	2	100.00	0.00	0.00
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	5	1	3	83.33	62.50	78.12
R:ADJ	1	0	4	100.00	20.00	55.56
R:ADJ:FORM	0	0	1	100.00	0.00	0.00
R:ADV	2	1	3	66.67	40.00	58.82
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	8	3	7	72.73	53.33	67.80
R:MORPH	7	2	15	77.78	31.82	60.34
R:NOUN	2	2	8	50.00	20.00	38.46
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	10	4	16	71.43	38.46	60.98
R:NOUN:POSS	0	0	5	100.00	0.00	0.00
R:ORTH	21	2	23	91.30	47.73	77.21
R:OTHER	19	6	37	76.00	33.93	60.90
R:PART	1	0	1	100.00	50.00	83.33
R:PREP	30	12	16	71.43	65.22	70.09
R:PRON	1	1	3	50.00	25.00	41.67
R:PUNCT	12	11	6	52.17	66.67	54.55
R:SPELL	11	0	26	100.00	29.73	67.90
R:VERB	4	1	9	80.00	30.77	60.61
R:VERB:FORM	9	0	3	100.00	75.00	93.75
R:VERB:SVA	10	1	1	90.91	90.91	90.91
R:VERB:TENSE	9	5	14	64.29	39.13	56.96
R:WO	5	3	10	62.50	33.33	53.19
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	0	2	100.00	0.00	0.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	24	5	19	82.76	55.81	75.47
U:NOUN	0	0	1	100.00	0.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	1	0	4	100.00	20.00	55.56
U:PREP	2	2	6	50.00	25.00	41.67
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	5	2	4	71.43	55.56	67.57
U:VERB:TENSE	4	1	2	80.00	66.67	76.92
UNK	1	0	4	100.00	20.00	55.56

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	106	18	98	85.48	51.96	75.71
R	209	40	248	83.94	45.73	71.92
U	44	10	45	81.48	49.44	72.13
UNK	0	0	3	100.00	0.00	0.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	0	8	100.00	0.00	0.00
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	3	1	5	75.00	37.50	62.50
CONJ	1	1	4	50.00	20.00	38.46
CONTR	2	0	2	100.00	50.00	83.33
DET	55	10	51	84.62	51.89	75.14
MORPH	7	1	17	87.50	29.17	62.50
NOUN	3	0	11	100.00	21.43	57.69
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	11	3	19	78.57	36.67	63.95
NOUN:POSS	0	1	8	0.00	0.00	0.00
ORTH	33	2	25	94.29	56.90	83.33
OTHER	31	3	68	91.18	31.31	65.96
PART	2	0	2	100.00	50.00	83.33
PREP	37	16	37	69.81	50.00	64.69
PRON	6	1	5	85.71	54.55	76.92
PUNCT	97	19	42	83.62	69.78	80.43
SPELL	13	0	25	100.00	34.21	72.22
UNK	0	0	3	100.00	0.00	0.00
VERB	4	1	13	80.00	23.53	54.05
VERB:FORM	10	0	5	100.00	66.67	90.91
VERB:SVA	10	1	1	90.91	90.91	90.91
VERB:TENSE	17	6	23	73.91	42.50	64.39
WO	16	2	18	88.89	47.06	75.47

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	3	100.00	0.00	0.00
M:CONJ	1	1	3	50.00	25.00	41.67
M:DET	23	3	25	88.46	47.92	75.66
M:NOUN	1	0	2	100.00	33.33	71.43
M:NOUN:POSS	0	1	0	0.00	100.00	0.00
M:OTHER	0	0	8	100.00	0.00	0.00
M:PART	1	0	1	100.00	50.00	83.33
M:PREP	5	2	15	71.43	25.00	52.08
M:PRON	3	0	3	100.00	50.00	83.33
M:PUNCT	67	11	32	85.90	67.68	81.51
M:VERB	0	0	3	100.00	0.00	0.00
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	4	0	3	100.00	57.14	86.96
R:ADJ	0	0	3	100.00	0.00	0.00
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	2	1	4	66.67	33.33	55.56
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	8	2	8	80.00	50.00	71.43
R:MORPH	7	1	17	87.50	29.17	62.50
R:NOUN	2	0	8	100.00	20.00	55.56
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	11	3	19	78.57	36.67	63.95
R:NOUN:POSS	0	0	7	100.00	0.00	0.00
R:ORTH	33	2	25	94.29	56.90	83.33
R:OTHER	30	3	54	90.91	35.71	69.44
R:PART	1	0	1	100.00	50.00	83.33
R:PREP	30	12	16	71.43	65.22	70.09
R:PRON	2	1	1	66.67	66.67	66.67
R:PUNCT	21	6	5	77.78	80.77	78.36
R:SPELL	13	0	25	100.00	34.21	72.22
R:VERB	4	1	10	80.00	28.57	58.82
R:VERB:FORM	9	0	5	100.00	64.29	90.00
R:VERB:SVA	10	1	1	90.91	90.91	90.91
R:VERB:TENSE	9	5	17	64.29	34.62	54.88
R:WO	16	2	18	88.89	47.06	75.47
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	1	0	1	100.00	50.00	83.33
U:CONTR	2	0	1	100.00	66.67	90.91
U:DET	24	5	18	82.76	57.14	75.95
U:NOUN	0	0	1	100.00	0.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	1	0	6	100.00	14.29	45.45
U:PREP	2	2	6	50.00	25.00	41.67
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	9	2	5	81.82	64.29	77.59
U:VERB:TENSE	4	1	3	80.00	57.14	74.07
UNK	0	0	3	100.00	0.00	0.00

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	166	129	303	56.27	35.39	50.33
Span-level detection	191	104	302	64.75	38.74	57.08
Token-level detection	220	105	325	67.69	40.37	59.62

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	75	27	37	73.53	66.96	72.12
R	82	75	246	52.23	25.00	42.89
U	9	27	20	25.00	31.03	26.01

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	3	3	25.00	25.00	25.00
ADV	1	5	0	16.67	100.00	20.00
CONJ	0	2	2	0.00	0.00	0.00
DET	10	19	5	34.48	66.67	38.17
MORPH	1	1	2	50.00	33.33	45.45
NOUN	1	8	9	11.11	10.00	10.87
NOUN:INFL	0	0	11	100.00	0.00	0.00
NOUN:NUM	6	8	9	42.86	40.00	42.25
NOUN:POSS	4	0	15	100.00	21.05	57.14
ORTH	17	1	40	94.44	29.82	65.89
OTHER	13	14	40	48.15	24.53	40.37
PART	1	0	0	100.00	100.00	100.00
PREP	6	22	10	21.43	37.50	23.44
PRON	1	3	5	25.00	16.67	22.73
PUNCT	72	16	50	81.82	59.02	75.95
SPELL	14	4	77	77.78	15.38	42.94
VERB	5	7	7	41.67	41.67	41.67
VERB:FORM	2	1	4	66.67	33.33	55.56
VERB:INFL	1	0	4	100.00	20.00	55.56
VERB:SVA	7	5	3	58.33	70.00	60.34
VERB:TENSE	1	10	6	9.09	14.29	9.80
WO	2	0	1	100.00	66.67	90.91

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	0	1	1	0.00	0.00	0.00
M:DET	5	9	1	35.71	83.33	40.32
M:NOUN	0	1	2	0.00	0.00	0.00
M:NOUN:POSS	3	0	4	100.00	42.86	78.95
M:PREP	0	4	0	0.00	100.00	0.00
M:PRON	0	1	2	0.00	0.00	0.00
M:PUNCT	66	9	25	88.00	72.53	84.40
M:VERB	1	2	2	33.33	33.33	33.33
R:ADJ	1	3	3	25.00	25.00	25.00
R:ADV	0	2	0	0.00	100.00	0.00
R:CONJ	0	1	0	0.00	100.00	0.00
R:DET	0	1	2	0.00	0.00	0.00
R:MORPH	1	1	2	50.00	33.33	45.45
R:NOUN	1	4	7	20.00	12.50	17.86
R:NOUN:INFL	0	0	11	100.00	0.00	0.00
R:NOUN:NUM	6	8	9	42.86	40.00	42.25
R:NOUN:POSS	1	0	11	100.00	8.33	31.25
R:ORTH	17	1	40	94.44	29.82	65.89
R:OTHER	13	12	39	52.00	25.00	42.76
R:PREP	6	16	8	27.27	42.86	29.41
R:PRON	1	0	3	100.00	25.00	62.50
R:PUNCT	4	5	13	44.44	23.53	37.74
R:SPELL	14	4	77	77.78	15.38	42.94
R:VERB	4	3	4	57.14	50.00	55.56
R:VERB:FORM	2	0	4	100.00	33.33	71.43
R:VERB:INFL	1	0	4	100.00	20.00	55.56
R:VERB:SVA	7	5	3	58.33	70.00	60.34
R:VERB:TENSE	1	9	5	10.00	16.67	10.87
R:WO	2	0	1	100.00	66.67	90.91
U:ADV	1	3	0	25.00	100.00	29.41
U:CONJ	0	0	1	100.00	0.00	0.00
U:DET	5	9	2	35.71	71.43	39.68
U:NOUN	0	3	0	0.00	100.00	0.00
U:OTHER	0	2	1	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	0	2	2	0.00	0.00	0.00
U:PRON	0	2	0	0.00	100.00	0.00
U:PUNCT	2	2	12	50.00	14.29	33.33
U:VERB	0	2	1	0.00	0.00	0.00
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	0	1	1	0.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	78	24	39	76.47	66.67	74.29
R	102	58	240	63.75	29.82	51.93
U	10	22	20	31.25	33.33	31.65
UNK	1	0	3	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	2	1	60.00	75.00	62.50
ADV	1	4	0	20.00	100.00	23.81
CONJ	0	1	2	0.00	0.00	0.00
DET	12	17	6	41.38	66.67	44.78
MORPH	2	1	2	66.67	50.00	62.50
NOUN	2	4	8	33.33	20.00	29.41
NOUN:INFL	0	0	11	100.00	0.00	0.00
NOUN:NUM	5	8	9	38.46	35.71	37.88
NOUN:POSS	5	0	14	100.00	26.32	64.10
ORTH	19	1	42	95.00	31.15	67.38
OTHER	19	11	37	63.33	33.93	53.98
PART	1	0	0	100.00	100.00	100.00
PREP	7	19	8	26.92	46.67	29.41
PRON	1	3	5	25.00	16.67	22.73
PUNCT	73	15	52	82.95	58.40	76.52
SPELL	19	0	73	100.00	20.65	56.55
UNK	1	0	3	100.00	25.00	62.50
VERB	5	6	9	45.45	35.71	43.10
VERB:FORM	2	1	5	66.67	28.57	52.63
VERB:INFL	1	0	4	100.00	20.00	55.56
VERB:SVA	7	5	3	58.33	70.00	60.34
VERB:TENSE	4	6	7	40.00	36.36	39.22
WO	2	0	1	100.00	66.67	90.91

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	0	0	1	100.00	0.00	0.00
M:DET	5	8	1	38.46	83.33	43.10
M:NOUN	0	1	2	0.00	0.00	0.00
M:NOUN:POSS	3	0	4	100.00	42.86	78.95
M:OTHER	2	0	0	100.00	100.00	100.00
M:PREP	0	3	0	0.00	100.00	0.00
M:PRON	0	1	2	0.00	0.00	0.00
M:PUNCT	67	9	26	88.16	72.04	84.38
M:VERB	1	2	2	33.33	33.33	33.33
M:VERB:TENSE	0	0	1	100.00	0.00	0.00
R:ADJ	3	2	1	60.00	75.00	62.50
R:ADV	0	2	0	0.00	100.00	0.00
R:CONJ	0	1	0	0.00	100.00	0.00
R:DET	1	1	2	50.00	33.33	45.45
R:MORPH	2	1	2	66.67	50.00	62.50
R:NOUN	2	1	6	66.67	25.00	50.00
R:NOUN:INFL	0	0	11	100.00	0.00	0.00
R:NOUN:NUM	5	8	9	38.46	35.71	37.88
R:NOUN:POSS	2	0	10	100.00	16.67	50.00
R:ORTH	19	1	42	95.00	31.15	67.38
R:OTHER	17	9	36	65.38	32.08	54.14
R:PREP	7	14	7	33.33	50.00	35.71
R:PRON	1	0	3	100.00	25.00	62.50
R:PUNCT	4	5	15	44.44	21.05	36.36
R:SPELL	19	0	73	100.00	20.65	56.55
R:VERB	4	2	5	66.67	44.44	60.61
R:VERB:FORM	2	0	5	100.00	28.57	66.67
R:VERB:INFL	1	0	4	100.00	20.00	55.56
R:VERB:SVA	7	5	3	58.33	70.00	60.34
R:VERB:TENSE	4	6	5	40.00	44.44	40.82
R:WO	2	0	1	100.00	66.67	90.91
U:ADV	1	2	0	33.33	100.00	38.46
U:CONJ	0	0	1	100.00	0.00	0.00
U:DET	6	8	3	42.86	66.67	46.15
U:NOUN	0	2	0	0.00	100.00	0.00
U:OTHER	0	2	1	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	0	2	1	0.00	0.00	0.00
U:PRON	0	2	0	0.00	100.00	0.00
U:PUNCT	2	1	11	66.67	15.38	40.00
U:VERB	0	2	2	0.00	0.00	0.00
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	0	0	1	100.00	0.00	0.00
UNK	1	0	3	100.00	25.00	62.50

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	83	22	42	79.05	66.40	76.15
R	125	62	258	66.84	32.64	55.26
U	10	21	22	32.26	31.25	32.05
UNK	2	0	3	100.00	40.00	76.92

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	2	2	60.00	60.00	60.00
ADV	1	4	2	20.00	33.33	21.74
CONJ	0	1	0	0.00	100.00	0.00
CONTR	0	0	2	100.00	0.00	0.00
DET	11	15	8	42.31	57.89	44.72
MORPH	2	0	3	100.00	40.00	76.92
NOUN	2	5	9	28.57	18.18	25.64
NOUN:INFL	0	0	11	100.00	0.00	0.00
NOUN:NUM	6	7	10	46.15	37.50	44.12
NOUN:POSS	5	0	15	100.00	25.00	62.50
ORTH	27	1	50	96.43	35.06	71.43
OTHER	26	17	43	60.47	37.68	53.94
PART	1	0	0	100.00	100.00	100.00
PREP	7	19	7	26.92	50.00	29.66
PRON	1	3	5	25.00	16.67	22.73
PUNCT	82	13	55	86.32	59.85	79.30
SPELL	21	0	72	100.00	22.58	59.32
UNK	2	0	3	100.00	40.00	76.92
VERB	5	7	11	41.67	31.25	39.06
VERB:FORM	3	0	4	100.00	42.86	78.95
VERB:INFL	1	0	4	100.00	20.00	55.56
VERB:SVA	7	5	4	58.33	63.64	59.32
VERB:TENSE	3	6	5	33.33	37.50	34.09
WO	4	0	0	100.00	100.00	100.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	0	1	100.00	0.00	0.00
M:DET	5	6	2	45.45	71.43	49.02
M:NOUN	0	1	3	0.00	0.00	0.00
M:NOUN:POSS	3	0	4	100.00	42.86	78.95
M:OTHER	2	0	0	100.00	100.00	100.00
M:PREP	0	3	0	0.00	100.00	0.00
M:PRON	0	1	2	0.00	0.00	0.00
M:PUNCT	72	9	27	88.89	72.73	85.11
M:VERB	1	2	2	33.33	33.33	33.33
M:VERB:TENSE	0	0	1	100.00	0.00	0.00
R:ADJ	3	2	1	60.00	75.00	62.50
R:ADV	0	2	0	0.00	100.00	0.00
R:CONJ	0	1	0	0.00	100.00	0.00
R:CONTR	0	0	2	100.00	0.00	0.00
R:DET	1	1	3	50.00	25.00	41.67
R:MORPH	2	0	3	100.00	40.00	76.92
R:NOUN	2	2	6	50.00	25.00	41.67
R:NOUN:INFL	0	0	11	100.00	0.00	0.00
R:NOUN:NUM	6	7	10	46.15	37.50	44.12
R:NOUN:POSS	2	0	11	100.00	15.38	47.62
R:ORTH	27	1	50	96.43	35.06	71.43
R:OTHER	24	14	41	63.16	36.92	55.30
R:PREP	7	14	6	33.33	53.85	36.08
R:PRON	1	0	3	100.00	25.00	62.50
R:PUNCT	7	4	17	63.64	29.17	51.47
R:SPELL	21	0	72	100.00	22.58	59.32
R:VERB	4	3	7	57.14	36.36	51.28
R:VERB:FORM	3	0	4	100.00	42.86	78.95
R:VERB:INFL	1	0	4	100.00	20.00	55.56
R:VERB:SVA	7	5	4	58.33	63.64	59.32
R:VERB:TENSE	3	6	3	33.33	50.00	35.71
R:WO	4	0	0	100.00	100.00	100.00
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	1	2	1	33.33	50.00	35.71
U:DET	5	8	3	38.46	62.50	41.67
U:NOUN	0	2	0	0.00	100.00	0.00
U:OTHER	0	3	2	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	0	2	1	0.00	0.00	0.00
U:PRON	0	2	0	0.00	100.00	0.00
U:PUNCT	3	0	11	100.00	21.43	57.69
U:VERB	0	2	2	0.00	0.00	0.00
U:VERB:TENSE	0	0	1	100.00	0.00	0.00
UNK	2	0	3	100.00	40.00	76.92

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:44:41+00:00
Competition submission:	22
Competition phase:	3 - Open phase

Detailed results

Submission information

Results