BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1161	8062	3480	12.59	25.02	13.98
Span-level detection	2252	6972	3234	24.41	41.05	26.57
Token-level detection	4589	8751	3892	34.40	54.11	37.10

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	348	284	740	55.06	31.99	48.12
R	678	6742	2401	9.14	22.02	10.35
U	135	1036	339	11.53	28.48	13.09

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	4	240	29	1.64	12.12	1.98
ADJ:FORM	1	11	5	8.33	16.67	9.26
ADV	8	67	37	10.67	17.78	11.59
CONJ	0	27	17	0.00	0.00	0.00
CONTR	6	6	3	50.00	66.67	52.63
DET	116	234	398	33.14	22.57	30.30
MORPH	23	37	111	38.33	17.16	30.75
NOUN	16	1620	105	0.98	13.22	1.20
NOUN:INFL	0	0	18	100.00	0.00	0.00
NOUN:NUM	95	132	147	41.85	39.26	41.30
NOUN:POSS	2	12	43	14.29	4.44	9.90
ORTH	132	77	236	63.16	35.87	54.82
OTHER	29	4112	690	0.70	4.03	0.84
PART	6	11	19	35.29	24.00	32.26
PREP	127	275	270	31.59	31.99	31.67
PRON	18	38	98	32.14	15.52	26.47
PUNCT	350	258	353	57.57	49.79	55.82
SPELL	3	14	284	17.65	1.05	4.23
VERB	18	512	181	3.40	9.05	3.88
VERB:FORM	90	98	99	47.87	47.62	47.82
VERB:INFL	1	0	7	100.00	12.50	41.67
VERB:SVA	50	50	80	50.00	38.46	47.17
VERB:TENSE	56	221	188	20.22	22.95	20.71
WO	10	10	62	50.00	13.89	32.89

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	3	0.00	0.00	0.00
M:ADV	1	5	10	16.67	9.09	14.29
M:CONJ	0	8	9	0.00	0.00	0.00
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	41	89	191	31.54	17.67	27.26
M:NOUN	0	6	11	0.00	0.00	0.00
M:NOUN:POSS	0	3	13	0.00	0.00	0.00
M:OTHER	0	22	44	0.00	0.00	0.00
M:PART	0	1	4	0.00	0.00	0.00
M:PREP	8	21	77	27.59	9.41	19.90
M:PRON	10	16	50	38.46	16.67	30.49
M:PUNCT	269	82	254	76.64	51.43	69.80
M:VERB	4	11	35	26.67	10.26	20.20
M:VERB:FORM	9	3	6	75.00	60.00	71.43
M:VERB:TENSE	6	14	33	30.00	15.38	25.21
R:ADJ	2	96	22	2.04	8.33	2.40
R:ADJ:FORM	1	11	5	8.33	16.67	9.26
R:ADV	3	21	16	12.50	15.79	13.04
R:CONJ	0	1	4	0.00	0.00	0.00
R:CONTR	4	5	0	44.44	100.00	50.00
R:DET	21	63	77	25.00	21.43	24.19
R:MORPH	23	37	111	38.33	17.16	30.75
R:NOUN	13	1359	83	0.95	13.54	1.16
R:NOUN:INFL	0	0	18	100.00	0.00	0.00
R:NOUN:NUM	95	132	147	41.85	39.26	41.30
R:NOUN:POSS	1	3	21	25.00	4.55	13.16
R:ORTH	132	77	236	63.16	35.87	54.82
R:OTHER	27	3953	625	0.68	4.14	0.81
R:PART	5	9	12	35.71	29.41	34.25
R:PREP	102	189	141	35.05	41.98	36.25
R:PRON	1	8	35	11.11	2.78	6.94
R:PUNCT	48	72	64	40.00	42.86	40.54
R:SPELL	3	14	284	17.65	1.05	4.23
R:VERB	9	352	129	2.49	6.52	2.84
R:VERB:FORM	79	88	87	47.31	47.59	47.36
R:VERB:INFL	1	0	7	100.00	12.50	41.67
R:VERB:SVA	50	50	80	50.00	38.46	47.17
R:VERB:TENSE	48	192	135	20.00	26.23	21.00
R:WO	10	10	62	50.00	13.89	32.89
U:ADJ	2	142	4	1.39	33.33	1.72
U:ADV	4	41	11	8.89	26.67	10.26
U:CONJ	0	18	4	0.00	0.00	0.00
U:CONTR	2	0	3	100.00	40.00	76.92
U:DET	54	82	130	39.71	29.35	37.09
U:NOUN	3	255	11	1.16	21.43	1.43
U:NOUN:POSS	1	6	9	14.29	10.00	13.16
U:OTHER	2	137	21	1.44	8.70	1.73
U:PART	1	1	3	50.00	25.00	41.67
U:PREP	17	65	52	20.73	24.64	21.41
U:PRON	7	14	13	33.33	35.00	33.65
U:PUNCT	33	104	35	24.09	48.53	26.79
U:VERB	5	149	17	3.25	22.73	3.92
U:VERB:FORM	2	7	6	22.22	25.00	22.73
U:VERB:TENSE	2	15	20	11.76	9.09	11.11

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	390	249	788	61.03	33.11	52.22
R	1649	5850	2036	21.99	44.75	24.48
U	174	873	359	16.62	32.65	18.43
UNK	39	0	51	100.00	43.33	79.27

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	22	194	35	10.19	38.60	11.94
ADJ:FORM	2	9	5	18.18	28.57	19.61
ADV	15	52	46	22.39	24.59	22.80
CONJ	0	26	24	0.00	0.00	0.00
CONTR	4	7	3	36.36	57.14	39.22
DET	137	216	418	38.81	24.68	34.82
MORPH	86	30	81	74.14	51.50	68.15
NOUN	84	1335	92	5.92	47.73	7.18
NOUN:INFL	8	0	11	100.00	42.11	78.43
NOUN:NUM	146	115	120	55.94	54.89	55.73
NOUN:POSS	14	11	37	56.00	27.45	46.36
ORTH	300	69	186	81.30	61.73	76.45
OTHER	236	3701	602	5.99	28.16	7.11
PART	8	10	20	44.44	28.57	40.00
PREP	167	222	290	42.93	36.54	41.48
PRON	29	33	98	46.77	22.83	38.67
PUNCT	376	234	405	61.64	48.14	58.37
SPELL	165	11	149	93.75	52.55	81.04
UNK	39	0	51	100.00	43.33	79.27
VERB	105	385	170	21.43	38.18	23.49
VERB:FORM	115	81	86	58.67	57.21	58.38
VERB:INFL	8	0	2	100.00	80.00	95.24
VERB:SVA	79	44	64	64.23	55.24	62.20
VERB:TENSE	96	179	172	34.91	35.82	35.09
WO	11	8	67	57.89	14.10	35.71

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	5	0.00	0.00	0.00
M:ADV	0	5	14	0.00	0.00	0.00
M:CONJ	0	7	13	0.00	0.00	0.00
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	49	83	195	37.12	20.08	31.74
M:NOUN	4	6	10	40.00	28.57	37.04
M:NOUN:POSS	0	2	15	0.00	0.00	0.00
M:OTHER	7	19	41	26.92	14.58	23.03
M:PART	1	1	3	50.00	25.00	41.67
M:PREP	11	17	87	39.29	11.22	26.19
M:PRON	13	14	48	48.15	21.31	38.46
M:PUNCT	277	71	288	79.60	49.03	70.77
M:VERB	7	8	36	46.67	16.28	33.98
M:VERB:FORM	11	3	5	78.57	68.75	76.39
M:VERB:TENSE	10	10	28	50.00	26.32	42.37
R:ADJ	20	79	26	20.20	43.48	22.62
R:ADJ:FORM	2	9	5	18.18	28.57	19.61
R:ADV	11	15	21	42.31	34.38	40.44
R:CONJ	0	1	6	0.00	0.00	0.00
R:CONTR	3	5	0	37.50	100.00	42.86
R:DET	29	58	84	33.33	25.66	31.45
R:MORPH	86	30	81	74.14	51.50	68.15
R:NOUN	71	1120	72	5.96	49.65	7.23
R:NOUN:INFL	8	0	11	100.00	42.11	78.43
R:NOUN:NUM	146	115	120	55.94	54.89	55.73
R:NOUN:POSS	13	3	12	81.25	52.00	73.03
R:ORTH	300	69	186	81.30	61.73	76.45
R:OTHER	222	3555	540	5.88	29.13	6.99
R:PART	6	8	13	42.86	31.58	40.00
R:PREP	133	152	154	46.67	46.34	46.60
R:PRON	6	6	34	50.00	15.00	34.09
R:PUNCT	62	66	73	48.44	45.93	47.91
R:SPELL	165	11	149	93.75	52.55	81.04
R:VERB	89	267	113	25.00	44.06	27.37
R:VERB:FORM	102	71	75	58.96	57.63	58.69
R:VERB:INFL	8	0	2	100.00	80.00	95.24
R:VERB:SVA	79	44	64	64.23	55.24	62.20
R:VERB:TENSE	77	158	128	32.77	37.56	33.62
R:WO	11	8	67	57.89	14.10	35.71
U:ADJ	2	113	4	1.74	33.33	2.15
U:ADV	4	32	11	11.11	26.67	12.58
U:CONJ	0	18	5	0.00	0.00	0.00
U:CONTR	1	1	3	50.00	25.00	41.67
U:DET	59	75	139	44.03	29.80	40.19
U:NOUN	9	209	10	4.13	47.37	5.05
U:NOUN:POSS	1	6	10	14.29	9.09	12.82
U:OTHER	7	127	21	5.22	25.00	6.21
U:PART	1	1	4	50.00	20.00	38.46
U:PREP	23	53	49	30.26	31.94	30.59
U:PRON	10	13	16	43.48	38.46	42.37
U:PUNCT	37	97	44	27.61	45.68	29.98
U:VERB	9	110	21	7.56	30.00	8.89
U:VERB:FORM	2	7	6	22.22	25.00	22.73
U:VERB:TENSE	9	11	16	45.00	36.00	42.86
UNK	39	0	51	100.00	43.33	79.27

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	896	183	756	83.04	54.24	75.07
R	3265	7467	2515	30.42	56.49	33.52
U	303	1101	483	21.58	38.55	23.66
UNK	125	0	138	100.00	47.53	81.91

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	41	188	30	17.90	57.75	20.77
ADJ:FORM	7	9	11	43.75	38.89	42.68
ADV	26	45	55	36.62	32.10	35.62
CONJ	23	17	24	57.50	48.94	55.56
CONTR	4	6	9	40.00	30.77	37.74
DET	257	180	414	58.81	38.30	53.12
MORPH	119	26	61	82.07	66.11	78.29
NOUN	171	1395	102	10.92	62.64	13.08
NOUN:INFL	17	0	2	100.00	89.47	97.70
NOUN:NUM	225	104	88	68.39	71.88	69.06
NOUN:POSS	36	7	34	83.72	51.43	74.38
ORTH	570	59	139	90.62	80.39	88.37
OTHER	921	5600	1217	14.12	43.08	16.32
PART	11	7	20	61.11	35.48	53.40
PREP	250	197	287	55.93	46.55	53.76
PRON	56	24	97	70.00	36.60	59.20
PUNCT	707	221	438	76.19	61.75	72.78
SPELL	324	9	0	97.30	100.00	97.83
UNK	125	0	138	100.00	47.53	81.91
VERB	178	375	191	32.19	48.24	34.48
VERB:FORM	139	65	82	68.14	62.90	67.02
VERB:INFL	8	0	1	100.00	88.89	97.56
VERB:SVA	98	37	59	72.59	62.42	70.30
VERB:TENSE	175	171	212	50.58	45.22	49.41
WO	101	9	181	91.82	35.82	69.94

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	2	5	60.00	37.50	53.57
M:ADV	8	5	17	61.54	32.00	51.95
M:CONJ	19	0	13	100.00	59.38	87.96
M:DET	144	60	168	70.59	46.15	63.83
M:NOUN	11	5	17	68.75	39.29	59.78
M:NOUN:POSS	6	2	12	75.00	33.33	60.00
M:OTHER	25	15	50	62.50	33.33	53.19
M:PART	1	1	4	50.00	20.00	38.46
M:PREP	42	14	73	75.00	36.52	61.95
M:PRON	32	9	44	78.05	42.11	66.67
M:PUNCT	531	57	279	90.31	65.56	83.97
M:VERB	21	6	41	77.78	33.87	61.76
M:VERB:FORM	14	2	5	87.50	73.68	84.34
M:VERB:TENSE	39	5	28	88.64	58.21	80.25
R:ADJ	36	79	22	31.30	62.07	34.75
R:ADJ:FORM	7	9	11	43.75	38.89	42.68
R:ADV	10	12	22	45.45	31.25	41.67
R:CONJ	2	1	5	66.67	28.57	52.63
R:CONTR	3	5	4	37.50	42.86	38.46
R:DET	35	53	95	39.77	26.92	36.31
R:MORPH	119	26	61	82.07	66.11	78.29
R:NOUN	140	1181	70	10.60	66.67	12.74
R:NOUN:INFL	17	0	2	100.00	89.47	97.70
R:NOUN:NUM	225	104	88	68.39	71.88	69.06
R:NOUN:POSS	26	3	8	89.66	76.47	86.67
R:ORTH	570	59	139	90.62	80.39	88.37
R:OTHER	855	5181	1065	14.17	44.53	16.40
R:PART	7	5	13	58.33	35.00	51.47
R:PREP	170	138	164	55.19	50.90	54.28
R:PRON	14	6	37	70.00	27.45	53.44
R:PUNCT	108	73	103	59.67	51.18	57.75
R:SPELL	324	9	0	97.30	100.00	97.83
R:VERB	146	264	121	35.61	54.68	38.28
R:VERB:FORM	123	56	73	68.72	62.76	67.43
R:VERB:INFL	8	0	1	100.00	88.89	97.56
R:VERB:SVA	98	37	59	72.59	62.42	70.30
R:VERB:TENSE	121	157	171	43.53	41.44	43.09
R:WO	101	9	181	91.82	35.82	69.94
U:ADJ	2	107	3	1.83	40.00	2.27
U:ADV	8	28	16	22.22	33.33	23.81
U:CONJ	2	16	6	11.11	25.00	12.50
U:CONTR	1	1	5	50.00	16.67	35.71
U:DET	78	67	151	53.79	34.06	48.21
U:NOUN	20	209	15	8.73	57.14	10.52
U:NOUN:POSS	4	2	14	66.67	22.22	47.62
U:OTHER	41	404	102	9.21	28.67	10.66
U:PART	3	1	3	75.00	50.00	68.18
U:PREP	38	45	50	45.78	43.18	45.24
U:PRON	10	9	16	52.63	38.46	49.02
U:PUNCT	68	91	56	42.77	54.84	44.74
U:VERB	11	105	29	9.48	27.50	10.91
U:VERB:FORM	2	7	4	22.22	33.33	23.81
U:VERB:TENSE	15	9	13	62.50	53.57	60.48
UNK	125	0	138	100.00	47.53	81.91

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	483	1861	1598	20.61	23.21	21.08
Span-level detection	947	1397	1453	40.40	39.46	40.21
Token-level detection	1780	1420	1677	55.63	51.49	54.75

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	115	108	322	51.57	26.32	43.27
R	311	1512	1122	17.06	21.70	17.82
U	57	241	154	19.13	27.01	20.31

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	32	7	3.03	12.50	3.57
ADJ:FORM	1	2	2	33.33	33.33	33.33
ADV	3	16	19	15.79	13.64	15.31
CONJ	0	5	5	0.00	0.00	0.00
CONTR	3	1	1	75.00	75.00	75.00
DET	58	68	171	46.03	25.33	39.56
MORPH	12	6	61	66.67	16.44	41.38
NOUN	6	367	47	1.61	11.32	1.94
NOUN:INFL	0	0	6	100.00	0.00	0.00
NOUN:NUM	42	47	81	47.19	34.15	43.84
NOUN:POSS	2	4	8	33.33	20.00	29.41
ORTH	79	26	113	75.24	41.15	64.54
OTHER	11	871	368	1.25	2.90	1.41
PART	5	4	8	55.56	38.46	51.02
PREP	48	85	114	36.09	29.63	34.58
PRON	11	16	50	40.74	18.03	32.54
PUNCT	102	75	146	57.63	41.13	53.35
SPELL	2	8	97	20.00	2.02	7.19
VERB	6	110	83	5.17	6.74	5.42
VERB:FORM	49	34	47	59.04	51.04	57.24
VERB:INFL	1	0	3	100.00	25.00	62.50
VERB:SVA	23	15	43	60.53	34.85	52.75
VERB:TENSE	15	64	100	18.99	13.04	17.40
WO	3	5	18	37.50	14.29	28.30

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	2	4	0.00	0.00	0.00
M:CONJ	0	3	1	0.00	0.00	0.00
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	22	30	67	42.31	24.72	37.04
M:NOUN	0	0	3	100.00	0.00	0.00
M:NOUN:POSS	0	1	3	0.00	0.00	0.00
M:OTHER	0	9	26	0.00	0.00	0.00
M:PART	0	1	2	0.00	0.00	0.00
M:PREP	3	7	38	30.00	7.32	18.52
M:PRON	7	8	24	46.67	22.58	38.46
M:PUNCT	74	33	111	69.16	40.00	60.36
M:VERB	1	6	19	14.29	5.00	10.42
M:VERB:FORM	6	2	5	75.00	54.55	69.77
M:VERB:TENSE	2	5	18	28.57	10.00	20.83
R:ADJ	0	14	5	0.00	0.00	0.00
R:ADJ:FORM	1	2	2	33.33	33.33	33.33
R:ADV	2	6	8	25.00	20.00	23.81
R:CONJ	0	1	1	0.00	0.00	0.00
R:CONTR	2	0	0	100.00	100.00	100.00
R:DET	10	19	33	34.48	23.26	31.45
R:MORPH	12	6	61	66.67	16.44	41.38
R:NOUN	3	294	37	1.01	7.50	1.22
R:NOUN:INFL	0	0	6	100.00	0.00	0.00
R:NOUN:NUM	42	47	81	47.19	34.15	43.84
R:NOUN:POSS	1	0	2	100.00	33.33	71.43
R:ORTH	79	26	113	75.24	41.15	64.54
R:OTHER	11	833	335	1.30	3.18	1.48
R:PART	4	2	5	66.67	44.44	60.61
R:PREP	37	66	57	35.92	39.36	36.56
R:PRON	0	2	19	0.00	0.00	0.00
R:PUNCT	20	17	23	54.05	46.51	52.36
R:SPELL	2	8	97	20.00	2.02	7.19
R:VERB	2	65	58	2.99	3.33	3.05
R:VERB:FORM	43	32	40	57.33	51.81	56.14
R:VERB:INFL	1	0	3	100.00	25.00	62.50
R:VERB:SVA	23	15	43	60.53	34.85	52.75
R:VERB:TENSE	13	52	75	20.00	14.77	18.68
R:WO	3	5	18	37.50	14.29	28.30
U:ADJ	1	18	1	5.26	50.00	6.41
U:ADV	1	8	7	11.11	12.50	11.36
U:CONJ	0	1	3	0.00	0.00	0.00
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	26	19	71	57.78	26.80	46.93
U:NOUN	3	73	7	3.95	30.00	4.78
U:NOUN:POSS	1	3	3	25.00	25.00	25.00
U:OTHER	0	29	7	0.00	0.00	0.00
U:PART	1	1	1	50.00	50.00	50.00
U:PREP	8	12	19	40.00	29.63	37.38
U:PRON	4	6	7	40.00	36.36	39.22
U:PUNCT	8	25	12	24.24	40.00	26.32
U:VERB	3	39	6	7.14	33.33	8.47
U:VERB:FORM	0	0	2	100.00	0.00	0.00
U:VERB:TENSE	0	7	7	0.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	133	91	321	59.38	29.30	49.26
R	726	1127	931	39.18	43.81	40.03
U	68	179	162	27.53	29.57	27.91
UNK	20	0	39	100.00	33.90	71.94

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	21	14	12.50	17.65	13.27
ADJ:FORM	1	2	2	33.33	33.33	33.33
ADV	6	9	24	40.00	20.00	33.33
CONJ	0	4	10	0.00	0.00	0.00
CONTR	1	2	1	33.33	50.00	35.71
DET	69	56	172	55.20	28.63	46.56
MORPH	44	1	48	97.78	47.83	80.88
NOUN	27	251	35	9.71	43.55	11.50
NOUN:INFL	1	0	5	100.00	16.67	50.00
NOUN:NUM	73	39	61	65.18	54.48	62.71
NOUN:POSS	5	4	8	55.56	38.46	51.02
ORTH	139	22	75	86.34	64.95	81.00
OTHER	121	680	309	15.11	28.14	16.65
PART	5	3	6	62.50	45.45	58.14
PREP	61	63	125	49.19	32.80	44.72
PRON	18	14	49	56.25	26.87	46.15
PUNCT	110	68	155	61.80	41.51	56.29
SPELL	69	5	40	93.24	63.30	85.19
UNK	20	0	39	100.00	33.90	71.94
VERB	37	61	87	37.76	29.84	35.85
VERB:FORM	59	30	37	66.29	61.46	65.27
VERB:INFL	5	0	1	100.00	83.33	96.15
VERB:SVA	39	12	37	76.47	51.32	69.64
VERB:TENSE	31	47	91	39.74	25.41	35.71
WO	3	3	22	50.00	12.00	30.61

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	0	2	8	0.00	0.00	0.00
M:CONJ	0	2	5	0.00	0.00	0.00
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	25	26	65	49.02	27.78	42.52
M:NOUN	1	0	3	100.00	25.00	62.50
M:NOUN:POSS	0	1	4	0.00	0.00	0.00
M:OTHER	4	7	20	36.36	16.67	29.41
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	4	6	42	40.00	8.70	23.26
M:PRON	8	7	23	53.33	25.81	43.96
M:PUNCT	77	27	114	74.04	40.31	63.43
M:VERB	3	4	19	42.86	13.64	30.00
M:VERB:FORM	8	2	4	80.00	66.67	76.92
M:VERB:TENSE	3	5	12	37.50	20.00	31.91
R:ADJ	2	10	11	16.67	15.38	16.39
R:ADJ:FORM	1	2	2	33.33	33.33	33.33
R:ADV	4	2	11	66.67	26.67	51.28
R:CONJ	0	1	0	0.00	100.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	16	15	36	51.61	30.77	45.45
R:MORPH	44	1	48	97.78	47.83	80.88
R:NOUN	24	196	28	10.91	46.15	12.88
R:NOUN:INFL	1	0	5	100.00	16.67	50.00
R:NOUN:NUM	73	39	61	65.18	54.48	62.71
R:NOUN:POSS	4	0	1	100.00	80.00	95.24
R:ORTH	139	22	75	86.34	64.95	81.00
R:OTHER	115	649	280	15.05	29.11	16.66
R:PART	4	1	4	80.00	50.00	71.43
R:PREP	48	49	64	49.48	42.86	48.00
R:PRON	5	1	17	83.33	22.73	54.35
R:PUNCT	24	15	25	61.54	48.98	58.54
R:SPELL	69	5	40	93.24	63.30	85.19
R:VERB	30	38	58	44.12	34.09	41.67
R:VERB:FORM	51	28	31	64.56	62.20	64.07
R:VERB:INFL	5	0	1	100.00	83.33	96.15
R:VERB:SVA	39	12	37	76.47	51.32	69.64
R:VERB:TENSE	24	38	74	38.71	24.49	34.68
R:WO	3	3	22	50.00	12.00	30.61
U:ADJ	1	11	1	8.33	50.00	10.00
U:ADV	2	5	5	28.57	28.57	28.57
U:CONJ	0	1	5	0.00	0.00	0.00
U:CONTR	0	1	1	0.00	0.00	0.00
U:DET	28	15	71	65.12	28.28	51.66
U:NOUN	2	55	4	3.51	33.33	4.27
U:NOUN:POSS	1	3	3	25.00	25.00	25.00
U:OTHER	2	24	9	7.69	18.18	8.70
U:PART	1	1	2	50.00	33.33	45.45
U:PREP	9	8	19	52.94	32.14	46.88
U:PRON	5	6	9	45.45	35.71	43.10
U:PUNCT	9	26	16	25.71	36.00	27.27
U:VERB	4	19	10	17.39	28.57	18.87
U:VERB:FORM	0	0	2	100.00	0.00	0.00
U:VERB:TENSE	4	4	5	50.00	44.44	48.78
UNK	20	0	39	100.00	33.90	71.94

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	313	51	325	85.99	49.06	74.74
R	1281	1185	1059	51.95	54.74	52.48
U	126	184	212	40.65	37.28	39.92
UNK	60	0	81	100.00	42.55	78.74

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	8	13	13	38.10	38.10	38.10
ADJ:FORM	3	2	4	60.00	42.86	55.56
ADV	12	8	24	60.00	33.33	51.72
CONJ	7	2	10	77.78	41.18	66.04
CONTR	1	1	3	50.00	25.00	41.67
DET	127	41	172	75.60	42.47	65.40
MORPH	61	0	34	100.00	64.21	89.97
NOUN	50	235	51	17.54	49.50	20.15
NOUN:INFL	4	0	2	100.00	66.67	90.91
NOUN:NUM	101	36	41	73.72	71.13	73.19
NOUN:POSS	12	0	12	100.00	50.00	83.33
ORTH	210	17	32	92.51	86.78	91.30
OTHER	400	834	531	32.41	42.96	34.09
PART	6	2	10	75.00	37.50	62.50
PREP	89	51	122	63.57	42.18	57.72
PRON	29	7	49	80.56	37.18	65.32
PUNCT	201	50	175	80.08	53.46	72.83
SPELL	110	4	0	96.49	100.00	97.17
UNK	60	0	81	100.00	42.55	78.74
VERB	65	50	89	56.52	42.21	52.93
VERB:FORM	66	19	34	77.65	66.00	75.00
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	51	7	32	87.93	61.45	80.95
VERB:TENSE	66	39	108	62.86	37.93	55.56
WO	37	2	47	94.87	44.05	77.08

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	0	1	100.00	66.67	90.91
M:ADV	4	2	6	66.67	40.00	58.82
M:CONJ	7	0	4	100.00	63.64	89.74
M:DET	69	15	64	82.14	51.88	73.56
M:NOUN	3	0	8	100.00	27.27	65.22
M:NOUN:POSS	1	0	3	100.00	25.00	62.50
M:OTHER	13	5	26	72.22	33.33	58.56
M:PART	0	1	1	0.00	0.00	0.00
M:PREP	20	2	34	90.91	37.04	70.42
M:PRON	17	3	21	85.00	44.74	72.03
M:PUNCT	143	18	119	88.82	54.58	78.92
M:VERB	10	3	21	76.92	32.26	60.24
M:VERB:FORM	9	1	4	90.00	69.23	84.91
M:VERB:TENSE	15	1	13	93.75	53.57	81.52
R:ADJ	5	6	10	45.45	33.33	42.37
R:ADJ:FORM	3	2	4	60.00	42.86	55.56
R:ADV	4	2	9	66.67	30.77	54.05
R:CONJ	0	1	1	0.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	16	14	36	53.33	30.77	46.51
R:MORPH	61	0	34	100.00	64.21	89.97
R:NOUN	42	188	33	18.26	56.00	21.11
R:NOUN:INFL	4	0	2	100.00	66.67	90.91
R:NOUN:NUM	101	36	41	73.72	71.13	73.19
R:NOUN:POSS	9	0	1	100.00	90.00	97.83
R:ORTH	210	17	32	92.51	86.78	91.30
R:OTHER	366	767	467	32.30	43.94	34.11
R:PART	5	0	7	100.00	41.67	78.12
R:PREP	55	42	68	56.70	44.72	53.82
R:PRON	6	1	19	85.71	24.00	56.60
R:PUNCT	39	12	36	76.47	52.00	69.89
R:SPELL	110	4	0	96.49	100.00	97.17
R:VERB	50	32	58	60.98	46.30	57.34
R:VERB:FORM	57	18	29	76.00	66.28	73.83
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	51	7	32	87.93	61.45	80.95
R:VERB:TENSE	45	34	92	56.96	32.85	49.67
R:WO	37	2	47	94.87	44.05	77.08
U:ADJ	1	7	2	12.50	33.33	14.29
U:ADV	4	4	9	50.00	30.77	44.44
U:CONJ	0	1	5	0.00	0.00	0.00
U:CONTR	0	1	3	0.00	0.00	0.00
U:DET	42	12	72	77.78	36.84	63.64
U:NOUN	5	47	10	9.62	33.33	11.21
U:NOUN:POSS	2	0	8	100.00	20.00	55.56
U:OTHER	21	62	38	25.30	35.59	26.85
U:PART	1	1	2	50.00	33.33	45.45
U:PREP	14	7	20	66.67	41.18	59.32
U:PRON	6	3	9	66.67	40.00	58.82
U:PUNCT	19	20	20	48.72	48.72	48.72
U:VERB	5	15	10	25.00	33.33	26.32
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	6	4	3	60.00	66.67	61.22
UNK	60	0	81	100.00	42.55	78.74

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	378	2157	1127	14.91	25.12	16.23
Span-level detection	674	1861	1062	26.59	38.82	28.38
Token-level detection	1389	2309	1311	37.56	51.44	39.70

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	118	85	269	58.13	30.49	49.21
R	221	1806	744	10.90	22.90	12.18
U	39	266	114	12.79	25.49	14.20

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	60	12	3.23	14.29	3.82
ADJ:FORM	0	6	2	0.00	0.00	0.00
ADV	2	20	14	9.09	12.50	9.62
CONJ	0	12	9	0.00	0.00	0.00
CONTR	1	1	1	50.00	50.00	50.00
DET	35	71	149	33.02	19.02	28.78
MORPH	7	6	30	53.85	18.92	39.33
NOUN	6	468	36	1.27	14.29	1.55
NOUN:NUM	31	32	37	49.21	45.59	48.44
NOUN:POSS	0	2	12	0.00	0.00	0.00
ORTH	20	24	55	45.45	26.67	39.84
OTHER	9	1026	220	0.87	3.93	1.03
PART	0	4	8	0.00	0.00	0.00
PREP	46	87	105	34.59	30.46	33.67
PRON	4	11	34	26.67	10.53	20.41
PUNCT	123	85	111	59.13	52.56	57.69
SPELL	1	5	62	16.67	1.59	5.75
VERB	11	132	74	7.69	12.94	8.37
VERB:FORM	27	25	37	51.92	42.19	49.63
VERB:SVA	23	12	24	65.71	48.94	61.50
VERB:TENSE	27	65	62	29.35	30.34	29.54
WO	3	3	33	50.00	8.33	25.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	1	0.00	0.00	0.00
M:ADV	0	1	5	0.00	0.00	0.00
M:CONJ	0	2	6	0.00	0.00	0.00
M:DET	11	27	86	28.95	11.34	22.09
M:NOUN	0	1	3	0.00	0.00	0.00
M:NOUN:POSS	0	1	5	0.00	0.00	0.00
M:OTHER	0	6	14	0.00	0.00	0.00
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	2	9	25	18.18	7.41	14.08
M:PRON	3	3	18	50.00	14.29	33.33
M:PUNCT	96	26	80	78.69	54.55	72.29
M:VERB	2	2	11	50.00	15.38	34.48
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	3	5	13	37.50	18.75	31.25
R:ADJ	2	22	9	8.33	18.18	9.35
R:ADJ:FORM	0	6	2	0.00	0.00	0.00
R:ADV	1	7	6	12.50	14.29	12.82
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	10	24	31	29.41	24.39	28.25
R:MORPH	7	6	30	53.85	18.92	39.33
R:NOUN	6	403	30	1.47	16.67	1.79
R:NOUN:NUM	31	32	37	49.21	45.59	48.44
R:NOUN:POSS	0	1	2	0.00	0.00	0.00
R:ORTH	20	24	55	45.45	26.67	39.84
R:OTHER	8	987	194	0.80	3.96	0.96
R:PART	0	4	5	0.00	0.00	0.00
R:PREP	36	59	57	37.89	38.71	38.05
R:PRON	0	5	11	0.00	0.00	0.00
R:PUNCT	17	28	23	37.78	42.50	38.64
R:SPELL	1	5	62	16.67	1.59	5.75
R:VERB	7	97	54	6.73	11.48	7.34
R:VERB:FORM	25	22	35	53.19	41.67	50.40
R:VERB:SVA	23	12	24	65.71	48.94	61.50
R:VERB:TENSE	23	58	42	28.40	35.38	29.56
R:WO	3	3	33	50.00	8.33	25.00
U:ADJ	0	36	2	0.00	0.00	0.00
U:ADV	1	12	3	7.69	25.00	8.93
U:CONJ	0	10	1	0.00	0.00	0.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	14	20	32	41.18	30.43	38.46
U:NOUN	0	64	3	0.00	0.00	0.00
U:NOUN:POSS	0	0	5	100.00	0.00	0.00
U:OTHER	1	33	12	2.94	7.69	3.36
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	8	19	23	29.63	25.81	28.78
U:PRON	1	3	5	25.00	16.67	22.73
U:PUNCT	10	31	8	24.39	55.56	27.47
U:VERB	2	33	9	5.71	18.18	6.62
U:VERB:FORM	1	3	2	25.00	33.33	26.32
U:VERB:TENSE	1	2	7	33.33	12.50	25.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	132	74	285	64.08	31.65	53.18
R	479	1561	653	23.48	42.31	25.77
U	52	226	117	18.71	30.77	20.30
UNK	11	0	7	100.00	61.11	88.71

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	9	51	12	15.00	42.86	17.24
ADJ:FORM	1	4	2	20.00	33.33	21.74
ADV	4	18	17	18.18	19.05	18.35
CONJ	0	12	9	0.00	0.00	0.00
CONTR	1	1	1	50.00	50.00	50.00
DET	41	67	160	37.96	20.40	32.39
MORPH	21	6	17	77.78	55.26	71.92
NOUN	37	395	32	8.56	53.62	10.29
NOUN:NUM	39	28	36	58.21	52.00	56.85
NOUN:POSS	1	2	12	33.33	7.69	20.00
ORTH	59	20	43	74.68	57.84	70.57
OTHER	60	926	195	6.09	23.53	7.14
PART	1	4	9	20.00	10.00	16.67
PREP	65	65	106	50.00	38.01	47.03
PRON	6	9	37	40.00	13.95	29.13
PUNCT	131	73	126	64.22	50.97	61.04
SPELL	39	5	30	88.64	56.52	79.59
UNK	11	0	7	100.00	61.11	88.71
VERB	44	91	68	32.59	39.29	33.74
VERB:FORM	33	18	36	64.71	47.83	60.44
VERB:SVA	31	10	18	75.61	63.27	72.77
VERB:TENSE	36	53	54	40.45	40.00	40.36
WO	4	3	35	57.14	10.26	29.85

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	1	0.00	0.00	0.00
M:ADV	0	1	5	0.00	0.00	0.00
M:CONJ	0	2	5	0.00	0.00	0.00
M:DET	15	26	92	36.59	14.02	27.68
M:NOUN	1	1	2	50.00	33.33	45.45
M:NOUN:POSS	0	1	5	0.00	0.00	0.00
M:OTHER	3	5	13	37.50	18.75	31.25
M:PART	1	0	2	100.00	33.33	71.43
M:PREP	3	7	27	30.00	10.00	21.43
M:PRON	3	3	19	50.00	13.64	32.61
M:PUNCT	98	21	91	82.35	51.85	73.68
M:VERB	3	2	11	60.00	21.43	44.12
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	4	3	12	57.14	25.00	45.45
R:ADJ	8	18	9	30.77	47.06	33.06
R:ADJ:FORM	1	4	2	20.00	33.33	21.74
R:ADV	4	7	7	36.36	36.36	36.36
R:CONJ	0	0	4	100.00	0.00	0.00
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	12	24	32	33.33	27.27	31.91
R:MORPH	21	6	17	77.78	55.26	71.92
R:NOUN	32	337	26	8.67	55.17	10.43
R:NOUN:NUM	39	28	36	58.21	52.00	56.85
R:NOUN:POSS	1	1	2	50.00	33.33	45.45
R:ORTH	59	20	43	74.68	57.84	70.57
R:OTHER	53	890	173	5.62	23.45	6.63
R:PART	0	4	6	0.00	0.00	0.00
R:PREP	51	43	59	54.26	46.36	52.47
R:PRON	0	4	12	0.00	0.00	0.00
R:PUNCT	23	27	24	46.00	48.94	46.56
R:SPELL	39	5	30	88.64	56.52	79.59
R:VERB	38	66	48	36.54	44.19	37.85
R:VERB:FORM	31	15	34	67.39	47.69	62.25
R:VERB:SVA	31	10	18	75.61	63.27	72.77
R:VERB:TENSE	31	48	36	39.24	46.27	40.47
R:WO	4	3	35	57.14	10.26	29.85
U:ADJ	1	31	2	3.12	33.33	3.82
U:ADV	0	10	5	0.00	0.00	0.00
U:CONJ	0	10	0	0.00	100.00	0.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	14	17	36	45.16	28.00	40.23
U:NOUN	4	57	4	6.56	50.00	7.94
U:NOUN:POSS	0	0	5	100.00	0.00	0.00
U:OTHER	4	31	9	11.43	30.77	13.07
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	11	15	20	42.31	35.48	40.74
U:PRON	3	2	6	60.00	33.33	51.72
U:PUNCT	10	25	11	28.57	47.62	31.06
U:VERB	3	23	9	11.54	25.00	12.93
U:VERB:FORM	1	3	2	25.00	33.33	26.32
U:VERB:TENSE	1	2	6	33.33	14.29	26.32
UNK	11	0	7	100.00	61.11	88.71

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	281	56	253	83.38	52.62	74.65
R	994	1931	881	33.98	53.01	36.61
U	85	322	161	20.88	34.55	22.68
UNK	29	0	16	100.00	64.44	90.06

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	16	48	10	25.00	61.54	28.37
ADJ:FORM	1	4	2	20.00	33.33	21.74
ADV	7	13	21	35.00	25.00	32.41
CONJ	11	8	7	57.89	61.11	58.51
CONTR	1	1	2	50.00	33.33	45.45
DET	76	52	155	59.38	32.90	51.14
MORPH	25	5	14	83.33	64.10	78.62
NOUN	65	400	27	13.98	70.65	16.65
NOUN:NUM	57	24	32	70.37	64.04	69.01
NOUN:POSS	5	2	9	71.43	35.71	59.52
ORTH	139	17	45	89.10	75.54	86.01
OTHER	307	1422	444	17.76	40.88	20.02
PART	2	3	7	40.00	22.22	34.48
PREP	93	58	101	61.59	47.94	58.27
PRON	15	7	38	68.18	28.30	53.19
PUNCT	224	77	119	74.42	65.31	72.40
SPELL	75	4	0	94.94	100.00	95.91
UNK	29	0	16	100.00	64.44	90.06
VERB	71	88	76	44.65	48.30	45.34
VERB:FORM	43	16	33	72.88	56.58	68.91
VERB:SVA	34	10	15	77.27	69.39	75.56
VERB:TENSE	61	46	66	57.01	48.03	54.95
WO	32	4	72	88.89	30.77	64.52

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	2	2	33.33	33.33	33.33
M:ADV	2	1	9	66.67	18.18	43.48
M:CONJ	8	0	5	100.00	61.54	88.89
M:DET	46	17	73	73.02	38.66	61.99
M:NOUN	3	1	4	75.00	42.86	65.22
M:NOUN:POSS	3	1	4	75.00	42.86	65.22
M:OTHER	7	3	12	70.00	36.84	59.32
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	12	7	23	63.16	34.29	54.05
M:PRON	9	2	17	81.82	34.62	64.29
M:PUNCT	167	18	79	90.27	67.89	84.69
M:VERB	9	2	13	81.82	40.91	68.18
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	12	2	11	85.71	52.17	75.95
R:ADJ	15	18	8	45.45	65.22	48.39
R:ADJ:FORM	1	4	2	20.00	33.33	21.74
R:ADV	4	3	8	57.14	33.33	50.00
R:CONJ	2	0	2	100.00	50.00	83.33
R:CONTR	1	1	1	50.00	50.00	50.00
R:DET	15	22	36	40.54	29.41	37.69
R:MORPH	25	5	14	83.33	64.10	78.62
R:NOUN	54	340	20	13.71	72.97	16.36
R:NOUN:NUM	57	24	32	70.37	64.04	69.01
R:NOUN:POSS	0	1	2	0.00	0.00	0.00
R:ORTH	139	17	45	89.10	75.54	86.01
R:OTHER	287	1281	388	18.30	42.52	20.66
R:PART	0	3	5	0.00	0.00	0.00
R:PREP	67	39	60	63.21	52.76	60.80
R:PRON	4	4	15	50.00	21.05	39.22
R:PUNCT	38	31	29	55.07	56.72	55.39
R:SPELL	75	4	0	94.94	100.00	95.91
R:VERB	58	64	47	47.54	55.24	48.90
R:VERB:FORM	40	13	32	75.47	55.56	70.42
R:VERB:SVA	34	10	15	77.27	69.39	75.56
R:VERB:TENSE	46	43	48	51.69	48.94	51.11
R:WO	32	4	72	88.89	30.77	64.52
U:ADJ	0	28	0	0.00	100.00	0.00
U:ADV	1	9	4	10.00	20.00	11.11
U:CONJ	1	8	0	11.11	100.00	13.51
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	15	13	46	53.57	24.59	43.35
U:NOUN	8	59	3	11.94	72.73	14.34
U:NOUN:POSS	2	0	3	100.00	40.00	76.92
U:OTHER	13	138	44	8.61	22.81	9.83
U:PART	2	0	1	100.00	66.67	90.91
U:PREP	14	12	18	53.85	43.75	51.47
U:PRON	2	1	6	66.67	25.00	50.00
U:PUNCT	19	28	11	40.43	63.33	43.58
U:VERB	4	22	16	15.38	20.00	16.13
U:VERB:FORM	1	3	1	25.00	50.00	27.78
U:VERB:TENSE	3	1	7	75.00	30.00	57.69
UNK	29	0	16	100.00	64.44	90.06

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	203	1673	405	10.82	33.39	12.51
Span-level detection	348	1529	390	18.54	47.15	21.10
Token-level detection	694	1925	515	26.50	57.40	29.70

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	65	51	97	56.03	40.12	51.92
R	108	1398	257	7.17	29.59	8.45
U	30	224	51	11.81	37.04	13.67

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	64	6	0.00	0.00	0.00
ADJ:FORM	0	1	1	0.00	0.00	0.00
ADV	3	14	3	17.65	50.00	20.27
CONJ	0	5	2	0.00	0.00	0.00
CONTR	2	3	1	40.00	66.67	43.48
DET	18	46	69	28.12	20.69	26.24
MORPH	3	11	16	21.43	15.79	20.00
NOUN	1	325	12	0.31	7.69	0.38
NOUN:INFL	0	0	1	100.00	0.00	0.00
NOUN:NUM	16	22	20	42.11	44.44	42.55
NOUN:POSS	0	5	6	0.00	0.00	0.00
ORTH	22	11	26	66.67	45.83	61.11
OTHER	5	862	56	0.58	8.20	0.71
PART	1	2	2	33.33	33.33	33.33
PREP	28	49	39	36.36	41.79	37.33
PRON	3	7	8	30.00	27.27	29.41
PUNCT	74	58	37	56.06	66.67	57.90
SPELL	0	0	36	100.00	0.00	0.00
VERB	0	107	12	0.00	0.00	0.00
VERB:FORM	10	22	12	31.25	45.45	33.33
VERB:SVA	1	9	9	10.00	10.00	10.00
VERB:TENSE	14	49	21	22.22	40.00	24.39
WO	2	1	10	66.67	16.67	41.67

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	1	0	0	100.00	100.00	100.00
M:CONJ	0	2	1	0.00	0.00	0.00
M:DET	7	16	33	30.43	17.50	26.52
M:NOUN	0	2	3	0.00	0.00	0.00
M:NOUN:POSS	0	1	0	0.00	100.00	0.00
M:OTHER	0	5	4	0.00	0.00	0.00
M:PREP	2	3	14	40.00	12.50	27.78
M:PRON	0	2	5	0.00	0.00	0.00
M:PUNCT	52	15	31	77.61	62.65	74.07
M:VERB	0	2	2	0.00	0.00	0.00
M:VERB:FORM	2	1	1	66.67	66.67	66.67
M:VERB:TENSE	1	2	2	33.33	33.33	33.33
R:ADJ	0	26	4	0.00	0.00	0.00
R:ADJ:FORM	0	1	1	0.00	0.00	0.00
R:ADV	0	4	2	0.00	0.00	0.00
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	3	0	25.00	100.00	29.41
R:DET	1	10	11	9.09	8.33	8.93
R:MORPH	3	11	16	21.43	15.79	20.00
R:NOUN	1	278	8	0.36	11.11	0.44
R:NOUN:INFL	0	0	1	100.00	0.00	0.00
R:NOUN:NUM	16	22	20	42.11	44.44	42.55
R:NOUN:POSS	0	1	5	0.00	0.00	0.00
R:ORTH	22	11	26	66.67	45.83	61.11
R:OTHER	4	828	51	0.48	7.27	0.59
R:PART	1	2	2	33.33	33.33	33.33
R:PREP	26	31	16	45.61	61.90	48.15
R:PRON	1	1	2	50.00	33.33	45.45
R:PUNCT	10	15	3	40.00	76.92	44.25
R:SPELL	0	0	36	100.00	0.00	0.00
R:VERB	0	79	9	0.00	0.00	0.00
R:VERB:FORM	7	19	9	26.92	43.75	29.17
R:VERB:SVA	1	9	9	10.00	10.00	10.00
R:VERB:TENSE	12	46	15	20.69	44.44	23.17
R:WO	2	1	10	66.67	16.67	41.67
U:ADJ	0	38	1	0.00	0.00	0.00
U:ADV	2	10	1	16.67	66.67	19.61
U:CONJ	0	3	0	0.00	100.00	0.00
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	10	20	25	33.33	28.57	32.26
U:NOUN	0	45	1	0.00	0.00	0.00
U:NOUN:POSS	0	3	1	0.00	0.00	0.00
U:OTHER	1	29	1	3.33	50.00	4.10
U:PREP	0	15	9	0.00	0.00	0.00
U:PRON	2	4	1	33.33	66.67	37.04
U:PUNCT	12	28	3	30.00	80.00	34.29
U:VERB	0	26	1	0.00	0.00	0.00
U:VERB:FORM	1	2	2	33.33	33.33	33.33
U:VERB:TENSE	1	1	4	50.00	20.00	38.46

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	72	47	112	60.50	39.13	54.55
R	230	1281	218	15.22	51.34	17.71
U	41	201	56	16.94	42.27	19.25
UNK	5	0	4	100.00	55.56	86.21

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	52	6	8.77	45.45	10.46
ADJ:FORM	0	1	1	0.00	0.00	0.00
ADV	4	11	4	26.67	50.00	29.41
CONJ	0	5	4	0.00	0.00	0.00
CONTR	2	3	1	40.00	66.67	43.48
DET	20	45	71	30.77	21.98	28.49
MORPH	13	10	14	56.52	48.15	54.62
NOUN	12	280	13	4.11	48.00	5.03
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	22	20	16	52.38	57.89	53.40
NOUN:POSS	1	4	5	20.00	16.67	19.23
ORTH	43	11	19	79.63	69.35	77.34
OTHER	28	822	51	3.29	35.44	4.02
PART	2	2	4	50.00	33.33	45.45
PREP	34	43	43	44.16	44.16	44.16
PRON	4	7	7	36.36	36.36	36.36
PUNCT	78	57	48	57.78	61.90	58.56
SPELL	16	0	24	100.00	40.00	76.92
UNK	5	0	4	100.00	55.56	86.21
VERB	11	88	10	11.11	52.38	13.19
VERB:FORM	16	18	11	47.06	59.26	49.08
VERB:SVA	5	9	5	35.71	50.00	37.88
VERB:TENSE	23	40	20	36.51	53.49	38.98
WO	2	1	9	66.67	18.18	43.48

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	0	2	2	0.00	0.00	0.00
M:DET	8	15	32	34.78	20.00	30.30
M:NOUN	2	2	2	50.00	50.00	50.00
M:OTHER	0	5	8	0.00	0.00	0.00
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	3	2	16	60.00	15.79	38.46
M:PRON	1	2	4	33.33	20.00	29.41
M:PUNCT	54	15	36	78.26	60.00	73.77
M:VERB	0	1	3	0.00	0.00	0.00
M:VERB:FORM	2	1	1	66.67	66.67	66.67
M:VERB:TENSE	2	2	4	50.00	33.33	45.45
R:ADJ	5	23	3	17.86	62.50	20.83
R:ADJ:FORM	0	1	1	0.00	0.00	0.00
R:ADV	2	3	2	40.00	50.00	41.67
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	3	0	25.00	100.00	29.41
R:DET	1	10	12	9.09	7.69	8.77
R:MORPH	13	10	14	56.52	48.15	54.62
R:NOUN	7	238	9	2.86	43.75	3.51
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	22	20	16	52.38	57.89	53.40
R:NOUN:POSS	1	1	3	50.00	25.00	41.67
R:ORTH	43	11	19	79.63	69.35	77.34
R:OTHER	27	789	41	3.31	39.71	4.05
R:PART	2	2	3	50.00	40.00	47.62
R:PREP	29	27	19	51.79	60.42	53.31
R:PRON	1	1	2	50.00	33.33	45.45
R:PUNCT	11	15	7	42.31	61.11	45.08
R:SPELL	16	0	24	100.00	40.00	76.92
R:VERB	9	65	6	12.16	60.00	14.47
R:VERB:FORM	13	15	8	46.43	61.90	48.87
R:VERB:SVA	5	9	5	35.71	50.00	37.88
R:VERB:TENSE	18	37	13	32.73	58.06	35.86
R:WO	2	1	9	66.67	18.18	43.48
U:ADJ	0	29	1	0.00	0.00	0.00
U:ADV	2	8	1	20.00	66.67	23.26
U:CONJ	0	3	0	0.00	100.00	0.00
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	11	20	27	35.48	28.95	33.95
U:NOUN	3	40	2	6.98	60.00	8.47
U:NOUN:POSS	0	3	2	0.00	0.00	0.00
U:OTHER	1	28	2	3.45	33.33	4.20
U:PREP	2	14	8	12.50	20.00	13.51
U:PRON	2	4	1	33.33	66.67	37.04
U:PUNCT	13	27	5	32.50	72.22	36.52
U:VERB	2	22	1	8.33	66.67	10.10
U:VERB:FORM	1	2	2	33.33	33.33	33.33
U:VERB:TENSE	3	1	3	75.00	50.00	68.18
UNK	5	0	4	100.00	55.56	86.21

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	160	42	104	79.21	60.61	74.63
R	456	1666	298	21.49	60.48	24.67
U	56	217	74	20.51	43.08	22.91
UNK	22	0	39	100.00	36.07	73.83

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	11	52	4	17.46	73.33	20.60
ADJ:FORM	0	1	2	0.00	0.00	0.00
ADV	5	9	9	35.71	35.71	35.71
CONJ	2	3	5	40.00	28.57	37.04
CONTR	2	3	1	40.00	66.67	43.48
DET	37	40	67	48.05	35.58	44.90
MORPH	17	9	10	65.38	62.96	64.89
NOUN	32	308	15	9.41	68.09	11.37
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	40	16	11	71.43	78.43	72.73
NOUN:POSS	5	4	5	55.56	50.00	54.35
ORTH	78	10	15	88.64	83.87	87.64
OTHER	108	1206	131	8.22	45.19	9.83
PART	3	2	3	60.00	50.00	57.69
PREP	50	38	44	56.82	53.19	56.05
PRON	9	7	6	56.25	60.00	56.96
PUNCT	138	60	59	69.70	70.05	69.77
SPELL	38	0	0	100.00	100.00	100.00
UNK	22	0	39	100.00	36.07	73.83
VERB	21	87	19	19.44	52.50	22.25
VERB:FORM	17	16	10	51.52	62.96	53.46
VERB:SVA	5	7	6	41.67	45.45	42.37
VERB:TENSE	33	45	23	42.31	58.93	44.84
WO	19	2	31	90.48	38.00	70.90

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	1	0	2	100.00	33.33	71.43
M:CONJ	2	0	2	100.00	50.00	83.33
M:DET	23	13	23	63.89	50.00	60.53
M:NOUN	4	2	2	66.67	66.67	66.67
M:NOUN:POSS	1	1	0	50.00	100.00	55.56
M:OTHER	3	5	10	37.50	23.08	33.33
M:PART	1	0	2	100.00	33.33	71.43
M:PREP	7	3	13	70.00	35.00	58.33
M:PRON	4	2	5	66.67	44.44	60.61
M:PUNCT	101	13	34	88.60	74.81	85.45
M:VERB	1	0	4	100.00	20.00	55.56
M:VERB:FORM	3	1	1	75.00	75.00	75.00
M:VERB:TENSE	9	2	4	81.82	69.23	78.95
R:ADJ	10	24	2	29.41	83.33	33.78
R:ADJ:FORM	0	1	2	0.00	0.00	0.00
R:ADV	2	2	4	50.00	33.33	45.45
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	3	0	25.00	100.00	29.41
R:DET	1	8	14	11.11	6.67	9.80
R:MORPH	17	9	10	65.38	62.96	64.89
R:NOUN	23	267	11	7.93	67.65	9.63
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	40	16	11	71.43	78.43	72.73
R:NOUN:POSS	4	1	2	80.00	66.67	76.92
R:ORTH	78	10	15	88.64	83.87	87.64
R:OTHER	101	1152	114	8.06	46.98	9.66
R:PART	2	2	1	50.00	66.67	52.63
R:PREP	37	22	22	62.71	62.71	62.71
R:PRON	3	1	0	75.00	100.00	78.95
R:PUNCT	21	20	12	51.22	63.64	53.30
R:SPELL	38	0	0	100.00	100.00	100.00
R:VERB	18	64	14	21.95	56.25	25.00
R:VERB:FORM	13	13	8	50.00	61.90	52.00
R:VERB:SVA	5	7	6	41.67	45.45	42.37
R:VERB:TENSE	21	42	17	33.33	55.26	36.21
R:WO	19	2	31	90.48	38.00	70.90
U:ADJ	1	28	0	3.45	100.00	4.27
U:ADV	2	7	3	22.22	40.00	24.39
U:CONJ	0	3	1	0.00	0.00	0.00
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	13	19	30	40.62	30.23	38.01
U:NOUN	5	39	2	11.36	71.43	13.66
U:NOUN:POSS	0	2	3	0.00	0.00	0.00
U:OTHER	4	49	7	7.55	36.36	8.97
U:PREP	6	13	9	31.58	40.00	32.97
U:PRON	2	4	1	33.33	66.67	37.04
U:PUNCT	16	27	13	37.21	55.17	39.80
U:VERB	2	23	1	8.00	66.67	9.71
U:VERB:FORM	1	2	1	33.33	50.00	35.71
U:VERB:TENSE	3	1	2	75.00	60.00	71.43
UNK	22	0	39	100.00	36.07	73.83

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	97	2371	350	3.93	21.70	4.70
Span-level detection	283	2185	329	11.47	46.24	13.50
Token-level detection	726	3097	389	18.99	65.11	22.12

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	50	40	52	55.56	49.02	54.11
R	38	2026	278	1.84	12.03	2.22
U	9	305	20	2.87	31.03	3.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	84	4	1.18	20.00	1.45
ADJ:FORM	0	2	0	0.00	100.00	0.00
ADV	0	17	1	0.00	0.00	0.00
CONJ	0	5	1	0.00	0.00	0.00
CONTR	0	1	0	0.00	100.00	0.00
DET	5	49	9	9.26	35.71	10.87
MORPH	1	14	4	6.67	20.00	7.69
NOUN	3	460	10	0.65	23.08	0.80
NOUN:INFL	0	0	11	100.00	0.00	0.00
NOUN:NUM	6	31	9	16.22	40.00	18.40
NOUN:POSS	0	1	17	0.00	0.00	0.00
ORTH	11	16	42	40.74	20.75	34.16
OTHER	4	1353	46	0.29	8.00	0.37
PART	0	1	1	0.00	0.00	0.00
PREP	5	54	12	8.47	29.41	9.88
PRON	0	4	6	0.00	0.00	0.00
PUNCT	51	40	59	56.04	46.36	53.80
SPELL	0	1	89	0.00	0.00	0.00
VERB	1	163	12	0.61	7.69	0.75
VERB:FORM	4	17	3	19.05	57.14	21.98
VERB:INFL	0	0	4	100.00	0.00	0.00
VERB:SVA	3	14	4	17.65	42.86	20.00
VERB:TENSE	0	43	5	0.00	0.00	0.00
WO	2	1	1	66.67	66.67	66.67

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	2	1	0.00	0.00	0.00
M:CONJ	0	1	1	0.00	0.00	0.00
M:DET	1	16	5	5.88	16.67	6.76
M:NOUN	0	3	2	0.00	0.00	0.00
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:OTHER	0	2	0	0.00	100.00	0.00
M:PREP	1	2	0	33.33	100.00	38.46
M:PRON	0	3	3	0.00	0.00	0.00
M:PUNCT	47	8	32	85.45	59.49	78.60
M:VERB	1	1	3	50.00	25.00	41.67
M:VERB:TENSE	0	2	0	0.00	100.00	0.00
R:ADJ	0	34	4	0.00	0.00	0.00
R:ADJ:FORM	0	2	0	0.00	100.00	0.00
R:ADV	0	4	0	0.00	100.00	0.00
R:CONTR	0	1	0	0.00	100.00	0.00
R:DET	0	10	2	0.00	0.00	0.00
R:MORPH	1	14	4	6.67	20.00	7.69
R:NOUN	3	384	8	0.78	27.27	0.96
R:NOUN:INFL	0	0	11	100.00	0.00	0.00
R:NOUN:NUM	6	31	9	16.22	40.00	18.40
R:NOUN:POSS	0	1	12	0.00	0.00	0.00
R:ORTH	11	16	42	40.74	20.75	34.16
R:OTHER	4	1305	45	0.31	8.16	0.38
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	3	33	11	8.33	21.43	9.49
R:PRON	0	0	3	100.00	0.00	0.00
R:PUNCT	1	12	15	7.69	6.25	7.35
R:SPELL	0	1	89	0.00	0.00	0.00
R:VERB	0	111	8	0.00	0.00	0.00
R:VERB:FORM	4	15	3	21.05	57.14	24.10
R:VERB:INFL	0	0	4	100.00	0.00	0.00
R:VERB:SVA	3	14	4	17.65	42.86	20.00
R:VERB:TENSE	0	36	3	0.00	0.00	0.00
R:WO	2	1	1	66.67	66.67	66.67
U:ADJ	1	50	0	1.96	100.00	2.44
U:ADV	0	11	0	0.00	100.00	0.00
U:CONJ	0	4	0	0.00	100.00	0.00
U:DET	4	23	2	14.81	66.67	17.54
U:NOUN	0	73	0	0.00	100.00	0.00
U:OTHER	0	46	1	0.00	0.00	0.00
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	1	19	1	5.00	50.00	6.10
U:PRON	0	1	0	0.00	100.00	0.00
U:PUNCT	3	20	12	13.04	20.00	14.02
U:VERB	0	51	1	0.00	0.00	0.00
U:VERB:FORM	0	2	0	0.00	100.00	0.00
U:VERB:TENSE	0	5	2	0.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	53	37	70	58.89	43.09	54.87
R	214	1881	234	10.21	47.77	12.12
U	13	267	24	4.64	35.14	5.62
UNK	3	0	1	100.00	75.00	93.75

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	70	3	6.67	62.50	8.12
ADJ:FORM	0	2	0	0.00	100.00	0.00
ADV	1	14	1	6.67	50.00	8.06
CONJ	0	5	1	0.00	0.00	0.00
CONTR	0	1	0	0.00	100.00	0.00
DET	7	48	15	12.73	31.82	14.46
MORPH	8	13	2	38.10	80.00	42.55
NOUN	8	409	12	1.92	40.00	2.37
NOUN:INFL	5	0	6	100.00	45.45	80.65
NOUN:NUM	12	28	7	30.00	63.16	33.52
NOUN:POSS	7	1	12	87.50	36.84	68.63
ORTH	59	16	49	78.67	54.63	72.30
OTHER	27	1273	47	2.08	36.49	2.56
PART	0	1	1	0.00	0.00	0.00
PREP	7	51	16	12.07	30.43	13.73
PRON	1	3	5	25.00	16.67	22.73
PUNCT	57	36	76	61.29	42.86	56.44
SPELL	41	1	55	97.62	42.71	77.65
UNK	3	0	1	100.00	75.00	93.75
VERB	13	145	5	8.23	72.22	10.00
VERB:FORM	7	15	2	31.82	77.78	36.08
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	4	13	4	23.53	50.00	26.32
VERB:TENSE	6	39	7	13.33	46.15	15.54
WO	2	1	1	66.67	66.67	66.67

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	2	0	0.00	100.00	0.00
M:CONJ	0	1	1	0.00	0.00	0.00
M:DET	1	16	6	5.88	14.29	6.67
M:NOUN	0	3	3	0.00	0.00	0.00
M:NOUN:POSS	0	0	6	100.00	0.00	0.00
M:OTHER	0	2	0	0.00	100.00	0.00
M:PREP	1	2	2	33.33	33.33	33.33
M:PRON	1	2	2	33.33	33.33	33.33
M:PUNCT	48	8	47	85.71	50.53	75.24
M:VERB	1	1	3	50.00	25.00	41.67
M:VERB:TENSE	1	0	0	100.00	100.00	100.00
R:ADJ	5	28	3	15.15	62.50	17.86
R:ADJ:FORM	0	2	0	0.00	100.00	0.00
R:ADV	1	3	1	25.00	50.00	27.78
R:CONTR	0	1	0	0.00	100.00	0.00
R:DET	0	9	4	0.00	0.00	0.00
R:MORPH	8	13	2	38.10	80.00	42.55
R:NOUN	8	349	9	2.24	47.06	2.77
R:NOUN:INFL	5	0	6	100.00	45.45	80.65
R:NOUN:NUM	12	28	7	30.00	63.16	33.52
R:NOUN:POSS	7	1	6	87.50	53.85	77.78
R:ORTH	59	16	49	78.67	54.63	72.30
R:OTHER	27	1227	46	2.15	36.99	2.65
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	5	33	12	13.16	29.41	14.79
R:PRON	0	0	3	100.00	0.00	0.00
R:PUNCT	4	9	17	30.77	19.05	27.40
R:SPELL	41	1	55	97.62	42.71	77.65
R:VERB	12	98	1	10.91	92.31	13.25
R:VERB:FORM	7	13	2	35.00	77.78	39.33
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	4	13	4	23.53	50.00	26.32
R:VERB:TENSE	4	35	5	10.26	44.44	12.12
R:WO	2	1	1	66.67	66.67	66.67
U:ADJ	0	42	0	0.00	100.00	0.00
U:ADV	0	9	0	0.00	100.00	0.00
U:CONJ	0	4	0	0.00	100.00	0.00
U:DET	6	23	5	20.69	54.55	23.62
U:NOUN	0	57	0	0.00	100.00	0.00
U:OTHER	0	44	1	0.00	0.00	0.00
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	1	16	2	5.88	33.33	7.04
U:PRON	0	1	0	0.00	100.00	0.00
U:PUNCT	5	19	12	20.83	29.41	22.12
U:VERB	0	46	1	0.00	0.00	0.00
U:VERB:FORM	0	2	0	0.00	100.00	0.00
U:VERB:TENSE	1	4	2	20.00	33.33	21.74
UNK	3	0	1	100.00	75.00	93.75

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	142	34	74	80.68	65.74	77.17
R	534	2685	277	16.59	65.84	19.51
U	36	378	36	8.70	50.00	10.42
UNK	14	0	2	100.00	87.50	97.22

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	75	3	7.41	66.67	9.01
ADJ:FORM	3	2	3	60.00	50.00	57.69
ADV	2	15	1	11.76	66.67	14.08
CONJ	3	4	2	42.86	60.00	45.45
CONTR	0	1	3	0.00	0.00	0.00
DET	17	47	20	26.56	45.95	29.01
MORPH	16	12	3	57.14	84.21	61.07
NOUN	24	452	9	5.04	72.73	6.20
NOUN:INFL	11	0	0	100.00	100.00	100.00
NOUN:NUM	27	28	4	49.09	87.10	53.78
NOUN:POSS	14	1	8	93.33	63.64	85.37
ORTH	143	15	47	90.51	75.26	86.98
OTHER	106	2138	111	4.72	48.85	5.77
PREP	18	50	20	26.47	47.37	29.03
PRON	3	3	4	50.00	42.86	48.39
PUNCT	144	34	85	80.90	62.88	76.51
SPELL	101	1	0	99.02	100.00	99.21
UNK	14	0	2	100.00	87.50	97.22
VERB	21	150	7	12.28	75.00	14.75
VERB:FORM	13	14	5	48.15	72.22	51.59
VERB:INFL	4	0	0	100.00	100.00	100.00
VERB:SVA	8	13	6	38.10	57.14	40.82
VERB:TENSE	15	41	15	26.79	50.00	29.53
WO	13	1	31	92.86	29.55	65.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	1	2	0	33.33	100.00	38.46
M:CONJ	2	0	2	100.00	50.00	83.33
M:DET	6	15	8	28.57	42.86	30.61
M:NOUN	1	2	3	33.33	25.00	31.25
M:NOUN:POSS	1	0	5	100.00	16.67	50.00
M:OTHER	2	2	2	50.00	50.00	50.00
M:PREP	3	2	3	60.00	50.00	57.69
M:PRON	2	2	1	50.00	66.67	52.63
M:PUNCT	120	8	47	93.75	71.86	88.37
M:VERB	1	1	3	50.00	25.00	41.67
M:VERB:TENSE	3	0	0	100.00	100.00	100.00
R:ADJ	6	31	2	16.22	75.00	19.23
R:ADJ:FORM	3	2	3	60.00	50.00	57.69
R:ADV	0	5	1	0.00	0.00	0.00
R:CONTR	0	1	3	0.00	0.00	0.00
R:DET	3	9	9	25.00	25.00	25.00
R:MORPH	16	12	3	57.14	84.21	61.07
R:NOUN	21	386	6	5.16	77.78	6.34
R:NOUN:INFL	11	0	0	100.00	100.00	100.00
R:NOUN:NUM	27	28	4	49.09	87.10	53.78
R:NOUN:POSS	13	1	3	92.86	81.25	90.28
R:ORTH	143	15	47	90.51	75.26	86.98
R:OTHER	101	1981	96	4.85	51.27	5.92
R:PREP	11	35	14	23.91	44.00	26.32
R:PRON	1	0	3	100.00	25.00	62.50
R:PUNCT	10	10	26	50.00	27.78	43.10
R:SPELL	101	1	0	99.02	100.00	99.21
R:VERB	20	104	2	16.13	90.91	19.31
R:VERB:FORM	13	12	4	52.00	76.47	55.56
R:VERB:INFL	4	0	0	100.00	100.00	100.00
R:VERB:SVA	8	13	6	38.10	57.14	40.82
R:VERB:TENSE	9	38	14	19.15	39.13	21.33
R:WO	13	1	31	92.86	29.55	65.00
U:ADJ	0	44	1	0.00	0.00	0.00
U:ADV	1	8	0	11.11	100.00	13.51
U:CONJ	1	4	0	20.00	100.00	23.81
U:DET	8	23	3	25.81	72.73	29.63
U:NOUN	2	64	0	3.03	100.00	3.76
U:OTHER	3	155	13	1.90	18.75	2.31
U:PREP	4	13	3	23.53	57.14	26.67
U:PRON	0	1	0	0.00	100.00	0.00
U:PUNCT	14	16	12	46.67	53.85	47.95
U:VERB	0	45	2	0.00	0.00	0.00
U:VERB:FORM	0	2	1	0.00	0.00	0.00
U:VERB:TENSE	3	3	1	50.00	75.00	53.57
UNK	14	0	2	100.00	87.50	97.22

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:47:03+00:00
Competition submission:	9
Competition phase:	3 - Open phase

Detailed results

Submission information

Results