BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	2924	1224	2386	70.49	55.07	66.75
Span-level detection	3383	774	2181	81.38	60.80	76.22
Token-level detection	4098	470	2461	89.71	62.48	82.52

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	939	342	521	73.30	64.32	71.31
R	1666	718	1648	69.88	50.27	64.82
U	319	164	217	66.05	59.51	64.63

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	13	15	30	46.43	30.23	41.94
ADJ:FORM	6	1	4	85.71	60.00	78.95
ADV	25	19	41	56.82	37.88	51.65
CONJ	7	17	20	29.17	25.93	28.46
CONTR	12	4	1	75.00	92.31	77.92
DET	421	149	228	73.86	64.87	71.87
MORPH	91	20	60	81.98	60.26	76.47
NOUN	36	63	86	36.36	29.51	34.75
NOUN:INFL	7	1	13	87.50	35.00	67.31
NOUN:NUM	199	85	64	70.07	75.67	71.12
NOUN:POSS	29	10	25	74.36	53.70	69.05
ORTH	229	28	162	89.11	58.57	80.69
OTHER	160	181	530	46.92	23.19	38.95
PART	24	8	10	75.00	70.59	74.07
PREP	262	125	193	67.70	57.58	65.40
PRON	59	20	82	74.68	41.84	64.55
PUNCT	636	192	291	76.81	68.61	75.02
SPELL	204	47	108	81.27	65.38	77.51
VERB	57	64	175	47.11	24.57	39.80
VERB:FORM	157	52	45	75.12	77.72	75.63
VERB:INFL	6	0	2	100.00	75.00	93.75
VERB:SVA	127	32	30	79.87	80.89	80.08
VERB:TENSE	122	64	137	65.59	47.10	60.82
WO	35	27	49	56.45	41.67	52.71

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	7	100.00	12.50	41.67
M:ADV	5	5	13	50.00	27.78	43.10
M:CONJ	4	14	13	22.22	23.53	22.47
M:CONTR	1	3	0	25.00	100.00	29.41
M:DET	210	65	92	76.36	69.54	74.89
M:NOUN	4	7	7	36.36	36.36	36.36
M:NOUN:POSS	7	4	8	63.64	46.67	59.32
M:OTHER	24	23	40	51.06	37.50	47.62
M:PART	3	1	1	75.00	75.00	75.00
M:PREP	57	35	47	61.96	54.81	60.38
M:PRON	37	11	39	77.08	48.68	69.03
M:PUNCT	535	146	208	78.56	72.01	77.16
M:VERB	13	15	25	46.43	34.21	43.33
M:VERB:FORM	14	2	1	87.50	93.33	88.61
M:VERB:TENSE	24	11	20	68.57	54.55	65.22
R:ADJ	9	11	18	45.00	33.33	42.06
R:ADJ:FORM	6	1	4	85.71	60.00	78.95
R:ADV	8	5	17	61.54	32.00	51.95
R:CONJ	1	0	3	100.00	25.00	62.50
R:CONTR	4	0	1	100.00	80.00	95.24
R:DET	49	28	63	63.64	43.75	58.33
R:MORPH	91	20	60	81.98	60.26	76.47
R:NOUN	28	41	70	40.58	28.57	37.43
R:NOUN:INFL	7	1	13	87.50	35.00	67.31
R:NOUN:NUM	199	85	64	70.07	75.67	71.12
R:NOUN:POSS	12	2	13	85.71	48.00	74.07
R:ORTH	229	28	162	89.11	58.57	80.69
R:OTHER	130	138	473	48.51	21.56	38.81
R:PART	18	7	6	72.00	75.00	72.58
R:PREP	160	71	119	69.26	57.35	66.50
R:PRON	14	6	30	70.00	31.82	56.45
R:PUNCT	68	35	59	66.02	53.54	63.08
R:SPELL	204	47	108	81.27	65.38	77.51
R:VERB	38	36	134	51.35	22.09	40.60
R:VERB:FORM	138	49	41	73.80	77.09	74.43
R:VERB:INFL	6	0	2	100.00	75.00	93.75
R:VERB:SVA	127	32	30	79.87	80.89	80.08
R:VERB:TENSE	85	48	109	63.91	43.81	58.54
R:WO	35	27	49	56.45	41.67	52.71
U:ADJ	3	4	5	42.86	37.50	41.67
U:ADV	12	9	11	57.14	52.17	56.07
U:CONJ	2	3	4	40.00	33.33	38.46
U:CONTR	7	1	0	87.50	100.00	89.74
U:DET	162	56	73	74.31	68.94	73.17
U:NOUN	4	15	9	21.05	30.77	22.47
U:NOUN:POSS	10	4	4	71.43	71.43	71.43
U:OTHER	6	20	17	23.08	26.09	23.62
U:PART	3	0	3	100.00	50.00	83.33
U:PREP	45	19	27	70.31	62.50	68.60
U:PRON	8	3	13	72.73	38.10	61.54
U:PUNCT	33	11	24	75.00	57.89	70.82
U:VERB	6	13	16	31.58	27.27	30.61
U:VERB:FORM	5	1	3	83.33	62.50	78.12
U:VERB:TENSE	13	5	8	72.22	61.90	69.89

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	1030	256	470	80.09	68.67	77.51
R	1989	389	1427	83.64	58.23	76.93
U	350	129	221	73.07	61.30	70.37
UNK	14	0	63	100.00	18.18	52.63

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	21	7	28	75.00	42.86	65.22
ADJ:FORM	4	2	5	66.67	44.44	60.61
ADV	26	17	41	60.47	38.81	54.39
CONJ	12	13	18	48.00	40.00	46.15
CONTR	9	3	1	75.00	90.00	77.59
DET	458	118	212	79.51	68.36	77.00
MORPH	95	12	58	88.79	62.09	81.76
NOUN	52	29	80	64.20	39.39	57.02
NOUN:INFL	11	1	8	91.67	57.89	82.09
NOUN:NUM	198	65	57	75.29	77.65	75.75
NOUN:POSS	30	9	22	76.92	57.69	72.12
ORTH	248	22	140	91.85	63.92	84.47
OTHER	311	83	458	78.93	40.44	66.31
PART	26	6	14	81.25	65.00	77.38
PREP	293	78	174	78.98	62.74	75.09
PRON	78	11	69	87.64	53.06	77.53
PUNCT	673	155	275	81.28	70.99	78.99
SPELL	251	6	60	97.67	80.71	93.73
UNK	14	0	63	100.00	18.18	52.63
VERB	106	29	154	78.52	40.77	66.25
VERB:FORM	155	27	48	85.16	76.35	83.24
VERB:INFL	7	0	2	100.00	77.78	94.59
VERB:SVA	133	20	26	86.93	83.65	86.25
VERB:TENSE	141	39	118	78.33	54.44	72.01
WO	31	22	50	58.49	38.27	52.90

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	6	100.00	14.29	45.45
M:ADV	5	4	13	55.56	27.78	46.30
M:CONJ	7	11	10	38.89	41.18	39.33
M:CONTR	0	2	0	0.00	100.00	0.00
M:DET	227	50	81	81.95	73.70	80.16
M:NOUN	6	4	7	60.00	46.15	56.60
M:NOUN:POSS	7	4	9	63.64	43.75	58.33
M:OTHER	36	14	41	72.00	46.75	64.98
M:PART	4	1	3	80.00	57.14	74.07
M:PREP	66	24	43	73.33	60.55	70.36
M:PRON	49	6	28	89.09	63.64	82.49
M:PUNCT	560	119	194	82.47	74.27	80.69
M:VERB	21	9	19	70.00	52.50	65.63
M:VERB:FORM	15	1	0	93.75	100.00	94.94
M:VERB:TENSE	26	7	16	78.79	61.90	74.71
R:ADJ	16	5	17	76.19	48.48	68.38
R:ADJ:FORM	4	2	5	66.67	44.44	60.61
R:ADV	10	3	17	76.92	37.04	63.29
R:CONJ	1	0	3	100.00	25.00	62.50
R:CONTR	3	0	1	100.00	75.00	93.75
R:DET	60	23	60	72.29	50.00	66.37
R:MORPH	95	12	58	88.79	62.09	81.76
R:NOUN	42	11	61	79.25	40.78	66.67
R:NOUN:INFL	11	1	8	91.67	57.89	82.09
R:NOUN:NUM	198	65	57	75.29	77.65	75.75
R:NOUN:POSS	13	2	9	86.67	59.09	79.27
R:ORTH	248	22	140	91.85	63.92	84.47
R:OTHER	265	53	397	83.33	40.03	68.51
R:PART	19	5	7	79.17	73.08	77.87
R:PREP	182	41	107	81.61	62.98	77.05
R:PRON	17	3	28	85.00	37.78	68.00
R:PUNCT	77	26	53	74.76	59.23	71.03
R:SPELL	251	6	60	97.67	80.71	93.73
R:VERB	74	12	120	86.05	38.14	68.77
R:VERB:FORM	135	25	46	84.38	74.59	82.22
R:VERB:INFL	7	0	2	100.00	77.78	94.59
R:VERB:SVA	133	20	26	86.93	83.65	86.25
R:VERB:TENSE	97	30	95	76.38	50.52	69.29
R:WO	31	22	50	58.49	38.27	52.90
U:ADJ	4	2	5	66.67	44.44	60.61
U:ADV	11	10	11	52.38	50.00	51.89
U:CONJ	4	2	5	66.67	44.44	60.61
U:CONTR	6	1	0	85.71	100.00	88.24
U:DET	171	45	71	79.17	70.66	77.31
U:NOUN	4	14	12	22.22	25.00	22.73
U:NOUN:POSS	10	3	4	76.92	71.43	75.76
U:OTHER	10	16	20	38.46	33.33	37.31
U:PART	3	0	4	100.00	42.86	78.95
U:PREP	45	13	24	77.59	65.22	74.75
U:PRON	12	2	13	85.71	48.00	74.07
U:PUNCT	36	10	28	78.26	56.25	72.58
U:VERB	11	8	15	57.89	42.31	53.92
U:VERB:FORM	5	1	2	83.33	71.43	80.65
U:VERB:TENSE	18	2	7	90.00	72.00	85.71
UNK	14	0	63	100.00	18.18	52.63

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	1146	153	463	88.22	71.22	84.20
R	2499	237	1634	91.34	60.46	82.87
U	411	80	277	83.71	59.74	77.49
UNK	42	0	87	100.00	32.56	70.71

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	23	5	34	82.14	40.35	68.05
ADJ:FORM	6	1	5	85.71	54.55	76.92
ADV	34	6	43	85.00	44.16	71.73
CONJ	20	3	20	86.96	50.00	75.76
CONTR	10	2	5	83.33	66.67	79.37
DET	474	81	212	85.41	69.10	81.56
MORPH	99	5	53	95.19	65.13	87.15
NOUN	69	12	91	85.19	43.13	71.28
NOUN:INFL	11	1	8	91.67	57.89	82.09
NOUN:NUM	200	37	58	84.39	77.52	82.92
NOUN:POSS	42	3	26	93.33	61.76	84.68
ORTH	331	16	135	95.39	71.03	89.27
OTHER	596	52	629	91.98	48.65	78.07
PART	20	2	10	90.91	66.67	84.75
PREP	312	46	185	87.15	62.78	80.87
PRON	89	7	54	92.71	62.24	84.44
PUNCT	779	103	286	88.32	73.15	84.80
SPELL	249	2	58	99.20	81.11	94.97
UNK	42	0	87	100.00	32.56	70.71
VERB	140	15	174	90.32	44.59	74.95
VERB:FORM	157	16	40	90.75	79.70	88.30
VERB:INFL	7	0	1	100.00	87.50	97.22
VERB:SVA	131	15	26	89.73	83.44	88.39
VERB:TENSE	162	25	149	86.63	52.09	76.49
WO	95	15	72	86.36	56.89	78.25

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	0	7	100.00	22.22	58.82
M:ADV	8	2	12	80.00	40.00	66.67
M:CONJ	16	1	11	94.12	59.26	84.21
M:CONTR	0	2	0	0.00	100.00	0.00
M:DET	234	21	73	91.76	76.22	88.17
M:NOUN	10	4	12	71.43	45.45	64.10
M:NOUN:POSS	9	3	8	75.00	52.94	69.23
M:OTHER	41	10	43	80.39	48.81	71.18
M:PART	4	0	2	100.00	66.67	90.91
M:PREP	75	11	45	87.21	62.50	80.82
M:PRON	57	3	20	95.00	74.03	89.91
M:PUNCT	614	88	187	87.46	76.65	85.07
M:VERB	30	5	23	85.71	56.60	77.72
M:VERB:FORM	16	0	0	100.00	100.00	100.00
M:VERB:TENSE	30	3	20	90.91	60.00	82.42
R:ADJ	18	3	20	85.71	47.37	73.77
R:ADJ:FORM	6	1	5	85.71	54.55	76.92
R:ADV	9	2	20	81.82	31.03	61.64
R:CONJ	0	1	7	0.00	0.00	0.00
R:CONTR	3	0	3	100.00	50.00	83.33
R:DET	60	20	60	75.00	50.00	68.18
R:MORPH	99	5	53	95.19	65.13	87.15
R:NOUN	53	5	65	91.38	44.92	75.71
R:NOUN:INFL	11	1	8	91.67	57.89	82.09
R:NOUN:NUM	200	37	58	84.39	77.52	82.92
R:NOUN:POSS	22	0	14	100.00	61.11	88.71
R:ORTH	331	16	135	95.39	71.03	89.27
R:OTHER	522	26	527	95.26	49.76	80.53
R:PART	14	2	4	87.50	77.78	85.37
R:PREP	189	31	111	85.91	63.00	80.08
R:PRON	20	2	25	90.91	44.44	75.19
R:PUNCT	114	10	70	91.94	61.96	83.82
R:SPELL	249	2	58	99.20	81.11	94.97
R:VERB	95	5	136	95.00	41.13	75.28
R:VERB:FORM	136	16	38	89.47	78.16	86.96
R:VERB:INFL	7	0	1	100.00	87.50	97.22
R:VERB:SVA	131	15	26	89.73	83.44	88.39
R:VERB:TENSE	115	22	118	83.94	49.36	73.62
R:WO	95	15	72	86.36	56.89	78.25
U:ADJ	3	2	7	60.00	30.00	50.00
U:ADV	17	2	11	89.47	60.71	81.73
U:CONJ	4	1	2	80.00	66.67	76.92
U:CONTR	7	0	2	100.00	77.78	94.59
U:DET	180	40	79	81.82	69.50	79.02
U:NOUN	6	3	14	66.67	30.00	53.57
U:NOUN:POSS	11	0	4	100.00	73.33	93.22
U:OTHER	33	16	59	67.35	35.87	57.29
U:PART	2	0	4	100.00	33.33	71.43
U:PREP	48	4	29	92.31	62.34	84.21
U:PRON	12	2	9	85.71	57.14	77.92
U:PUNCT	51	5	29	91.07	63.75	83.88
U:VERB	15	5	15	75.00	50.00	68.18
U:VERB:FORM	5	0	2	100.00	71.43	92.59
U:VERB:TENSE	17	0	11	100.00	60.71	88.54
UNK	42	0	87	100.00	32.56	70.71

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1272	573	1108	68.94	53.45	65.16
Span-level detection	1503	345	990	81.33	60.29	76.02
Token-level detection	1866	183	1083	91.07	63.28	83.71

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	342	164	249	67.59	57.87	65.39
R	789	341	757	69.82	51.03	65.03
U	141	68	102	67.46	58.02	65.34

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	4	4	10	50.00	28.57	43.48
ADJ:FORM	3	1	2	75.00	60.00	71.43
ADV	12	11	22	52.17	35.29	47.62
CONJ	5	4	8	55.56	38.46	51.02
CONTR	6	3	1	66.67	85.71	69.77
DET	177	62	115	74.06	60.62	70.91
MORPH	48	15	34	76.19	58.54	71.86
NOUN	11	29	44	27.50	20.00	25.58
NOUN:INFL	5	1	2	83.33	71.43	80.65
NOUN:NUM	96	44	34	68.57	73.85	69.57
NOUN:POSS	8	1	8	88.89	50.00	76.92
ORTH	129	15	76	89.58	62.93	82.59
OTHER	78	95	272	45.09	22.29	37.43
PART	13	2	5	86.67	72.22	83.33
PREP	112	44	85	71.79	56.85	68.21
PRON	34	12	46	73.91	42.50	64.39
PUNCT	200	83	125	70.67	61.54	68.63
SPELL	83	22	26	79.05	76.15	78.45
VERB	30	35	85	46.15	26.09	40.00
VERB:FORM	82	22	19	78.85	81.19	79.30
VERB:INFL	3	0	0	100.00	100.00	100.00
VERB:SVA	67	18	13	78.82	83.75	79.76
VERB:TENSE	56	40	63	58.33	47.06	55.67
WO	10	10	13	50.00	43.48	48.54

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	1	100.00	50.00	83.33
M:ADV	2	4	7	33.33	22.22	30.30
M:CONJ	3	3	5	50.00	37.50	46.88
M:CONTR	1	3	0	25.00	100.00	29.41
M:DET	79	30	43	72.48	64.75	70.79
M:NOUN	1	2	2	33.33	33.33	33.33
M:NOUN:POSS	1	0	4	100.00	20.00	55.56
M:OTHER	18	14	22	56.25	45.00	53.57
M:PART	1	1	1	50.00	50.00	50.00
M:PREP	28	17	24	62.22	53.85	60.34
M:PRON	21	7	19	75.00	52.50	69.08
M:PUNCT	159	65	94	70.98	62.85	69.19
M:VERB	5	8	18	38.46	21.74	33.33
M:VERB:FORM	11	2	0	84.62	100.00	87.30
M:VERB:TENSE	11	8	9	57.89	55.00	57.29
R:ADJ	1	2	7	33.33	12.50	25.00
R:ADJ:FORM	3	1	2	75.00	60.00	71.43
R:ADV	4	2	9	66.67	30.77	54.05
R:CONJ	1	0	0	100.00	100.00	100.00
R:CONTR	2	0	1	100.00	66.67	90.91
R:DET	22	15	26	59.46	45.83	56.12
R:MORPH	48	15	34	76.19	58.54	71.86
R:NOUN	7	18	37	28.00	15.91	24.31
R:NOUN:INFL	5	1	2	83.33	71.43	80.65
R:NOUN:NUM	96	44	34	68.57	73.85	69.57
R:NOUN:POSS	3	1	2	75.00	60.00	71.43
R:ORTH	129	15	76	89.58	62.93	82.59
R:OTHER	59	72	245	45.04	19.41	35.63
R:PART	11	1	2	91.67	84.62	90.16
R:PREP	62	21	50	74.70	55.36	69.82
R:PRON	9	2	19	81.82	32.14	62.50
R:PUNCT	33	14	25	70.21	56.90	67.07
R:SPELL	83	22	26	79.05	76.15	78.45
R:VERB	20	18	61	52.63	24.69	42.92
R:VERB:FORM	70	20	19	77.78	78.65	77.95
R:VERB:INFL	3	0	0	100.00	100.00	100.00
R:VERB:SVA	67	18	13	78.82	83.75	79.76
R:VERB:TENSE	41	29	54	58.57	43.16	54.67
R:WO	10	10	13	50.00	43.48	48.54
U:ADJ	2	2	2	50.00	50.00	50.00
U:ADV	6	5	6	54.55	50.00	53.57
U:CONJ	1	1	3	50.00	25.00	41.67
U:CONTR	3	0	0	100.00	100.00	100.00
U:DET	76	17	46	81.72	62.30	76.92
U:NOUN	3	9	5	25.00	37.50	26.79
U:NOUN:POSS	4	0	2	100.00	66.67	90.91
U:OTHER	1	9	5	10.00	16.67	10.87
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	22	6	11	78.57	66.67	75.86
U:PRON	4	3	8	57.14	33.33	50.00
U:PUNCT	8	4	6	66.67	57.14	64.52
U:VERB	5	9	6	35.71	45.45	37.31
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	4	3	0	57.14	100.00	62.50

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	391	115	207	77.27	65.38	74.56
R	937	178	639	84.04	59.45	77.62
U	167	52	98	76.26	63.02	73.18
UNK	8	0	46	100.00	14.81	46.51

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	7	3	11	70.00	38.89	60.34
ADJ:FORM	2	1	3	66.67	40.00	58.82
ADV	11	10	20	52.38	35.48	47.83
CONJ	9	3	6	75.00	60.00	71.43
CONTR	4	2	1	66.67	80.00	68.97
DET	205	47	97	81.35	67.88	78.24
MORPH	53	10	33	84.13	61.63	78.40
NOUN	18	13	38	58.06	32.14	50.00
NOUN:INFL	6	1	0	85.71	100.00	88.24
NOUN:NUM	96	32	30	75.00	76.19	75.24
NOUN:POSS	8	1	8	88.89	50.00	76.92
ORTH	139	11	55	92.67	71.65	87.53
OTHER	166	44	224	79.05	42.56	67.48
PART	13	1	6	92.86	68.42	86.67
PREP	127	22	74	85.23	63.18	79.67
PRON	41	8	40	83.67	50.62	74.01
PUNCT	211	66	108	76.17	66.14	73.93
SPELL	94	3	12	96.91	88.68	95.14
UNK	8	0	46	100.00	14.81	46.51
VERB	56	16	74	77.78	43.08	66.99
VERB:FORM	80	10	22	88.89	78.43	86.58
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	70	8	11	89.74	86.42	89.06
VERB:TENSE	67	25	56	72.83	54.47	68.23
WO	9	8	14	52.94	39.13	49.45

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	1	100.00	50.00	83.33
M:ADV	2	3	8	40.00	20.00	33.33
M:CONJ	5	3	2	62.50	71.43	64.10
M:CONTR	0	2	0	0.00	100.00	0.00
M:DET	92	25	36	78.63	71.88	77.18
M:NOUN	2	0	1	100.00	66.67	90.91
M:NOUN:POSS	1	0	5	100.00	16.67	50.00
M:OTHER	22	7	20	75.86	52.38	69.62
M:PART	1	1	1	50.00	50.00	50.00
M:PREP	33	11	20	75.00	62.26	72.05
M:PRON	24	5	15	82.76	61.54	77.42
M:PUNCT	170	50	80	77.27	68.00	75.22
M:VERB	12	2	13	85.71	48.00	74.07
M:VERB:FORM	12	1	0	92.31	100.00	93.75
M:VERB:TENSE	14	5	5	73.68	73.68	73.68
R:ADJ	3	2	8	60.00	27.27	48.39
R:ADJ:FORM	2	1	3	66.67	40.00	58.82
R:ADV	4	1	7	80.00	36.36	64.52
R:CONJ	1	0	0	100.00	100.00	100.00
R:CONTR	1	0	1	100.00	50.00	83.33
R:DET	27	12	21	69.23	56.25	66.18
R:MORPH	53	10	33	84.13	61.63	78.40
R:NOUN	14	4	30	77.78	31.82	60.34
R:NOUN:INFL	6	1	0	85.71	100.00	88.24
R:NOUN:NUM	96	32	30	75.00	76.19	75.24
R:NOUN:POSS	3	1	1	75.00	75.00	75.00
R:ORTH	139	11	55	92.67	71.65	87.53
R:OTHER	140	29	198	82.84	41.42	69.03
R:PART	11	0	3	100.00	78.57	94.83
R:PREP	71	7	46	91.03	60.68	82.75
R:PRON	9	1	18	90.00	33.33	67.16
R:PUNCT	33	12	21	73.33	61.11	70.51
R:SPELL	94	3	12	96.91	88.68	95.14
R:VERB	36	8	54	81.82	40.00	67.67
R:VERB:FORM	67	9	22	88.16	75.28	85.24
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	70	8	11	89.74	86.42	89.06
R:VERB:TENSE	45	18	50	71.43	47.37	64.84
R:WO	9	8	14	52.94	39.13	49.45
U:ADJ	3	1	2	75.00	60.00	71.43
U:ADV	5	6	5	45.45	50.00	46.30
U:CONJ	3	0	4	100.00	42.86	78.95
U:CONTR	3	0	0	100.00	100.00	100.00
U:DET	86	10	40	89.58	68.25	84.31
U:NOUN	2	9	7	18.18	22.22	18.87
U:NOUN:POSS	4	0	2	100.00	66.67	90.91
U:OTHER	4	8	6	33.33	40.00	34.48
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	23	4	8	85.19	74.19	82.73
U:PRON	8	2	7	80.00	53.33	72.73
U:PUNCT	8	4	7	66.67	53.33	63.49
U:VERB	8	6	7	57.14	53.33	56.34
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	8	2	1	80.00	88.89	81.63
UNK	8	0	46	100.00	14.81	46.51

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	457	65	179	87.55	71.86	83.88
R	1178	91	731	92.83	61.71	84.32
U	200	27	107	88.11	65.15	82.30
UNK	31	0	66	100.00	31.96	70.14

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	7	2	11	77.78	38.89	64.81
ADJ:FORM	3	1	2	75.00	60.00	71.43
ADV	15	4	18	78.95	45.45	68.81
CONJ	12	2	6	85.71	66.67	81.08
CONTR	5	2	2	71.43	71.43	71.43
DET	222	28	98	88.80	69.37	84.09
MORPH	54	4	31	93.10	63.53	85.17
NOUN	27	3	47	90.00	36.49	69.59
NOUN:INFL	6	1	0	85.71	100.00	88.24
NOUN:NUM	100	17	30	85.47	76.92	83.61
NOUN:POSS	14	0	7	100.00	66.67	90.91
ORTH	166	8	50	95.40	76.85	91.01
OTHER	303	22	292	93.23	50.92	79.95
PART	10	0	6	100.00	62.50	89.29
PREP	143	6	80	95.97	64.13	87.30
PRON	47	4	28	92.16	62.67	84.23
PUNCT	265	43	103	86.04	72.01	82.81
SPELL	91	0	13	100.00	87.50	97.22
UNK	31	0	66	100.00	31.96	70.14
VERB	76	9	82	89.41	48.10	76.31
VERB:FORM	79	6	16	92.94	83.16	90.80
VERB:INFL	3	0	0	100.00	100.00	100.00
VERB:SVA	72	5	10	93.51	87.80	92.31
VERB:TENSE	85	13	62	86.73	57.82	78.85
WO	30	3	23	90.91	56.60	81.08

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	1	100.00	50.00	83.33
M:ADV	5	2	6	71.43	45.45	64.10
M:CONJ	9	1	2	90.00	81.82	88.24
M:CONTR	0	2	0	0.00	100.00	0.00
M:DET	98	11	30	89.91	76.56	86.88
M:NOUN	4	0	3	100.00	57.14	86.96
M:NOUN:POSS	2	0	3	100.00	40.00	76.92
M:OTHER	23	5	20	82.14	53.49	74.19
M:PART	1	0	1	100.00	50.00	83.33
M:PREP	41	2	20	95.35	67.21	87.98
M:PRON	29	2	10	93.55	74.36	88.96
M:PUNCT	198	37	63	84.26	75.86	82.43
M:VERB	15	1	14	93.75	51.72	80.65
M:VERB:FORM	13	0	0	100.00	100.00	100.00
M:VERB:TENSE	18	2	6	90.00	75.00	86.54
R:ADJ	3	1	8	75.00	27.27	55.56
R:ADJ:FORM	3	1	2	75.00	60.00	71.43
R:ADV	4	1	8	80.00	33.33	62.50
R:CONJ	0	1	2	0.00	0.00	0.00
R:CONTR	1	0	1	100.00	50.00	83.33
R:DET	27	9	24	75.00	52.94	69.23
R:MORPH	54	4	31	93.10	63.53	85.17
R:NOUN	20	2	33	90.91	37.74	70.92
R:NOUN:INFL	6	1	0	85.71	100.00	88.24
R:NOUN:NUM	100	17	30	85.47	76.92	83.61
R:NOUN:POSS	7	0	2	100.00	77.78	94.59
R:ORTH	166	8	50	95.40	76.85	91.01
R:OTHER	267	11	260	96.04	50.66	81.45
R:PART	8	0	3	100.00	72.73	93.02
R:PREP	78	3	50	96.30	60.94	86.28
R:PRON	12	0	14	100.00	46.15	81.08
R:PUNCT	51	3	33	94.44	60.71	85.00
R:SPELL	91	0	13	100.00	87.50	97.22
R:VERB	51	4	64	92.73	44.35	76.12
R:VERB:FORM	65	6	16	91.55	80.25	89.04
R:VERB:INFL	3	0	0	100.00	100.00	100.00
R:VERB:SVA	72	5	10	93.51	87.80	92.31
R:VERB:TENSE	59	11	54	84.29	52.21	75.06
R:WO	30	3	23	90.91	56.60	81.08
U:ADJ	3	1	2	75.00	60.00	71.43
U:ADV	6	1	4	85.71	60.00	78.95
U:CONJ	3	0	2	100.00	60.00	88.24
U:CONTR	4	0	1	100.00	80.00	95.24
U:DET	97	8	44	92.38	68.79	86.45
U:NOUN	3	1	11	75.00	21.43	50.00
U:NOUN:POSS	5	0	2	100.00	71.43	92.59
U:OTHER	13	6	12	68.42	52.00	64.36
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	24	1	10	96.00	70.59	89.55
U:PRON	6	2	4	75.00	60.00	71.43
U:PUNCT	16	3	7	84.21	69.57	80.81
U:VERB	10	4	4	71.43	71.43	71.43
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	8	0	2	100.00	80.00	95.24
UNK	31	0	66	100.00	31.96	70.14

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	905	368	806	71.09	52.89	66.51
Span-level detection	1037	241	748	81.14	58.10	75.18
Token-level detection	1264	146	878	89.65	59.01	81.21

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	308	106	175	74.40	63.77	72.00
R	491	212	558	69.84	46.81	63.58
U	106	50	73	67.95	59.22	66.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	5	12	50.00	29.41	43.86
ADJ:FORM	3	0	0	100.00	100.00	100.00
ADV	10	4	17	71.43	37.04	60.24
CONJ	1	10	9	9.09	10.00	9.26
CONTR	3	0	0	100.00	100.00	100.00
DET	155	34	76	82.01	67.10	78.52
MORPH	26	4	15	86.67	63.41	80.75
NOUN	18	17	27	51.43	40.00	48.65
NOUN:NUM	59	24	17	71.08	77.63	72.30
NOUN:POSS	10	3	4	76.92	71.43	75.76
ORTH	42	5	46	89.36	47.73	76.09
OTHER	40	57	185	41.24	17.78	32.63
PART	8	4	4	66.67	66.67	66.67
PREP	95	50	69	65.52	57.93	63.84
PRON	17	4	27	80.95	38.64	66.41
PUNCT	187	63	99	74.80	65.38	72.71
SPELL	47	9	23	83.93	67.14	79.93
VERB	19	23	64	45.24	22.89	37.85
VERB:FORM	52	17	20	75.36	72.22	74.71
VERB:SVA	48	7	13	87.27	78.69	85.41
VERB:TENSE	44	17	54	72.13	44.90	64.33
WO	16	11	25	59.26	39.02	53.69

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	4	100.00	0.00	0.00
M:ADV	2	0	6	100.00	25.00	62.50
M:CONJ	1	9	6	10.00	14.29	10.64
M:DET	88	19	32	82.24	73.33	80.29
M:NOUN	2	3	2	40.00	50.00	41.67
M:NOUN:POSS	4	1	0	80.00	100.00	83.33
M:OTHER	4	8	12	33.33	25.00	31.25
M:PART	2	0	0	100.00	100.00	100.00
M:PREP	15	14	15	51.72	50.00	51.37
M:PRON	13	2	14	86.67	48.15	74.71
M:PUNCT	160	43	71	78.82	69.26	76.70
M:VERB	7	4	3	63.64	70.00	64.81
M:VERB:FORM	1	0	1	100.00	50.00	83.33
M:VERB:TENSE	9	3	9	75.00	50.00	68.18
R:ADJ	4	3	6	57.14	40.00	52.63
R:ADJ:FORM	3	0	0	100.00	100.00	100.00
R:ADV	3	2	6	60.00	33.33	51.72
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	20	2	30	90.91	40.00	72.46
R:MORPH	26	4	15	86.67	63.41	80.75
R:NOUN	15	9	22	62.50	40.54	56.39
R:NOUN:NUM	59	24	17	71.08	77.63	72.30
R:NOUN:POSS	2	0	2	100.00	50.00	83.33
R:ORTH	42	5	46	89.36	47.73	76.09
R:OTHER	32	41	163	43.84	16.41	32.85
R:PART	5	4	3	55.56	62.50	56.82
R:PREP	60	30	46	66.67	56.60	64.38
R:PRON	1	2	9	33.33	10.00	22.73
R:PUNCT	18	16	21	52.94	46.15	51.43
R:SPELL	47	9	23	83.93	67.14	79.93
R:VERB	12	15	53	44.44	18.46	34.68
R:VERB:FORM	48	16	17	75.00	73.85	74.77
R:VERB:SVA	48	7	13	87.27	78.69	85.41
R:VERB:TENSE	29	12	39	70.73	42.65	62.50
R:WO	16	11	25	59.26	39.02	53.69
U:ADJ	1	2	2	33.33	33.33	33.33
U:ADV	5	2	5	71.43	50.00	65.79
U:CONJ	0	1	1	0.00	0.00	0.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	47	13	14	78.33	77.05	78.07
U:NOUN	1	5	3	16.67	25.00	17.86
U:NOUN:POSS	4	2	2	66.67	66.67	66.67
U:OTHER	4	8	10	33.33	28.57	32.26
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	20	6	8	76.92	71.43	75.76
U:PRON	3	0	4	100.00	42.86	78.95
U:PUNCT	9	4	7	69.23	56.25	66.18
U:VERB	0	4	8	0.00	0.00	0.00
U:VERB:FORM	3	1	2	75.00	60.00	71.43
U:VERB:TENSE	6	2	6	75.00	50.00	68.18

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	337	81	162	80.62	67.54	77.61
R	585	123	496	82.63	54.12	74.75
U	111	37	78	75.00	58.73	71.06
UNK	4	0	12	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	8	3	11	72.73	42.11	63.49
ADJ:FORM	2	1	0	66.67	100.00	71.43
ADV	13	3	17	81.25	43.33	69.15
CONJ	2	7	10	22.22	16.67	20.83
CONTR	2	1	0	66.67	100.00	71.43
DET	160	25	75	86.49	68.09	82.05
MORPH	25	1	13	96.15	65.79	88.03
NOUN	22	13	27	62.86	44.90	58.20
NOUN:NUM	59	19	16	75.64	78.67	76.23
NOUN:POSS	10	2	2	83.33	83.33	83.33
ORTH	45	5	46	90.00	49.45	77.32
OTHER	85	29	163	74.56	34.27	60.37
PART	10	4	7	71.43	58.82	68.49
PREP	105	36	64	74.47	62.13	71.62
PRON	25	0	22	100.00	53.19	85.03
PUNCT	205	48	93	81.03	68.79	78.24
SPELL	55	2	15	96.49	78.57	92.28
UNK	4	0	12	100.00	25.00	62.50
VERB	39	10	55	79.59	41.49	67.24
VERB:FORM	50	9	21	84.75	70.42	81.43
VERB:SVA	48	6	11	88.89	81.36	87.27
VERB:TENSE	49	9	42	84.48	53.85	75.85
WO	14	8	26	63.64	35.00	54.69

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	3	100.00	0.00	0.00
M:ADV	3	0	5	100.00	37.50	75.00
M:CONJ	2	6	6	25.00	25.00	25.00
M:DET	90	13	29	87.38	75.63	84.75
M:NOUN	2	3	2	40.00	50.00	41.67
M:NOUN:POSS	4	1	0	80.00	100.00	83.33
M:OTHER	10	6	13	62.50	43.48	57.47
M:PART	3	0	1	100.00	75.00	93.75
M:PREP	18	11	15	62.07	54.55	60.40
M:PRON	20	0	9	100.00	68.97	91.74
M:PUNCT	168	35	68	82.76	71.19	80.15
M:VERB	8	4	2	66.67	80.00	68.97
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	8	2	9	80.00	47.06	70.18
R:ADJ	7	2	6	77.78	53.85	71.43
R:ADJ:FORM	2	1	0	66.67	100.00	71.43
R:ADV	5	1	6	83.33	45.45	71.43
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	24	1	31	96.00	43.64	77.42
R:MORPH	25	1	13	96.15	65.79	88.03
R:NOUN	18	5	21	78.26	46.15	68.70
R:NOUN:NUM	59	19	16	75.64	78.67	76.23
R:NOUN:POSS	2	0	0	100.00	100.00	100.00
R:ORTH	45	5	46	90.00	49.45	77.32
R:OTHER	70	18	139	79.55	33.49	62.39
R:PART	6	4	4	60.00	60.00	60.00
R:PREP	67	21	40	76.14	62.62	72.98
R:PRON	2	0	8	100.00	20.00	55.56
R:PUNCT	26	10	16	72.22	61.90	69.89
R:SPELL	55	2	15	96.49	78.57	92.28
R:VERB	29	4	47	87.88	38.16	69.71
R:VERB:FORM	46	8	19	85.19	70.77	81.85
R:VERB:SVA	48	6	11	88.89	81.36	87.27
R:VERB:TENSE	34	7	29	82.93	53.97	74.89
R:WO	14	8	26	63.64	35.00	54.69
U:ADJ	1	1	2	50.00	33.33	45.45
U:ADV	5	2	6	71.43	45.45	64.10
U:CONJ	0	1	1	0.00	0.00	0.00
U:CONTR	1	1	0	50.00	100.00	55.56
U:DET	46	11	15	80.70	75.41	79.58
U:NOUN	2	5	4	28.57	33.33	29.41
U:NOUN:POSS	4	1	2	80.00	66.67	76.92
U:OTHER	5	5	11	50.00	31.25	44.64
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	20	4	9	83.33	68.97	80.00
U:PRON	3	0	5	100.00	37.50	75.00
U:PUNCT	11	3	9	78.57	55.00	72.37
U:VERB	2	2	6	50.00	25.00	41.67
U:VERB:FORM	3	1	2	75.00	60.00	71.43
U:VERB:TENSE	7	0	4	100.00	63.64	89.74
UNK	4	0	12	100.00	25.00	62.50

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	366	45	178	89.05	67.28	83.64
R	759	80	576	90.46	56.85	80.90
U	133	21	114	86.36	53.85	77.06
UNK	6	0	10	100.00	37.50	75.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	10	2	15	83.33	40.00	68.49
ADJ:FORM	3	0	0	100.00	100.00	100.00
ADV	15	0	20	100.00	42.86	78.95
CONJ	4	0	12	100.00	25.00	62.50
CONTR	2	0	0	100.00	100.00	100.00
DET	159	18	74	89.83	68.24	84.48
MORPH	27	0	13	100.00	67.50	91.22
NOUN	28	8	27	77.78	50.91	70.35
NOUN:NUM	57	12	17	82.61	77.03	81.43
NOUN:POSS	12	0	4	100.00	75.00	93.75
ORTH	74	3	37	96.10	66.67	88.31
OTHER	187	17	238	91.67	44.00	75.34
PART	8	2	3	80.00	72.73	78.43
PREP	107	25	71	81.06	60.11	75.78
PRON	28	0	20	100.00	58.33	87.50
PUNCT	236	32	101	88.06	70.03	83.75
SPELL	53	2	15	96.36	77.94	92.01
UNK	6	0	10	100.00	37.50	75.00
VERB	51	3	69	94.44	42.50	75.89
VERB:FORM	51	4	19	92.73	72.86	87.93
VERB:SVA	45	5	11	90.00	80.36	87.89
VERB:TENSE	55	5	65	91.67	45.83	76.39
WO	46	8	37	85.19	55.42	76.92

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	3	100.00	25.00	62.50
M:ADV	3	0	6	100.00	33.33	71.43
M:CONJ	4	0	7	100.00	36.36	74.07
M:DET	89	4	29	95.70	75.42	90.82
M:NOUN	3	3	4	50.00	42.86	48.39
M:NOUN:POSS	4	0	1	100.00	80.00	95.24
M:OTHER	12	4	14	75.00	46.15	66.67
M:PART	3	0	0	100.00	100.00	100.00
M:PREP	17	8	18	68.00	48.57	62.96
M:PRON	21	0	7	100.00	75.00	93.75
M:PUNCT	184	25	72	88.04	71.88	84.25
M:VERB	14	1	5	93.33	73.68	88.61
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	10	0	12	100.00	45.45	80.65
R:ADJ	9	1	10	90.00	47.37	76.27
R:ADJ:FORM	3	0	0	100.00	100.00	100.00
R:ADV	4	0	9	100.00	30.77	68.97
R:CONJ	0	0	5	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	25	2	27	92.59	48.08	78.13
R:MORPH	27	0	13	100.00	67.50	91.22
R:NOUN	23	3	20	88.46	53.49	78.23
R:NOUN:NUM	57	12	17	82.61	77.03	81.43
R:NOUN:POSS	4	0	1	100.00	80.00	95.24
R:ORTH	74	3	37	96.10	66.67	88.31
R:OTHER	156	9	185	94.55	45.75	77.92
R:PART	4	2	1	66.67	80.00	68.97
R:PREP	68	17	42	80.00	61.82	75.56
R:PRON	2	0	9	100.00	18.18	52.63
R:PUNCT	39	6	19	86.67	67.24	81.93
R:SPELL	53	2	15	96.36	77.94	92.01
R:VERB	33	1	55	97.06	37.50	73.66
R:VERB:FORM	47	4	17	92.16	73.44	87.69
R:VERB:SVA	45	5	11	90.00	80.36	87.89
R:VERB:TENSE	39	5	46	88.64	45.88	74.71
R:WO	46	8	37	85.19	55.42	76.92
U:ADJ	0	1	2	0.00	0.00	0.00
U:ADV	8	0	5	100.00	61.54	88.89
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	45	12	18	78.95	71.43	77.32
U:NOUN	2	2	3	50.00	40.00	47.62
U:NOUN:POSS	4	0	2	100.00	66.67	90.91
U:OTHER	19	4	39	82.61	32.76	63.33
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	22	0	11	100.00	66.67	90.91
U:PRON	5	0	4	100.00	55.56	86.21
U:PUNCT	13	1	10	92.86	56.52	82.28
U:VERB	4	1	9	80.00	30.77	60.61
U:VERB:FORM	3	0	2	100.00	60.00	88.24
U:VERB:TENSE	6	0	7	100.00	46.15	81.08
UNK	6	0	10	100.00	37.50	75.00

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	425	131	251	76.44	62.87	73.28
Span-level detection	472	85	245	84.74	65.83	80.14
Token-level detection	544	60	279	90.07	66.10	83.98

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	164	37	60	81.59	73.21	79.77
R	204	75	167	73.12	54.99	68.59
U	57	19	24	75.00	70.37	74.03

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	1	6	50.00	14.29	33.33
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	3	2	2	60.00	60.00	60.00
CONJ	0	1	3	0.00	0.00	0.00
CONTR	3	0	0	100.00	100.00	100.00
DET	74	26	32	74.00	69.81	73.12
MORPH	13	1	9	92.86	59.09	83.33
NOUN	3	9	8	25.00	27.27	25.42
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	28	9	9	75.68	75.68	75.68
NOUN:POSS	3	2	4	60.00	42.86	55.56
ORTH	32	6	12	84.21	72.73	81.63
OTHER	22	11	39	66.67	36.07	56.99
PART	2	1	1	66.67	66.67	66.67
PREP	45	13	26	77.59	63.38	74.26
PRON	5	2	6	71.43	45.45	64.10
PUNCT	120	20	26	85.71	82.19	84.99
SPELL	19	6	17	76.00	52.78	69.85
VERB	3	3	17	50.00	15.00	34.09
VERB:FORM	13	7	3	65.00	81.25	67.71
VERB:SVA	7	2	2	77.78	77.78	77.78
VERB:TENSE	18	4	17	81.82	51.43	73.17
WO	9	5	10	64.29	47.37	60.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	1	1	0	50.00	100.00	55.56
M:CONJ	0	1	2	0.00	0.00	0.00
M:DET	36	11	15	76.60	70.59	75.31
M:NOUN	1	1	1	50.00	50.00	50.00
M:NOUN:POSS	0	1	0	0.00	100.00	0.00
M:OTHER	2	1	6	66.67	25.00	50.00
M:PREP	12	1	8	92.31	60.00	83.33
M:PRON	2	1	4	66.67	33.33	55.56
M:PUNCT	104	17	18	85.95	85.25	85.81
M:VERB	0	2	2	0.00	0.00	0.00
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	4	0	2	100.00	66.67	90.91
R:ADJ	1	1	3	50.00	25.00	41.67
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	6	4	7	60.00	46.15	56.60
R:MORPH	13	1	9	92.86	59.09	83.33
R:NOUN	2	7	6	22.22	25.00	22.73
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	28	9	9	75.68	75.68	75.68
R:NOUN:POSS	1	0	4	100.00	20.00	55.56
R:ORTH	32	6	12	84.21	72.73	81.63
R:OTHER	19	9	32	67.86	37.25	58.28
R:PART	2	1	1	66.67	66.67	66.67
R:PREP	30	10	13	75.00	69.77	73.89
R:PRON	2	1	1	66.67	66.67	66.67
R:PUNCT	5	1	5	83.33	50.00	73.53
R:SPELL	19	6	17	76.00	52.78	69.85
R:VERB	3	1	14	75.00	17.65	45.45
R:VERB:FORM	10	7	3	58.82	76.92	61.73
R:VERB:SVA	7	2	2	77.78	77.78	77.78
R:VERB:TENSE	11	4	14	73.33	44.00	64.71
R:WO	9	5	10	64.29	47.37	60.00
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	1	1	0	50.00	100.00	55.56
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	32	11	10	74.42	76.19	74.77
U:NOUN	0	1	1	0.00	0.00	0.00
U:NOUN:POSS	2	1	0	66.67	100.00	71.43
U:OTHER	1	1	1	50.00	50.00	50.00
U:PREP	3	2	5	60.00	37.50	53.57
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	11	2	3	84.62	78.57	83.33
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	3	0	1	100.00	75.00	93.75

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	173	29	60	85.64	74.25	83.09
R	242	41	154	85.51	61.11	79.19
U	56	15	28	78.87	66.67	76.09
UNK	1	0	3	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	6	100.00	14.29	45.45
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	2	2	3	50.00	40.00	47.62
CONJ	0	1	2	0.00	0.00	0.00
CONTR	3	0	0	100.00	100.00	100.00
DET	77	20	34	79.38	69.37	77.15
MORPH	14	1	10	93.33	58.33	83.33
NOUN	7	2	8	77.78	46.67	68.63
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	27	7	6	79.41	81.82	79.88
NOUN:POSS	3	2	4	60.00	42.86	55.56
ORTH	34	4	12	89.47	73.91	85.86
OTHER	29	6	40	82.86	42.03	69.38
PART	2	0	1	100.00	66.67	90.91
PREP	49	6	27	89.09	64.47	82.77
PRON	8	2	5	80.00	61.54	75.47
PUNCT	125	17	26	88.03	82.78	86.93
SPELL	31	1	8	96.88	79.49	92.81
UNK	1	0	3	100.00	25.00	62.50
VERB	5	2	17	71.43	22.73	50.00
VERB:FORM	15	3	3	83.33	83.33	83.33
VERB:SVA	9	1	2	90.00	81.82	88.24
VERB:TENSE	20	3	17	86.96	54.05	77.52
WO	8	5	9	61.54	47.06	57.97

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	0	1	0	0.00	100.00	0.00
M:CONJ	0	1	2	0.00	0.00	0.00
M:DET	38	8	14	82.61	73.08	80.51
M:NOUN	2	0	2	100.00	50.00	83.33
M:NOUN:POSS	0	1	0	0.00	100.00	0.00
M:OTHER	3	1	7	75.00	30.00	57.69
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	13	0	8	100.00	61.90	89.04
M:PRON	3	1	3	75.00	50.00	68.18
M:PUNCT	108	14	17	88.52	86.40	88.09
M:VERB	0	2	2	0.00	0.00	0.00
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	4	0	2	100.00	66.67	90.91
R:ADJ	1	0	3	100.00	25.00	62.50
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	3	100.00	25.00	62.50
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	8	3	8	72.73	50.00	66.67
R:MORPH	14	1	10	93.33	58.33	83.33
R:NOUN	5	2	5	71.43	50.00	65.79
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	27	7	6	79.41	81.82	79.88
R:NOUN:POSS	1	0	4	100.00	20.00	55.56
R:ORTH	34	4	12	89.47	73.91	85.86
R:OTHER	25	4	31	86.21	44.64	72.67
R:PART	2	0	0	100.00	100.00	100.00
R:PREP	34	5	13	87.18	72.34	83.74
R:PRON	4	1	1	80.00	80.00	80.00
R:PUNCT	5	1	6	83.33	45.45	71.43
R:SPELL	31	1	8	96.88	79.49	92.81
R:VERB	5	0	14	100.00	26.32	64.10
R:VERB:FORM	12	3	3	80.00	80.00	80.00
R:VERB:SVA	9	1	2	90.00	81.82	88.24
R:VERB:TENSE	13	3	14	81.25	48.15	71.43
R:WO	8	5	9	61.54	47.06	57.97
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	1	1	0	50.00	100.00	55.56
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	31	9	12	77.50	72.09	76.35
U:NOUN	0	0	1	100.00	0.00	0.00
U:NOUN:POSS	2	1	0	66.67	100.00	71.43
U:OTHER	1	1	2	50.00	33.33	45.45
U:PREP	2	1	6	66.67	25.00	50.00
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	12	2	3	85.71	80.00	84.51
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	3	0	1	100.00	75.00	93.75
UNK	1	0	3	100.00	25.00	62.50

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	187	21	64	89.90	74.50	86.33
R	292	27	173	91.54	62.80	83.86
U	62	12	34	83.78	64.58	79.08
UNK	3	0	8	100.00	27.27	65.22

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	7	100.00	12.50	41.67
ADJ:FORM	0	0	3	100.00	0.00	0.00
ADV	4	1	4	80.00	50.00	71.43
CONJ	2	0	2	100.00	50.00	83.33
CONTR	3	0	1	100.00	75.00	93.75
DET	77	14	31	84.62	71.30	81.57
MORPH	14	1	8	93.33	63.64	85.37
NOUN	8	0	8	100.00	50.00	83.33
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	27	2	6	93.10	81.82	90.60
NOUN:POSS	5	1	5	83.33	50.00	73.53
ORTH	42	3	11	93.33	79.25	90.13
OTHER	56	8	65	87.50	46.28	74.27
PART	2	0	1	100.00	66.67	90.91
PREP	50	5	25	90.91	66.67	84.75
PRON	9	2	5	81.82	64.29	77.59
PUNCT	140	13	30	91.50	82.35	89.51
SPELL	32	0	6	100.00	84.21	96.39
UNK	3	0	8	100.00	27.27	65.22
VERB	7	1	17	87.50	29.17	62.50
VERB:FORM	16	1	3	94.12	84.21	91.95
VERB:SVA	8	1	2	88.89	80.00	86.96
VERB:TENSE	17	4	19	80.95	47.22	70.83
WO	19	3	12	86.36	61.29	79.83

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	3	100.00	0.00	0.00
M:CONJ	2	0	2	100.00	50.00	83.33
M:DET	40	5	12	88.89	76.92	86.21
M:NOUN	2	0	2	100.00	50.00	83.33
M:NOUN:POSS	1	1	0	50.00	100.00	55.56
M:OTHER	4	1	9	80.00	30.77	60.61
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	15	0	7	100.00	68.18	91.46
M:PRON	4	1	3	80.00	57.14	74.07
M:PUNCT	115	11	20	91.27	85.19	89.98
M:VERB	0	1	3	0.00	0.00	0.00
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	2	1	2	66.67	50.00	62.50
R:ADJ	1	0	2	100.00	33.33	71.43
R:ADJ:FORM	0	0	3	100.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	7	3	8	70.00	46.67	63.64
R:MORPH	14	1	8	93.33	63.64	85.37
R:NOUN	5	0	6	100.00	45.45	80.65
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	27	2	6	93.10	81.82	90.60
R:NOUN:POSS	2	0	5	100.00	28.57	66.67
R:ORTH	42	3	11	93.33	79.25	90.13
R:OTHER	51	4	50	92.73	50.50	79.44
R:PART	2	0	0	100.00	100.00	100.00
R:PREP	33	4	12	89.19	73.33	85.49
R:PRON	4	1	1	80.00	80.00	80.00
R:PUNCT	9	1	7	90.00	56.25	80.36
R:SPELL	32	0	6	100.00	84.21	96.39
R:VERB	7	0	13	100.00	35.00	72.92
R:VERB:FORM	13	1	3	92.86	81.25	90.28
R:VERB:SVA	8	1	2	88.89	80.00	86.96
R:VERB:TENSE	12	3	16	80.00	42.86	68.18
R:WO	19	3	12	86.36	61.29	79.83
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	3	1	2	75.00	60.00	71.43
U:CONTR	2	0	1	100.00	66.67	90.91
U:DET	30	6	11	83.33	73.17	81.08
U:NOUN	1	0	0	100.00	100.00	100.00
U:NOUN:POSS	2	0	0	100.00	100.00	100.00
U:OTHER	1	3	6	25.00	14.29	21.74
U:PREP	2	1	6	66.67	25.00	50.00
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	16	1	3	94.12	84.21	91.95
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	3	0	1	100.00	75.00	93.75
UNK	3	0	8	100.00	27.27	65.22

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	322	152	221	67.93	59.30	66.01
Span-level detection	371	103	198	78.27	65.20	75.25
Token-level detection	424	81	221	83.96	65.74	79.55

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	125	35	37	78.12	77.16	77.93
R	182	90	166	66.91	52.30	63.37
U	15	27	18	35.71	45.45	37.31

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	5	2	37.50	60.00	40.54
ADV	0	2	0	0.00	100.00	0.00
CONJ	1	2	0	33.33	100.00	38.46
CONTR	0	1	0	0.00	100.00	0.00
DET	15	27	5	35.71	75.00	39.89
MORPH	4	0	2	100.00	66.67	90.91
NOUN	4	8	7	33.33	36.36	33.90
NOUN:INFL	0	0	11	100.00	0.00	0.00
NOUN:NUM	16	8	4	66.67	80.00	68.97
NOUN:POSS	8	4	9	66.67	47.06	61.54
ORTH	26	2	28	92.86	48.15	78.31
OTHER	20	18	34	52.63	37.04	48.54
PART	1	1	0	50.00	100.00	55.56
PREP	10	18	13	35.71	43.48	37.04
PRON	3	2	3	60.00	50.00	57.69
PUNCT	129	26	41	83.23	75.88	81.65
SPELL	55	10	42	84.62	56.70	77.03
VERB	5	3	9	62.50	35.71	54.35
VERB:FORM	10	6	3	62.50	76.92	64.94
VERB:INFL	3	0	2	100.00	60.00	88.24
VERB:SVA	5	5	2	50.00	71.43	53.19
VERB:TENSE	4	3	3	57.14	57.14	57.14
WO	0	1	1	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	0	1	0	0.00	100.00	0.00
M:DET	7	5	2	58.33	77.78	61.40
M:NOUN	0	1	2	0.00	0.00	0.00
M:NOUN:POSS	2	2	4	50.00	33.33	45.45
M:PREP	2	3	0	40.00	100.00	45.45
M:PRON	1	1	2	50.00	33.33	45.45
M:PUNCT	112	21	25	84.21	81.75	83.71
M:VERB	1	1	2	50.00	33.33	45.45
R:ADJ	3	5	2	37.50	60.00	40.54
R:ADV	0	1	0	0.00	100.00	0.00
R:DET	1	7	0	12.50	100.00	15.15
R:MORPH	4	0	2	100.00	66.67	90.91
R:NOUN	4	7	5	36.36	44.44	37.74
R:NOUN:INFL	0	0	11	100.00	0.00	0.00
R:NOUN:NUM	16	8	4	66.67	80.00	68.97
R:NOUN:POSS	6	1	5	85.71	54.55	76.92
R:ORTH	26	2	28	92.86	48.15	78.31
R:OTHER	20	16	33	55.56	37.74	50.76
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	8	10	10	44.44	44.44	44.44
R:PRON	2	1	1	66.67	66.67	66.67
R:PUNCT	12	4	8	75.00	60.00	71.43
R:SPELL	55	10	42	84.62	56.70	77.03
R:VERB	3	2	6	60.00	33.33	51.72
R:VERB:FORM	10	6	2	62.50	83.33	65.79
R:VERB:INFL	3	0	2	100.00	60.00	88.24
R:VERB:SVA	5	5	2	50.00	71.43	53.19
R:VERB:TENSE	4	3	2	57.14	66.67	58.82
R:WO	0	1	1	0.00	0.00	0.00
U:ADV	0	1	0	0.00	100.00	0.00
U:CONJ	1	1	0	50.00	100.00	55.56
U:CONTR	0	1	0	0.00	100.00	0.00
U:DET	7	15	3	31.82	70.00	35.71
U:NOUN:POSS	0	1	0	0.00	100.00	0.00
U:OTHER	0	2	1	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	0	5	3	0.00	0.00	0.00
U:PUNCT	5	1	8	83.33	38.46	67.57
U:VERB	1	0	1	100.00	50.00	83.33
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	0	0	1	100.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	129	31	41	80.63	75.88	79.63
R	225	47	138	82.72	61.98	77.53
U	16	25	17	39.02	48.48	40.61
UNK	1	0	2	100.00	33.33	71.43

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	1	0	83.33	100.00	86.21
ADV	0	2	1	0.00	0.00	0.00
CONJ	1	2	0	33.33	100.00	38.46
DET	16	26	6	38.10	72.73	42.11
MORPH	3	0	2	100.00	60.00	88.24
NOUN	5	1	7	83.33	41.67	69.44
NOUN:INFL	3	0	8	100.00	27.27	65.22
NOUN:NUM	16	7	5	69.57	76.19	70.80
NOUN:POSS	9	4	8	69.23	52.94	65.22
ORTH	30	2	27	93.75	52.63	81.08
OTHER	31	4	31	88.57	50.00	76.73
PART	1	1	0	50.00	100.00	55.56
PREP	12	14	9	46.15	57.14	48.00
PRON	4	1	2	80.00	66.67	76.92
PUNCT	132	24	48	84.62	73.33	82.09
SPELL	71	0	25	100.00	73.96	93.42
UNK	1	0	2	100.00	33.33	71.43
VERB	6	1	8	85.71	42.86	71.43
VERB:FORM	10	5	2	66.67	83.33	69.44
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	6	5	2	54.55	75.00	57.69
VERB:TENSE	5	2	3	71.43	62.50	69.44
WO	0	1	1	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	0	1	0	0.00	100.00	0.00
M:DET	7	4	2	63.64	77.78	66.04
M:NOUN	0	1	2	0.00	0.00	0.00
M:NOUN:POSS	2	2	4	50.00	33.33	45.45
M:OTHER	1	0	1	100.00	50.00	83.33
M:PREP	2	2	0	50.00	100.00	55.56
M:PRON	2	0	1	100.00	66.67	90.91
M:PUNCT	114	20	29	85.07	79.72	83.95
M:VERB	1	1	2	50.00	33.33	45.45
R:ADJ	5	1	0	83.33	100.00	86.21
R:ADV	0	1	1	0.00	0.00	0.00
R:DET	1	7	0	12.50	100.00	15.15
R:MORPH	3	0	2	100.00	60.00	88.24
R:NOUN	5	0	5	100.00	50.00	83.33
R:NOUN:INFL	3	0	8	100.00	27.27	65.22
R:NOUN:NUM	16	7	5	69.57	76.19	70.80
R:NOUN:POSS	7	1	4	87.50	63.64	81.40
R:ORTH	30	2	27	93.75	52.63	81.08
R:OTHER	30	2	29	93.75	50.85	80.21
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	10	8	8	55.56	55.56	55.56
R:PRON	2	1	1	66.67	66.67	66.67
R:PUNCT	13	3	10	81.25	56.52	74.71
R:SPELL	71	0	25	100.00	73.96	93.42
R:VERB	4	0	5	100.00	44.44	80.00
R:VERB:FORM	10	5	2	66.67	83.33	69.44
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	6	5	2	54.55	75.00	57.69
R:VERB:TENSE	5	2	2	71.43	71.43	71.43
R:WO	0	1	1	0.00	0.00	0.00
U:ADV	0	1	0	0.00	100.00	0.00
U:CONJ	1	1	0	50.00	100.00	55.56
U:DET	8	15	4	34.78	66.67	38.46
U:NOUN:POSS	0	1	0	0.00	100.00	0.00
U:OTHER	0	2	1	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	0	4	1	0.00	0.00	0.00
U:PUNCT	5	1	9	83.33	35.71	65.79
U:VERB	1	0	1	100.00	50.00	83.33
U:VERB:TENSE	0	0	1	100.00	0.00	0.00
UNK	1	0	2	100.00	33.33	71.43

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	136	22	42	86.08	76.40	83.95
R	270	39	154	87.38	63.68	81.33
U	16	20	22	44.44	42.11	43.96
UNK	2	0	3	100.00	40.00	76.92

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	1	1	83.33	83.33	83.33
ADV	0	1	1	0.00	0.00	0.00
CONJ	2	1	0	66.67	100.00	71.43
CONTR	0	0	2	100.00	0.00	0.00
DET	16	21	9	43.24	64.00	46.24
MORPH	4	0	1	100.00	80.00	95.24
NOUN	6	1	9	85.71	40.00	69.77
NOUN:INFL	3	0	8	100.00	27.27	65.22
NOUN:NUM	16	6	5	72.73	76.19	73.39
NOUN:POSS	11	2	10	84.62	52.38	75.34
ORTH	49	2	37	96.08	56.98	84.48
OTHER	50	5	34	90.91	59.52	82.24
PREP	12	10	9	54.55	57.14	55.05
PRON	5	1	1	83.33	83.33	83.33
PUNCT	138	15	52	90.20	72.63	86.03
SPELL	73	0	24	100.00	75.26	93.83
UNK	2	0	3	100.00	40.00	76.92
VERB	6	2	6	75.00	50.00	68.18
VERB:FORM	11	5	2	68.75	84.62	71.43
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	6	4	3	60.00	66.67	61.22
VERB:TENSE	5	3	3	62.50	62.50	62.50
WO	0	1	0	0.00	100.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	1	0	0	100.00	100.00	100.00
M:DET	7	1	2	87.50	77.78	85.37
M:NOUN	1	1	3	50.00	25.00	41.67
M:NOUN:POSS	2	2	4	50.00	33.33	45.45
M:OTHER	2	0	0	100.00	100.00	100.00
M:PREP	2	1	0	66.67	100.00	71.43
M:PRON	3	0	0	100.00	100.00	100.00
M:PUNCT	117	15	32	88.64	78.52	86.41
M:VERB	1	2	1	33.33	50.00	35.71
R:ADJ	5	1	0	83.33	100.00	86.21
R:ADV	0	1	1	0.00	0.00	0.00
R:CONTR	0	0	2	100.00	0.00	0.00
R:DET	1	6	1	14.29	50.00	16.67
R:MORPH	4	0	1	100.00	80.00	95.24
R:NOUN	5	0	6	100.00	45.45	80.65
R:NOUN:INFL	3	0	8	100.00	27.27	65.22
R:NOUN:NUM	16	6	5	72.73	76.19	73.39
R:NOUN:POSS	9	0	6	100.00	60.00	88.24
R:ORTH	49	2	37	96.08	56.98	84.48
R:OTHER	48	2	32	96.00	60.00	85.71
R:PREP	10	7	7	58.82	58.82	58.82
R:PRON	2	1	1	66.67	66.67	66.67
R:PUNCT	15	0	11	100.00	57.69	87.21
R:SPELL	73	0	24	100.00	75.26	93.83
R:VERB	4	0	4	100.00	50.00	83.33
R:VERB:FORM	11	5	2	68.75	84.62	71.43
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	6	4	3	60.00	66.67	61.22
R:VERB:TENSE	5	3	2	62.50	71.43	64.10
R:WO	0	1	0	0.00	100.00	0.00
U:ADJ	0	0	1	100.00	0.00	0.00
U:CONJ	1	1	0	50.00	100.00	55.56
U:DET	8	14	6	36.36	57.14	39.22
U:OTHER	0	3	2	0.00	0.00	0.00
U:PREP	0	2	2	0.00	0.00	0.00
U:PUNCT	6	0	9	100.00	40.00	76.92
U:VERB	1	0	1	100.00	50.00	83.33
U:VERB:TENSE	0	0	1	100.00	0.00	0.00
UNK	2	0	3	100.00	40.00	76.92

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:43:22+00:00
Competition submission:	5
Competition phase:	3 - Open phase

Detailed results

Submission information

Results