BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	2926	1244	2357	70.17	55.39	66.61
Span-level detection	3336	841	2204	79.87	60.22	74.97
Token-level detection	4102	553	2470	88.12	62.42	81.41

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	889	288	565	75.53	61.14	72.14
R	1748	847	1542	67.36	53.13	63.94
U	289	109	250	72.61	53.62	67.81

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	18	19	24	48.65	42.86	47.37
ADJ:FORM	7	1	3	87.50	70.00	83.33
ADV	29	18	39	61.70	42.65	56.64
CONJ	6	7	17	46.15	26.09	40.00
CONTR	11	1	1	91.67	91.67	91.67
DET	362	99	270	78.52	57.28	73.10
MORPH	113	46	52	71.07	68.48	70.54
NOUN	36	70	80	33.96	31.03	33.33
NOUN:INFL	12	4	7	75.00	63.16	72.29
NOUN:NUM	192	69	63	73.56	75.29	73.90
NOUN:POSS	30	12	27	71.43	52.63	66.67
ORTH	124	94	234	56.88	34.64	50.41
OTHER	155	157	511	49.68	23.27	40.49
PART	21	9	10	70.00	67.74	69.54
PREP	267	122	204	68.64	56.69	65.86
PRON	67	23	68	74.44	49.63	67.68
PUNCT	651	178	293	78.53	68.96	76.41
SPELL	263	81	64	76.45	80.43	77.22
VERB	82	50	156	62.12	34.45	53.52
VERB:FORM	169	50	38	77.17	81.64	78.02
VERB:INFL	7	0	1	100.00	87.50	97.22
VERB:SVA	131	35	20	78.92	86.75	80.37
VERB:TENSE	124	69	128	64.25	49.21	60.55
WO	49	30	47	62.03	51.04	59.47

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	4	7	33.33	22.22	30.30
M:ADV	7	10	18	41.18	28.00	37.63
M:CONJ	4	7	13	36.36	23.53	32.79
M:CONTR	1	0	0	100.00	100.00	100.00
M:DET	185	54	114	77.41	61.87	73.71
M:NOUN	2	12	8	14.29	20.00	15.15
M:NOUN:POSS	9	6	7	60.00	56.25	59.21
M:OTHER	15	17	46	46.88	24.59	39.68
M:PART	2	2	3	50.00	40.00	47.62
M:PREP	45	29	57	60.81	44.12	56.53
M:PRON	39	16	28	70.91	58.21	67.94
M:PUNCT	527	108	215	82.99	71.02	80.29
M:VERB	17	7	20	70.83	45.95	63.91
M:VERB:FORM	12	5	7	70.59	63.16	68.97
M:VERB:TENSE	22	11	22	66.67	50.00	62.50
R:ADJ	11	9	13	55.00	45.83	52.88
R:ADJ:FORM	7	1	3	87.50	70.00	83.33
R:ADV	9	4	9	69.23	50.00	64.29
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	4	1	0	80.00	100.00	83.33
R:DET	48	15	66	76.19	42.11	65.57
R:MORPH	113	46	52	71.07	68.48	70.54
R:NOUN	32	40	62	44.44	34.04	41.88
R:NOUN:INFL	12	4	7	75.00	63.16	72.29
R:NOUN:NUM	192	69	63	73.56	75.29	73.90
R:NOUN:POSS	14	4	16	77.78	46.67	68.63
R:ORTH	124	94	234	56.88	34.64	50.41
R:OTHER	130	127	443	50.58	22.69	40.60
R:PART	15	7	5	68.18	75.00	69.44
R:PREP	182	81	110	69.20	62.33	67.71
R:PRON	19	5	28	79.17	40.43	66.43
R:PUNCT	91	61	52	59.87	63.64	60.59
R:SPELL	263	81	64	76.45	80.43	77.22
R:VERB	55	35	118	61.11	31.79	51.59
R:VERB:FORM	153	44	28	77.66	84.53	78.95
R:VERB:INFL	7	0	1	100.00	87.50	97.22
R:VERB:SVA	131	35	20	78.92	86.75	80.37
R:VERB:TENSE	87	54	99	61.70	46.77	58.00
R:WO	49	30	47	62.03	51.04	59.47
U:ADJ	5	6	4	45.45	55.56	47.17
U:ADV	13	4	12	76.47	52.00	69.89
U:CONJ	2	0	2	100.00	50.00	83.33
U:CONTR	6	0	1	100.00	85.71	96.77
U:DET	129	30	90	81.13	58.90	75.44
U:NOUN	2	18	10	10.00	16.67	10.87
U:NOUN:POSS	7	2	4	77.78	63.64	74.47
U:OTHER	10	13	22	43.48	31.25	40.32
U:PART	4	0	2	100.00	66.67	90.91
U:PREP	40	12	37	76.92	51.95	70.18
U:PRON	9	2	12	81.82	42.86	69.23
U:PUNCT	33	9	26	78.57	55.93	72.69
U:VERB	10	8	18	55.56	35.71	50.00
U:VERB:FORM	4	1	3	80.00	57.14	74.07
U:VERB:TENSE	15	4	7	78.95	68.18	76.53

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	959	216	522	81.62	64.75	77.58
R	2037	540	1374	79.05	59.72	74.24
U	309	85	253	78.43	54.98	72.26
UNK	31	0	55	100.00	36.05	73.81

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	28	14	25	66.67	52.83	63.35
ADJ:FORM	6	1	4	85.71	60.00	78.95
ADV	32	14	44	69.57	42.11	61.54
CONJ	7	2	19	77.78	26.92	56.45
CONTR	9	1	1	90.00	90.00	90.00
DET	389	79	247	83.12	61.16	77.55
MORPH	115	26	50	81.56	69.70	78.88
NOUN	57	46	79	55.34	41.91	52.01
NOUN:INFL	15	1	4	93.75	78.95	90.36
NOUN:NUM	188	50	65	78.99	74.31	78.01
NOUN:POSS	32	10	25	76.19	56.14	71.11
ORTH	140	71	220	66.35	38.89	58.14
OTHER	324	97	428	76.96	43.09	66.50
PART	24	8	12	75.00	66.67	73.17
PREP	298	78	184	79.26	61.83	75.03
PRON	77	14	58	84.62	57.04	77.15
PUNCT	672	149	284	81.85	70.29	79.25
SPELL	273	37	43	88.06	86.39	87.72
UNK	31	0	55	100.00	36.05	73.81
VERB	120	24	145	83.33	45.28	71.34
VERB:FORM	164	37	37	81.59	81.59	81.59
VERB:INFL	7	0	3	100.00	70.00	92.11
VERB:SVA	143	18	13	88.82	91.67	89.38
VERB:TENSE	139	38	116	78.53	54.51	72.17
WO	46	26	43	63.89	51.69	61.01

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	3	6	50.00	33.33	45.45
M:ADV	9	6	16	60.00	36.00	52.94
M:CONJ	5	2	15	71.43	25.00	52.08
M:DET	203	42	98	82.86	67.44	79.23
M:NOUN	6	7	7	46.15	46.15	46.15
M:NOUN:POSS	9	6	8	60.00	52.94	58.44
M:OTHER	27	13	37	67.50	42.19	60.27
M:PART	2	2	3	50.00	40.00	47.62
M:PREP	48	23	55	67.61	46.60	62.02
M:PRON	44	12	26	78.57	62.86	74.83
M:PUNCT	544	85	208	86.49	72.34	83.23
M:VERB	21	4	19	84.00	52.50	75.00
M:VERB:FORM	13	4	5	76.47	72.22	75.58
M:VERB:TENSE	25	7	19	78.12	56.82	72.67
R:ADJ	20	5	15	80.00	57.14	74.07
R:ADJ:FORM	6	1	4	85.71	60.00	78.95
R:ADV	10	4	15	71.43	40.00	61.73
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	3	1	0	75.00	100.00	78.95
R:DET	55	13	61	80.88	47.41	70.88
R:MORPH	115	26	50	81.56	69.70	78.88
R:NOUN	47	25	61	65.28	43.52	59.34
R:NOUN:INFL	15	1	4	93.75	78.95	90.36
R:NOUN:NUM	188	50	65	78.99	74.31	78.01
R:NOUN:POSS	16	2	13	88.89	55.17	79.21
R:ORTH	140	71	220	66.35	38.89	58.14
R:OTHER	286	72	367	79.89	43.80	68.59
R:PART	18	6	6	75.00	75.00	75.00
R:PREP	207	48	94	81.18	68.77	78.35
R:PRON	21	0	23	100.00	47.73	82.03
R:PUNCT	93	56	49	62.42	65.49	63.01
R:SPELL	273	37	43	88.06	86.39	87.72
R:VERB	86	16	108	84.31	44.33	71.43
R:VERB:FORM	148	32	29	82.22	83.62	82.50
R:VERB:INFL	7	0	3	100.00	70.00	92.11
R:VERB:SVA	143	18	13	88.82	91.67	89.38
R:VERB:TENSE	94	30	87	75.81	51.93	69.42
R:WO	46	26	43	63.89	51.69	61.01
U:ADJ	5	6	4	45.45	55.56	47.17
U:ADV	13	4	13	76.47	50.00	69.15
U:CONJ	2	0	3	100.00	40.00	76.92
U:CONTR	6	0	1	100.00	85.71	96.77
U:DET	131	24	88	84.52	59.82	78.07
U:NOUN	4	14	11	22.22	26.67	22.99
U:NOUN:POSS	7	2	4	77.78	63.64	74.47
U:OTHER	11	12	24	47.83	31.43	43.31
U:PART	4	0	3	100.00	57.14	86.96
U:PREP	43	7	35	86.00	55.13	77.34
U:PRON	12	2	9	85.71	57.14	77.92
U:PUNCT	35	8	27	81.40	56.45	74.79
U:VERB	13	4	18	76.47	41.94	65.66
U:VERB:FORM	3	1	3	75.00	50.00	68.18
U:VERB:TENSE	20	1	10	95.24	66.67	87.72
UNK	31	0	55	100.00	36.05	73.81

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	1100	120	517	90.16	68.03	84.65
R	2568	378	1554	87.17	62.30	80.72
U	381	55	317	87.39	54.58	78.01
UNK	53	0	82	100.00	39.26	76.37

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	27	10	29	72.97	48.21	66.18
ADJ:FORM	5	1	5	83.33	50.00	73.53
ADV	39	7	40	84.78	49.37	74.14
CONJ	16	1	16	94.12	50.00	80.00
CONTR	9	0	3	100.00	75.00	93.75
DET	434	48	233	90.04	65.07	83.62
MORPH	117	13	51	90.00	69.64	85.03
NOUN	74	26	88	74.00	45.68	65.84
NOUN:INFL	16	1	3	94.12	84.21	91.95
NOUN:NUM	194	40	61	82.91	76.08	81.44
NOUN:POSS	44	6	26	88.00	62.86	81.48
ORTH	226	54	215	80.71	51.25	72.39
OTHER	626	67	603	90.33	50.94	78.23
PART	18	2	9	90.00	66.67	84.11
PREP	300	64	179	82.42	62.63	77.52
PRON	88	7	50	92.63	63.77	84.94
PUNCT	807	95	302	89.47	72.77	85.54
SPELL	271	22	41	92.49	86.86	91.31
UNK	53	0	82	100.00	39.26	76.37
VERB	144	14	174	91.14	45.28	75.79
VERB:FORM	166	18	35	90.22	82.59	88.58
VERB:INFL	5	0	1	100.00	83.33	96.15
VERB:SVA	143	12	15	92.26	90.51	91.90
VERB:TENSE	155	29	141	84.24	52.36	75.10
WO	125	16	68	88.65	64.77	82.56

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	2	6	50.00	25.00	41.67
M:ADV	12	3	13	80.00	48.00	70.59
M:CONJ	13	1	9	92.86	59.09	83.33
M:DET	227	16	92	93.42	71.16	87.92
M:NOUN	7	5	11	58.33	38.89	53.03
M:NOUN:POSS	15	4	5	78.95	75.00	78.12
M:OTHER	36	8	31	81.82	53.73	74.07
M:PART	4	1	3	80.00	57.14	74.07
M:PREP	57	12	53	82.61	51.82	73.83
M:PRON	50	6	23	89.29	68.49	84.18
M:PUNCT	606	58	221	91.27	73.28	86.99
M:VERB	27	1	24	96.43	52.94	82.82
M:VERB:FORM	16	0	3	100.00	84.21	96.39
M:VERB:TENSE	28	3	23	90.32	54.90	80.00
R:ADJ	21	4	18	84.00	53.85	75.54
R:ADJ:FORM	5	1	5	83.33	50.00	73.53
R:ADV	11	4	16	73.33	40.74	63.22
R:CONJ	0	0	6	100.00	0.00	0.00
R:CONTR	3	0	0	100.00	100.00	100.00
R:DET	58	11	59	84.06	49.57	73.79
R:MORPH	117	13	51	90.00	69.64	85.03
R:NOUN	59	16	61	78.67	49.17	70.24
R:NOUN:INFL	16	1	3	94.12	84.21	91.95
R:NOUN:NUM	194	40	61	82.91	76.08	81.44
R:NOUN:POSS	22	1	12	95.65	64.71	87.30
R:ORTH	226	54	215	80.71	51.25	72.39
R:OTHER	553	48	494	92.01	52.82	80.12
R:PART	11	1	2	91.67	84.62	90.16
R:PREP	199	47	88	80.89	69.34	78.28
R:PRON	25	0	19	100.00	56.82	86.81
R:PUNCT	148	32	53	82.22	73.63	80.35
R:SPELL	271	22	41	92.49	86.86	91.31
R:VERB	102	12	127	89.47	44.54	74.45
R:VERB:FORM	147	18	28	89.09	84.00	88.02
R:VERB:INFL	5	0	1	100.00	83.33	96.15
R:VERB:SVA	143	12	15	92.26	90.51	91.90
R:VERB:TENSE	107	25	111	81.06	49.08	71.72
R:WO	125	16	68	88.65	64.77	82.56
U:ADJ	4	4	5	50.00	44.44	48.78
U:ADV	16	0	11	100.00	59.26	87.91
U:CONJ	3	0	1	100.00	75.00	93.75
U:CONTR	6	0	3	100.00	66.67	90.91
U:DET	149	21	82	87.65	64.50	81.78
U:NOUN	8	5	16	61.54	33.33	52.63
U:NOUN:POSS	7	1	9	87.50	43.75	72.92
U:OTHER	37	11	78	77.08	32.17	60.26
U:PART	3	0	4	100.00	42.86	78.95
U:PREP	44	5	38	89.80	53.66	79.14
U:PRON	13	1	8	92.86	61.90	84.42
U:PUNCT	53	5	28	91.38	65.43	84.66
U:VERB	15	1	23	93.75	39.47	73.53
U:VERB:FORM	3	0	4	100.00	42.86	78.95
U:VERB:TENSE	20	1	7	95.24	74.07	90.09
UNK	53	0	82	100.00	39.26	76.37

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1243	506	1080	71.07	53.51	66.69
Span-level detection	1448	303	1007	82.70	58.98	76.54
Token-level detection	1813	156	1078	92.08	62.71	84.19

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	301	130	262	69.84	53.46	65.81
R	823	337	707	70.95	53.79	66.69
U	119	39	111	75.32	51.74	69.03

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	7	7	41.67	41.67	41.67
ADJ:FORM	3	0	1	100.00	75.00	93.75
ADV	12	5	19	70.59	38.71	60.61
CONJ	4	5	5	44.44	44.44	44.44
CONTR	6	0	0	100.00	100.00	100.00
DET	151	43	135	77.84	52.80	71.09
MORPH	59	18	25	76.62	70.24	75.26
NOUN	15	27	40	35.71	27.27	33.63
NOUN:INFL	6	0	1	100.00	85.71	96.77
NOUN:NUM	92	25	32	78.63	74.19	77.70
NOUN:POSS	7	3	7	70.00	50.00	64.81
ORTH	83	32	115	72.17	41.92	63.07
OTHER	72	75	271	48.98	20.99	38.67
PART	11	3	5	78.57	68.75	76.39
PREP	112	37	81	75.17	58.03	70.98
PRON	35	13	44	72.92	44.30	64.58
PUNCT	185	67	116	73.41	61.46	70.66
SPELL	106	30	13	77.94	89.08	79.94
VERB	44	24	68	64.71	39.29	57.29
VERB:FORM	88	25	16	77.88	84.62	79.14
VERB:INFL	3	0	0	100.00	100.00	100.00
VERB:SVA	67	20	11	77.01	85.90	78.64
VERB:TENSE	60	35	53	63.16	53.10	60.85
WO	17	12	15	58.62	53.12	57.43

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	1	50.00	50.00	50.00
M:ADV	2	4	11	33.33	15.38	27.03
M:CONJ	2	5	3	28.57	40.00	30.30
M:CONTR	1	0	0	100.00	100.00	100.00
M:DET	75	27	49	73.53	60.48	70.49
M:NOUN	0	5	3	0.00	0.00	0.00
M:NOUN:POSS	2	2	1	50.00	66.67	52.63
M:OTHER	8	7	26	53.33	23.53	42.55
M:PART	1	0	2	100.00	33.33	71.43
M:PREP	17	12	31	58.62	35.42	51.83
M:PRON	21	9	16	70.00	56.76	66.88
M:PUNCT	141	42	93	77.05	60.26	72.98
M:VERB	10	3	11	76.92	47.62	68.49
M:VERB:FORM	9	5	6	64.29	60.00	63.38
M:VERB:TENSE	11	8	9	57.89	55.00	57.29
R:ADJ	1	3	5	25.00	16.67	22.73
R:ADJ:FORM	3	0	1	100.00	75.00	93.75
R:ADV	4	0	5	100.00	44.44	80.00
R:CONTR	2	0	0	100.00	100.00	100.00
R:DET	16	5	31	76.19	34.04	61.07
R:MORPH	59	18	25	76.62	70.24	75.26
R:NOUN	13	15	31	46.43	29.55	41.67
R:NOUN:INFL	6	0	1	100.00	85.71	96.77
R:NOUN:NUM	92	25	32	78.63	74.19	77.70
R:NOUN:POSS	2	1	5	66.67	28.57	52.63
R:ORTH	83	32	115	72.17	41.92	63.07
R:OTHER	60	62	237	49.18	20.20	38.22
R:PART	9	3	2	75.00	81.82	76.27
R:PREP	75	22	39	77.32	65.79	74.70
R:PRON	11	3	18	78.57	37.93	64.71
R:PUNCT	40	24	17	62.50	70.18	63.90
R:SPELL	106	30	13	77.94	89.08	79.94
R:VERB	29	17	50	63.04	36.71	55.13
R:VERB:FORM	79	20	10	79.80	88.76	81.44
R:VERB:INFL	3	0	0	100.00	100.00	100.00
R:VERB:SVA	67	20	11	77.01	85.90	78.64
R:VERB:TENSE	46	25	44	64.79	51.11	61.50
R:WO	17	12	15	58.62	53.12	57.43
U:ADJ	3	3	1	50.00	75.00	53.57
U:ADV	6	1	3	85.71	66.67	81.08
U:CONJ	2	0	2	100.00	50.00	83.33
U:CONTR	3	0	0	100.00	100.00	100.00
U:DET	60	11	55	84.51	52.17	75.19
U:NOUN	2	7	6	22.22	25.00	22.73
U:NOUN:POSS	3	0	1	100.00	75.00	93.75
U:OTHER	4	6	8	40.00	33.33	38.46
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	20	3	11	86.96	64.52	81.30
U:PRON	3	1	10	75.00	23.08	51.72
U:PUNCT	4	1	6	80.00	40.00	66.67
U:VERB	5	4	7	55.56	41.67	52.08
U:VERB:TENSE	3	2	0	60.00	100.00	65.22

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	343	85	231	80.14	59.76	75.02
R	950	190	624	83.33	60.36	77.44
U	139	28	111	83.23	55.60	75.71
UNK	16	0	41	100.00	28.07	66.12

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	10	5	9	66.67	52.63	63.29
ADJ:FORM	2	0	2	100.00	50.00	83.33
ADV	14	4	23	77.78	37.84	64.22
CONJ	4	2	8	66.67	33.33	55.56
CONTR	4	0	0	100.00	100.00	100.00
DET	171	31	115	84.65	59.79	78.15
MORPH	61	8	25	88.41	70.93	84.25
NOUN	22	20	38	52.38	36.67	48.25
NOUN:INFL	5	0	1	100.00	83.33	96.15
NOUN:NUM	90	16	35	84.91	72.00	81.97
NOUN:POSS	7	3	7	70.00	50.00	64.81
ORTH	83	23	112	78.30	42.56	67.04
OTHER	172	45	209	79.26	45.14	68.86
PART	13	2	4	86.67	76.47	84.42
PREP	129	13	68	90.85	65.48	84.31
PRON	40	8	34	83.33	54.05	75.19
PUNCT	191	47	115	80.25	62.42	75.91
SPELL	101	14	8	87.83	92.66	88.75
UNK	16	0	41	100.00	28.07	66.12
VERB	65	8	66	89.04	49.62	76.83
VERB:FORM	83	17	17	83.00	83.00	83.00
VERB:INFL	3	0	2	100.00	60.00	88.24
VERB:SVA	73	9	8	89.02	90.12	89.24
VERB:TENSE	71	18	46	79.78	60.68	75.05
WO	18	10	14	64.29	56.25	62.50

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	1	50.00	50.00	50.00
M:ADV	4	3	10	57.14	28.57	47.62
M:CONJ	2	2	5	50.00	28.57	43.48
M:DET	90	19	37	82.57	70.87	79.93
M:NOUN	1	4	2	20.00	33.33	21.74
M:NOUN:POSS	2	2	2	50.00	50.00	50.00
M:OTHER	15	5	19	75.00	44.12	65.79
M:PART	1	0	1	100.00	50.00	83.33
M:PREP	21	7	26	75.00	44.68	66.04
M:PRON	22	7	13	75.86	62.86	72.85
M:PUNCT	147	24	93	85.96	61.25	79.55
M:VERB	13	1	10	92.86	56.52	82.28
M:VERB:FORM	10	4	5	71.43	66.67	70.42
M:VERB:TENSE	14	6	7	70.00	66.67	69.31
R:ADJ	5	1	7	83.33	41.67	69.44
R:ADJ:FORM	2	0	2	100.00	50.00	83.33
R:ADV	4	0	9	100.00	30.77	68.97
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	18	4	27	81.82	40.00	67.67
R:MORPH	61	8	25	88.41	70.93	84.25
R:NOUN	18	10	29	64.29	38.30	56.60
R:NOUN:INFL	5	0	1	100.00	83.33	96.15
R:NOUN:NUM	90	16	35	84.91	72.00	81.97
R:NOUN:POSS	2	1	4	66.67	33.33	55.56
R:ORTH	83	23	112	78.30	42.56	67.04
R:OTHER	152	34	182	81.72	45.51	70.50
R:PART	11	2	2	84.62	84.62	84.62
R:PREP	85	5	32	94.44	72.65	89.10
R:PRON	12	0	14	100.00	46.15	81.08
R:PUNCT	39	22	16	63.93	70.91	65.22
R:SPELL	101	14	8	87.83	92.66	88.75
R:VERB	45	6	47	88.24	48.91	76.01
R:VERB:FORM	73	13	11	84.88	86.90	85.28
R:VERB:INFL	3	0	2	100.00	60.00	88.24
R:VERB:SVA	73	9	8	89.02	90.12	89.24
R:VERB:TENSE	49	12	37	80.33	56.98	74.24
R:WO	18	10	14	64.29	56.25	62.50
U:ADJ	4	3	1	57.14	80.00	60.61
U:ADV	6	1	4	85.71	60.00	78.95
U:CONJ	2	0	3	100.00	40.00	76.92
U:CONTR	3	0	0	100.00	100.00	100.00
U:DET	63	8	51	88.73	55.26	79.15
U:NOUN	3	6	7	33.33	30.00	32.61
U:NOUN:POSS	3	0	1	100.00	75.00	93.75
U:OTHER	5	6	8	45.45	38.46	43.86
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	23	1	10	95.83	69.70	89.15
U:PRON	6	1	7	85.71	46.15	73.17
U:PUNCT	5	1	6	83.33	45.45	71.43
U:VERB	7	1	9	87.50	43.75	72.92
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	8	0	2	100.00	80.00	95.24
UNK	16	0	41	100.00	28.07	66.12

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	408	39	214	91.28	65.59	84.65
R	1198	102	694	92.15	63.32	84.46
U	171	15	117	91.94	59.38	82.85
UNK	36	0	53	100.00	40.45	77.25

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	8	1	10	88.89	44.44	74.07
ADJ:FORM	2	0	2	100.00	50.00	83.33
ADV	19	2	21	90.48	47.50	76.61
CONJ	8	1	5	88.89	61.54	81.63
CONTR	5	0	1	100.00	83.33	96.15
DET	195	19	105	91.12	65.00	84.34
MORPH	59	2	27	96.72	68.60	89.39
NOUN	36	9	43	80.00	45.57	69.50
NOUN:INFL	6	0	0	100.00	100.00	100.00
NOUN:NUM	91	10	33	90.10	73.39	86.17
NOUN:POSS	12	2	11	85.71	52.17	75.95
ORTH	114	17	100	87.02	53.27	77.24
OTHER	328	28	275	92.13	54.39	80.91
PART	11	0	3	100.00	78.57	94.83
PREP	127	11	67	92.03	65.46	85.12
PRON	47	2	26	95.92	64.38	87.36
PUNCT	255	19	119	93.07	68.18	86.73
SPELL	98	7	8	93.33	92.45	93.16
UNK	36	0	53	100.00	40.45	77.25
VERB	75	4	79	94.94	48.70	79.79
VERB:FORM	82	6	13	93.18	86.32	91.72
VERB:INFL	1	0	0	100.00	100.00	100.00
VERB:SVA	76	5	8	93.83	90.48	93.14
VERB:TENSE	80	8	53	90.91	60.15	82.47
WO	42	3	16	93.33	72.41	88.24

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	1	100.00	50.00	83.33
M:ADV	6	2	9	75.00	40.00	63.83
M:CONJ	5	1	2	83.33	71.43	80.65
M:DET	100	9	35	91.74	74.07	87.57
M:NOUN	2	2	5	50.00	28.57	43.48
M:NOUN:POSS	4	1	1	80.00	80.00	80.00
M:OTHER	20	3	14	86.96	58.82	79.37
M:PART	2	0	1	100.00	66.67	90.91
M:PREP	27	3	24	90.00	52.94	78.95
M:PRON	25	2	12	92.59	67.57	86.21
M:PUNCT	175	14	88	92.59	66.54	85.87
M:VERB	13	0	12	100.00	52.00	84.42
M:VERB:FORM	12	0	3	100.00	80.00	95.24
M:VERB:TENSE	16	2	7	88.89	69.57	84.21
R:ADJ	4	0	8	100.00	33.33	71.43
R:ADJ:FORM	2	0	2	100.00	50.00	83.33
R:ADV	5	0	8	100.00	38.46	75.76
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	20	5	27	80.00	42.55	68.03
R:MORPH	59	2	27	96.72	68.60	89.39
R:NOUN	29	4	29	87.88	50.00	76.32
R:NOUN:INFL	6	0	0	100.00	100.00	100.00
R:NOUN:NUM	91	10	33	90.10	73.39	86.17
R:NOUN:POSS	5	1	5	83.33	50.00	73.53
R:ORTH	114	17	100	87.02	53.27	77.24
R:OTHER	296	20	246	93.67	54.61	81.95
R:PART	8	0	0	100.00	100.00	100.00
R:PREP	78	8	33	90.70	70.27	85.71
R:PRON	15	0	9	100.00	62.50	89.29
R:PUNCT	64	5	24	92.75	72.73	87.91
R:SPELL	98	7	8	93.33	92.45	93.16
R:VERB	57	3	57	95.00	50.00	80.51
R:VERB:FORM	70	6	8	92.11	89.74	91.62
R:VERB:INFL	1	0	0	100.00	100.00	100.00
R:VERB:SVA	76	5	8	93.83	90.48	93.14
R:VERB:TENSE	57	6	44	90.48	56.44	80.74
R:WO	42	3	16	93.33	72.41	88.24
U:ADJ	3	1	1	75.00	75.00	75.00
U:ADV	8	0	4	100.00	66.67	90.91
U:CONJ	3	0	1	100.00	75.00	93.75
U:CONTR	4	0	1	100.00	80.00	95.24
U:DET	75	5	43	93.75	63.56	85.62
U:NOUN	5	3	9	62.50	35.71	54.35
U:NOUN:POSS	3	0	5	100.00	37.50	75.00
U:OTHER	12	5	15	70.59	44.44	63.16
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	22	0	10	100.00	68.75	91.67
U:PRON	7	0	5	100.00	58.33	87.50
U:PUNCT	16	0	7	100.00	69.57	91.95
U:VERB	5	1	10	83.33	33.33	64.10
U:VERB:FORM	0	0	2	100.00	0.00	0.00
U:VERB:TENSE	7	0	2	100.00	77.78	94.59
UNK	36	0	53	100.00	40.45	77.25

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	886	369	789	70.60	52.90	66.17
Span-level detection	1005	254	724	79.83	58.13	74.28
Token-level detection	1261	149	870	89.43	59.17	81.13

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	278	93	190	74.93	59.40	71.21
R	508	245	513	67.46	49.76	62.98
U	100	31	86	76.34	53.76	70.42

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	5	12	54.55	33.33	48.39
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	12	5	16	70.59	42.86	62.50
CONJ	1	1	11	50.00	8.33	25.00
CONTR	3	1	0	75.00	100.00	78.95
DET	133	28	86	82.61	60.73	77.06
MORPH	32	15	14	68.09	69.57	68.38
NOUN	16	19	24	45.71	40.00	44.44
NOUN:NUM	56	15	16	78.87	77.78	78.65
NOUN:POSS	8	4	9	66.67	47.06	61.54
ORTH	17	32	51	34.69	25.00	32.20
OTHER	40	46	173	46.51	18.78	35.91
PART	6	3	5	66.67	54.55	63.83
PREP	95	43	80	68.84	54.29	65.34
PRON	22	8	19	73.33	53.66	68.32
PUNCT	190	56	95	77.24	66.67	74.86
SPELL	60	26	12	69.77	83.33	72.12
VERB	27	16	64	62.79	29.67	51.33
VERB:FORM	53	9	18	85.48	74.65	83.07
VERB:SVA	45	6	9	88.24	83.33	87.21
VERB:TENSE	41	17	52	70.69	44.09	63.08
WO	20	13	23	60.61	46.51	57.14

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	5	0.00	0.00	0.00
M:ADV	4	2	6	66.67	40.00	58.82
M:CONJ	1	1	9	50.00	10.00	27.78
M:DET	71	19	43	78.89	62.28	74.89
M:NOUN	2	5	2	28.57	50.00	31.25
M:NOUN:POSS	2	1	3	66.67	40.00	58.82
M:OTHER	4	7	14	36.36	22.22	32.26
M:PART	1	1	1	50.00	50.00	50.00
M:PREP	15	9	16	62.50	48.39	59.06
M:PRON	15	5	8	75.00	65.22	72.82
M:PUNCT	149	36	69	80.54	68.35	77.77
M:VERB	5	2	6	71.43	45.45	64.10
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	8	3	8	72.73	50.00	66.67
R:ADJ	5	1	4	83.33	55.56	75.76
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	4	1	2	80.00	66.67	76.92
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	25	3	26	89.29	49.02	76.69
R:MORPH	32	15	14	68.09	69.57	68.38
R:NOUN	14	6	20	70.00	41.18	61.40
R:NOUN:NUM	56	15	16	78.87	77.78	78.65
R:NOUN:POSS	4	1	3	80.00	57.14	74.07
R:ORTH	17	32	51	34.69	25.00	32.20
R:OTHER	31	36	147	46.27	17.42	34.75
R:PART	4	2	3	66.67	57.14	64.52
R:PREP	64	31	49	67.37	56.64	64.91
R:PRON	3	2	9	60.00	25.00	46.88
R:PUNCT	28	19	19	59.57	59.57	59.57
R:SPELL	60	26	12	69.77	83.33	72.12
R:VERB	18	12	49	60.00	26.87	48.13
R:VERB:FORM	48	9	16	84.21	75.00	82.19
R:VERB:SVA	45	6	9	88.24	83.33	87.21
R:VERB:TENSE	26	13	39	66.67	40.00	58.82
R:WO	20	13	23	60.61	46.51	57.14
U:ADJ	1	2	3	33.33	25.00	31.25
U:ADV	4	2	8	66.67	33.33	55.56
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	37	6	17	86.05	68.52	81.86
U:NOUN	0	8	2	0.00	0.00	0.00
U:NOUN:POSS	2	2	3	50.00	40.00	47.62
U:OTHER	5	3	12	62.50	29.41	51.02
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	16	3	15	84.21	51.61	74.77
U:PRON	4	1	2	80.00	66.67	76.92
U:PUNCT	13	1	7	92.86	65.00	85.53
U:VERB	4	2	9	66.67	30.77	54.05
U:VERB:FORM	4	0	2	100.00	66.67	90.91
U:VERB:TENSE	7	1	5	87.50	58.33	79.55

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	294	77	180	79.25	62.03	75.08
R	599	151	446	79.87	57.32	74.04
U	101	26	89	79.53	53.16	72.35
UNK	11	0	9	100.00	55.00	85.94

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	9	4	12	69.23	42.86	61.64
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	13	4	17	76.47	43.33	66.33
CONJ	1	0	10	100.00	9.09	33.33
CONTR	3	1	0	75.00	100.00	78.95
DET	138	23	84	85.71	62.16	79.68
MORPH	29	8	12	78.38	70.73	76.72
NOUN	23	14	23	62.16	50.00	59.28
NOUN:NUM	57	8	16	87.69	78.08	85.59
NOUN:POSS	8	3	8	72.73	50.00	66.67
ORTH	28	22	42	56.00	40.00	51.85
OTHER	82	30	150	73.21	35.34	60.29
PART	7	3	7	70.00	50.00	64.81
PREP	105	29	76	78.36	58.01	73.22
PRON	26	4	19	86.67	57.78	78.79
PUNCT	200	52	86	79.37	69.93	77.28
SPELL	61	14	8	81.33	88.41	82.66
UNK	11	0	9	100.00	55.00	85.94
VERB	40	8	55	83.33	42.11	69.69
VERB:FORM	52	5	18	91.23	74.29	87.25
VERB:SVA	49	2	5	96.08	90.74	94.96
VERB:TENSE	42	8	46	84.00	47.73	72.92
WO	18	11	21	62.07	46.15	58.06

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	5	50.00	16.67	35.71
M:ADV	4	1	6	80.00	40.00	66.67
M:CONJ	1	0	9	100.00	10.00	35.71
M:DET	73	16	42	82.02	63.48	77.49
M:NOUN	3	3	2	50.00	60.00	51.72
M:NOUN:POSS	2	1	3	66.67	40.00	58.82
M:OTHER	6	6	11	50.00	35.29	46.15
M:PART	1	1	1	50.00	50.00	50.00
M:PREP	14	9	18	60.87	43.75	56.45
M:PRON	18	3	9	85.71	66.67	81.08
M:PUNCT	156	33	61	82.54	71.89	80.16
M:VERB	6	2	6	75.00	50.00	68.18
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	8	1	7	88.89	53.33	78.43
R:ADJ	8	1	4	88.89	66.67	83.33
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	5	1	3	83.33	62.50	78.12
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	27	2	26	93.10	50.94	79.88
R:MORPH	29	8	12	78.38	70.73	76.72
R:NOUN	19	4	19	82.61	50.00	73.08
R:NOUN:NUM	57	8	16	87.69	78.08	85.59
R:NOUN:POSS	4	0	2	100.00	66.67	90.91
R:ORTH	28	22	42	56.00	40.00	51.85
R:OTHER	71	21	126	77.17	36.04	62.83
R:PART	5	2	4	71.43	55.56	67.57
R:PREP	75	19	42	79.79	64.10	76.06
R:PRON	4	0	8	100.00	33.33	71.43
R:PUNCT	31	18	16	63.27	65.96	63.79
R:SPELL	61	14	8	81.33	88.41	82.66
R:VERB	29	5	42	85.29	40.85	70.05
R:VERB:FORM	48	5	16	90.57	75.00	86.96
R:VERB:SVA	49	2	5	96.08	90.74	94.96
R:VERB:TENSE	27	6	33	81.82	45.00	70.31
R:WO	18	11	21	62.07	46.15	58.06
U:ADJ	0	2	3	0.00	0.00	0.00
U:ADV	4	2	8	66.67	33.33	55.56
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	38	5	16	88.37	70.37	84.07
U:NOUN	1	7	2	12.50	33.33	14.29
U:NOUN:POSS	2	2	3	50.00	40.00	47.62
U:OTHER	5	3	13	62.50	27.78	50.00
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	16	1	16	94.12	50.00	80.00
U:PRON	4	1	2	80.00	66.67	76.92
U:PUNCT	13	1	9	92.86	59.09	83.33
U:VERB	5	1	7	83.33	41.67	69.44
U:VERB:FORM	3	0	2	100.00	60.00	88.24
U:VERB:TENSE	7	1	6	87.50	53.85	77.78
UNK	11	0	9	100.00	55.00	85.94

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	338	38	189	89.89	64.14	83.21
R	779	98	523	88.83	59.83	80.98
U	132	13	138	91.03	48.89	77.65
UNK	12	0	20	100.00	37.50	75.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	10	4	10	71.43	50.00	65.79
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	14	1	14	93.33	50.00	79.55
CONJ	4	0	11	100.00	26.67	64.52
CONTR	2	0	0	100.00	100.00	100.00
DET	151	9	79	94.37	65.65	86.78
MORPH	33	2	13	94.29	71.74	88.71
NOUN	27	7	26	79.41	50.94	71.43
NOUN:NUM	60	6	13	90.91	82.19	89.02
NOUN:POSS	12	1	6	92.31	66.67	85.71
ORTH	58	13	45	81.69	56.31	74.94
OTHER	189	15	233	92.65	44.79	76.33
PART	5	1	5	83.33	50.00	73.53
PREP	106	21	76	83.46	58.24	76.81
PRON	28	3	19	90.32	59.57	81.87
PUNCT	235	34	101	87.36	69.94	83.22
SPELL	61	7	7	89.71	89.71	89.71
UNK	12	0	20	100.00	37.50	75.00
VERB	51	4	71	92.73	41.80	74.56
VERB:FORM	51	3	20	94.44	71.83	88.85
VERB:SVA	47	1	7	97.92	87.04	95.53
VERB:TENSE	49	6	60	89.09	44.95	74.47
WO	53	10	34	84.13	60.92	78.17

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	2	0.00	0.00	0.00
M:ADV	5	0	4	100.00	55.56	86.21
M:CONJ	4	0	7	100.00	36.36	74.07
M:DET	82	3	39	96.47	67.77	88.94
M:NOUN	3	3	2	50.00	60.00	51.72
M:NOUN:POSS	4	0	2	100.00	66.67	90.91
M:OTHER	8	3	10	72.73	44.44	64.52
M:PART	2	0	1	100.00	66.67	90.91
M:PREP	14	4	19	77.78	42.42	66.67
M:PRON	19	2	7	90.48	73.08	86.36
M:PUNCT	175	21	76	89.29	69.72	84.54
M:VERB	11	0	9	100.00	55.00	85.94
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	9	1	11	90.00	45.00	75.00
R:ADJ	10	1	6	90.91	62.50	83.33
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	5	1	5	83.33	50.00	73.53
R:CONJ	0	0	4	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	28	1	23	96.55	54.90	83.83
R:MORPH	33	2	13	94.29	71.74	88.71
R:NOUN	22	2	19	91.67	53.66	80.29
R:NOUN:NUM	60	6	13	90.91	82.19	89.02
R:NOUN:POSS	6	0	0	100.00	100.00	100.00
R:ORTH	58	13	45	81.69	56.31	74.94
R:OTHER	156	12	168	92.86	48.15	78.31
R:PART	2	1	2	66.67	50.00	62.50
R:PREP	75	16	38	82.42	66.37	78.62
R:PRON	5	0	9	100.00	35.71	73.53
R:PUNCT	45	13	16	77.59	73.77	76.79
R:SPELL	61	7	7	89.71	89.71	89.71
R:VERB	31	4	51	88.57	37.80	69.82
R:VERB:FORM	46	3	18	93.88	71.88	88.46
R:VERB:SVA	47	1	7	97.92	87.04	95.53
R:VERB:TENSE	32	4	45	88.89	41.56	72.40
R:WO	53	10	34	84.13	60.92	78.17
U:ADJ	0	2	2	0.00	0.00	0.00
U:ADV	4	0	5	100.00	44.44	80.00
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	41	5	17	89.13	70.69	84.71
U:NOUN	2	2	5	50.00	28.57	43.48
U:NOUN:POSS	2	1	4	66.67	33.33	55.56
U:OTHER	25	0	55	100.00	31.25	69.44
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	17	1	19	94.44	47.22	78.70
U:PRON	4	1	3	80.00	57.14	74.07
U:PUNCT	15	0	9	100.00	62.50	89.29
U:VERB	9	0	11	100.00	45.00	80.36
U:VERB:FORM	3	0	2	100.00	60.00	88.24
U:VERB:TENSE	8	1	4	88.89	66.67	83.33
UNK	12	0	20	100.00	37.50	75.00

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	424	157	277	72.98	60.49	70.08
Span-level detection	465	117	271	79.90	63.18	75.88
Token-level detection	541	95	310	85.06	63.57	79.68

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	164	27	77	85.86	68.05	81.59
R	207	109	166	65.51	55.50	63.23
U	53	21	34	71.62	60.92	69.19

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	3	4	40.00	33.33	38.46
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	4	2	4	66.67	50.00	62.50
CONJ	1	1	1	50.00	50.00	50.00
CONTR	2	0	1	100.00	66.67	90.91
DET	69	13	41	84.15	62.73	78.77
MORPH	16	5	12	76.19	57.14	71.43
NOUN	1	12	10	7.69	9.09	7.94
NOUN:INFL	1	1	0	50.00	100.00	55.56
NOUN:NUM	28	10	7	73.68	80.00	74.87
NOUN:POSS	4	1	3	80.00	57.14	74.07
ORTH	10	12	27	45.45	27.03	40.00
OTHER	22	21	40	51.16	35.48	47.01
PART	3	0	0	100.00	100.00	100.00
PREP	45	15	31	75.00	59.21	71.20
PRON	7	1	3	87.50	70.00	83.33
PUNCT	121	23	38	84.03	76.10	82.31
SPELL	33	10	6	76.74	84.62	78.20
VERB	5	8	14	38.46	26.32	35.21
VERB:FORM	15	5	3	75.00	83.33	76.53
VERB:SVA	10	3	0	76.92	100.00	80.65
VERB:TENSE	16	8	21	66.67	43.24	60.15
WO	9	3	9	75.00	50.00	68.18

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	1	100.00	50.00	83.33
M:ADV	1	2	1	33.33	50.00	35.71
M:CONJ	1	1	1	50.00	50.00	50.00
M:DET	35	3	19	92.11	64.81	84.95
M:NOUN	0	1	1	0.00	0.00	0.00
M:NOUN:POSS	1	1	0	50.00	100.00	55.56
M:OTHER	3	2	6	60.00	33.33	51.72
M:PREP	11	3	10	78.57	52.38	71.43
M:PRON	2	1	3	66.67	40.00	58.82
M:PUNCT	103	11	28	90.35	78.63	87.73
M:VERB	1	2	1	33.33	50.00	35.71
M:VERB:FORM	2	0	1	100.00	66.67	90.91
M:VERB:TENSE	3	0	5	100.00	37.50	75.00
R:ADJ	0	2	3	0.00	0.00	0.00
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	6	3	8	66.67	42.86	60.00
R:MORPH	16	5	12	76.19	57.14	71.43
R:NOUN	1	9	7	10.00	12.50	10.42
R:NOUN:INFL	1	1	0	50.00	100.00	55.56
R:NOUN:NUM	28	10	7	73.68	80.00	74.87
R:NOUN:POSS	1	0	3	100.00	25.00	62.50
R:ORTH	10	12	27	45.45	27.03	40.00
R:OTHER	18	17	33	51.43	35.29	47.12
R:PART	2	0	0	100.00	100.00	100.00
R:PREP	31	10	13	75.61	70.45	74.52
R:PRON	3	0	0	100.00	100.00	100.00
R:PUNCT	10	8	6	55.56	62.50	56.82
R:SPELL	33	10	6	76.74	84.62	78.20
R:VERB	4	4	12	50.00	25.00	41.67
R:VERB:FORM	13	5	2	72.22	86.67	74.71
R:VERB:SVA	10	3	0	76.92	100.00	80.65
R:VERB:TENSE	9	7	14	56.25	39.13	51.72
R:WO	9	3	9	75.00	50.00	68.18
U:ADJ	1	1	0	50.00	100.00	55.56
U:ADV	2	0	1	100.00	66.67	90.91
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	28	7	14	80.00	66.67	76.92
U:NOUN	0	2	2	0.00	0.00	0.00
U:NOUN:POSS	2	0	0	100.00	100.00	100.00
U:OTHER	1	2	1	33.33	50.00	35.71
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	3	2	8	60.00	27.27	48.39
U:PRON	2	0	0	100.00	100.00	100.00
U:PUNCT	8	4	4	66.67	66.67	66.67
U:VERB	0	2	1	0.00	0.00	0.00
U:VERB:TENSE	4	1	2	80.00	66.67	76.92

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	170	22	70	88.54	70.83	84.33
R	241	81	163	74.84	59.65	71.22
U	52	14	35	78.79	59.77	74.07
UNK	2	0	3	100.00	40.00	76.92

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	2	4	60.00	42.86	55.56
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	4	1	3	80.00	57.14	74.07
CONJ	2	0	1	100.00	66.67	90.91
CONTR	2	0	1	100.00	66.67	90.91
DET	70	11	37	86.42	65.42	81.21
MORPH	19	3	12	86.36	61.29	79.83
NOUN	5	6	14	45.45	26.32	39.68
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	26	8	6	76.47	81.25	77.38
NOUN:POSS	4	1	3	80.00	57.14	74.07
ORTH	14	10	24	58.33	36.84	52.24
OTHER	36	13	43	73.47	45.57	65.45
PART	3	0	1	100.00	75.00	93.75
PREP	47	13	30	78.33	61.04	74.13
PRON	8	1	3	88.89	72.73	85.11
PUNCT	124	21	34	85.52	78.48	84.01
SPELL	34	8	4	80.95	89.47	82.52
UNK	2	0	3	100.00	40.00	76.92
VERB	7	6	14	53.85	33.33	47.95
VERB:FORM	16	5	2	76.19	88.89	78.43
VERB:SVA	11	1	0	91.67	100.00	93.22
VERB:TENSE	19	4	22	82.61	46.34	71.43
WO	7	3	8	70.00	46.67	63.64

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	0	100.00	100.00	100.00
M:ADV	1	1	0	50.00	100.00	55.56
M:CONJ	2	0	1	100.00	66.67	90.91
M:DET	35	3	16	92.11	68.63	86.21
M:NOUN	1	0	2	100.00	33.33	71.43
M:NOUN:POSS	1	1	0	50.00	100.00	55.56
M:OTHER	4	1	6	80.00	40.00	66.67
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	11	3	10	78.57	52.38	71.43
M:PRON	3	1	3	75.00	50.00	68.18
M:PUNCT	105	11	25	90.52	80.77	88.38
M:VERB	1	1	1	50.00	50.00	50.00
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	3	0	5	100.00	37.50	75.00
R:ADJ	1	1	4	50.00	20.00	38.46
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	9	3	6	75.00	60.00	71.43
R:MORPH	19	3	12	86.36	61.29	79.83
R:NOUN	4	6	10	40.00	28.57	37.04
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	26	8	6	76.47	81.25	77.38
R:NOUN:POSS	1	0	3	100.00	25.00	62.50
R:ORTH	14	10	24	58.33	36.84	52.24
R:OTHER	31	11	35	73.81	46.97	66.24
R:PART	2	0	0	100.00	100.00	100.00
R:PREP	33	8	12	80.49	73.33	78.95
R:PRON	3	0	0	100.00	100.00	100.00
R:PUNCT	10	7	6	58.82	62.50	59.52
R:SPELL	34	8	4	80.95	89.47	82.52
R:VERB	6	3	12	66.67	33.33	55.56
R:VERB:FORM	14	5	2	73.68	87.50	76.09
R:VERB:SVA	11	1	0	91.67	100.00	93.22
R:VERB:TENSE	12	4	15	75.00	44.44	65.93
R:WO	7	3	8	70.00	46.67	63.64
U:ADJ	1	1	0	50.00	100.00	55.56
U:ADV	2	0	1	100.00	66.67	90.91
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	26	5	15	83.87	63.41	78.79
U:NOUN	0	0	2	100.00	0.00	0.00
U:NOUN:POSS	2	0	0	100.00	100.00	100.00
U:OTHER	1	1	2	50.00	33.33	45.45
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	3	2	8	60.00	27.27	48.39
U:PRON	2	0	0	100.00	100.00	100.00
U:PUNCT	9	3	3	75.00	75.00	75.00
U:VERB	0	2	1	0.00	0.00	0.00
U:VERB:TENSE	4	0	2	100.00	66.67	90.91
UNK	2	0	3	100.00	40.00	76.92

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	187	18	72	91.22	72.20	86.65
R	295	64	189	82.17	60.95	76.82
U	57	13	41	81.43	58.16	75.40
UNK	2	0	8	100.00	20.00	55.56

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	2	7	60.00	30.00	50.00
ADJ:FORM	0	0	3	100.00	0.00	0.00
ADV	4	0	4	100.00	50.00	83.33
CONJ	3	0	0	100.00	100.00	100.00
CONTR	2	0	2	100.00	50.00	83.33
DET	73	9	36	89.02	66.97	83.52
MORPH	19	3	10	86.36	65.52	81.20
NOUN	4	5	14	44.44	22.22	37.04
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	27	7	8	79.41	77.14	78.95
NOUN:POSS	6	1	3	85.71	66.67	81.08
ORTH	21	8	28	72.41	42.86	63.64
OTHER	54	13	59	80.60	47.79	70.87
PART	2	0	1	100.00	66.67	90.91
PREP	49	11	27	81.67	64.47	77.53
PRON	9	1	3	90.00	75.00	86.54
PUNCT	146	17	32	89.57	82.02	87.95
SPELL	35	7	4	83.33	89.74	84.54
UNK	2	0	8	100.00	20.00	55.56
VERB	9	4	15	69.23	37.50	59.21
VERB:FORM	18	1	2	94.74	90.00	93.75
VERB:SVA	10	1	0	90.91	100.00	92.59
VERB:TENSE	19	4	26	82.61	42.22	69.34
WO	24	1	18	96.00	57.14	84.51

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	3	100.00	25.00	62.50
M:CONJ	3	0	0	100.00	100.00	100.00
M:DET	38	2	15	95.00	71.70	89.20
M:NOUN	1	0	2	100.00	33.33	71.43
M:NOUN:POSS	2	1	0	66.67	100.00	71.43
M:OTHER	5	1	7	83.33	41.67	69.44
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	13	1	9	92.86	59.09	83.33
M:PRON	4	1	3	80.00	57.14	74.07
M:PUNCT	114	11	25	91.20	82.01	89.20
M:VERB	1	1	2	50.00	33.33	45.45
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	3	0	5	100.00	37.50	75.00
R:ADJ	1	1	3	50.00	25.00	41.67
R:ADJ:FORM	0	0	3	100.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	8	2	6	80.00	57.14	74.07
R:MORPH	19	3	10	86.36	65.52	81.20
R:NOUN	3	5	10	37.50	23.08	33.33
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	27	7	8	79.41	77.14	78.95
R:NOUN:POSS	2	0	3	100.00	40.00	76.92
R:ORTH	21	8	28	72.41	42.86	63.64
R:OTHER	49	10	46	83.05	51.58	74.02
R:PART	1	0	0	100.00	100.00	100.00
R:PREP	33	8	10	80.49	76.74	79.71
R:PRON	3	0	0	100.00	100.00	100.00
R:PUNCT	19	3	4	86.36	82.61	85.59
R:SPELL	35	7	4	83.33	89.74	84.54
R:VERB	8	3	12	72.73	40.00	62.50
R:VERB:FORM	16	1	2	94.12	88.89	93.02
R:VERB:SVA	10	1	0	90.91	100.00	92.59
R:VERB:TENSE	12	4	20	75.00	37.50	62.50
R:WO	24	1	18	96.00	57.14	84.51
U:ADJ	1	1	1	50.00	50.00	50.00
U:ADV	3	0	2	100.00	60.00	88.24
U:CONTR	1	0	2	100.00	33.33	71.43
U:DET	27	5	15	84.38	64.29	79.41
U:NOUN	0	0	2	100.00	0.00	0.00
U:NOUN:POSS	2	0	0	100.00	100.00	100.00
U:OTHER	0	2	6	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	3	2	8	60.00	27.27	48.39
U:PRON	2	0	0	100.00	100.00	100.00
U:PUNCT	13	3	3	81.25	81.25	81.25
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	4	0	1	100.00	80.00	95.24
UNK	2	0	8	100.00	20.00	55.56

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	373	212	211	63.76	63.87	63.78
Span-level detection	418	167	202	71.45	67.42	70.61
Token-level detection	487	153	212	76.09	69.67	74.72

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	146	38	36	79.35	80.22	79.52
R	210	156	156	57.38	57.38	57.38
U	17	18	19	48.57	47.22	48.30

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	4	1	55.56	83.33	59.52
ADJ:FORM	1	0	0	100.00	100.00	100.00
ADV	1	6	0	14.29	100.00	17.24
DET	9	15	8	37.50	52.94	39.82
MORPH	6	8	1	42.86	85.71	47.62
NOUN	4	12	6	25.00	40.00	27.03
NOUN:INFL	5	3	6	62.50	45.45	58.14
NOUN:NUM	16	19	8	45.71	66.67	48.78
NOUN:POSS	11	4	8	73.33	57.89	69.62
ORTH	14	18	41	43.75	25.45	38.25
OTHER	21	15	27	58.33	43.75	54.69
PART	1	3	0	25.00	100.00	29.41
PREP	15	27	12	35.71	55.56	38.46
PRON	3	1	2	75.00	60.00	71.43
PUNCT	155	32	44	82.89	77.89	81.84
SPELL	64	15	33	81.01	65.98	77.48
VERB	6	2	10	75.00	37.50	62.50
VERB:FORM	13	11	1	54.17	92.86	59.09
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	9	6	0	60.00	100.00	65.22
VERB:TENSE	7	9	2	43.75	77.78	47.95
WO	3	2	0	60.00	100.00	65.22

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	0	0.00	100.00	0.00
M:ADV	0	2	0	0.00	100.00	0.00
M:DET	4	5	3	44.44	57.14	46.51
M:NOUN	0	1	2	0.00	0.00	0.00
M:NOUN:POSS	4	2	3	66.67	57.14	64.52
M:OTHER	0	1	0	0.00	100.00	0.00
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	2	5	0	28.57	100.00	33.33
M:PRON	1	1	1	50.00	50.00	50.00
M:PUNCT	134	19	25	87.58	84.28	86.90
M:VERB	1	0	2	100.00	33.33	71.43
R:ADJ	5	3	1	62.50	83.33	65.79
R:ADJ:FORM	1	0	0	100.00	100.00	100.00
R:ADV	0	3	0	0.00	100.00	0.00
R:DET	1	4	1	20.00	50.00	22.73
R:MORPH	6	8	1	42.86	85.71	47.62
R:NOUN	4	10	4	28.57	50.00	31.25
R:NOUN:INFL	5	3	6	62.50	45.45	58.14
R:NOUN:NUM	16	19	8	45.71	66.67	48.78
R:NOUN:POSS	7	2	5	77.78	58.33	72.92
R:ORTH	14	18	41	43.75	25.45	38.25
R:OTHER	21	12	26	63.64	44.68	58.66
R:PART	0	2	0	0.00	100.00	0.00
R:PREP	12	18	9	40.00	57.14	42.55
R:PRON	2	0	1	100.00	66.67	90.91
R:PUNCT	13	10	10	56.52	56.52	56.52
R:SPELL	64	15	33	81.01	65.98	77.48
R:VERB	4	2	7	66.67	36.36	57.14
R:VERB:FORM	13	10	0	56.52	100.00	61.90
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	9	6	0	60.00	100.00	65.22
R:VERB:TENSE	6	9	2	40.00	75.00	44.12
R:WO	3	2	0	60.00	100.00	65.22
U:ADV	1	1	0	50.00	100.00	55.56
U:DET	4	6	4	40.00	50.00	41.67
U:NOUN	0	1	0	0.00	100.00	0.00
U:OTHER	0	2	1	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	1	4	3	20.00	25.00	20.83
U:PUNCT	8	3	9	72.73	47.06	65.57
U:VERB	1	0	1	100.00	50.00	83.33
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	1	0	0	100.00	100.00	100.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	152	32	41	82.61	78.76	81.81
R	247	118	141	67.67	63.66	66.83
U	17	17	18	50.00	48.57	49.71
UNK	2	0	2	100.00	50.00	83.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	3	0	66.67	100.00	71.43
ADJ:FORM	1	0	0	100.00	100.00	100.00
ADV	1	5	1	16.67	50.00	19.23
DET	10	14	11	41.67	47.62	42.74
MORPH	6	7	1	46.15	85.71	50.85
NOUN	7	6	4	53.85	63.64	55.56
NOUN:INFL	8	1	3	88.89	72.73	85.11
NOUN:NUM	15	18	8	45.45	65.22	48.39
NOUN:POSS	13	3	7	81.25	65.00	77.38
ORTH	15	16	42	48.39	26.32	41.44
OTHER	34	9	26	79.07	56.67	73.28
PART	1	3	0	25.00	100.00	29.41
PREP	17	23	10	42.50	62.96	45.45
PRON	3	1	2	75.00	60.00	71.43
PUNCT	157	29	49	84.41	76.21	82.63
SPELL	77	1	23	98.72	77.00	93.45
UNK	2	0	2	100.00	50.00	83.33
VERB	8	2	10	80.00	44.44	68.97
VERB:FORM	13	10	0	56.52	100.00	61.90
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	10	6	0	62.50	100.00	67.57
VERB:TENSE	7	8	2	46.67	77.78	50.72
WO	3	2	0	60.00	100.00	65.22

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	0	0.00	100.00	0.00
M:ADV	0	1	0	0.00	100.00	0.00
M:DET	5	4	3	55.56	62.50	56.82
M:NOUN	1	0	1	100.00	50.00	83.33
M:NOUN:POSS	4	2	3	66.67	57.14	64.52
M:OTHER	2	1	1	66.67	66.67	66.67
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	2	4	1	33.33	66.67	37.04
M:PRON	1	1	1	50.00	50.00	50.00
M:PUNCT	136	17	29	88.89	82.42	87.52
M:VERB	1	0	2	100.00	33.33	71.43
R:ADJ	6	2	0	75.00	100.00	78.95
R:ADJ:FORM	1	0	0	100.00	100.00	100.00
R:ADV	0	3	1	0.00	0.00	0.00
R:DET	1	4	2	20.00	33.33	21.74
R:MORPH	6	7	1	46.15	85.71	50.85
R:NOUN	6	5	3	54.55	66.67	56.60
R:NOUN:INFL	8	1	3	88.89	72.73	85.11
R:NOUN:NUM	15	18	8	45.45	65.22	48.39
R:NOUN:POSS	9	1	4	90.00	69.23	84.91
R:ORTH	15	16	42	48.39	26.32	41.44
R:OTHER	32	6	24	84.21	57.14	76.92
R:PART	0	2	0	0.00	100.00	0.00
R:PREP	14	16	8	46.67	63.64	49.30
R:PRON	2	0	1	100.00	66.67	90.91
R:PUNCT	13	9	11	59.09	54.17	58.04
R:SPELL	77	1	23	98.72	77.00	93.45
R:VERB	6	2	7	75.00	46.15	66.67
R:VERB:FORM	13	9	0	59.09	100.00	64.36
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	10	6	0	62.50	100.00	67.57
R:VERB:TENSE	6	8	2	42.86	75.00	46.88
R:WO	3	2	0	60.00	100.00	65.22
U:ADV	1	1	0	50.00	100.00	55.56
U:DET	4	6	6	40.00	40.00	40.00
U:NOUN	0	1	0	0.00	100.00	0.00
U:OTHER	0	2	1	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	1	3	1	25.00	50.00	27.78
U:PUNCT	8	3	9	72.73	47.06	65.57
U:VERB	1	0	1	100.00	50.00	83.33
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	1	0	0	100.00	100.00	100.00
UNK	2	0	2	100.00	50.00	83.33

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	167	25	42	86.98	79.90	85.47
R	296	114	148	72.20	66.67	71.02
U	21	14	21	60.00	50.00	57.69
UNK	3	0	1	100.00	75.00	93.75

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	3	2	66.67	75.00	68.18
ADV	2	4	1	33.33	66.67	37.04
CONJ	1	0	0	100.00	100.00	100.00
DET	15	11	13	57.69	53.57	56.82
MORPH	6	6	1	50.00	85.71	54.55
NOUN	7	5	5	58.33	58.33	58.33
NOUN:INFL	8	1	3	88.89	72.73	85.11
NOUN:NUM	16	17	7	48.48	69.57	51.61
NOUN:POSS	14	2	6	87.50	70.00	83.33
ORTH	33	16	42	67.35	44.00	60.89
OTHER	55	11	36	83.33	60.44	77.46
PART	0	1	0	0.00	100.00	0.00
PREP	18	21	9	46.15	66.67	49.18
PRON	4	1	2	80.00	66.67	76.92
PUNCT	171	25	50	87.24	77.38	85.07
SPELL	77	1	22	98.72	77.78	93.67
UNK	3	0	1	100.00	75.00	93.75
VERB	9	2	9	81.82	50.00	72.58
VERB:FORM	15	8	0	65.22	100.00	70.09
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	10	5	0	66.67	100.00	71.43
VERB:TENSE	7	11	2	38.89	77.78	43.21
WO	6	2	0	75.00	100.00	78.95

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	0	0.00	100.00	0.00
M:ADV	1	1	0	50.00	100.00	55.56
M:CONJ	1	0	0	100.00	100.00	100.00
M:DET	7	2	3	77.78	70.00	76.09
M:NOUN	1	0	2	100.00	33.33	71.43
M:NOUN:POSS	5	2	2	71.43	71.43	71.43
M:OTHER	3	1	0	75.00	100.00	78.95
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	3	4	1	42.86	75.00	46.88
M:PRON	2	1	1	66.67	66.67	66.67
M:PUNCT	142	12	32	92.21	81.61	89.87
M:VERB	2	0	1	100.00	66.67	90.91
R:ADJ	6	2	1	75.00	85.71	76.92
R:ADV	0	3	1	0.00	0.00	0.00
R:DET	2	3	3	40.00	40.00	40.00
R:MORPH	6	6	1	50.00	85.71	54.55
R:NOUN	5	5	3	50.00	62.50	52.08
R:NOUN:INFL	8	1	3	88.89	72.73	85.11
R:NOUN:NUM	16	17	7	48.48	69.57	51.61
R:NOUN:POSS	9	0	4	100.00	69.23	91.84
R:ORTH	33	16	42	67.35	44.00	60.89
R:OTHER	52	6	34	89.66	60.47	81.76
R:PREP	13	15	7	46.43	65.00	49.24
R:PRON	2	0	1	100.00	66.67	90.91
R:PUNCT	20	11	9	64.52	68.97	65.36
R:SPELL	77	1	22	98.72	77.78	93.67
R:VERB	6	2	7	75.00	46.15	66.67
R:VERB:FORM	15	8	0	65.22	100.00	70.09
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	10	5	0	66.67	100.00	71.43
R:VERB:TENSE	6	11	2	35.29	75.00	39.47
R:WO	6	2	0	75.00	100.00	78.95
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	1	0	0	100.00	100.00	100.00
U:DET	6	6	7	50.00	46.15	49.18
U:NOUN	1	0	0	100.00	100.00	100.00
U:OTHER	0	4	2	0.00	0.00	0.00
U:PREP	2	2	1	50.00	66.67	52.63
U:PUNCT	9	2	9	81.82	50.00	72.58
U:VERB	1	0	1	100.00	50.00	83.33
U:VERB:TENSE	1	0	0	100.00	100.00	100.00
UNK	3	0	1	100.00	75.00	93.75

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:44:27+00:00
Competition submission:	18
Competition phase:	3 - Open phase

Detailed results

Submission information

Results