BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	2812	1313	2469	68.17	53.25	64.55
Span-level detection	3185	948	2305	77.06	58.01	72.31
Token-level detection	3980	679	2608	85.43	60.41	78.89

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	735	327	619	69.21	54.28	65.60
R	1709	751	1617	69.47	51.38	64.90
U	368	235	233	61.03	61.23	61.07

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	16	10	37	61.54	30.19	50.96
ADJ:FORM	6	2	5	75.00	54.55	69.77
ADV	22	22	41	50.00	34.92	46.03
CONJ	4	3	21	57.14	16.00	37.74
CONTR	12	3	1	80.00	92.31	82.19
DET	383	171	265	69.13	59.10	66.86
MORPH	85	27	68	75.89	55.56	70.72
NOUN	37	57	75	39.36	33.04	37.91
NOUN:INFL	11	2	7	84.62	61.11	78.57
NOUN:NUM	159	57	90	73.61	63.86	71.43
NOUN:POSS	33	7	24	82.50	57.89	76.04
ORTH	214	19	169	91.85	55.87	81.37
OTHER	162	222	521	42.19	23.72	36.50
PART	20	5	12	80.00	62.50	75.76
PREP	272	158	209	63.26	56.55	61.79
PRON	55	30	85	64.71	39.29	57.29
PUNCT	581	227	308	71.91	65.35	70.49
SPELL	231	29	91	88.85	71.74	84.80
VERB	81	65	154	55.48	34.47	49.45
VERB:FORM	132	46	65	74.16	67.01	72.61
VERB:INFL	5	0	3	100.00	62.50	89.29
VERB:SVA	122	34	27	78.21	81.88	78.91
VERB:TENSE	140	85	130	62.22	51.85	59.83
WO	29	32	61	47.54	32.22	43.41

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	1	8	66.67	20.00	45.45
M:ADV	6	11	17	35.29	26.09	32.97
M:CONJ	3	3	12	50.00	20.00	38.46
M:DET	138	50	140	73.40	49.64	66.99
M:NOUN	1	15	8	6.25	11.11	6.85
M:NOUN:POSS	6	1	9	85.71	40.00	69.77
M:OTHER	15	31	36	32.61	29.41	31.91
M:PART	3	0	4	100.00	42.86	78.95
M:PREP	44	37	59	54.32	42.72	51.52
M:PRON	31	17	40	64.58	43.66	58.94
M:PUNCT	439	131	234	77.02	65.23	74.33
M:VERB	12	21	23	36.36	34.29	35.93
M:VERB:FORM	14	3	6	82.35	70.00	79.55
M:VERB:TENSE	21	6	23	77.78	47.73	69.08
R:ADJ	10	5	21	66.67	32.26	54.95
R:ADJ:FORM	6	2	5	75.00	54.55	69.77
R:ADV	7	4	11	63.64	38.89	56.45
R:CONJ	0	0	4	100.00	0.00	0.00
R:CONTR	3	3	1	50.00	75.00	53.57
R:DET	56	18	61	75.68	47.86	67.80
R:MORPH	85	27	68	75.89	55.56	70.72
R:NOUN	33	32	61	50.77	35.11	46.61
R:NOUN:INFL	11	2	7	84.62	61.11	78.57
R:NOUN:NUM	159	57	90	73.61	63.86	71.43
R:NOUN:POSS	20	2	10	90.91	66.67	84.75
R:ORTH	214	19	169	91.85	55.87	81.37
R:OTHER	135	161	467	45.61	22.43	37.79
R:PART	16	5	4	76.19	80.00	76.92
R:PREP	175	96	118	64.58	59.73	63.54
R:PRON	13	11	29	54.17	30.95	47.10
R:PUNCT	106	77	43	57.92	71.14	60.16
R:SPELL	231	29	91	88.85	71.74	84.80
R:VERB	59	31	114	65.56	34.10	55.35
R:VERB:FORM	113	40	56	73.86	66.86	72.34
R:VERB:INFL	5	0	3	100.00	62.50	89.29
R:VERB:SVA	122	34	27	78.21	81.88	78.91
R:VERB:TENSE	101	64	96	61.21	51.27	58.93
R:WO	29	32	61	47.54	32.22	43.41
U:ADJ	4	4	8	50.00	33.33	45.45
U:ADV	9	7	13	56.25	40.91	52.33
U:CONJ	1	0	5	100.00	16.67	50.00
U:CONTR	9	0	0	100.00	100.00	100.00
U:DET	189	103	64	64.73	74.70	66.50
U:NOUN	3	10	6	23.08	33.33	24.59
U:NOUN:POSS	7	4	5	63.64	58.33	62.50
U:OTHER	12	30	18	28.57	40.00	30.30
U:PART	1	0	4	100.00	20.00	55.56
U:PREP	53	25	32	67.95	62.35	66.75
U:PRON	11	2	16	84.62	40.74	69.62
U:PUNCT	36	19	31	65.45	53.73	62.72
U:VERB	10	13	17	43.48	37.04	42.02
U:VERB:FORM	5	3	3	62.50	62.50	62.50
U:VERB:TENSE	18	15	11	54.55	62.07	55.90

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	816	244	565	76.98	59.09	72.58
R	1965	504	1462	79.59	57.34	73.86
U	394	200	214	66.33	64.80	66.02
UNK	10	0	64	100.00	13.51	43.86

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	22	7	36	75.86	37.93	63.22
ADJ:FORM	6	1	4	85.71	60.00	78.95
ADV	26	17	35	60.47	42.62	55.79
CONJ	6	3	18	66.67	25.00	50.00
CONTR	11	3	2	78.57	84.62	79.71
DET	410	153	240	72.82	63.08	70.64
MORPH	88	13	65	87.13	57.52	78.99
NOUN	51	41	69	55.43	42.50	52.25
NOUN:INFL	12	1	6	92.31	66.67	85.71
NOUN:NUM	153	48	87	76.12	63.75	73.28
NOUN:POSS	35	5	20	87.50	63.64	81.40
ORTH	225	13	160	94.54	58.44	84.14
OTHER	306	147	452	67.55	40.37	59.53
PART	18	4	15	81.82	54.55	74.38
PREP	317	110	187	74.24	62.90	71.65
PRON	75	17	67	81.52	52.82	73.53
PUNCT	605	191	299	76.01	66.92	74.00
SPELL	231	6	82	97.47	73.80	91.59
UNK	10	0	64	100.00	13.51	43.86
VERB	121	36	143	77.07	45.83	67.83
VERB:FORM	134	34	58	79.76	69.79	77.55
VERB:INFL	5	0	4	100.00	55.56	86.21
VERB:SVA	128	17	19	88.28	87.07	88.03
VERB:TENSE	160	55	120	74.42	57.14	70.18
WO	30	26	53	53.57	36.14	48.86

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	1	8	75.00	27.27	55.56
M:ADV	6	8	12	42.86	33.33	40.54
M:CONJ	4	3	11	57.14	26.67	46.51
M:DET	151	42	126	78.24	54.51	71.97
M:NOUN	3	12	7	20.00	30.00	21.43
M:NOUN:POSS	6	1	9	85.71	40.00	69.77
M:OTHER	32	22	36	59.26	47.06	56.34
M:PART	2	0	5	100.00	28.57	66.67
M:PREP	55	26	54	67.90	50.46	63.51
M:PRON	41	10	30	80.39	57.75	74.55
M:PUNCT	454	102	224	81.65	66.96	78.22
M:VERB	20	12	18	62.50	52.63	60.24
M:VERB:FORM	14	3	3	82.35	82.35	82.35
M:VERB:TENSE	25	2	22	92.59	53.19	80.65
R:ADJ	15	4	20	78.95	42.86	67.57
R:ADJ:FORM	6	1	4	85.71	60.00	78.95
R:ADV	10	2	13	83.33	43.48	70.42
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	2	3	1	40.00	66.67	43.48
R:DET	67	17	57	79.76	54.03	72.83
R:MORPH	88	13	65	87.13	57.52	78.99
R:NOUN	45	20	54	69.23	45.45	62.67
R:NOUN:INFL	12	1	6	92.31	66.67	85.71
R:NOUN:NUM	153	48	87	76.12	63.75	73.28
R:NOUN:POSS	22	1	6	95.65	78.57	91.67
R:ORTH	225	13	160	94.54	58.44	84.14
R:OTHER	261	97	396	72.91	39.73	62.47
R:PART	15	4	6	78.95	71.43	77.32
R:PREP	204	67	106	75.28	65.81	73.17
R:PRON	20	5	26	80.00	43.48	68.49
R:PUNCT	112	74	41	60.22	73.20	62.43
R:SPELL	231	6	82	97.47	73.80	91.59
R:VERB	88	14	111	86.27	44.22	72.49
R:VERB:FORM	115	28	53	80.42	68.45	77.70
R:VERB:INFL	5	0	4	100.00	55.56	86.21
R:VERB:SVA	128	17	19	88.28	87.07	88.03
R:VERB:TENSE	111	43	90	72.08	55.22	67.93
R:WO	30	26	53	53.57	36.14	48.86
U:ADJ	4	2	8	66.67	33.33	55.56
U:ADV	10	7	10	58.82	50.00	56.82
U:CONJ	2	0	5	100.00	28.57	66.67
U:CONTR	9	0	1	100.00	90.00	97.83
U:DET	192	94	57	67.13	77.11	68.92
U:NOUN	3	9	8	25.00	27.27	25.42
U:NOUN:POSS	7	3	5	70.00	58.33	67.31
U:OTHER	13	28	20	31.71	39.39	32.99
U:PART	1	0	4	100.00	20.00	55.56
U:PREP	58	17	27	77.33	68.24	75.32
U:PRON	14	2	11	87.50	56.00	78.65
U:PUNCT	39	15	34	72.22	53.42	67.47
U:VERB	13	10	14	56.52	48.15	54.62
U:VERB:FORM	5	3	2	62.50	71.43	64.10
U:VERB:TENSE	24	10	8	70.59	75.00	71.43
UNK	10	0	64	100.00	13.51	43.86

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	944	153	557	86.05	62.89	80.15
R	2540	355	1694	87.74	59.99	80.31
U	470	171	273	73.32	63.26	71.06
UNK	26	0	84	100.00	23.64	60.75

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	22	7	30	75.86	42.31	65.48
ADJ:FORM	6	1	4	85.71	60.00	78.95
ADV	30	10	45	75.00	40.00	63.83
CONJ	16	1	17	94.12	48.48	79.21
CONTR	10	1	2	90.91	83.33	89.29
DET	440	117	239	78.99	64.80	75.68
MORPH	89	8	58	91.75	60.54	83.18
NOUN	70	27	75	72.16	48.28	65.67
NOUN:INFL	13	0	6	100.00	68.42	91.55
NOUN:NUM	157	33	94	82.63	62.55	77.65
NOUN:POSS	46	3	18	93.88	71.88	88.46
ORTH	315	8	150	97.52	67.74	89.64
OTHER	634	112	637	84.99	49.88	74.50
PART	12	2	12	85.71	50.00	75.00
PREP	334	84	198	79.90	62.78	75.77
PRON	95	10	62	90.48	60.51	82.32
PUNCT	753	130	284	85.28	72.61	82.40
SPELL	229	1	85	99.57	72.93	92.79
UNK	26	0	84	100.00	23.64	60.75
VERB	134	22	179	85.90	42.81	71.50
VERB:FORM	135	24	58	84.91	69.95	81.42
VERB:INFL	5	0	2	100.00	71.43	92.59
VERB:SVA	130	11	25	92.20	83.87	90.40
VERB:TENSE	186	48	146	79.49	56.02	73.34
WO	93	19	98	83.04	48.69	72.77

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	1	6	75.00	33.33	60.00
M:ADV	10	4	11	71.43	47.62	64.94
M:CONJ	14	1	10	93.33	58.33	83.33
M:DET	160	20	126	88.89	55.94	79.52
M:NOUN	8	11	7	42.11	53.33	43.96
M:NOUN:POSS	8	1	7	88.89	53.33	78.43
M:OTHER	40	14	39	74.07	50.63	67.80
M:PART	2	0	3	100.00	40.00	76.92
M:PREP	67	15	55	81.71	54.92	74.44
M:PRON	53	5	27	91.38	66.25	84.94
M:PUNCT	513	71	212	87.84	70.76	83.80
M:VERB	23	9	29	71.88	44.23	63.89
M:VERB:FORM	14	1	3	93.33	82.35	90.91
M:VERB:TENSE	29	0	22	100.00	56.86	86.83
R:ADJ	16	5	19	76.19	45.71	67.23
R:ADJ:FORM	6	1	4	85.71	60.00	78.95
R:ADV	9	2	16	81.82	36.00	65.22
R:CONJ	1	0	4	100.00	20.00	55.56
R:CONTR	2	1	1	66.67	66.67	66.67
R:DET	71	14	55	83.53	56.35	76.18
R:MORPH	89	8	58	91.75	60.54	83.18
R:NOUN	56	10	57	84.85	49.56	74.27
R:NOUN:INFL	13	0	6	100.00	68.42	91.55
R:NOUN:NUM	157	33	94	82.63	62.55	77.65
R:NOUN:POSS	30	1	5	96.77	85.71	94.34
R:ORTH	315	8	150	97.52	67.74	89.64
R:OTHER	549	63	529	89.71	50.93	77.85
R:PART	8	2	5	80.00	61.54	75.47
R:PREP	207	58	112	78.11	64.89	75.05
R:PRON	24	5	26	82.76	48.00	72.29
R:PUNCT	183	45	46	80.26	79.91	80.19
R:SPELL	229	1	85	99.57	72.93	92.79
R:VERB	97	10	130	90.65	42.73	74.05
R:VERB:FORM	117	21	51	84.78	69.64	81.25
R:VERB:INFL	5	0	2	100.00	71.43	92.59
R:VERB:SVA	130	11	25	92.20	83.87	90.40
R:VERB:TENSE	133	37	116	78.24	53.41	71.58
R:WO	93	19	98	83.04	48.69	72.77
U:ADJ	3	1	5	75.00	37.50	62.50
U:ADV	11	4	18	73.33	37.93	61.80
U:CONJ	1	0	3	100.00	25.00	62.50
U:CONTR	8	0	1	100.00	88.89	97.56
U:DET	209	83	58	71.58	78.28	72.82
U:NOUN	6	6	11	50.00	35.29	46.15
U:NOUN:POSS	8	1	6	88.89	57.14	80.00
U:OTHER	45	35	69	56.25	39.47	51.84
U:PART	2	0	4	100.00	33.33	71.43
U:PREP	60	11	31	84.51	65.93	80.00
U:PRON	18	0	9	100.00	66.67	90.91
U:PUNCT	57	14	26	80.28	68.67	77.66
U:VERB	14	3	20	82.35	41.18	68.63
U:VERB:FORM	4	2	4	66.67	50.00	62.50
U:VERB:TENSE	24	11	8	68.57	75.00	69.77
UNK	26	0	84	100.00	23.64	60.75

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1192	570	1152	67.65	50.85	63.46
Span-level detection	1383	381	1061	78.40	56.59	72.79
Token-level detection	1774	215	1178	89.19	60.09	81.32

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	268	163	289	62.18	48.11	58.75
R	771	326	756	70.28	50.49	65.17
U	153	81	107	65.38	58.85	63.96

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	4	3	14	57.14	22.22	43.48
ADJ:FORM	4	0	2	100.00	66.67	90.91
ADV	8	12	21	40.00	27.59	36.70
CONJ	3	0	9	100.00	25.00	62.50
CONTR	7	2	0	77.78	100.00	81.40
DET	168	61	120	73.36	58.33	69.77
MORPH	48	13	34	78.69	58.54	73.62
NOUN	15	28	35	34.88	30.00	33.78
NOUN:INFL	4	2	1	66.67	80.00	68.97
NOUN:NUM	80	26	44	75.47	64.52	72.99
NOUN:POSS	8	2	7	80.00	53.33	72.73
ORTH	108	12	87	90.00	55.38	80.00
OTHER	79	112	278	41.36	22.13	35.24
PART	11	2	4	84.62	73.33	82.09
PREP	117	55	81	68.02	59.09	66.03
PRON	31	14	49	68.89	38.75	59.62
PUNCT	173	97	134	64.07	56.35	62.36
SPELL	93	12	23	88.57	80.17	86.75
VERB	35	32	74	52.24	32.11	46.42
VERB:FORM	65	19	30	77.38	68.42	75.41
VERB:INFL	2	0	1	100.00	66.67	90.91
VERB:SVA	60	18	17	76.92	77.92	77.12
VERB:TENSE	62	37	64	62.63	49.21	59.39
WO	7	11	23	38.89	23.33	34.31

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	2	100.00	33.33	71.43
M:ADV	2	6	9	25.00	18.18	23.26
M:CONJ	2	0	4	100.00	33.33	71.43
M:DET	63	25	59	71.59	51.64	66.46
M:NOUN	0	9	3	0.00	0.00	0.00
M:NOUN:POSS	1	0	2	100.00	33.33	71.43
M:OTHER	9	15	22	37.50	29.03	35.43
M:PART	1	0	0	100.00	100.00	100.00
M:PREP	21	18	29	53.85	42.00	50.97
M:PRON	17	8	20	68.00	45.95	62.04
M:PUNCT	124	66	110	65.26	52.99	62.37
M:VERB	5	9	14	35.71	26.32	33.33
M:VERB:FORM	10	3	5	76.92	66.67	74.63
M:VERB:TENSE	12	4	10	75.00	54.55	69.77
R:ADJ	1	1	8	50.00	11.11	29.41
R:ADJ:FORM	4	0	2	100.00	66.67	90.91
R:ADV	4	1	5	80.00	44.44	68.97
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	2	2	0	50.00	100.00	55.56
R:DET	20	6	27	76.92	42.55	66.23
R:MORPH	48	13	34	78.69	58.54	73.62
R:NOUN	13	12	29	52.00	30.95	45.77
R:NOUN:INFL	4	2	1	66.67	80.00	68.97
R:NOUN:NUM	80	26	44	75.47	64.52	72.99
R:NOUN:POSS	4	1	4	80.00	50.00	71.43
R:ORTH	108	12	87	90.00	55.38	80.00
R:OTHER	65	84	250	43.62	20.63	35.68
R:PART	10	2	1	83.33	90.91	84.75
R:PREP	71	30	41	70.30	63.39	68.80
R:PRON	9	5	17	64.29	34.62	54.88
R:PUNCT	41	28	14	59.42	74.55	61.93
R:SPELL	93	12	23	88.57	80.17	86.75
R:VERB	24	15	52	61.54	31.58	51.72
R:VERB:FORM	54	16	25	77.14	68.35	75.21
R:VERB:INFL	2	0	1	100.00	66.67	90.91
R:VERB:SVA	60	18	17	76.92	77.92	77.12
R:VERB:TENSE	47	29	50	61.84	48.45	58.60
R:WO	7	11	23	38.89	23.33	34.31
U:ADJ	2	2	4	50.00	33.33	45.45
U:ADV	2	5	7	28.57	22.22	27.03
U:CONJ	1	0	4	100.00	20.00	55.56
U:CONTR	5	0	0	100.00	100.00	100.00
U:DET	85	30	34	73.91	71.43	73.40
U:NOUN	2	7	3	22.22	40.00	24.39
U:NOUN:POSS	3	1	1	75.00	75.00	75.00
U:OTHER	5	13	6	27.78	45.45	30.12
U:PART	0	0	3	100.00	0.00	0.00
U:PREP	25	7	11	78.12	69.44	76.22
U:PRON	5	1	12	83.33	29.41	60.98
U:PUNCT	8	3	10	72.73	44.44	64.52
U:VERB	6	8	8	42.86	42.86	42.86
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	3	4	4	42.86	42.86	42.86

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	309	114	250	73.05	55.28	68.64
R	898	200	669	81.79	57.31	75.35
U	172	67	96	71.97	64.18	70.26
UNK	4	0	46	100.00	8.00	30.30

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	7	1	13	87.50	35.00	67.31
ADJ:FORM	3	0	2	100.00	60.00	88.24
ADV	9	10	21	47.37	30.00	42.45
CONJ	5	0	8	100.00	38.46	75.76
CONTR	6	2	1	75.00	85.71	76.92
DET	186	53	99	77.82	65.26	74.94
MORPH	49	5	34	90.74	59.04	81.94
NOUN	21	19	31	52.50	40.38	49.53
NOUN:INFL	5	1	0	83.33	100.00	86.21
NOUN:NUM	77	21	44	78.57	63.64	75.05
NOUN:POSS	10	1	5	90.91	66.67	84.75
ORTH	115	8	79	93.50	59.28	83.82
OTHER	166	68	230	70.94	41.92	62.31
PART	10	3	6	76.92	62.50	73.53
PREP	133	33	71	80.12	65.20	76.61
PRON	42	7	38	85.71	52.50	76.09
PUNCT	177	75	126	70.24	58.42	67.51
SPELL	91	4	20	95.79	81.98	92.67
UNK	4	0	46	100.00	8.00	30.30
VERB	59	16	73	78.67	44.70	68.29
VERB:FORM	65	16	27	80.25	70.65	78.13
VERB:INFL	2	0	2	100.00	50.00	83.33
VERB:SVA	62	8	12	88.57	83.78	87.57
VERB:TENSE	72	20	57	78.26	55.81	72.43
WO	7	10	16	41.18	30.43	38.46

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	2	100.00	33.33	71.43
M:ADV	2	5	8	28.57	20.00	26.32
M:CONJ	3	0	4	100.00	42.86	78.95
M:DET	70	21	47	76.92	59.83	72.77
M:NOUN	0	8	2	0.00	0.00	0.00
M:NOUN:POSS	1	0	3	100.00	25.00	62.50
M:OTHER	22	9	21	70.97	51.16	65.87
M:PART	1	0	0	100.00	100.00	100.00
M:PREP	26	11	23	70.27	53.06	65.99
M:PRON	21	4	15	84.00	58.33	77.21
M:PUNCT	127	46	103	73.41	55.22	68.87
M:VERB	11	5	10	68.75	52.38	64.71
M:VERB:FORM	10	3	2	76.92	83.33	78.12
M:VERB:TENSE	14	2	10	87.50	58.33	79.55
R:ADJ	4	0	7	100.00	36.36	74.07
R:ADJ:FORM	3	0	2	100.00	60.00	88.24
R:ADV	5	0	6	100.00	45.45	80.65
R:CONTR	1	2	0	33.33	100.00	38.46
R:DET	26	7	24	78.79	52.00	71.43
R:MORPH	49	5	34	90.74	59.04	81.94
R:NOUN	20	5	24	80.00	45.45	69.44
R:NOUN:INFL	5	1	0	83.33	100.00	86.21
R:NOUN:NUM	77	21	44	78.57	63.64	75.05
R:NOUN:POSS	6	1	1	85.71	85.71	85.71
R:ORTH	115	8	79	93.50	59.28	83.82
R:OTHER	139	46	202	75.14	40.76	64.29
R:PART	9	3	3	75.00	75.00	75.00
R:PREP	79	17	40	82.29	66.39	78.53
R:PRON	13	2	15	86.67	46.43	73.86
R:PUNCT	40	26	13	60.61	75.47	63.09
R:SPELL	91	4	20	95.79	81.98	92.67
R:VERB	40	4	56	90.91	41.67	73.53
R:VERB:FORM	54	13	25	80.60	68.35	77.81
R:VERB:INFL	2	0	2	100.00	50.00	83.33
R:VERB:SVA	62	8	12	88.57	83.78	87.57
R:VERB:TENSE	51	17	44	75.00	53.68	69.48
R:WO	7	10	16	41.18	30.43	38.46
U:ADJ	2	1	4	66.67	33.33	55.56
U:ADV	2	5	7	28.57	22.22	27.03
U:CONJ	2	0	4	100.00	33.33	71.43
U:CONTR	5	0	1	100.00	83.33	96.15
U:DET	90	25	28	78.26	76.27	77.85
U:NOUN	1	6	5	14.29	16.67	14.71
U:NOUN:POSS	3	0	1	100.00	75.00	93.75
U:OTHER	5	13	7	27.78	41.67	29.76
U:PART	0	0	3	100.00	0.00	0.00
U:PREP	28	5	8	84.85	77.78	83.33
U:PRON	8	1	8	88.89	50.00	76.92
U:PUNCT	10	3	10	76.92	50.00	69.44
U:VERB	8	7	7	53.33	53.33	53.33
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	7	1	3	87.50	70.00	83.33
UNK	4	0	46	100.00	8.00	30.30

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	373	66	223	84.97	62.58	79.29
R	1169	109	783	91.47	59.89	82.74
U	213	40	115	84.19	64.94	79.48
UNK	19	0	57	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	8	0	10	100.00	44.44	80.00
ADJ:FORM	3	0	1	100.00	75.00	93.75
ADV	14	6	26	70.00	35.00	58.33
CONJ	8	0	7	100.00	53.33	85.11
CONTR	6	1	0	85.71	100.00	88.24
DET	205	33	101	86.13	66.99	81.48
MORPH	47	3	28	94.00	62.67	85.45
NOUN	34	10	37	77.27	47.89	68.83
NOUN:INFL	6	0	0	100.00	100.00	100.00
NOUN:NUM	83	10	48	89.25	63.36	82.50
NOUN:POSS	14	0	5	100.00	73.68	93.33
ORTH	143	2	63	98.62	69.42	90.97
OTHER	343	45	317	88.40	51.97	77.53
PART	6	1	7	85.71	46.15	73.17
PREP	145	20	79	87.88	64.73	82.01
PRON	56	4	30	93.33	65.12	85.89
PUNCT	242	43	105	84.91	69.74	81.37
SPELL	86	1	24	98.85	78.18	93.89
UNK	19	0	57	100.00	25.00	62.50
VERB	64	6	92	91.43	41.03	73.39
VERB:FORM	66	6	27	91.67	70.97	86.61
VERB:INFL	2	0	0	100.00	100.00	100.00
VERB:SVA	67	3	16	95.71	80.72	92.29
VERB:TENSE	86	15	67	85.15	56.21	77.20
WO	21	6	31	77.78	40.38	65.62

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	2	100.00	33.33	71.43
M:ADV	5	2	8	71.43	38.46	60.98
M:CONJ	6	0	3	100.00	66.67	90.91
M:DET	72	11	46	86.75	61.02	80.00
M:NOUN	3	7	1	30.00	75.00	34.09
M:NOUN:POSS	2	0	2	100.00	50.00	83.33
M:OTHER	26	5	21	83.87	55.32	76.02
M:PART	1	0	0	100.00	100.00	100.00
M:PREP	32	6	25	84.21	56.14	76.56
M:PRON	30	2	11	93.75	73.17	88.76
M:PUNCT	158	30	78	84.04	66.95	79.96
M:VERB	13	2	16	86.67	44.83	73.03
M:VERB:FORM	10	1	2	90.91	83.33	89.29
M:VERB:TENSE	14	0	8	100.00	63.64	89.74
R:ADJ	5	0	6	100.00	45.45	80.65
R:ADJ:FORM	3	0	1	100.00	75.00	93.75
R:ADV	6	0	8	100.00	42.86	78.95
R:CONJ	1	0	1	100.00	50.00	83.33
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	28	5	23	84.85	54.90	76.50
R:MORPH	47	3	28	94.00	62.67	85.45
R:NOUN	27	0	29	100.00	48.21	82.32
R:NOUN:INFL	6	0	0	100.00	100.00	100.00
R:NOUN:NUM	83	10	48	89.25	63.36	82.50
R:NOUN:POSS	8	0	1	100.00	88.89	97.56
R:ORTH	143	2	63	98.62	69.42	90.97
R:OTHER	299	33	271	90.06	52.46	78.77
R:PART	5	1	4	83.33	55.56	75.76
R:PREP	82	13	45	86.32	64.57	80.87
R:PRON	15	2	14	88.24	51.72	77.32
R:PUNCT	67	9	21	88.16	76.14	85.46
R:SPELL	86	1	24	98.85	78.18	93.89
R:VERB	46	2	68	95.83	40.35	75.16
R:VERB:FORM	55	5	24	91.67	69.62	86.21
R:VERB:INFL	2	0	0	100.00	100.00	100.00
R:VERB:SVA	67	3	16	95.71	80.72	92.29
R:VERB:TENSE	66	13	57	83.54	53.66	75.17
R:WO	21	6	31	77.78	40.38	65.62
U:ADJ	2	0	2	100.00	50.00	83.33
U:ADV	3	4	10	42.86	23.08	36.59
U:CONJ	1	0	3	100.00	25.00	62.50
U:CONTR	5	0	0	100.00	100.00	100.00
U:DET	105	17	32	86.07	76.64	84.00
U:NOUN	4	3	7	57.14	36.36	51.28
U:NOUN:POSS	4	0	2	100.00	66.67	90.91
U:OTHER	18	7	25	72.00	41.86	62.94
U:PART	0	0	3	100.00	0.00	0.00
U:PREP	31	1	9	96.88	77.50	92.26
U:PRON	11	0	5	100.00	68.75	91.67
U:PUNCT	17	4	6	80.95	73.91	79.44
U:VERB	5	2	8	71.43	38.46	60.98
U:VERB:FORM	1	0	1	100.00	50.00	83.33
U:VERB:TENSE	6	2	2	75.00	75.00	75.00
UNK	19	0	57	100.00	25.00	62.50

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	852	365	822	70.01	50.90	65.12
Span-level detection	959	263	749	78.48	56.15	72.70
Token-level detection	1203	184	850	86.73	58.60	79.13

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	238	94	208	71.69	53.36	67.08
R	492	214	533	69.69	48.00	63.91
U	122	57	81	68.16	60.10	66.38

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	7	4	14	63.64	33.33	53.85
ADJ:FORM	2	2	1	50.00	66.67	52.63
ADV	9	5	18	64.29	33.33	54.22
CONJ	1	3	10	25.00	9.09	18.52
CONTR	2	1	1	66.67	66.67	66.67
DET	128	45	99	73.99	56.39	69.64
MORPH	23	5	19	82.14	54.76	74.68
NOUN	15	17	26	46.88	36.59	44.38
NOUN:NUM	48	9	23	84.21	67.61	80.27
NOUN:POSS	9	2	6	81.82	60.00	76.27
ORTH	44	3	33	93.62	57.14	83.02
OTHER	37	61	174	37.76	17.54	30.68
PART	7	1	8	87.50	46.67	74.47
PREP	94	46	82	67.14	53.41	63.86
PRON	16	11	27	59.26	37.21	52.98
PUNCT	183	68	98	72.91	65.12	71.21
SPELL	52	9	20	85.25	72.22	82.28
VERB	30	19	59	61.22	33.71	52.63
VERB:FORM	44	13	28	77.19	61.11	73.33
VERB:SVA	42	7	8	85.71	84.00	85.37
VERB:TENSE	47	18	43	72.31	52.22	67.14
WO	12	16	25	42.86	32.43	40.27

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	3	50.00	25.00	41.67
M:ADV	3	4	8	42.86	27.27	38.46
M:CONJ	1	3	6	25.00	14.29	21.74
M:DET	49	16	55	75.38	47.12	67.31
M:NOUN	1	3	2	25.00	33.33	26.32
M:NOUN:POSS	2	0	3	100.00	40.00	76.92
M:OTHER	5	12	10	29.41	33.33	30.12
M:PART	2	0	4	100.00	33.33	71.43
M:PREP	11	10	18	52.38	37.93	48.67
M:PRON	12	6	15	66.67	44.44	60.61
M:PUNCT	140	33	70	80.92	66.67	77.61
M:VERB	5	4	5	55.56	50.00	54.35
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	5	2	9	71.43	35.71	59.52
R:ADJ	5	2	8	71.43	38.46	60.98
R:ADJ:FORM	2	2	1	50.00	66.67	52.63
R:ADV	2	1	4	66.67	33.33	55.56
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	24	6	28	80.00	46.15	69.77
R:MORPH	23	5	19	82.14	54.76	74.68
R:NOUN	13	11	22	54.17	37.14	49.62
R:NOUN:NUM	48	9	23	84.21	67.61	80.27
R:NOUN:POSS	5	0	0	100.00	100.00	100.00
R:ORTH	44	3	33	93.62	57.14	83.02
R:OTHER	26	41	154	38.81	14.44	29.02
R:PART	5	1	3	83.33	62.50	78.12
R:PREP	62	27	52	69.66	54.39	65.96
R:PRON	0	5	8	0.00	0.00	0.00
R:PUNCT	32	32	19	50.00	62.75	52.12
R:SPELL	52	9	20	85.25	72.22	82.28
R:VERB	21	11	48	65.62	30.43	53.30
R:VERB:FORM	40	11	26	78.43	60.61	74.07
R:VERB:SVA	42	7	8	85.71	84.00	85.37
R:VERB:TENSE	34	14	28	70.83	54.84	66.93
R:WO	12	16	25	42.86	32.43	40.27
U:ADJ	1	1	3	50.00	25.00	41.67
U:ADV	4	0	6	100.00	40.00	76.92
U:CONJ	0	0	1	100.00	0.00	0.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	55	23	16	70.51	77.46	71.80
U:NOUN	1	3	2	25.00	33.33	26.32
U:NOUN:POSS	2	2	3	50.00	40.00	47.62
U:OTHER	6	8	10	42.86	37.50	41.67
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	21	9	12	70.00	63.64	68.63
U:PRON	4	0	4	100.00	50.00	83.33
U:PUNCT	11	3	9	78.57	55.00	72.37
U:VERB	4	4	6	50.00	40.00	47.62
U:VERB:FORM	3	2	2	60.00	60.00	60.00
U:VERB:TENSE	8	2	6	80.00	57.14	74.07

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	261	76	187	77.45	58.26	72.66
R	567	141	476	80.08	54.36	73.16
U	127	46	74	73.41	63.18	71.11
UNK	4	0	12	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	10	4	15	71.43	40.00	61.73
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	13	3	12	81.25	52.00	73.03
CONJ	1	3	8	25.00	11.11	20.00
CONTR	2	1	1	66.67	66.67	66.67
DET	134	39	90	77.46	59.82	73.14
MORPH	23	2	16	92.00	58.97	82.73
NOUN	18	15	23	54.55	43.90	52.02
NOUN:NUM	46	9	22	83.64	67.65	79.86
NOUN:POSS	8	2	6	80.00	57.14	74.07
ORTH	43	1	34	97.73	55.84	84.98
OTHER	72	44	158	62.07	31.30	51.87
PART	6	1	8	85.71	42.86	71.43
PREP	109	32	74	77.30	59.56	72.96
PRON	22	6	22	78.57	50.00	70.51
PUNCT	193	61	89	75.98	68.44	74.35
SPELL	51	0	19	100.00	72.86	93.07
UNK	4	0	12	100.00	25.00	62.50
VERB	43	10	48	81.13	47.25	70.96
VERB:FORM	46	6	24	88.46	65.71	82.73
VERB:SVA	45	3	5	93.75	90.00	92.98
VERB:TENSE	54	8	37	87.10	59.34	79.65
WO	13	12	26	52.00	33.33	46.76

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	1	4	66.67	33.33	55.56
M:ADV	4	3	4	57.14	50.00	55.56
M:CONJ	1	3	5	25.00	16.67	22.73
M:DET	53	14	51	79.10	50.96	71.24
M:NOUN	1	3	2	25.00	33.33	26.32
M:NOUN:POSS	2	0	3	100.00	40.00	76.92
M:OTHER	7	10	11	41.18	38.89	40.70
M:PART	1	0	4	100.00	20.00	55.56
M:PREP	14	8	18	63.64	43.75	58.33
M:PRON	16	4	11	80.00	59.26	74.77
M:PUNCT	147	27	62	84.48	70.33	81.22
M:VERB	6	3	4	66.67	60.00	65.22
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	6	0	8	100.00	42.86	78.95
R:ADJ	7	2	8	77.78	46.67	68.63
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	4	0	5	100.00	44.44	80.00
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	27	4	26	87.10	50.94	76.27
R:MORPH	23	2	16	92.00	58.97	82.73
R:NOUN	15	9	19	62.50	44.12	57.69
R:NOUN:NUM	46	9	22	83.64	67.65	79.86
R:NOUN:POSS	4	0	0	100.00	100.00	100.00
R:ORTH	43	1	34	97.73	55.84	84.98
R:OTHER	58	27	136	68.24	29.90	54.31
R:PART	5	1	3	83.33	62.50	78.12
R:PREP	73	19	45	79.35	61.86	75.10
R:PRON	2	2	8	50.00	20.00	38.46
R:PUNCT	35	32	15	52.24	70.00	55.03
R:SPELL	51	0	19	100.00	72.86	93.07
R:VERB	32	5	40	86.49	44.44	72.73
R:VERB:FORM	42	4	22	91.30	65.62	84.68
R:VERB:SVA	45	3	5	93.75	90.00	92.98
R:VERB:TENSE	39	7	24	84.78	61.90	78.95
R:WO	13	12	26	52.00	33.33	46.76
U:ADJ	1	1	3	50.00	25.00	41.67
U:ADV	5	0	3	100.00	62.50	89.29
U:CONJ	0	0	1	100.00	0.00	0.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	54	21	13	72.00	80.60	73.57
U:NOUN	2	3	2	40.00	50.00	41.67
U:NOUN:POSS	2	2	3	50.00	40.00	47.62
U:OTHER	7	7	11	50.00	38.89	47.30
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	22	5	11	81.48	66.67	78.01
U:PRON	4	0	3	100.00	57.14	86.96
U:PUNCT	11	2	12	84.62	47.83	73.33
U:VERB	5	2	4	71.43	55.56	67.57
U:VERB:FORM	3	2	2	60.00	60.00	60.00
U:VERB:TENSE	9	1	5	90.00	64.29	83.33
UNK	4	0	12	100.00	25.00	62.50

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	293	40	200	87.99	59.43	80.27
R	753	102	539	88.07	58.28	79.90
U	154	42	100	78.57	60.63	74.18
UNK	3	0	11	100.00	21.43	57.69

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	10	5	11	66.67	47.62	61.73
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	12	2	12	85.71	50.00	75.00
CONJ	6	1	8	85.71	42.86	71.43
CONTR	1	0	1	100.00	50.00	83.33
DET	140	28	88	83.33	61.40	77.78
MORPH	27	0	17	100.00	61.36	88.82
NOUN	24	11	22	68.57	52.17	64.52
NOUN:NUM	45	8	20	84.91	69.23	81.23
NOUN:POSS	12	1	6	92.31	66.67	85.71
ORTH	72	1	35	98.63	67.29	90.23
OTHER	174	27	229	86.57	43.18	72.08
PART	4	0	4	100.00	50.00	83.33
PREP	111	22	76	83.46	59.36	77.19
PRON	25	3	26	89.29	49.02	76.69
PUNCT	233	43	86	84.42	73.04	81.87
SPELL	52	0	18	100.00	74.29	93.53
UNK	3	0	11	100.00	21.43	57.69
VERB	50	8	64	86.21	43.86	72.25
VERB:FORM	46	5	23	90.20	66.67	84.25
VERB:SVA	43	3	5	93.48	89.58	92.67
VERB:TENSE	66	5	48	92.96	57.89	82.91
WO	44	10	40	81.48	52.38	73.33

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	1	2	66.67	50.00	62.50
M:ADV	5	2	2	71.43	71.43	71.43
M:CONJ	6	1	5	85.71	54.55	76.92
M:DET	57	4	54	93.44	51.35	80.28
M:NOUN	2	3	3	40.00	40.00	40.00
M:NOUN:POSS	2	0	3	100.00	40.00	76.92
M:OTHER	10	6	12	62.50	45.45	58.14
M:PART	1	0	2	100.00	33.33	71.43
M:PREP	15	2	18	88.24	45.45	74.26
M:PRON	17	1	13	94.44	56.67	83.33
M:PUNCT	157	17	67	90.23	70.09	85.33
M:VERB	8	3	8	72.73	50.00	66.67
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	10	0	11	100.00	47.62	81.97
R:ADJ	7	3	8	70.00	46.67	63.64
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	2	0	5	100.00	28.57	66.67
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	28	4	25	87.50	52.83	77.35
R:MORPH	27	0	17	100.00	61.36	88.82
R:NOUN	20	5	16	80.00	55.56	73.53
R:NOUN:NUM	45	8	20	84.91	69.23	81.23
R:NOUN:POSS	8	0	0	100.00	100.00	100.00
R:ORTH	72	1	35	98.63	67.29	90.23
R:OTHER	138	12	179	92.00	43.53	75.25
R:PART	2	0	1	100.00	66.67	90.91
R:PREP	75	17	45	81.52	62.50	76.84
R:PRON	3	2	9	60.00	25.00	46.88
R:PUNCT	61	24	11	71.76	84.72	74.03
R:SPELL	52	0	18	100.00	74.29	93.53
R:VERB	34	5	48	87.18	41.46	71.43
R:VERB:FORM	43	3	21	93.48	67.19	86.69
R:VERB:SVA	43	3	5	93.48	89.58	92.67
R:VERB:TENSE	46	4	32	92.00	58.97	82.73
R:WO	44	10	40	81.48	52.38	73.33
U:ADJ	1	1	1	50.00	50.00	50.00
U:ADV	5	0	5	100.00	50.00	83.33
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	55	20	9	73.33	85.94	75.55
U:NOUN	2	3	3	40.00	40.00	40.00
U:NOUN:POSS	2	1	3	66.67	40.00	58.82
U:OTHER	26	9	38	74.29	40.62	63.73
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	21	3	13	87.50	61.76	80.77
U:PRON	5	0	4	100.00	55.56	86.21
U:PUNCT	15	2	8	88.24	65.22	82.42
U:VERB	8	0	8	100.00	50.00	83.33
U:VERB:FORM	2	2	2	50.00	50.00	50.00
U:VERB:TENSE	10	1	5	90.91	66.67	84.75
UNK	3	0	11	100.00	21.43	57.69

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	426	165	269	72.08	61.29	69.63
Span-level detection	469	123	272	79.22	63.29	75.43
Token-level detection	549	103	323	84.20	62.96	78.88

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	131	36	79	78.44	62.38	74.60
R	226	95	165	70.40	57.80	67.46
U	69	34	25	66.99	73.40	68.18

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	1	6	50.00	14.29	33.33
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	4	0	2	100.00	66.67	90.91
CONJ	0	0	2	100.00	0.00	0.00
CONTR	3	0	0	100.00	100.00	100.00
DET	71	24	40	74.74	63.96	72.30
MORPH	9	1	12	90.00	42.86	73.77
NOUN	3	3	7	50.00	30.00	44.12
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	16	7	17	69.57	48.48	64.00
NOUN:POSS	4	2	4	66.67	50.00	62.50
ORTH	32	2	13	94.12	71.11	88.40
OTHER	22	24	39	47.83	36.07	44.90
PART	1	2	0	33.33	100.00	38.46
PREP	48	29	30	62.34	61.54	62.18
PRON	6	3	6	66.67	50.00	62.50
PUNCT	110	29	32	79.14	77.46	78.80
SPELL	29	4	9	87.88	76.32	85.29
VERB	7	7	14	50.00	33.33	45.45
VERB:FORM	17	6	3	73.91	85.00	75.89
VERB:SVA	10	1	0	90.91	100.00	92.59
VERB:TENSE	23	16	20	58.97	53.49	57.79
WO	8	4	11	66.67	42.11	59.70

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	1	0	0	100.00	100.00	100.00
M:CONJ	0	0	2	100.00	0.00	0.00
M:DET	20	5	24	80.00	45.45	69.44
M:NOUN	0	1	1	0.00	0.00	0.00
M:NOUN:POSS	1	1	0	50.00	100.00	55.56
M:OTHER	1	3	4	25.00	20.00	23.81
M:PREP	11	5	10	68.75	52.38	64.71
M:PRON	2	3	3	40.00	40.00	40.00
M:PUNCT	87	14	26	86.14	76.99	84.14
M:VERB	1	4	2	20.00	33.33	21.74
M:VERB:FORM	3	0	1	100.00	75.00	93.75
M:VERB:TENSE	4	0	4	100.00	50.00	83.33
R:ADJ	1	0	3	100.00	25.00	62.50
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	10	3	5	76.92	66.67	74.63
R:MORPH	9	1	12	90.00	42.86	73.77
R:NOUN	3	2	5	60.00	37.50	53.57
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	16	7	17	69.57	48.48	64.00
R:NOUN:POSS	1	0	4	100.00	20.00	55.56
R:ORTH	32	2	13	94.12	71.11	88.40
R:OTHER	20	19	34	51.28	37.04	47.62
R:PART	1	2	0	33.33	100.00	38.46
R:PREP	32	22	15	59.26	68.09	60.84
R:PRON	2	0	3	100.00	40.00	76.92
R:PUNCT	15	7	2	68.18	88.24	71.43
R:SPELL	29	4	9	87.88	76.32	85.29
R:VERB	6	3	11	66.67	35.29	56.60
R:VERB:FORM	13	6	2	68.42	86.67	71.43
R:VERB:SVA	10	1	0	90.91	100.00	92.59
R:VERB:TENSE	14	12	15	53.85	48.28	52.63
R:WO	8	4	11	66.67	42.11	59.70
U:ADJ	0	1	1	0.00	0.00	0.00
U:ADV	2	0	0	100.00	100.00	100.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	41	16	11	71.93	78.85	73.21
U:NOUN	0	0	1	100.00	0.00	0.00
U:NOUN:POSS	2	1	0	66.67	100.00	71.43
U:OTHER	1	2	1	33.33	50.00	35.71
U:PREP	5	2	5	71.43	50.00	65.79
U:PRON	2	0	0	100.00	100.00	100.00
U:PUNCT	8	8	4	50.00	66.67	52.63
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	5	4	1	55.56	83.33	59.52

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	142	26	84	84.52	62.83	79.06
R	255	69	159	78.70	61.59	74.56
U	70	28	25	71.43	73.68	71.87
UNK	2	0	4	100.00	33.33	71.43

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	5	100.00	16.67	50.00
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	3	0	2	100.00	60.00	88.24
CONJ	0	0	2	100.00	0.00	0.00
CONTR	3	0	0	100.00	100.00	100.00
DET	73	21	44	77.66	62.39	74.04
MORPH	10	0	12	100.00	45.45	80.65
NOUN	6	2	10	75.00	37.50	62.50
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	15	4	14	78.95	51.72	71.43
NOUN:POSS	4	2	4	66.67	50.00	62.50
ORTH	35	2	11	94.59	76.09	90.21
OTHER	33	15	38	68.75	46.48	62.74
PART	1	0	1	100.00	50.00	83.33
PREP	56	22	28	71.79	66.67	70.71
PRON	9	2	4	81.82	69.23	78.95
PUNCT	114	28	35	80.28	76.51	79.50
SPELL	31	1	6	96.88	83.78	93.94
UNK	2	0	4	100.00	33.33	71.43
VERB	10	4	14	71.43	41.67	62.50
VERB:FORM	17	4	4	80.95	80.95	80.95
VERB:SVA	10	0	0	100.00	100.00	100.00
VERB:TENSE	26	13	23	66.67	53.06	63.41
WO	8	3	9	72.73	47.06	65.57

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:CONJ	0	0	2	100.00	0.00	0.00
M:DET	22	3	26	88.00	45.83	74.32
M:NOUN	1	0	2	100.00	33.33	71.43
M:NOUN:POSS	1	1	0	50.00	100.00	55.56
M:OTHER	2	2	4	50.00	33.33	45.45
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	12	4	11	75.00	52.17	68.97
M:PRON	4	2	2	66.67	66.67	66.67
M:PUNCT	90	13	28	87.38	76.27	84.91
M:VERB	2	1	2	66.67	50.00	62.50
M:VERB:FORM	3	0	1	100.00	75.00	93.75
M:VERB:TENSE	5	0	4	100.00	55.56	86.21
R:ADJ	1	0	3	100.00	25.00	62.50
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	12	3	6	80.00	66.67	76.92
R:MORPH	10	0	12	100.00	45.45	80.65
R:NOUN	5	2	7	71.43	41.67	62.50
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	15	4	14	78.95	51.72	71.43
R:NOUN:POSS	1	0	4	100.00	20.00	55.56
R:ORTH	35	2	11	94.59	76.09	90.21
R:OTHER	30	12	33	71.43	47.62	64.94
R:PART	1	0	0	100.00	100.00	100.00
R:PREP	38	17	12	69.09	76.00	70.37
R:PRON	3	0	2	100.00	60.00	88.24
R:PUNCT	15	8	3	65.22	83.33	68.18
R:SPELL	31	1	6	96.88	83.78	93.94
R:VERB	8	3	11	72.73	42.11	63.49
R:VERB:FORM	13	4	3	76.47	81.25	77.38
R:VERB:SVA	10	0	0	100.00	100.00	100.00
R:VERB:TENSE	15	10	19	60.00	44.12	55.97
R:WO	8	3	9	72.73	47.06	65.57
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	2	0	0	100.00	100.00	100.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	39	15	12	72.22	76.47	73.03
U:NOUN	0	0	1	100.00	0.00	0.00
U:NOUN:POSS	2	1	0	66.67	100.00	71.43
U:OTHER	1	1	1	50.00	50.00	50.00
U:PREP	6	1	5	85.71	54.55	76.92
U:PRON	2	0	0	100.00	100.00	100.00
U:PUNCT	9	7	4	56.25	69.23	58.44
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	6	3	0	66.67	100.00	71.43
UNK	2	0	4	100.00	33.33	71.43

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	157	24	87	86.74	64.34	81.10
R	313	52	190	85.75	62.23	79.72
U	75	27	32	73.53	70.09	72.82
UNK	4	0	14	100.00	22.22	58.82

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	6	100.00	14.29	45.45
ADJ:FORM	0	0	3	100.00	0.00	0.00
ADV	3	0	5	100.00	37.50	75.00
CONJ	1	0	2	100.00	33.33	71.43
CONTR	3	0	1	100.00	75.00	93.75
DET	74	18	42	80.43	63.79	76.45
MORPH	9	0	10	100.00	47.37	81.82
NOUN	5	1	10	83.33	33.33	64.10
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	15	3	17	83.33	46.88	72.12
NOUN:POSS	6	1	3	85.71	66.67	81.08
ORTH	47	3	11	94.00	81.03	91.09
OTHER	58	10	51	85.29	53.21	76.12
PART	1	1	1	50.00	50.00	50.00
PREP	57	20	29	74.03	66.28	72.34
PRON	11	2	4	84.62	73.33	82.09
PUNCT	137	25	39	84.57	77.84	83.13
SPELL	31	0	6	100.00	83.78	96.27
UNK	4	0	14	100.00	22.22	58.82
VERB	11	4	15	73.33	42.31	63.95
VERB:FORM	17	2	4	89.47	80.95	87.63
VERB:SVA	9	0	2	100.00	81.82	95.74
VERB:TENSE	26	12	26	68.42	50.00	63.73
WO	21	1	22	95.45	48.84	80.15

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:CONJ	1	0	2	100.00	33.33	71.43
M:DET	24	2	24	92.31	50.00	78.95
M:NOUN	1	0	2	100.00	33.33	71.43
M:NOUN:POSS	2	1	0	66.67	100.00	71.43
M:OTHER	3	2	6	60.00	33.33	51.72
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	15	4	10	78.95	60.00	74.26
M:PRON	5	2	2	71.43	71.43	71.43
M:PUNCT	97	12	31	88.99	75.78	85.99
M:VERB	1	1	3	50.00	25.00	41.67
M:VERB:FORM	3	0	1	100.00	75.00	93.75
M:VERB:TENSE	5	0	3	100.00	62.50	89.29
R:ADJ	1	0	3	100.00	25.00	62.50
R:ADJ:FORM	0	0	3	100.00	0.00	0.00
R:ADV	1	0	3	100.00	25.00	62.50
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	11	2	6	84.62	64.71	79.71
R:MORPH	9	0	10	100.00	47.37	81.82
R:NOUN	4	1	7	80.00	36.36	64.52
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	15	3	17	83.33	46.88	72.12
R:NOUN:POSS	2	0	3	100.00	40.00	76.92
R:ORTH	47	3	11	94.00	81.03	91.09
R:OTHER	54	6	41	90.00	56.84	80.60
R:PART	1	1	0	50.00	100.00	55.56
R:PREP	36	15	14	70.59	72.00	70.87
R:PRON	4	0	2	100.00	66.67	90.91
R:PUNCT	27	6	4	81.82	87.10	82.82
R:SPELL	31	0	6	100.00	83.78	96.27
R:VERB	9	3	11	75.00	45.00	66.18
R:VERB:FORM	13	2	3	86.67	81.25	85.53
R:VERB:SVA	9	0	2	100.00	81.82	95.74
R:VERB:TENSE	15	9	22	62.50	40.54	56.39
R:WO	21	1	22	95.45	48.84	80.15
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	2	0	2	100.00	50.00	83.33
U:CONTR	2	0	1	100.00	66.67	90.91
U:DET	39	14	12	73.58	76.47	74.14
U:NOUN	0	0	1	100.00	0.00	0.00
U:NOUN:POSS	2	0	0	100.00	100.00	100.00
U:OTHER	1	2	4	33.33	20.00	29.41
U:PREP	6	1	5	85.71	54.55	76.92
U:PRON	2	0	0	100.00	100.00	100.00
U:PUNCT	13	7	4	65.00	76.47	67.01
U:VERB	1	0	1	100.00	50.00	83.33
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	6	3	1	66.67	85.71	69.77
UNK	4	0	14	100.00	22.22	58.82

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	342	213	226	61.62	60.21	61.33
Span-level detection	374	181	223	67.39	62.65	66.38
Token-level detection	454	177	257	71.95	63.85	70.17

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	98	34	43	74.24	69.50	73.24
R	220	116	163	65.48	57.44	63.69
U	24	63	20	27.59	54.55	30.61

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	4	2	3	66.67	57.14	64.52
ADV	1	5	0	16.67	100.00	20.00
DET	16	41	6	28.07	72.73	32.00
MORPH	5	8	3	38.46	62.50	41.67
NOUN	4	9	7	30.77	36.36	31.75
NOUN:INFL	5	0	6	100.00	45.45	80.65
NOUN:NUM	15	15	6	50.00	71.43	53.19
NOUN:POSS	12	1	7	92.31	63.16	84.51
ORTH	30	2	36	93.75	45.45	77.32
OTHER	24	25	30	48.98	44.44	48.00
PART	1	0	0	100.00	100.00	100.00
PREP	13	28	16	31.71	44.83	33.68
PRON	2	2	3	50.00	40.00	47.62
PUNCT	115	33	44	77.70	72.33	76.56
SPELL	57	4	39	93.44	59.38	83.82
VERB	9	7	7	56.25	56.25	56.25
VERB:FORM	6	8	4	42.86	60.00	45.45
VERB:INFL	3	0	2	100.00	60.00	88.24
VERB:SVA	10	8	2	55.56	83.33	59.52
VERB:TENSE	8	14	3	36.36	72.73	40.40
WO	2	1	2	66.67	50.00	62.50

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	1	0	0.00	100.00	0.00
M:DET	6	4	2	60.00	75.00	62.50
M:NOUN	0	2	2	0.00	0.00	0.00
M:NOUN:POSS	2	0	4	100.00	33.33	71.43
M:OTHER	0	1	0	0.00	100.00	0.00
M:PREP	1	4	2	20.00	33.33	21.74
M:PRON	0	0	2	100.00	0.00	0.00
M:PUNCT	88	18	28	83.02	75.86	81.48
M:VERB	1	4	2	20.00	33.33	21.74
R:ADJ	3	2	2	60.00	60.00	60.00
R:ADV	0	2	0	0.00	100.00	0.00
R:DET	2	3	1	40.00	66.67	43.48
R:MORPH	5	8	3	38.46	62.50	41.67
R:NOUN	4	7	5	36.36	44.44	37.74
R:NOUN:INFL	5	0	6	100.00	45.45	80.65
R:NOUN:NUM	15	15	6	50.00	71.43	53.19
R:NOUN:POSS	10	1	2	90.91	83.33	89.29
R:ORTH	30	2	36	93.75	45.45	77.32
R:OTHER	24	17	29	58.54	45.28	55.30
R:PREP	10	17	10	37.04	50.00	39.06
R:PRON	2	1	1	66.67	66.67	66.67
R:PUNCT	18	10	8	64.29	69.23	65.22
R:SPELL	57	4	39	93.44	59.38	83.82
R:VERB	8	2	3	80.00	72.73	78.43
R:VERB:FORM	6	7	3	46.15	66.67	49.18
R:VERB:INFL	3	0	2	100.00	60.00	88.24
R:VERB:SVA	10	8	2	55.56	83.33	59.52
R:VERB:TENSE	6	9	3	40.00	66.67	43.48
R:WO	2	1	2	66.67	50.00	62.50
U:ADJ	1	0	0	100.00	100.00	100.00
U:ADV	1	2	0	33.33	100.00	38.46
U:DET	8	34	3	19.05	72.73	22.35
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	0	7	1	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	2	7	4	22.22	33.33	23.81
U:PRON	0	1	0	0.00	100.00	0.00
U:PUNCT	9	5	8	64.29	52.94	61.64
U:VERB	0	1	2	0.00	0.00	0.00
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	2	5	0	28.57	100.00	33.33

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	104	28	44	78.79	70.27	76.92
R	245	94	158	72.27	60.79	69.64
U	25	59	19	29.76	56.82	32.89
UNK	0	0	2	100.00	0.00	0.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	4	2	3	66.67	57.14	64.52
ADV	1	4	0	20.00	100.00	23.81
DET	17	40	7	29.82	70.83	33.73
MORPH	6	6	3	50.00	66.67	52.63
NOUN	6	5	5	54.55	54.55	54.55
NOUN:INFL	5	0	6	100.00	45.45	80.65
NOUN:NUM	15	14	7	51.72	68.18	54.35
NOUN:POSS	13	0	5	100.00	72.22	92.86
ORTH	32	2	36	94.12	47.06	78.43
OTHER	35	20	26	63.64	57.38	62.28
PART	1	0	0	100.00	100.00	100.00
PREP	19	23	14	45.24	57.58	47.26
PRON	2	2	3	50.00	40.00	47.62
PUNCT	121	27	49	81.76	71.18	79.40
SPELL	58	1	37	98.31	61.05	87.61
UNK	0	0	2	100.00	0.00	0.00
VERB	9	6	8	60.00	52.94	58.44
VERB:FORM	6	8	3	42.86	66.67	46.15
VERB:INFL	3	0	2	100.00	60.00	88.24
VERB:SVA	11	6	2	64.71	84.62	67.90
VERB:TENSE	8	14	3	36.36	72.73	40.40
WO	2	1	2	66.67	50.00	62.50

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:DET	6	4	2	60.00	75.00	62.50
M:NOUN	1	1	1	50.00	50.00	50.00
M:NOUN:POSS	2	0	3	100.00	40.00	76.92
M:OTHER	1	1	0	50.00	100.00	55.56
M:PREP	3	3	2	50.00	60.00	51.72
M:PRON	0	0	2	100.00	0.00	0.00
M:PUNCT	90	16	31	84.91	74.38	82.57
M:VERB	1	3	2	25.00	33.33	26.32
R:ADJ	3	2	2	60.00	60.00	60.00
R:ADV	0	2	0	0.00	100.00	0.00
R:DET	2	3	1	40.00	66.67	43.48
R:MORPH	6	6	3	50.00	66.67	52.63
R:NOUN	5	4	4	55.56	55.56	55.56
R:NOUN:INFL	5	0	6	100.00	45.45	80.65
R:NOUN:NUM	15	14	7	51.72	68.18	54.35
R:NOUN:POSS	11	0	1	100.00	91.67	98.21
R:ORTH	32	2	36	94.12	47.06	78.43
R:OTHER	34	12	25	73.91	57.63	69.96
R:PREP	14	14	9	50.00	60.87	51.85
R:PRON	2	1	1	66.67	66.67	66.67
R:PUNCT	22	8	10	73.33	68.75	72.37
R:SPELL	58	1	37	98.31	61.05	87.61
R:VERB	8	2	4	80.00	66.67	76.92
R:VERB:FORM	6	7	3	46.15	66.67	49.18
R:VERB:INFL	3	0	2	100.00	60.00	88.24
R:VERB:SVA	11	6	2	64.71	84.62	67.90
R:VERB:TENSE	6	9	3	40.00	66.67	43.48
R:WO	2	1	2	66.67	50.00	62.50
U:ADJ	1	0	0	100.00	100.00	100.00
U:ADV	1	2	0	33.33	100.00	38.46
U:DET	9	33	4	21.43	69.23	24.86
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	0	7	1	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	2	6	3	25.00	40.00	27.03
U:PRON	0	1	0	0.00	100.00	0.00
U:PUNCT	9	3	8	75.00	52.94	69.23
U:VERB	0	1	2	0.00	0.00	0.00
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	2	5	0	28.57	100.00	33.33
UNK	0	0	2	100.00	0.00	0.00

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	121	23	47	84.03	72.02	81.32
R	305	92	182	76.83	62.63	73.49
U	28	62	26	31.11	51.85	33.82
UNK	0	0	2	100.00	0.00	0.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	2	3	60.00	50.00	57.69
ADV	1	2	2	33.33	33.33	33.33
CONJ	1	0	0	100.00	100.00	100.00
DET	21	38	8	35.59	72.41	39.62
MORPH	6	5	3	54.55	66.67	56.60
NOUN	7	5	6	58.33	53.85	57.38
NOUN:INFL	5	0	6	100.00	45.45	80.65
NOUN:NUM	14	12	9	53.85	60.87	55.12
NOUN:POSS	14	1	4	93.33	77.78	89.74
ORTH	53	2	41	96.36	56.38	84.39
OTHER	59	30	40	66.29	59.60	64.84
PART	1	0	0	100.00	100.00	100.00
PREP	21	22	14	48.84	60.00	50.72
PRON	3	1	2	75.00	60.00	71.43
PUNCT	141	19	54	88.12	72.31	84.43
SPELL	60	0	37	100.00	61.86	89.02
UNK	0	0	2	100.00	0.00	0.00
VERB	9	4	8	69.23	52.94	65.22
VERB:FORM	6	11	4	35.29	60.00	38.46
VERB:INFL	3	0	2	100.00	60.00	88.24
VERB:SVA	11	5	2	68.75	84.62	71.43
VERB:TENSE	8	16	5	33.33	61.54	36.70
WO	7	2	5	77.78	58.33	72.92

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	1	0	0	100.00	100.00	100.00
M:DET	7	3	2	70.00	77.78	71.43
M:NOUN	2	1	1	66.67	66.67	66.67
M:NOUN:POSS	2	0	2	100.00	50.00	83.33
M:OTHER	1	1	0	50.00	100.00	55.56
M:PREP	5	3	2	62.50	71.43	64.10
M:PRON	1	0	1	100.00	50.00	83.33
M:PUNCT	101	12	36	89.38	73.72	85.74
M:VERB	1	3	2	25.00	33.33	26.32
R:ADJ	3	2	2	60.00	60.00	60.00
R:ADV	0	2	0	0.00	100.00	0.00
R:DET	4	3	1	57.14	80.00	60.61
R:MORPH	6	5	3	54.55	66.67	56.60
R:NOUN	5	4	5	55.56	50.00	54.35
R:NOUN:INFL	5	0	6	100.00	45.45	80.65
R:NOUN:NUM	14	12	9	53.85	60.87	55.12
R:NOUN:POSS	12	1	1	92.31	92.31	92.31
R:ORTH	53	2	41	96.36	56.38	84.39
R:OTHER	58	12	38	82.86	60.42	77.13
R:PREP	14	13	8	51.85	63.64	53.85
R:PRON	2	1	1	66.67	66.67	66.67
R:PUNCT	28	6	10	82.35	73.68	80.46
R:SPELL	60	0	37	100.00	61.86	89.02
R:VERB	8	0	3	100.00	72.73	93.02
R:VERB:FORM	6	11	3	35.29	66.67	38.96
R:VERB:INFL	3	0	2	100.00	60.00	88.24
R:VERB:SVA	11	5	2	68.75	84.62	71.43
R:VERB:TENSE	6	11	5	35.29	54.55	37.97
R:WO	7	2	5	77.78	58.33	72.92
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	1	0	1	100.00	50.00	83.33
U:DET	10	32	5	23.81	66.67	27.32
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	0	17	2	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	2	6	4	25.00	33.33	26.32
U:PUNCT	12	1	8	92.31	60.00	83.33
U:VERB	0	1	3	0.00	0.00	0.00
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	2	5	0	28.57	100.00	33.33
UNK	0	0	2	100.00	0.00	0.00

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:47:06+00:00
Competition submission:	10
Competition phase:	3 - Open phase

Detailed results

Submission information

Results