BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	2312	982	2506	70.19	47.99	64.24
Span-level detection	2601	702	2422	78.75	51.78	71.32
Token-level detection	2989	600	2899	83.28	50.76	73.82

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	732	319	577	69.65	55.92	66.39
R	1432	569	1630	71.56	46.77	64.70
U	148	94	299	61.16	33.11	52.30

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	9	7	24	56.25	27.27	46.39
ADJ:FORM	5	0	5	100.00	50.00	83.33
ADV	13	16	36	44.83	26.53	39.39
CONJ	3	8	12	27.27	20.00	25.42
CONTR	6	5	8	54.55	42.86	51.72
DET	276	115	316	70.59	46.62	64.01
MORPH	75	18	72	80.65	51.02	72.25
NOUN	38	48	80	44.19	32.20	41.13
NOUN:INFL	15	1	2	93.75	88.24	92.59
NOUN:NUM	135	26	95	83.85	58.70	77.23
NOUN:POSS	32	5	22	86.49	59.26	79.21
ORTH	209	27	166	88.56	55.73	79.23
OTHER	125	121	514	50.81	19.56	38.51
PART	10	2	10	83.33	50.00	73.53
PREP	157	59	245	72.69	39.05	62.01
PRON	65	30	77	68.42	45.77	62.26
PUNCT	468	264	327	63.93	58.87	62.85
SPELL	298	62	34	82.78	89.76	84.09
VERB	50	28	147	64.10	25.38	49.12
VERB:FORM	111	22	67	83.46	62.36	78.17
VERB:INFL	7	0	1	100.00	87.50	97.22
VERB:SVA	123	39	32	75.93	79.35	76.59
VERB:TENSE	63	38	156	62.38	28.77	50.56
WO	19	41	58	31.67	24.68	29.97

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	3	5	25.00	16.67	22.73
M:ADV	3	2	12	60.00	20.00	42.86
M:CONJ	2	6	5	25.00	28.57	25.64
M:CONTR	1	2	0	33.33	100.00	38.46
M:DET	176	56	122	75.86	59.06	71.78
M:NOUN	1	12	7	7.69	12.50	8.33
M:NOUN:POSS	5	0	10	100.00	33.33	71.43
M:OTHER	5	14	40	26.32	11.11	20.66
M:PART	1	1	1	50.00	50.00	50.00
M:PREP	40	26	56	60.61	41.67	55.56
M:PRON	35	18	40	66.04	46.67	60.98
M:PUNCT	420	151	237	73.56	63.93	71.40
M:VERB	16	11	15	59.26	51.61	57.55
M:VERB:FORM	14	6	1	70.00	93.33	73.68
M:VERB:TENSE	12	11	26	52.17	31.58	46.15
R:ADJ	7	3	16	70.00	30.43	55.56
R:ADJ:FORM	5	0	5	100.00	50.00	83.33
R:ADV	6	9	12	40.00	33.33	38.46
R:CONJ	0	0	5	100.00	0.00	0.00
R:CONTR	3	3	2	50.00	60.00	51.72
R:DET	37	39	72	48.68	33.94	44.79
R:MORPH	75	18	72	80.65	51.02	72.25
R:NOUN	34	30	66	53.12	34.00	47.75
R:NOUN:INFL	15	1	2	93.75	88.24	92.59
R:NOUN:NUM	135	26	95	83.85	58.70	77.23
R:NOUN:POSS	23	5	6	82.14	79.31	81.56
R:ORTH	209	27	166	88.56	55.73	79.23
R:OTHER	119	86	458	58.05	20.62	42.59
R:PART	8	1	6	88.89	57.14	80.00
R:PREP	92	28	146	76.67	38.66	64.07
R:PRON	24	7	21	77.42	53.33	71.01
R:PUNCT	21	96	60	17.95	25.93	19.13
R:SPELL	298	62	34	82.78	89.76	84.09
R:VERB	30	11	118	73.17	20.27	48.08
R:VERB:FORM	94	15	63	86.24	59.87	79.26
R:VERB:INFL	7	0	1	100.00	87.50	97.22
R:VERB:SVA	123	39	32	75.93	79.35	76.59
R:VERB:TENSE	48	22	114	68.57	29.63	54.30
R:WO	19	41	58	31.67	24.68	29.97
U:ADJ	1	1	3	50.00	25.00	41.67
U:ADV	4	5	12	44.44	25.00	38.46
U:CONJ	1	2	2	33.33	33.33	33.33
U:CONTR	2	0	6	100.00	25.00	62.50
U:DET	63	20	122	75.90	34.05	60.93
U:NOUN	3	6	7	33.33	30.00	32.61
U:NOUN:POSS	4	0	6	100.00	40.00	76.92
U:OTHER	1	21	16	4.55	5.88	4.76
U:PART	1	0	3	100.00	25.00	62.50
U:PREP	25	5	43	83.33	36.76	66.49
U:PRON	6	5	16	54.55	27.27	45.45
U:PUNCT	27	17	30	61.36	47.37	57.94
U:VERB	4	6	14	40.00	22.22	34.48
U:VERB:FORM	3	1	3	75.00	50.00	68.18
U:VERB:TENSE	3	5	16	37.50	15.79	29.41

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	806	254	548	76.04	59.53	72.04
R	1621	370	1517	81.42	51.66	73.00
U	158	78	306	66.95	34.05	56.11
UNK	16	0	51	100.00	23.88	61.07

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	15	7	31	68.18	32.61	55.97
ADJ:FORM	4	0	5	100.00	44.44	80.00
ADV	17	13	34	56.67	33.33	49.71
CONJ	7	4	11	63.64	38.89	56.45
CONTR	4	5	8	44.44	33.33	41.67
DET	299	87	304	77.46	49.59	69.63
MORPH	81	8	66	91.01	55.10	80.52
NOUN	59	29	71	67.05	45.38	61.20
NOUN:INFL	16	0	2	100.00	88.89	97.56
NOUN:NUM	130	11	85	92.20	60.47	83.44
NOUN:POSS	34	4	21	89.47	61.82	82.13
ORTH	221	16	153	93.25	59.09	83.59
OTHER	239	69	460	77.60	34.19	61.89
PART	11	2	12	84.62	47.83	73.33
PREP	160	40	250	80.00	39.02	66.12
PRON	72	20	71	78.26	50.35	70.45
PUNCT	500	245	317	67.11	61.20	65.84
SPELL	297	32	25	90.27	92.24	90.66
UNK	16	0	51	100.00	23.88	61.07
VERB	79	19	143	80.61	35.59	64.33
VERB:FORM	105	17	64	86.07	62.13	79.91
VERB:INFL	7	0	2	100.00	77.78	94.59
VERB:SVA	129	17	29	88.36	81.65	86.93
VERB:TENSE	80	18	149	81.63	34.93	64.41
WO	19	39	58	32.76	24.68	30.74

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	3	6	40.00	25.00	35.71
M:ADV	4	1	9	80.00	30.77	60.61
M:CONJ	5	2	5	71.43	50.00	65.79
M:CONTR	0	2	0	0.00	100.00	0.00
M:DET	194	38	113	83.62	63.19	78.54
M:NOUN	6	8	6	42.86	50.00	44.12
M:NOUN:POSS	5	0	11	100.00	31.25	69.44
M:OTHER	13	10	36	56.52	26.53	46.10
M:PART	2	1	2	66.67	50.00	62.50
M:PREP	40	18	59	68.97	40.40	60.42
M:PRON	40	12	34	76.92	54.05	70.92
M:PUNCT	441	140	231	75.90	65.62	73.60
M:VERB	25	6	12	80.65	67.57	77.64
M:VERB:FORM	15	7	1	68.18	93.75	72.12
M:VERB:TENSE	14	6	23	70.00	37.84	59.83
R:ADJ	12	3	21	80.00	36.36	64.52
R:ADJ:FORM	4	0	5	100.00	44.44	80.00
R:ADV	9	7	13	56.25	40.91	52.33
R:CONJ	0	0	4	100.00	0.00	0.00
R:CONTR	2	3	2	40.00	50.00	41.67
R:DET	42	35	69	54.55	37.84	50.12
R:MORPH	81	8	66	91.01	55.10	80.52
R:NOUN	49	17	56	74.24	46.67	66.40
R:NOUN:INFL	16	0	2	100.00	88.89	97.56
R:NOUN:NUM	130	11	85	92.20	60.47	83.44
R:NOUN:POSS	25	4	5	86.21	83.33	85.62
R:ORTH	221	16	153	93.25	59.09	83.59
R:OTHER	224	40	405	84.85	35.61	66.47
R:PART	8	1	7	88.89	53.33	78.43
R:PREP	96	19	151	83.48	38.87	67.89
R:PRON	26	3	21	89.66	55.32	79.75
R:PUNCT	29	89	54	24.58	34.94	26.13
R:SPELL	297	32	25	90.27	92.24	90.66
R:VERB	49	8	115	85.96	29.88	62.50
R:VERB:FORM	87	9	61	90.62	58.78	81.77
R:VERB:INFL	7	0	2	100.00	77.78	94.59
R:VERB:SVA	129	17	29	88.36	81.65	86.93
R:VERB:TENSE	59	9	108	86.76	35.33	67.20
R:WO	19	39	58	32.76	24.68	30.74
U:ADJ	1	1	4	50.00	20.00	38.46
U:ADV	4	5	12	44.44	25.00	38.46
U:CONJ	2	2	2	50.00	50.00	50.00
U:CONTR	2	0	6	100.00	25.00	62.50
U:DET	63	14	122	81.82	34.05	63.89
U:NOUN	4	4	9	50.00	30.77	44.44
U:NOUN:POSS	4	0	5	100.00	44.44	80.00
U:OTHER	2	19	19	9.52	9.52	9.52
U:PART	1	0	3	100.00	25.00	62.50
U:PREP	24	3	40	88.89	37.50	69.77
U:PRON	6	5	16	54.55	27.27	45.45
U:PUNCT	30	16	32	65.22	48.39	60.98
U:VERB	5	5	16	50.00	23.81	40.98
U:VERB:FORM	3	1	2	75.00	60.00	71.43
U:VERB:TENSE	7	3	18	70.00	28.00	53.85
UNK	16	0	51	100.00	23.88	61.07

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	904	190	587	82.63	60.63	77.04
R	1847	310	1821	85.63	50.35	75.11
U	197	100	396	66.33	33.22	55.31
UNK	41	0	95	100.00	30.15	68.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	20	4	36	83.33	35.71	65.79
ADJ:FORM	4	0	6	100.00	40.00	76.92
ADV	20	8	45	71.43	30.77	56.50
CONJ	14	3	14	82.35	50.00	72.92
CONTR	3	5	10	37.50	23.08	33.33
DET	313	61	319	83.69	49.53	73.54
MORPH	84	6	69	93.33	54.90	81.87
NOUN	74	25	89	74.75	45.40	66.19
NOUN:INFL	16	0	2	100.00	88.89	97.56
NOUN:NUM	133	7	91	95.00	59.38	84.82
NOUN:POSS	46	2	22	95.83	67.65	88.46
ORTH	260	11	186	95.94	58.30	84.97
OTHER	369	92	665	80.04	35.69	64.11
PART	8	0	9	100.00	47.06	81.63
PREP	170	26	276	86.73	38.12	69.11
PRON	79	14	65	84.95	54.86	76.55
PUNCT	575	233	348	71.16	62.30	69.19
SPELL	297	17	26	94.59	91.95	94.05
UNK	41	0	95	100.00	30.15	68.33
VERB	91	16	177	85.05	33.96	65.37
VERB:FORM	109	4	71	96.46	60.56	86.23
VERB:INFL	6	0	1	100.00	85.71	96.77
VERB:SVA	126	13	28	90.65	81.82	88.73
VERB:TENSE	86	14	185	86.00	31.73	64.08
WO	45	39	64	53.57	41.28	50.56

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	1	7	75.00	30.00	57.69
M:ADV	9	1	11	90.00	45.00	75.00
M:CONJ	10	1	7	90.91	58.82	81.97
M:CONTR	0	2	0	0.00	100.00	0.00
M:DET	201	16	108	92.63	65.05	85.39
M:NOUN	9	9	12	50.00	42.86	48.39
M:NOUN:POSS	7	0	11	100.00	38.89	76.09
M:OTHER	17	7	40	70.83	29.82	55.56
M:PART	2	0	3	100.00	40.00	76.92
M:PREP	49	10	59	83.05	45.37	71.22
M:PRON	43	7	34	86.00	55.84	77.62
M:PUNCT	498	128	248	79.55	66.76	76.62
M:VERB	26	5	20	83.87	56.52	76.47
M:VERB:FORM	13	0	2	100.00	86.67	97.01
M:VERB:TENSE	17	3	25	85.00	40.48	69.67
R:ADJ	14	2	24	87.50	36.84	68.63
R:ADJ:FORM	4	0	6	100.00	40.00	76.92
R:ADV	8	3	15	72.73	34.78	59.70
R:CONJ	2	0	5	100.00	28.57	66.67
R:CONTR	2	3	4	40.00	33.33	38.46
R:DET	43	33	73	56.58	37.07	51.19
R:MORPH	84	6	69	93.33	54.90	81.87
R:NOUN	56	13	58	81.16	49.12	71.79
R:NOUN:INFL	16	0	2	100.00	88.89	97.56
R:NOUN:NUM	133	7	91	95.00	59.38	84.82
R:NOUN:POSS	35	2	4	94.59	89.74	93.58
R:ORTH	260	11	186	95.94	58.30	84.97
R:OTHER	343	35	556	90.74	38.15	71.13
R:PART	5	0	3	100.00	62.50	89.29
R:PREP	98	15	172	86.73	36.30	67.87
R:PRON	28	3	16	90.32	63.64	83.33
R:PUNCT	29	89	70	24.58	29.29	25.39
R:SPELL	297	17	26	94.59	91.95	94.05
R:VERB	58	7	138	89.23	29.59	63.60
R:VERB:FORM	93	3	66	96.88	58.49	85.64
R:VERB:INFL	6	0	1	100.00	85.71	96.77
R:VERB:SVA	126	13	28	90.65	81.82	88.73
R:VERB:TENSE	62	9	144	87.32	30.10	63.27
R:WO	45	39	64	53.57	41.28	50.56
U:ADJ	3	1	5	75.00	37.50	62.50
U:ADV	3	4	19	42.86	13.64	30.00
U:CONJ	2	2	2	50.00	50.00	50.00
U:CONTR	1	0	6	100.00	14.29	45.45
U:DET	69	12	138	85.19	33.33	64.97
U:NOUN	9	3	19	75.00	32.14	59.21
U:NOUN:POSS	4	0	7	100.00	36.36	74.07
U:OTHER	9	50	69	15.25	11.54	14.33
U:PART	1	0	3	100.00	25.00	62.50
U:PREP	23	1	45	95.83	33.82	70.12
U:PRON	8	4	15	66.67	34.78	56.34
U:PUNCT	48	16	30	75.00	61.54	71.86
U:VERB	7	4	19	63.64	26.92	50.00
U:VERB:FORM	3	1	3	75.00	50.00	68.18
U:VERB:TENSE	7	2	16	77.78	30.43	59.32
UNK	41	0	95	100.00	30.15	68.33

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	867	348	1207	71.36	41.80	62.52
Span-level detection	1013	206	1180	83.10	46.19	71.65
Token-level detection	1201	128	1382	90.37	46.50	76.02

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	218	118	277	64.88	44.04	59.27
R	596	200	797	74.87	42.79	65.11
U	53	30	133	63.86	28.49	51.16

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	4	8	42.86	27.27	38.46
ADJ:FORM	4	0	1	100.00	80.00	95.24
ADV	4	2	16	66.67	20.00	45.45
CONJ	1	2	5	33.33	16.67	27.78
CONTR	5	3	3	62.50	62.50	62.50
DET	108	35	154	75.52	41.22	64.75
MORPH	40	13	40	75.47	50.00	68.49
NOUN	11	12	33	47.83	25.00	40.44
NOUN:INFL	5	1	0	83.33	100.00	86.21
NOUN:NUM	60	14	51	81.08	54.05	73.71
NOUN:POSS	6	0	9	100.00	40.00	76.92
ORTH	98	11	102	89.91	49.00	77.04
OTHER	52	46	287	53.06	15.34	35.57
PART	4	0	3	100.00	57.14	86.96
PREP	56	17	101	76.71	35.67	62.36
PRON	32	14	46	69.57	41.03	61.07
PUNCT	95	68	138	58.28	40.77	53.67
SPELL	105	32	14	76.64	88.24	78.71
VERB	24	11	63	68.57	27.59	52.86
VERB:FORM	58	13	28	81.69	67.44	78.38
VERB:INFL	3	0	0	100.00	100.00	100.00
VERB:SVA	60	18	19	76.92	75.95	76.73
VERB:TENSE	24	21	70	53.33	25.53	43.80
WO	9	11	16	45.00	36.00	42.86

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	2	1	33.33	50.00	35.71
M:ADV	1	0	4	100.00	20.00	55.56
M:CONJ	0	2	2	0.00	0.00	0.00
M:CONTR	1	2	0	33.33	100.00	38.46
M:DET	65	22	62	74.71	51.18	68.42
M:NOUN	0	4	2	0.00	0.00	0.00
M:NOUN:POSS	1	0	3	100.00	25.00	62.50
M:OTHER	2	11	24	15.38	7.69	12.82
M:PREP	17	10	28	62.96	37.78	55.56
M:PRON	18	10	23	64.29	43.90	58.82
M:PUNCT	87	39	108	69.05	44.62	62.23
M:VERB	8	5	8	61.54	50.00	58.82
M:VERB:FORM	11	6	0	64.71	100.00	69.62
M:VERB:TENSE	6	5	12	54.55	33.33	48.39
R:ADJ	1	2	5	33.33	16.67	27.78
R:ADJ:FORM	4	0	1	100.00	80.00	95.24
R:ADV	2	2	6	50.00	25.00	41.67
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	3	1	0	75.00	100.00	78.95
R:DET	15	8	27	65.22	35.71	55.97
R:MORPH	40	13	40	75.47	50.00	68.49
R:NOUN	9	5	28	64.29	24.32	48.39
R:NOUN:INFL	5	1	0	83.33	100.00	86.21
R:NOUN:NUM	60	14	51	81.08	54.05	73.71
R:NOUN:POSS	4	0	3	100.00	57.14	86.96
R:ORTH	98	11	102	89.91	49.00	77.04
R:OTHER	50	31	258	61.73	16.23	39.56
R:PART	4	0	1	100.00	80.00	95.24
R:PREP	30	6	57	83.33	34.48	64.94
R:PRON	12	1	13	92.31	48.00	77.92
R:PUNCT	4	23	22	14.81	15.38	14.93
R:SPELL	105	32	14	76.64	88.24	78.71
R:VERB	13	3	50	81.25	20.63	51.18
R:VERB:FORM	47	7	28	87.04	62.67	80.76
R:VERB:INFL	3	0	0	100.00	100.00	100.00
R:VERB:SVA	60	18	19	76.92	75.95	76.73
R:VERB:TENSE	18	11	55	62.07	24.66	47.62
R:WO	9	11	16	45.00	36.00	42.86
U:ADJ	1	0	2	100.00	33.33	71.43
U:ADV	1	0	6	100.00	14.29	45.45
U:CONJ	1	0	2	100.00	33.33	71.43
U:CONTR	1	0	3	100.00	25.00	62.50
U:DET	28	5	65	84.85	30.11	62.22
U:NOUN	2	3	3	40.00	40.00	40.00
U:NOUN:POSS	1	0	3	100.00	25.00	62.50
U:OTHER	0	4	5	0.00	0.00	0.00
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	9	1	16	90.00	36.00	69.23
U:PRON	2	3	10	40.00	16.67	31.25
U:PUNCT	4	6	8	40.00	33.33	38.46
U:VERB	3	3	5	50.00	37.50	46.88
U:VERB:TENSE	0	5	3	0.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	251	89	261	73.82	49.02	67.04
R	691	95	740	87.91	48.29	75.52
U	62	22	138	73.81	31.00	57.84
UNK	9	0	41	100.00	18.00	52.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	4	13	55.56	27.78	46.30
ADJ:FORM	3	0	1	100.00	75.00	93.75
ADV	8	1	17	88.89	32.00	65.57
CONJ	3	0	4	100.00	42.86	78.95
CONTR	3	3	3	50.00	50.00	50.00
DET	120	27	142	81.63	45.80	70.59
MORPH	43	4	38	91.49	53.09	79.93
NOUN	16	6	33	72.73	32.65	58.39
NOUN:INFL	5	0	0	100.00	100.00	100.00
NOUN:NUM	59	5	45	92.19	56.73	81.94
NOUN:POSS	6	0	9	100.00	40.00	76.92
ORTH	107	4	89	96.40	54.59	83.59
OTHER	122	18	252	87.14	32.62	65.31
PART	4	0	4	100.00	50.00	83.33
PREP	57	9	106	86.36	34.97	66.74
PRON	31	10	45	75.61	40.79	64.58
PUNCT	104	61	135	63.03	43.51	57.84
SPELL	106	14	8	88.33	92.98	89.23
UNK	9	0	41	100.00	18.00	52.33
VERB	40	7	65	85.11	38.10	68.26
VERB:FORM	52	12	30	81.25	63.41	76.92
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	63	6	17	91.30	78.75	88.48
VERB:TENSE	35	6	67	85.37	34.31	65.79
WO	9	9	15	50.00	37.50	46.88

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	2	2	33.33	33.33	33.33
M:ADV	3	0	3	100.00	50.00	83.33
M:CONJ	1	0	1	100.00	50.00	83.33
M:CONTR	0	2	0	0.00	100.00	0.00
M:DET	74	17	55	81.32	57.36	75.05
M:NOUN	0	3	2	0.00	0.00	0.00
M:NOUN:POSS	1	0	4	100.00	20.00	55.56
M:OTHER	9	8	21	52.94	30.00	45.92
M:PREP	18	6	29	75.00	38.30	62.94
M:PRON	17	7	22	70.83	43.59	62.96
M:PUNCT	93	34	105	73.23	46.97	65.86
M:VERB	14	1	6	93.33	70.00	87.50
M:VERB:FORM	12	7	0	63.16	100.00	68.18
M:VERB:TENSE	8	2	11	80.00	42.11	67.80
R:ADJ	3	2	9	60.00	25.00	46.88
R:ADJ:FORM	3	0	1	100.00	75.00	93.75
R:ADV	3	1	8	75.00	27.27	55.56
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	2	1	0	66.67	100.00	71.43
R:DET	17	7	24	70.83	41.46	62.04
R:MORPH	43	4	38	91.49	53.09	79.93
R:NOUN	14	2	26	87.50	35.00	67.31
R:NOUN:INFL	5	0	0	100.00	100.00	100.00
R:NOUN:NUM	59	5	45	92.19	56.73	81.94
R:NOUN:POSS	4	0	3	100.00	57.14	86.96
R:ORTH	107	4	89	96.40	54.59	83.59
R:OTHER	112	7	223	94.12	33.43	69.05
R:PART	4	0	2	100.00	66.67	90.91
R:PREP	30	3	61	90.91	32.97	67.26
R:PRON	12	0	14	100.00	46.15	81.08
R:PUNCT	6	21	22	22.22	21.43	22.06
R:SPELL	106	14	8	88.33	92.98	89.23
R:VERB	23	3	51	88.46	31.08	64.61
R:VERB:FORM	40	5	30	88.89	57.14	80.00
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	63	6	17	91.30	78.75	88.48
R:VERB:TENSE	23	1	52	95.83	30.67	67.25
R:WO	9	9	15	50.00	37.50	46.88
U:ADJ	1	0	2	100.00	33.33	71.43
U:ADV	2	0	6	100.00	25.00	62.50
U:CONJ	2	0	2	100.00	50.00	83.33
U:CONTR	1	0	3	100.00	25.00	62.50
U:DET	29	3	63	90.62	31.52	65.91
U:NOUN	2	1	5	66.67	28.57	52.63
U:NOUN:POSS	1	0	2	100.00	33.33	71.43
U:OTHER	1	3	8	25.00	11.11	20.00
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	9	0	16	100.00	36.00	73.77
U:PRON	2	3	9	40.00	18.18	32.26
U:PUNCT	5	6	8	45.45	38.46	43.86
U:VERB	3	3	8	50.00	27.27	42.86
U:VERB:TENSE	4	3	4	57.14	50.00	55.56
UNK	9	0	41	100.00	18.00	52.33

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	294	54	272	84.48	51.94	75.08
R	799	55	875	93.56	47.73	78.49
U	85	19	170	81.73	33.33	63.34
UNK	23	0	65	100.00	26.14	63.89

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	7	2	12	77.78	36.84	63.64
ADJ:FORM	3	0	1	100.00	75.00	93.75
ADV	10	0	21	100.00	32.26	70.42
CONJ	7	0	7	100.00	50.00	83.33
CONTR	3	3	2	50.00	60.00	51.72
DET	128	15	155	89.51	45.23	74.85
MORPH	44	2	41	95.65	51.76	81.78
NOUN	27	4	44	87.10	38.03	69.23
NOUN:INFL	5	0	0	100.00	100.00	100.00
NOUN:NUM	62	2	46	96.88	57.41	85.16
NOUN:POSS	9	0	10	100.00	47.37	81.82
ORTH	118	2	97	98.33	54.88	84.89
OTHER	189	14	341	93.10	35.66	70.42
PART	2	0	5	100.00	28.57	66.67
PREP	65	4	119	94.20	35.33	70.65
PRON	36	6	38	85.71	48.65	74.38
PUNCT	139	57	144	70.92	49.12	65.14
SPELL	106	3	8	97.25	92.98	96.36
UNK	23	0	65	100.00	26.14	63.89
VERB	42	3	79	93.33	34.71	69.77
VERB:FORM	52	3	35	94.55	59.77	84.69
VERB:INFL	2	0	0	100.00	100.00	100.00
VERB:SVA	63	4	14	94.03	81.82	91.30
VERB:TENSE	38	3	89	92.68	29.92	65.29
WO	21	1	9	95.45	70.00	88.98

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	2	100.00	33.33	71.43
M:ADV	5	0	3	100.00	62.50	89.29
M:CONJ	5	0	4	100.00	55.56	86.21
M:CONTR	0	2	0	0.00	100.00	0.00
M:DET	77	7	54	91.67	58.78	82.44
M:NOUN	2	4	6	33.33	25.00	31.25
M:NOUN:POSS	1	0	4	100.00	20.00	55.56
M:OTHER	7	5	18	58.33	28.00	47.95
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	24	2	28	92.31	46.15	76.92
M:PRON	19	4	22	82.61	46.34	71.43
M:PUNCT	121	30	108	80.13	52.84	72.63
M:VERB	13	0	9	100.00	59.09	87.84
M:VERB:FORM	10	0	1	100.00	90.91	98.04
M:VERB:TENSE	9	0	12	100.00	42.86	78.95
R:ADJ	4	2	9	66.67	30.77	54.05
R:ADJ:FORM	3	0	1	100.00	75.00	93.75
R:ADV	3	0	9	100.00	25.00	62.50
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	2	1	0	66.67	100.00	71.43
R:DET	17	6	28	73.91	37.78	62.04
R:MORPH	44	2	41	95.65	51.76	81.78
R:NOUN	21	0	26	100.00	44.68	80.15
R:NOUN:INFL	5	0	0	100.00	100.00	100.00
R:NOUN:NUM	62	2	46	96.88	57.41	85.16
R:NOUN:POSS	7	0	3	100.00	70.00	92.11
R:ORTH	118	2	97	98.33	54.88	84.89
R:OTHER	176	3	301	98.32	36.90	73.76
R:PART	2	0	2	100.00	50.00	83.33
R:PREP	31	2	71	93.94	30.39	66.24
R:PRON	14	0	9	100.00	60.87	88.61
R:PUNCT	5	21	30	19.23	14.29	17.99
R:SPELL	106	3	8	97.25	92.98	96.36
R:VERB	26	2	63	92.86	29.21	64.68
R:VERB:FORM	42	3	33	93.33	56.00	82.35
R:VERB:INFL	2	0	0	100.00	100.00	100.00
R:VERB:SVA	63	4	14	94.03	81.82	91.30
R:VERB:TENSE	25	1	74	96.15	25.25	61.58
R:WO	21	1	9	95.45	70.00	88.98
U:ADJ	2	0	1	100.00	66.67	90.91
U:ADV	2	0	9	100.00	18.18	52.63
U:CONJ	2	0	2	100.00	50.00	83.33
U:CONTR	1	0	2	100.00	33.33	71.43
U:DET	34	2	73	94.44	31.78	67.73
U:NOUN	4	0	12	100.00	25.00	62.50
U:NOUN:POSS	1	0	3	100.00	25.00	62.50
U:OTHER	6	6	22	50.00	21.43	39.47
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	10	0	20	100.00	33.33	71.43
U:PRON	3	2	7	60.00	30.00	50.00
U:PUNCT	13	6	6	68.42	68.42	68.42
U:VERB	3	1	7	75.00	30.00	57.69
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	4	2	3	66.67	57.14	64.52
UNK	23	0	65	100.00	26.14	63.89

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	636	281	869	69.36	42.26	61.47
Span-level detection	718	203	815	77.96	46.84	68.81
Token-level detection	812	175	1010	82.27	44.57	70.36

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	222	96	184	69.81	54.68	66.15
R	368	160	576	69.70	38.98	60.21
U	46	25	109	64.79	29.68	52.39

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	2	9	50.00	18.18	37.04
ADJ:FORM	1	0	2	100.00	33.33	71.43
ADV	6	6	13	50.00	31.58	44.78
CONJ	2	0	6	100.00	25.00	62.50
CONTR	1	1	2	50.00	33.33	45.45
DET	91	34	121	72.80	42.92	63.90
MORPH	20	3	20	86.96	50.00	75.76
NOUN	12	17	26	41.38	31.58	38.96
NOUN:NUM	40	8	26	83.33	60.61	77.52
NOUN:POSS	8	1	6	88.89	57.14	80.00
ORTH	42	9	31	82.35	57.53	75.81
OTHER	24	25	178	48.98	11.88	30.15
PART	2	2	6	50.00	25.00	41.67
PREP	55	24	100	69.62	35.48	58.39
PRON	22	8	23	73.33	48.89	66.67
PUNCT	123	83	95	59.71	56.42	59.02
SPELL	64	16	9	80.00	87.67	81.42
VERB	10	7	64	58.82	13.51	35.21
VERB:FORM	38	7	29	84.44	56.72	76.92
VERB:SVA	44	11	10	80.00	81.48	80.29
VERB:TENSE	23	7	63	76.67	26.74	55.83
WO	6	10	30	37.50	16.67	30.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	2	0.00	0.00	0.00
M:ADV	1	0	6	100.00	14.29	45.45
M:CONJ	2	0	3	100.00	40.00	76.92
M:DET	68	20	46	77.27	59.65	72.96
M:NOUN	1	3	1	25.00	50.00	27.78
M:NOUN:POSS	1	0	3	100.00	25.00	62.50
M:OTHER	2	2	11	50.00	15.38	34.48
M:PART	1	1	1	50.00	50.00	50.00
M:PREP	13	12	16	52.00	44.83	50.39
M:PRON	13	5	12	72.22	52.00	67.01
M:PUNCT	109	45	65	70.78	62.64	68.99
M:VERB	5	3	5	62.50	50.00	59.52
M:VERB:FORM	1	0	1	100.00	50.00	83.33
M:VERB:TENSE	5	4	12	55.56	29.41	47.17
R:ADJ	2	0	7	100.00	22.22	58.82
R:ADJ:FORM	1	0	2	100.00	33.33	71.43
R:ADV	3	4	3	42.86	50.00	44.12
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	11	8	37	57.89	22.92	44.35
R:MORPH	20	3	20	86.96	50.00	75.76
R:NOUN	10	12	23	45.45	30.30	41.32
R:NOUN:NUM	40	8	26	83.33	60.61	77.52
R:NOUN:POSS	6	1	0	85.71	100.00	88.24
R:ORTH	42	9	31	82.35	57.53	75.81
R:OTHER	21	19	157	52.50	11.80	31.07
R:PART	1	1	4	50.00	20.00	38.46
R:PREP	31	10	64	75.61	32.63	59.85
R:PRON	6	2	6	75.00	50.00	68.18
R:PUNCT	5	33	22	13.16	18.52	13.97
R:SPELL	64	16	9	80.00	87.67	81.42
R:VERB	5	3	52	62.50	8.77	28.09
R:VERB:FORM	34	6	26	85.00	56.67	77.27
R:VERB:SVA	44	11	10	80.00	81.48	80.29
R:VERB:TENSE	16	3	43	84.21	27.12	59.26
R:WO	6	10	30	37.50	16.67	30.00
U:ADJ	0	1	0	0.00	100.00	0.00
U:ADV	2	2	4	50.00	33.33	45.45
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	12	6	38	66.67	24.00	49.18
U:NOUN	1	2	2	33.33	33.33	33.33
U:NOUN:POSS	1	0	3	100.00	25.00	62.50
U:OTHER	1	4	10	20.00	9.09	16.13
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	11	2	20	84.62	35.48	66.27
U:PRON	3	1	5	75.00	37.50	62.50
U:PUNCT	9	5	8	64.29	52.94	61.64
U:VERB	0	1	7	0.00	0.00	0.00
U:VERB:FORM	3	1	2	75.00	60.00	71.43
U:VERB:TENSE	2	0	8	100.00	20.00	55.56

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	245	77	170	76.09	59.04	71.93
R	421	106	528	79.89	44.36	68.86
U	48	20	110	70.59	30.38	55.81
UNK	4	0	7	100.00	36.36	74.07

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	2	11	71.43	31.25	56.82
ADJ:FORM	1	0	2	100.00	33.33	71.43
ADV	8	5	11	61.54	42.11	56.34
CONJ	3	0	6	100.00	33.33	71.43
CONTR	1	1	2	50.00	33.33	45.45
DET	97	20	117	82.91	45.33	71.11
MORPH	21	3	17	87.50	55.26	78.36
NOUN	20	11	17	64.52	54.05	62.11
NOUN:NUM	40	4	25	90.91	61.54	82.99
NOUN:POSS	8	1	6	88.89	57.14	80.00
ORTH	43	6	31	87.76	58.11	79.63
OTHER	52	14	160	78.79	24.53	54.62
PART	3	2	6	60.00	33.33	51.72
PREP	56	17	101	76.71	35.67	62.36
PRON	28	4	19	87.50	59.57	80.00
PUNCT	132	80	87	62.26	60.27	61.86
SPELL	60	10	9	85.71	86.96	85.96
UNK	4	0	7	100.00	36.36	74.07
VERB	20	4	58	83.33	25.64	57.47
VERB:FORM	38	3	25	92.68	60.32	83.70
VERB:SVA	46	3	9	93.88	83.64	91.63
VERB:TENSE	26	3	57	89.66	31.33	65.33
WO	6	10	32	37.50	15.79	29.41

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	2	50.00	33.33	45.45
M:ADV	1	0	5	100.00	16.67	50.00
M:CONJ	3	0	4	100.00	42.86	78.95
M:DET	74	11	43	87.06	63.25	80.96
M:NOUN	3	2	1	60.00	75.00	62.50
M:NOUN:POSS	1	0	3	100.00	25.00	62.50
M:OTHER	2	1	9	66.67	18.18	43.48
M:PART	2	1	1	66.67	66.67	66.67
M:PREP	12	10	18	54.55	40.00	50.85
M:PRON	18	3	8	85.71	69.23	81.82
M:PUNCT	115	44	61	72.33	65.34	70.81
M:VERB	7	2	4	77.78	63.64	74.47
M:VERB:FORM	1	0	1	100.00	50.00	83.33
M:VERB:TENSE	5	2	10	71.43	33.33	58.14
R:ADJ	4	0	8	100.00	33.33	71.43
R:ADJ:FORM	1	0	2	100.00	33.33	71.43
R:ADV	5	3	2	62.50	71.43	64.10
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	12	6	36	66.67	25.00	50.00
R:MORPH	21	3	17	87.50	55.26	78.36
R:NOUN	15	7	14	68.18	51.72	64.10
R:NOUN:NUM	40	4	25	90.91	61.54	82.99
R:NOUN:POSS	6	1	0	85.71	100.00	88.24
R:ORTH	43	6	31	87.76	58.11	79.63
R:OTHER	49	9	142	84.48	25.65	57.92
R:PART	1	1	4	50.00	20.00	38.46
R:PREP	33	6	65	84.62	33.67	64.96
R:PRON	7	0	5	100.00	58.33	87.50
R:PUNCT	7	31	16	18.42	30.43	20.00
R:SPELL	60	10	9	85.71	86.96	85.96
R:VERB	12	2	48	85.71	20.00	51.72
R:VERB:FORM	34	2	22	94.44	60.71	85.00
R:VERB:SVA	46	3	9	93.88	83.64	91.63
R:VERB:TENSE	19	1	38	95.00	33.33	69.34
R:WO	6	10	32	37.50	15.79	29.41
U:ADJ	0	1	1	0.00	0.00	0.00
U:ADV	2	2	4	50.00	33.33	45.45
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	11	3	38	78.57	22.45	52.38
U:NOUN	2	2	2	50.00	50.00	50.00
U:NOUN:POSS	1	0	3	100.00	25.00	62.50
U:OTHER	1	4	9	20.00	10.00	16.67
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	11	1	18	91.67	37.93	71.43
U:PRON	3	1	6	75.00	33.33	60.00
U:PUNCT	10	5	10	66.67	50.00	62.50
U:VERB	1	0	6	100.00	14.29	45.45
U:VERB:FORM	3	1	2	75.00	60.00	71.43
U:VERB:TENSE	2	0	9	100.00	18.18	52.63
UNK	4	0	7	100.00	36.36	74.07

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	264	55	189	82.76	58.28	76.34
R	488	97	648	83.42	42.96	70.20
U	49	23	152	68.06	24.38	50.10
UNK	11	0	21	100.00	34.38	72.37

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	7	2	15	77.78	31.82	60.34
ADJ:FORM	1	0	2	100.00	33.33	71.43
ADV	8	1	16	88.89	33.33	66.67
CONJ	5	0	6	100.00	45.45	80.65
CONTR	0	1	2	0.00	0.00	0.00
DET	100	11	119	90.09	45.66	75.41
MORPH	23	3	17	88.46	57.50	79.86
NOUN	21	11	23	65.62	47.73	61.05
NOUN:NUM	40	3	28	93.02	58.82	83.33
NOUN:POSS	12	1	7	92.31	63.16	84.51
ORTH	54	5	46	91.53	54.00	80.36
OTHER	88	21	242	80.73	26.67	57.44
PART	2	0	3	100.00	40.00	76.92
PREP	56	10	109	84.85	33.94	65.27
PRON	29	2	20	93.55	59.18	83.82
PUNCT	139	73	96	65.57	59.15	64.17
SPELL	61	7	10	89.71	85.92	88.92
UNK	11	0	21	100.00	34.38	72.37
VERB	27	4	77	87.10	25.96	59.21
VERB:FORM	39	1	27	97.50	59.09	86.28
VERB:SVA	44	3	11	93.62	80.00	90.53
VERB:TENSE	29	2	68	93.55	29.90	65.61
WO	16	14	45	53.33	26.23	44.20

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	1	2	66.67	50.00	62.50
M:ADV	3	0	7	100.00	30.00	68.18
M:CONJ	4	0	3	100.00	57.14	86.96
M:DET	76	3	40	96.20	65.52	87.96
M:NOUN	3	2	2	60.00	60.00	60.00
M:NOUN:POSS	1	0	3	100.00	25.00	62.50
M:OTHER	6	1	14	85.71	30.00	62.50
M:PART	2	0	1	100.00	66.67	90.91
M:PREP	13	6	19	68.42	40.62	60.19
M:PRON	18	1	8	94.74	69.23	88.24
M:PUNCT	120	38	70	75.95	63.16	72.99
M:VERB	8	2	9	80.00	47.06	70.18
M:VERB:FORM	1	0	1	100.00	50.00	83.33
M:VERB:TENSE	7	1	10	87.50	41.18	71.43
R:ADJ	5	0	11	100.00	31.25	69.44
R:ADJ:FORM	1	0	2	100.00	33.33	71.43
R:ADV	4	0	3	100.00	57.14	86.96
R:CONJ	1	0	3	100.00	25.00	62.50
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	14	5	36	73.68	28.00	55.56
R:MORPH	23	3	17	88.46	57.50	79.86
R:NOUN	16	7	17	69.57	48.48	64.00
R:NOUN:NUM	40	3	28	93.02	58.82	83.33
R:NOUN:POSS	10	1	0	90.91	100.00	92.59
R:ORTH	54	5	46	91.53	54.00	80.36
R:OTHER	80	11	190	87.91	29.63	63.09
R:PART	0	0	1	100.00	0.00	0.00
R:PREP	33	4	72	89.19	31.43	65.22
R:PRON	7	0	6	100.00	53.85	85.37
R:PUNCT	8	30	18	21.05	30.77	22.47
R:SPELL	61	7	10	89.71	85.92	88.92
R:VERB	16	2	58	88.89	21.62	54.79
R:VERB:FORM	35	0	24	100.00	59.32	87.94
R:VERB:SVA	44	3	11	93.62	80.00	90.53
R:VERB:TENSE	20	1	49	95.24	28.99	65.36
R:WO	16	14	45	53.33	26.23	44.20
U:ADJ	0	1	2	0.00	0.00	0.00
U:ADV	1	1	6	50.00	14.29	33.33
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	10	3	43	76.92	18.87	47.62
U:NOUN	2	2	4	50.00	33.33	45.45
U:NOUN:POSS	1	0	4	100.00	20.00	55.56
U:OTHER	2	9	38	18.18	5.00	11.90
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	10	0	18	100.00	35.71	73.53
U:PRON	4	1	6	80.00	40.00	66.67
U:PUNCT	11	5	8	68.75	57.89	66.27
U:VERB	3	0	10	100.00	23.08	60.00
U:VERB:FORM	3	1	2	75.00	60.00	71.43
U:VERB:TENSE	2	0	9	100.00	18.18	52.63
UNK	11	0	21	100.00	34.38	72.37

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	354	175	268	66.92	56.91	64.65
Span-level detection	387	143	275	73.02	58.46	69.55
Token-level detection	445	133	329	76.99	57.49	72.10

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	131	52	67	71.58	66.16	70.43
R	194	102	160	65.54	54.80	63.07
U	29	21	41	58.00	41.43	53.70

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	5	100.00	16.67	50.00
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	2	4	4	33.33	33.33	33.33
CONJ	0	1	1	0.00	0.00	0.00
CONTR	0	1	3	0.00	0.00	0.00
DET	65	22	36	74.71	64.36	72.38
MORPH	11	1	11	91.67	50.00	78.57
NOUN	7	7	13	50.00	35.00	46.05
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	22	1	10	95.65	68.75	88.71
NOUN:POSS	5	2	1	71.43	83.33	73.53
ORTH	27	1	13	96.43	67.50	88.82
OTHER	19	25	33	43.18	36.54	41.67
PART	2	0	1	100.00	66.67	90.91
PREP	31	8	35	79.49	46.97	69.82
PRON	5	6	7	45.45	41.67	44.64
PUNCT	88	59	38	59.86	69.84	61.62
SPELL	36	11	3	76.60	92.31	79.30
VERB	3	7	14	30.00	17.65	26.32
VERB:FORM	6	2	7	75.00	46.15	66.67
VERB:SVA	11	4	1	73.33	91.67	76.39
VERB:TENSE	9	3	20	75.00	31.03	58.44
WO	3	10	10	23.08	23.08	23.08

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	1	1	0	50.00	100.00	55.56
M:CONJ	0	1	0	0.00	100.00	0.00
M:DET	37	7	13	84.09	74.00	81.86
M:NOUN	0	2	1	0.00	0.00	0.00
M:OTHER	1	1	5	50.00	16.67	35.71
M:PREP	7	3	11	70.00	38.89	60.34
M:PRON	2	3	4	40.00	33.33	38.46
M:PUNCT	79	31	28	71.82	73.83	72.21
M:VERB	1	3	1	25.00	50.00	27.78
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	1	0	2	100.00	33.33	71.43
R:ADJ	1	0	2	100.00	33.33	71.43
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	9	10	7	47.37	56.25	48.91
R:MORPH	11	1	11	91.67	50.00	78.57
R:NOUN	7	4	10	63.64	41.18	57.38
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	22	1	10	95.65	68.75	88.71
R:NOUN:POSS	3	2	1	60.00	75.00	62.50
R:ORTH	27	1	13	96.43	67.50	88.82
R:OTHER	18	18	27	50.00	40.00	47.62
R:PART	2	0	1	100.00	66.67	90.91
R:PREP	22	4	19	84.62	53.66	75.86
R:PRON	2	3	2	40.00	50.00	41.67
R:PUNCT	4	24	4	14.29	50.00	16.67
R:SPELL	36	11	3	76.60	92.31	79.30
R:VERB	2	3	12	40.00	14.29	29.41
R:VERB:FORM	4	2	7	66.67	36.36	57.14
R:VERB:SVA	11	4	1	73.33	91.67	76.39
R:VERB:TENSE	8	3	14	72.73	36.36	60.61
R:WO	3	10	10	23.08	23.08	23.08
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	3	2	0.00	0.00	0.00
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	19	5	16	79.17	54.29	72.52
U:NOUN	0	1	2	0.00	0.00	0.00
U:NOUN:POSS	2	0	0	100.00	100.00	100.00
U:OTHER	0	6	1	0.00	0.00	0.00
U:PREP	2	1	5	66.67	28.57	52.63
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	5	4	6	55.56	45.45	53.19
U:VERB	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	0	0	4	100.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	139	45	69	75.54	66.83	73.62
R	218	79	161	73.40	57.52	69.56
U	29	19	44	60.42	39.73	54.72
UNK	1	0	1	100.00	50.00	83.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	6	100.00	14.29	45.45
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	1	4	4	20.00	20.00	20.00
CONJ	0	1	1	0.00	0.00	0.00
CONTR	0	1	3	0.00	0.00	0.00
DET	69	18	39	79.31	63.89	75.66
MORPH	12	0	10	100.00	54.55	85.71
NOUN	12	5	16	70.59	42.86	62.50
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	20	0	8	100.00	71.43	92.59
NOUN:POSS	5	2	1	71.43	83.33	73.53
ORTH	28	0	14	100.00	66.67	90.91
OTHER	27	19	33	58.70	45.00	55.33
PART	2	0	2	100.00	50.00	83.33
PREP	32	4	35	88.89	47.76	75.83
PRON	7	4	6	63.64	53.85	61.40
PUNCT	93	56	40	62.42	69.92	63.79
SPELL	36	8	2	81.82	94.74	84.11
UNK	1	0	1	100.00	50.00	83.33
VERB	6	5	14	54.55	30.00	46.88
VERB:FORM	6	2	7	75.00	46.15	66.67
VERB:SVA	12	2	1	85.71	92.31	86.96
VERB:TENSE	12	2	21	85.71	36.36	67.42
WO	3	10	9	23.08	25.00	23.44

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	0	1	0	0.00	100.00	0.00
M:CONJ	0	1	0	0.00	100.00	0.00
M:DET	39	5	14	88.64	73.58	85.15
M:NOUN	1	2	2	33.33	33.33	33.33
M:OTHER	1	1	6	50.00	14.29	33.33
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	7	1	11	87.50	38.89	70.00
M:PRON	3	2	3	60.00	50.00	57.69
M:PUNCT	83	29	27	74.11	75.45	74.37
M:VERB	2	3	1	40.00	66.67	43.48
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	1	0	2	100.00	33.33	71.43
R:ADJ	1	0	3	100.00	25.00	62.50
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	11	9	7	55.00	61.11	56.12
R:MORPH	12	0	10	100.00	54.55	85.71
R:NOUN	11	2	12	84.62	47.83	73.33
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	20	0	8	100.00	71.43	92.59
R:NOUN:POSS	3	2	1	60.00	75.00	62.50
R:ORTH	28	0	14	100.00	66.67	90.91
R:OTHER	26	13	25	66.67	50.98	62.80
R:PART	2	0	1	100.00	66.67	90.91
R:PREP	24	2	19	92.31	55.81	81.63
R:PRON	3	2	2	60.00	60.00	60.00
R:PUNCT	4	23	7	14.81	36.36	16.81
R:SPELL	36	8	2	81.82	94.74	84.11
R:VERB	4	1	12	80.00	25.00	55.56
R:VERB:FORM	4	2	7	66.67	36.36	57.14
R:VERB:SVA	12	2	1	85.71	92.31	86.96
R:VERB:TENSE	11	2	15	84.62	42.31	70.51
R:WO	3	10	9	23.08	25.00	23.44
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	3	2	0.00	0.00	0.00
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	19	4	18	82.61	51.35	73.64
U:NOUN	0	1	2	0.00	0.00	0.00
U:NOUN:POSS	2	0	0	100.00	100.00	100.00
U:OTHER	0	5	2	0.00	0.00	0.00
U:PREP	1	1	5	50.00	16.67	35.71
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	6	4	6	60.00	50.00	57.69
U:VERB	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	0	0	4	100.00	0.00	0.00
UNK	1	0	1	100.00	50.00	83.33

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	162	41	82	79.80	66.39	76.70
R	242	65	186	78.83	56.54	73.07
U	38	27	54	58.46	41.30	53.98
UNK	3	0	7	100.00	30.00	68.18

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	7	100.00	12.50	41.67
ADJ:FORM	0	0	3	100.00	0.00	0.00
ADV	1	4	6	20.00	14.29	18.52
CONJ	1	0	1	100.00	50.00	83.33
CONTR	0	1	4	0.00	0.00	0.00
DET	70	15	37	82.35	65.42	78.30
MORPH	12	0	10	100.00	54.55	85.71
NOUN	12	4	15	75.00	44.44	65.93
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	19	0	10	100.00	65.52	90.48
NOUN:POSS	9	1	0	90.00	100.00	91.84
ORTH	31	0	16	100.00	65.96	90.64
OTHER	43	26	58	62.32	42.57	57.03
PART	2	0	1	100.00	66.67	90.91
PREP	34	3	39	91.89	46.58	76.92
PRON	7	4	7	63.64	50.00	60.34
PUNCT	117	55	50	68.02	70.06	68.42
SPELL	36	7	2	83.72	94.74	85.71
UNK	3	0	7	100.00	30.00	68.18
VERB	8	5	15	61.54	34.78	53.33
VERB:FORM	8	0	7	100.00	53.33	85.11
VERB:SVA	11	1	1	91.67	91.67	91.67
VERB:TENSE	12	2	23	85.71	34.29	65.93
WO	6	5	10	54.55	37.50	50.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	3	100.00	0.00	0.00
M:ADV	0	1	0	0.00	100.00	0.00
M:DET	41	3	13	93.18	75.93	89.13
M:NOUN	1	2	2	33.33	33.33	33.33
M:NOUN:POSS	2	0	0	100.00	100.00	100.00
M:OTHER	3	1	8	75.00	27.27	55.56
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	8	1	11	88.89	42.11	72.73
M:PRON	3	2	4	60.00	42.86	55.56
M:PUNCT	99	28	35	77.95	73.88	77.10
M:VERB	2	3	2	40.00	50.00	41.67
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	1	0	3	100.00	25.00	62.50
R:ADJ	0	0	3	100.00	0.00	0.00
R:ADJ:FORM	0	0	3	100.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONJ	1	0	1	100.00	50.00	83.33
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	10	9	6	52.63	62.50	54.35
R:MORPH	12	0	10	100.00	54.55	85.71
R:NOUN	10	1	11	90.91	47.62	76.92
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	19	0	10	100.00	65.52	90.48
R:NOUN:POSS	5	1	0	83.33	100.00	86.21
R:ORTH	31	0	16	100.00	65.96	90.64
R:OTHER	40	10	42	80.00	48.78	70.92
R:PART	2	0	0	100.00	100.00	100.00
R:PREP	25	2	22	92.59	53.19	80.65
R:PRON	3	2	1	60.00	75.00	62.50
R:PUNCT	5	23	9	17.86	35.71	19.84
R:SPELL	36	7	2	83.72	94.74	85.71
R:VERB	6	1	12	85.71	33.33	65.22
R:VERB:FORM	6	0	7	100.00	46.15	81.08
R:VERB:SVA	11	1	1	91.67	91.67	91.67
R:VERB:TENSE	11	2	17	84.62	39.29	68.75
R:WO	6	5	10	54.55	37.50	50.00
U:ADJ	1	0	1	100.00	50.00	83.33
U:ADV	0	3	4	0.00	0.00	0.00
U:CONTR	0	0	3	100.00	0.00	0.00
U:DET	19	3	18	86.36	51.35	76.00
U:NOUN	1	1	2	50.00	33.33	45.45
U:NOUN:POSS	2	0	0	100.00	100.00	100.00
U:OTHER	0	15	8	0.00	0.00	0.00
U:PREP	1	0	6	100.00	14.29	45.45
U:PRON	1	0	2	100.00	33.33	71.43
U:PUNCT	13	4	6	76.47	68.42	74.71
U:VERB	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	0	0	3	100.00	0.00	0.00
UNK	3	0	7	100.00	30.00	68.18

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	455	178	162	71.88	73.74	72.25
Span-level detection	483	150	152	76.30	76.06	76.26
Token-level detection	531	164	178	76.40	74.89	76.10

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	161	53	49	75.23	76.67	75.52
R	274	107	97	71.92	73.85	72.30
U	20	18	16	52.63	55.56	53.19

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	1	2	75.00	60.00	71.43
ADV	1	4	3	20.00	25.00	20.83
CONJ	0	5	0	0.00	100.00	0.00
DET	12	24	5	33.33	70.59	37.27
MORPH	4	1	1	80.00	80.00	80.00
NOUN	8	12	8	40.00	50.00	41.67
NOUN:INFL	9	0	2	100.00	81.82	95.74
NOUN:NUM	13	3	8	81.25	61.90	76.47
NOUN:POSS	13	2	6	86.67	68.42	82.28
ORTH	42	6	20	87.50	67.74	82.68
OTHER	30	25	16	54.55	65.22	56.39
PART	2	0	0	100.00	100.00	100.00
PREP	15	10	9	60.00	62.50	60.48
PRON	6	2	1	75.00	85.71	76.92
PUNCT	162	54	56	75.00	74.31	74.86
SPELL	93	3	8	96.88	92.08	95.88
VERB	13	3	6	81.25	68.42	78.31
VERB:FORM	9	0	3	100.00	75.00	93.75
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	8	6	2	57.14	80.00	60.61
VERB:TENSE	7	7	3	50.00	70.00	53.03
WO	1	10	2	9.09	33.33	10.64

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	1	2	0.00	0.00	0.00
M:CONJ	0	3	0	0.00	100.00	0.00
M:DET	6	7	1	46.15	85.71	50.85
M:NOUN	0	3	3	0.00	0.00	0.00
M:NOUN:POSS	3	0	4	100.00	42.86	78.95
M:PREP	3	1	1	75.00	75.00	75.00
M:PRON	2	0	1	100.00	66.67	90.91
M:PUNCT	145	36	36	80.11	80.11	80.11
M:VERB	2	0	1	100.00	66.67	90.91
M:VERB:TENSE	0	2	0	0.00	100.00	0.00
R:ADJ	3	1	2	75.00	60.00	71.43
R:ADV	0	3	1	0.00	0.00	0.00
R:DET	2	13	1	13.33	66.67	15.87
R:MORPH	4	1	1	80.00	80.00	80.00
R:NOUN	8	9	5	47.06	61.54	49.38
R:NOUN:INFL	9	0	2	100.00	81.82	95.74
R:NOUN:NUM	13	3	8	81.25	61.90	76.47
R:NOUN:POSS	10	2	2	83.33	83.33	83.33
R:ORTH	42	6	20	87.50	67.74	82.68
R:OTHER	30	18	16	62.50	65.22	63.03
R:PART	1	0	0	100.00	100.00	100.00
R:PREP	9	8	6	52.94	60.00	54.22
R:PRON	4	1	0	80.00	100.00	83.33
R:PUNCT	8	16	12	33.33	40.00	34.48
R:SPELL	93	3	8	96.88	92.08	95.88
R:VERB	10	2	4	83.33	71.43	80.65
R:VERB:FORM	9	0	2	100.00	81.82	95.74
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	8	6	2	57.14	80.00	60.61
R:VERB:TENSE	6	5	2	54.55	75.00	57.69
R:WO	1	10	2	9.09	33.33	10.64
U:ADV	1	0	0	100.00	100.00	100.00
U:CONJ	0	2	0	0.00	100.00	0.00
U:DET	4	4	3	50.00	57.14	51.28
U:OTHER	0	7	0	0.00	100.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	3	1	2	75.00	60.00	71.43
U:PRON	0	1	0	0.00	100.00	0.00
U:PUNCT	9	2	8	81.82	52.94	73.77
U:VERB	1	1	1	50.00	50.00	50.00
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	1	0	1	100.00	50.00	83.33

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	171	43	48	79.91	78.08	79.53
R	291	90	88	76.38	76.78	76.46
U	19	17	14	52.78	57.58	53.67
UNK	2	0	2	100.00	50.00	83.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	4	1	1	80.00	80.00	80.00
ADV	0	3	2	0.00	0.00	0.00
CONJ	1	3	0	25.00	100.00	29.41
DET	13	22	6	37.14	68.42	40.88
MORPH	5	1	1	83.33	83.33	83.33
NOUN	11	7	5	61.11	68.75	62.50
NOUN:INFL	9	0	2	100.00	81.82	95.74
NOUN:NUM	11	2	7	84.62	61.11	78.57
NOUN:POSS	15	1	5	93.75	75.00	89.29
ORTH	43	6	19	87.76	69.35	83.33
OTHER	38	18	15	67.86	71.70	68.59
PART	2	0	0	100.00	100.00	100.00
PREP	15	10	8	60.00	65.22	60.98
PRON	6	2	1	75.00	85.71	76.92
PUNCT	171	48	55	78.08	75.66	77.59
SPELL	95	0	6	100.00	94.06	98.75
UNK	2	0	2	100.00	50.00	83.33
VERB	13	3	6	81.25	68.42	78.31
VERB:FORM	9	0	2	100.00	81.82	95.74
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	8	6	2	57.14	80.00	60.61
VERB:TENSE	7	7	4	50.00	63.64	52.24
WO	1	10	2	9.09	33.33	10.64

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	1	1	0	50.00	100.00	55.56
M:DET	7	5	1	58.33	87.50	62.50
M:NOUN	2	1	1	66.67	66.67	66.67
M:NOUN:POSS	3	0	4	100.00	42.86	78.95
M:OTHER	1	0	0	100.00	100.00	100.00
M:PREP	3	1	1	75.00	75.00	75.00
M:PRON	2	0	1	100.00	66.67	90.91
M:PUNCT	150	33	38	81.97	79.79	81.52
M:VERB	2	0	1	100.00	66.67	90.91
M:VERB:TENSE	0	2	0	0.00	100.00	0.00
R:ADJ	4	1	1	80.00	80.00	80.00
R:ADV	0	3	1	0.00	0.00	0.00
R:DET	2	13	2	13.33	50.00	15.62
R:MORPH	5	1	1	83.33	83.33	83.33
R:NOUN	9	6	4	60.00	69.23	61.64
R:NOUN:INFL	9	0	2	100.00	81.82	95.74
R:NOUN:NUM	11	2	7	84.62	61.11	78.57
R:NOUN:POSS	12	1	1	92.31	92.31	92.31
R:ORTH	43	6	19	87.76	69.35	83.33
R:OTHER	37	11	15	77.08	71.15	75.82
R:PART	1	0	0	100.00	100.00	100.00
R:PREP	9	8	6	52.94	60.00	54.22
R:PRON	4	1	0	80.00	100.00	83.33
R:PUNCT	12	14	9	46.15	57.14	48.00
R:SPELL	95	0	6	100.00	94.06	98.75
R:VERB	10	2	4	83.33	71.43	80.65
R:VERB:FORM	9	0	2	100.00	81.82	95.74
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	8	6	2	57.14	80.00	60.61
R:VERB:TENSE	6	5	3	54.55	66.67	56.60
R:WO	1	10	2	9.09	33.33	10.64
U:CONJ	0	2	0	0.00	100.00	0.00
U:DET	4	4	3	50.00	57.14	51.28
U:OTHER	0	7	0	0.00	100.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	3	1	1	75.00	75.00	75.00
U:PRON	0	1	0	0.00	100.00	0.00
U:PUNCT	9	1	8	90.00	52.94	78.95
U:VERB	1	1	1	50.00	50.00	50.00
U:VERB:TENSE	1	0	1	100.00	50.00	83.33
UNK	2	0	2	100.00	50.00	83.33

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	184	40	44	82.14	80.70	81.85
R	318	93	112	77.37	73.95	76.66
U	25	31	20	44.64	55.56	46.47
UNK	4	0	2	100.00	66.67	90.91

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	0	2	100.00	71.43	92.59
ADV	1	3	2	25.00	33.33	26.32
CONJ	1	3	0	25.00	100.00	29.41
CONTR	0	0	2	100.00	0.00	0.00
DET	15	20	8	42.86	65.22	46.01
MORPH	5	1	1	83.33	83.33	83.33
NOUN	14	6	7	70.00	66.67	69.31
NOUN:INFL	9	0	2	100.00	81.82	95.74
NOUN:NUM	12	2	7	85.71	63.16	80.00
NOUN:POSS	16	0	5	100.00	76.19	94.12
ORTH	57	4	27	93.44	67.86	86.89
OTHER	49	31	24	61.25	67.12	62.34
PART	2	0	0	100.00	100.00	100.00
PREP	15	9	9	62.50	62.50	62.50
PRON	7	2	0	77.78	100.00	81.40
PUNCT	180	48	58	78.95	75.63	78.26
SPELL	94	0	6	100.00	94.00	98.74
UNK	4	0	2	100.00	66.67	90.91
VERB	14	4	6	77.78	70.00	76.09
VERB:FORM	10	0	2	100.00	83.33	96.15
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	8	5	2	61.54	80.00	64.52
VERB:TENSE	7	7	5	50.00	58.33	51.47
WO	2	19	0	9.52	100.00	11.63

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	1	0	1	100.00	50.00	83.33
M:CONJ	1	1	0	50.00	100.00	55.56
M:DET	7	3	1	70.00	87.50	72.92
M:NOUN	3	1	2	75.00	60.00	71.43
M:NOUN:POSS	3	0	4	100.00	42.86	78.95
M:OTHER	1	0	0	100.00	100.00	100.00
M:PREP	4	1	1	80.00	80.00	80.00
M:PRON	3	0	0	100.00	100.00	100.00
M:PUNCT	158	32	35	83.16	81.87	82.90
M:VERB	3	0	0	100.00	100.00	100.00
M:VERB:TENSE	0	2	0	0.00	100.00	0.00
R:ADJ	5	0	1	100.00	83.33	96.15
R:ADV	0	3	1	0.00	0.00	0.00
R:CONTR	0	0	2	100.00	0.00	0.00
R:DET	2	13	3	13.33	40.00	15.38
R:MORPH	5	1	1	83.33	83.33	83.33
R:NOUN	9	5	4	64.29	69.23	65.22
R:NOUN:INFL	9	0	2	100.00	81.82	95.74
R:NOUN:NUM	12	2	7	85.71	63.16	80.00
R:NOUN:POSS	13	0	1	100.00	92.86	98.48
R:ORTH	57	4	27	93.44	67.86	86.89
R:OTHER	47	11	23	81.03	67.14	77.81
R:PART	1	0	0	100.00	100.00	100.00
R:PREP	9	7	7	56.25	56.25	56.25
R:PRON	4	1	0	80.00	100.00	83.33
R:PUNCT	11	15	13	42.31	45.83	42.97
R:SPELL	94	0	6	100.00	94.00	98.74
R:VERB	10	2	5	83.33	66.67	79.37
R:VERB:FORM	10	0	2	100.00	83.33	96.15
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	8	5	2	61.54	80.00	64.52
R:VERB:TENSE	6	5	4	54.55	60.00	55.56
R:WO	2	19	0	9.52	100.00	11.63
U:ADJ	0	0	1	100.00	0.00	0.00
U:CONJ	0	2	0	0.00	100.00	0.00
U:DET	6	4	4	60.00	60.00	60.00
U:NOUN	2	0	1	100.00	66.67	90.91
U:OTHER	1	20	1	4.76	50.00	5.81
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	2	1	1	66.67	66.67	66.67
U:PRON	0	1	0	0.00	100.00	0.00
U:PUNCT	11	1	10	91.67	52.38	79.71
U:VERB	1	2	1	33.33	50.00	35.71
U:VERB:TENSE	1	0	1	100.00	50.00	83.33
UNK	4	0	2	100.00	66.67	90.91

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:47:51+00:00
Competition submission:	7
Competition phase:	3 - Open phase

Detailed results

Submission information

Results