BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1299	1619	3199	44.52	28.88	40.17
Span-level detection	1719	1201	3131	58.87	35.44	52.00
Token-level detection	2068	950	3845	68.52	34.97	57.49

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	161	40	777	80.10	17.16	46.21
R	1034	1384	2068	42.76	33.33	40.47
U	104	195	354	34.78	22.71	31.44

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	7	28	12.50	3.45	8.20
ADJ:FORM	0	1	7	0.00	0.00	0.00
ADV	1	2	38	33.33	2.56	9.80
CONJ	1	44	21	2.22	4.55	2.48
CONTR	0	0	8	100.00	0.00	0.00
DET	68	264	429	20.48	13.68	18.63
MORPH	24	28	104	46.15	18.75	35.71
NOUN	6	6	90	50.00	6.25	20.83
NOUN:INFL	6	8	13	42.86	31.58	40.00
NOUN:NUM	194	249	90	43.79	68.31	47.18
NOUN:POSS	0	0	45	100.00	0.00	0.00
ORTH	5	44	344	10.20	1.43	4.59
OTHER	38	148	646	20.43	5.56	13.31
PART	7	11	15	38.89	31.82	37.23
PREP	171	263	253	39.40	40.33	39.58
PRON	28	54	101	34.15	21.71	30.63
PUNCT	265	235	339	53.00	43.87	50.88
SPELL	241	74	80	76.51	75.08	76.22
VERB	4	12	175	25.00	2.23	8.23
VERB:FORM	94	102	90	47.96	51.09	48.55
VERB:INFL	6	0	1	100.00	85.71	96.77
VERB:SVA	122	42	24	74.39	83.56	76.06
VERB:TENSE	17	23	191	42.50	8.17	23.10
WO	0	2	67	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	3	100.00	0.00	0.00
M:ADV	0	0	8	100.00	0.00	0.00
M:CONJ	0	0	12	100.00	0.00	0.00
M:DET	0	0	214	100.00	0.00	0.00
M:NOUN	0	0	11	100.00	0.00	0.00
M:NOUN:POSS	0	0	13	100.00	0.00	0.00
M:OTHER	0	0	45	100.00	0.00	0.00
M:PART	0	0	3	100.00	0.00	0.00
M:PREP	0	0	76	100.00	0.00	0.00
M:PRON	0	0	58	100.00	0.00	0.00
M:PUNCT	161	40	261	80.10	38.15	65.66
M:VERB	0	0	30	100.00	0.00	0.00
M:VERB:FORM	0	0	10	100.00	0.00	0.00
M:VERB:TENSE	0	0	33	100.00	0.00	0.00
R:ADJ	1	7	23	12.50	4.17	8.93
R:ADJ:FORM	0	1	7	0.00	0.00	0.00
R:ADV	1	2	16	33.33	5.88	17.24
R:CONJ	1	44	4	2.22	20.00	2.70
R:CONTR	0	0	4	100.00	0.00	0.00
R:DET	68	264	61	20.48	52.71	23.34
R:MORPH	24	28	104	46.15	18.75	35.71
R:NOUN	6	6	64	50.00	8.57	25.42
R:NOUN:INFL	6	8	13	42.86	31.58	40.00
R:NOUN:NUM	194	249	90	43.79	68.31	47.18
R:NOUN:POSS	0	0	23	100.00	0.00	0.00
R:ORTH	5	44	344	10.20	1.43	4.59
R:OTHER	38	148	580	20.43	6.15	13.95
R:PART	7	11	8	38.89	46.67	40.23
R:PREP	171	262	121	39.49	58.56	42.24
R:PRON	28	54	22	34.15	56.00	37.04
R:PUNCT	0	1	64	0.00	0.00	0.00
R:SPELL	241	74	80	76.51	75.08	76.22
R:VERB	4	12	130	25.00	2.99	10.10
R:VERB:FORM	94	102	75	47.96	55.62	49.32
R:VERB:INFL	6	0	1	100.00	85.71	96.77
R:VERB:SVA	122	42	24	74.39	83.56	76.06
R:VERB:TENSE	17	23	143	42.50	10.62	26.56
R:WO	0	2	67	0.00	0.00	0.00
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	0	0	14	100.00	0.00	0.00
U:CONJ	0	0	5	100.00	0.00	0.00
U:CONTR	0	0	4	100.00	0.00	0.00
U:DET	0	0	154	100.00	0.00	0.00
U:NOUN	0	0	15	100.00	0.00	0.00
U:NOUN:POSS	0	0	9	100.00	0.00	0.00
U:OTHER	0	0	21	100.00	0.00	0.00
U:PART	0	0	4	100.00	0.00	0.00
U:PREP	0	1	56	0.00	0.00	0.00
U:PRON	0	0	21	100.00	0.00	0.00
U:PUNCT	104	194	14	34.90	88.14	39.69
U:VERB	0	0	15	100.00	0.00	0.00
U:VERB:FORM	0	0	5	100.00	0.00	0.00
U:VERB:TENSE	0	0	15	100.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	177	28	776	86.34	18.57	49.92
R	1390	1001	1943	58.13	41.70	53.89
U	144	172	354	45.57	28.92	40.86
UNK	8	0	58	100.00	12.12	40.82

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	5	35	37.50	7.89	21.43
ADJ:FORM	0	0	6	100.00	0.00	0.00
ADV	2	2	43	50.00	4.44	16.39
CONJ	5	43	21	10.42	19.23	11.47
CONTR	0	0	8	100.00	0.00	0.00
DET	109	221	411	33.03	20.96	29.62
MORPH	41	16	98	71.93	29.50	55.86
NOUN	30	3	98	90.91	23.44	57.69
NOUN:INFL	7	4	13	63.64	35.00	54.69
NOUN:NUM	177	205	88	46.34	66.79	49.36
NOUN:POSS	7	0	44	100.00	13.73	44.30
ORTH	35	36	338	49.30	9.38	26.64
OTHER	176	99	598	64.00	22.74	46.96
PART	9	9	17	50.00	34.62	45.92
PREP	234	193	227	54.80	50.76	53.94
PRON	34	44	88	43.59	27.87	39.17
PUNCT	282	201	348	58.39	44.76	55.04
SPELL	266	14	50	95.00	84.18	92.62
UNK	8	0	58	100.00	12.12	40.82
VERB	41	6	184	87.23	18.22	49.64
VERB:FORM	85	68	88	55.56	49.13	54.14
VERB:INFL	6	0	2	100.00	75.00	93.75
VERB:SVA	121	18	23	87.05	84.03	86.43
VERB:TENSE	41	12	180	77.36	18.55	47.34
WO	0	2	65	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	3	100.00	0.00	0.00
M:ADV	1	0	10	100.00	9.09	33.33
M:CONJ	3	0	12	100.00	20.00	55.56
M:DET	3	0	209	100.00	1.42	6.70
M:NOUN	1	0	9	100.00	10.00	35.71
M:NOUN:POSS	0	0	16	100.00	0.00	0.00
M:OTHER	1	0	50	100.00	1.96	9.09
M:PART	0	0	3	100.00	0.00	0.00
M:PREP	3	0	78	100.00	3.70	16.13
M:PRON	0	0	52	100.00	0.00	0.00
M:PUNCT	163	28	262	85.34	38.35	68.54
M:VERB	2	0	32	100.00	5.88	23.81
M:VERB:FORM	0	0	8	100.00	0.00	0.00
M:VERB:TENSE	0	0	32	100.00	0.00	0.00
R:ADJ	3	5	28	37.50	9.68	23.81
R:ADJ:FORM	0	0	6	100.00	0.00	0.00
R:ADV	1	2	20	33.33	4.76	15.15
R:CONJ	1	43	3	2.27	25.00	2.78
R:CONTR	0	0	4	100.00	0.00	0.00
R:DET	95	221	48	30.06	66.43	33.76
R:MORPH	41	16	98	71.93	29.50	55.86
R:NOUN	27	3	72	90.00	27.27	61.64
R:NOUN:INFL	7	4	13	63.64	35.00	54.69
R:NOUN:NUM	177	205	88	46.34	66.79	49.36
R:NOUN:POSS	7	0	17	100.00	29.17	67.31
R:ORTH	35	36	338	49.30	9.38	26.64
R:OTHER	174	99	523	63.74	24.96	48.63
R:PART	9	9	10	50.00	47.37	49.45
R:PREP	219	193	104	53.16	67.80	55.56
R:PRON	31	44	20	41.33	60.78	44.16
R:PUNCT	17	1	69	94.44	19.77	53.80
R:SPELL	266	14	50	95.00	84.18	92.62
R:VERB	34	6	134	85.00	20.24	51.83
R:VERB:FORM	84	68	77	55.26	52.17	54.62
R:VERB:INFL	6	0	2	100.00	75.00	93.75
R:VERB:SVA	121	18	23	87.05	84.03	86.43
R:VERB:TENSE	35	12	131	74.47	21.08	49.44
R:WO	0	2	65	0.00	0.00	0.00
U:ADJ	0	0	4	100.00	0.00	0.00
U:ADV	0	0	13	100.00	0.00	0.00
U:CONJ	1	0	6	100.00	14.29	45.45
U:CONTR	0	0	4	100.00	0.00	0.00
U:DET	11	0	154	100.00	6.67	26.32
U:NOUN	2	0	17	100.00	10.53	37.04
U:NOUN:POSS	0	0	11	100.00	0.00	0.00
U:OTHER	1	0	25	100.00	3.85	16.67
U:PART	0	0	4	100.00	0.00	0.00
U:PREP	12	0	45	100.00	21.05	57.14
U:PRON	3	0	16	100.00	15.79	48.39
U:PUNCT	102	172	17	37.23	85.71	41.98
U:VERB	5	0	18	100.00	21.74	58.14
U:VERB:FORM	1	0	3	100.00	25.00	62.50
U:VERB:TENSE	6	0	17	100.00	26.09	63.83
UNK	8	0	58	100.00	12.12	40.82

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	399	15	873	96.38	31.37	68.14
R	1464	771	2373	65.50	38.15	57.29
U	172	164	495	51.19	25.79	42.76
UNK	33	0	104	100.00	24.09	61.34

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	5	49	50.00	9.26	26.60
ADJ:FORM	0	0	10	100.00	0.00	0.00
ADV	6	2	61	75.00	8.96	30.30
CONJ	14	10	26	58.33	35.00	51.47
CONTR	0	0	12	100.00	0.00	0.00
DET	132	196	442	40.24	23.00	34.99
MORPH	38	12	106	76.00	26.39	55.23
NOUN	32	2	119	94.12	21.19	55.75
NOUN:INFL	8	4	13	66.67	38.10	57.97
NOUN:NUM	172	171	101	50.15	63.00	52.28
NOUN:POSS	12	0	52	100.00	18.75	53.57
ORTH	50	34	379	59.52	11.66	32.68
OTHER	287	65	871	81.53	24.78	55.92
PART	5	6	15	45.45	25.00	39.06
PREP	248	152	265	62.00	48.34	58.68
PRON	47	40	89	54.02	34.56	48.55
PUNCT	399	180	406	68.91	49.57	63.92
SPELL	259	3	51	98.85	83.55	95.36
UNK	33	0	104	100.00	24.09	61.34
VERB	45	5	247	90.00	15.41	45.73
VERB:FORM	92	38	94	70.77	49.46	65.16
VERB:INFL	6	0	2	100.00	75.00	93.75
VERB:SVA	117	13	32	90.00	78.52	87.44
VERB:TENSE	53	7	213	88.33	19.92	52.37
WO	8	5	86	61.54	8.51	27.40

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	0	6	100.00	25.00	62.50
M:ADV	4	0	17	100.00	19.05	54.05
M:CONJ	11	0	14	100.00	44.00	79.71
M:DET	23	0	223	100.00	9.35	34.02
M:NOUN	4	0	14	100.00	22.22	58.82
M:NOUN:POSS	4	0	14	100.00	22.22	58.82
M:OTHER	15	0	61	100.00	19.74	55.15
M:PART	0	0	3	100.00	0.00	0.00
M:PREP	22	0	83	100.00	20.95	56.99
M:PRON	13	0	51	100.00	20.31	56.03
M:PUNCT	277	15	298	94.86	48.17	79.46
M:VERB	5	0	49	100.00	9.26	33.78
M:VERB:FORM	11	0	4	100.00	73.33	93.22
M:VERB:TENSE	8	0	36	100.00	18.18	52.63
R:ADJ	3	5	34	37.50	8.11	21.74
R:ADJ:FORM	0	0	10	100.00	0.00	0.00
R:ADV	2	2	22	50.00	8.33	25.00
R:CONJ	0	10	5	0.00	0.00	0.00
R:CONTR	0	0	6	100.00	0.00	0.00
R:DET	93	196	47	32.18	66.43	35.88
R:MORPH	38	12	106	76.00	26.39	55.23
R:NOUN	24	2	81	92.31	22.86	57.42
R:NOUN:INFL	8	4	13	66.67	38.10	57.97
R:NOUN:NUM	172	171	101	50.15	63.00	52.28
R:NOUN:POSS	8	0	27	100.00	22.86	59.70
R:ORTH	50	34	379	59.52	11.66	32.68
R:OTHER	261	65	714	80.06	26.77	57.26
R:PART	4	6	8	40.00	33.33	38.46
R:PREP	209	152	124	57.89	62.76	58.81
R:PRON	30	40	23	42.86	56.60	45.05
R:PUNCT	18	1	90	94.74	16.67	48.91
R:SPELL	259	3	51	98.85	83.55	95.36
R:VERB	35	5	168	87.50	17.24	48.21
R:VERB:FORM	80	38	85	67.80	48.48	62.79
R:VERB:INFL	6	0	2	100.00	75.00	93.75
R:VERB:SVA	117	13	32	90.00	78.52	87.44
R:VERB:TENSE	39	7	159	84.78	19.70	51.05
R:WO	8	5	86	61.54	8.51	27.40
U:ADJ	0	0	9	100.00	0.00	0.00
U:ADV	0	0	22	100.00	0.00	0.00
U:CONJ	3	0	7	100.00	30.00	68.18
U:CONTR	0	0	6	100.00	0.00	0.00
U:DET	16	0	172	100.00	8.51	31.75
U:NOUN	4	0	24	100.00	14.29	45.45
U:NOUN:POSS	0	0	11	100.00	0.00	0.00
U:OTHER	11	0	96	100.00	10.28	36.42
U:PART	1	0	4	100.00	20.00	55.56
U:PREP	17	0	58	100.00	22.67	59.44
U:PRON	4	0	15	100.00	21.05	57.14
U:PUNCT	104	164	18	38.81	85.25	43.55
U:VERB	5	0	30	100.00	14.29	45.45
U:VERB:FORM	1	0	5	100.00	16.67	50.00
U:VERB:TENSE	6	0	18	100.00	25.00	62.50
UNK	33	0	104	100.00	24.09	61.34

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	485	517	1542	48.40	23.93	40.18
Span-level detection	691	312	1494	68.89	31.62	55.75
Token-level detection	854	202	1793	80.87	32.26	62.15

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	33	19	346	63.46	8.71	28.11
R	430	448	1022	48.97	29.61	43.31
U	22	50	174	30.56	11.22	22.73

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	2	9	0.00	0.00	0.00
ADJ:FORM	0	1	3	0.00	0.00	0.00
ADV	1	0	19	100.00	5.00	20.83
CONJ	0	9	7	0.00	0.00	0.00
CONTR	0	0	2	100.00	0.00	0.00
DET	22	64	201	25.58	9.87	19.40
MORPH	13	13	56	50.00	18.84	37.57
NOUN	1	3	39	25.00	2.50	8.93
NOUN:INFL	5	4	2	55.56	71.43	58.14
NOUN:NUM	87	71	52	55.06	62.59	56.42
NOUN:POSS	0	0	11	100.00	0.00	0.00
ORTH	0	9	192	0.00	0.00	0.00
OTHER	18	61	360	22.78	4.76	12.97
PART	4	4	6	50.00	40.00	47.62
PREP	58	70	105	45.31	35.58	42.96
PRON	12	19	57	38.71	17.39	31.09
PUNCT	55	68	145	44.72	27.50	39.74
SPELL	89	37	26	70.63	77.39	71.89
VERB	0	5	82	0.00	0.00	0.00
VERB:FORM	49	48	45	50.52	52.13	50.83
VERB:INFL	3	0	0	100.00	100.00	100.00
VERB:SVA	66	18	13	78.57	83.54	79.52
VERB:TENSE	2	10	93	16.67	2.11	6.99
WO	0	1	17	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	0	3	100.00	0.00	0.00
M:CONJ	0	0	1	100.00	0.00	0.00
M:DET	0	0	87	100.00	0.00	0.00
M:NOUN	0	0	5	100.00	0.00	0.00
M:NOUN:POSS	0	0	3	100.00	0.00	0.00
M:OTHER	0	0	26	100.00	0.00	0.00
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	0	0	34	100.00	0.00	0.00
M:PRON	0	0	31	100.00	0.00	0.00
M:PUNCT	33	19	113	63.46	22.60	46.61
M:VERB	0	0	16	100.00	0.00	0.00
M:VERB:FORM	0	0	8	100.00	0.00	0.00
M:VERB:TENSE	0	0	17	100.00	0.00	0.00
R:ADJ	0	2	7	0.00	0.00	0.00
R:ADJ:FORM	0	1	3	0.00	0.00	0.00
R:ADV	1	0	8	100.00	11.11	38.46
R:CONJ	0	9	2	0.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	22	64	30	25.58	42.31	27.78
R:MORPH	13	13	56	50.00	18.84	37.57
R:NOUN	1	3	25	25.00	3.85	11.90
R:NOUN:INFL	5	4	2	55.56	71.43	58.14
R:NOUN:NUM	87	71	52	55.06	62.59	56.42
R:NOUN:POSS	0	0	5	100.00	0.00	0.00
R:ORTH	0	9	192	0.00	0.00	0.00
R:OTHER	18	61	328	22.78	5.20	13.60
R:PART	4	4	3	50.00	57.14	51.28
R:PREP	58	69	47	45.67	55.24	47.31
R:PRON	12	19	13	38.71	48.00	40.27
R:PUNCT	0	0	26	100.00	0.00	0.00
R:SPELL	89	37	26	70.63	77.39	71.89
R:VERB	0	5	61	0.00	0.00	0.00
R:VERB:FORM	49	48	35	50.52	58.33	51.91
R:VERB:INFL	3	0	0	100.00	100.00	100.00
R:VERB:SVA	66	18	13	78.57	83.54	79.52
R:VERB:TENSE	2	10	70	16.67	2.78	8.33
R:WO	0	1	17	0.00	0.00	0.00
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	0	8	100.00	0.00	0.00
U:CONJ	0	0	4	100.00	0.00	0.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	0	0	84	100.00	0.00	0.00
U:NOUN	0	0	9	100.00	0.00	0.00
U:NOUN:POSS	0	0	3	100.00	0.00	0.00
U:OTHER	0	0	6	100.00	0.00	0.00
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	0	1	24	0.00	0.00	0.00
U:PRON	0	0	13	100.00	0.00	0.00
U:PUNCT	22	49	6	30.99	78.57	35.26
U:VERB	0	0	5	100.00	0.00	0.00
U:VERB:FORM	0	0	2	100.00	0.00	0.00
U:VERB:TENSE	0	0	6	100.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	42	13	336	76.36	11.11	35.12
R	600	257	946	70.01	38.81	60.31
U	42	42	172	50.00	19.63	38.18
UNK	7	0	40	100.00	14.89	46.67

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	1	12	50.00	7.69	23.81
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	2	0	23	100.00	8.00	30.30
CONJ	3	8	5	27.27	37.50	28.85
CONTR	0	0	2	100.00	0.00	0.00
DET	43	48	188	47.25	18.61	36.13
MORPH	23	6	55	79.31	29.49	59.28
NOUN	13	1	37	92.86	26.00	61.32
NOUN:INFL	4	2	2	66.67	66.67	66.67
NOUN:NUM	73	51	50	58.87	59.35	58.97
NOUN:POSS	0	0	13	100.00	0.00	0.00
ORTH	15	5	183	75.00	7.58	26.98
OTHER	100	30	324	76.92	23.58	52.97
PART	5	2	6	71.43	45.45	64.10
PREP	83	37	101	69.17	45.11	62.50
PRON	16	14	46	53.33	25.81	43.96
PUNCT	62	55	142	52.99	30.39	46.13
SPELL	97	9	14	91.51	87.39	90.65
UNK	7	0	40	100.00	14.89	46.67
VERB	20	2	91	90.91	18.02	50.25
VERB:FORM	40	30	42	57.14	48.78	55.25
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	63	7	11	90.00	85.14	88.98
VERB:TENSE	18	3	87	85.71	17.14	47.62
WO	0	1	17	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	1	0	5	100.00	16.67	50.00
M:CONJ	2	0	1	100.00	66.67	90.91
M:DET	3	0	83	100.00	3.49	15.31
M:NOUN	0	0	3	100.00	0.00	0.00
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:OTHER	1	0	28	100.00	3.45	15.15
M:PREP	1	0	37	100.00	2.63	11.90
M:PRON	0	0	26	100.00	0.00	0.00
M:PUNCT	33	13	107	71.74	23.57	50.93
M:VERB	1	0	17	100.00	5.56	22.73
M:VERB:FORM	0	0	6	100.00	0.00	0.00
M:VERB:TENSE	0	0	17	100.00	0.00	0.00
R:ADJ	1	1	9	50.00	10.00	27.78
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	11	100.00	8.33	31.25
R:CONJ	0	8	0	0.00	100.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	35	48	21	42.17	62.50	45.10
R:MORPH	23	6	55	79.31	29.49	59.28
R:NOUN	12	1	25	92.31	32.43	67.42
R:NOUN:INFL	4	2	2	66.67	66.67	66.67
R:NOUN:NUM	73	51	50	58.87	59.35	58.97
R:NOUN:POSS	0	0	3	100.00	0.00	0.00
R:ORTH	15	5	183	75.00	7.58	26.98
R:OTHER	98	30	288	76.56	25.39	54.57
R:PART	5	2	4	71.43	55.56	67.57
R:PREP	78	37	45	67.83	63.41	66.90
R:PRON	14	14	11	50.00	56.00	51.09
R:PUNCT	7	0	28	100.00	20.00	55.56
R:SPELL	97	9	14	91.51	87.39	90.65
R:VERB	17	2	67	89.47	20.24	53.12
R:VERB:FORM	40	30	35	57.14	53.33	56.34
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	63	7	11	90.00	85.14	88.98
R:VERB:TENSE	14	3	63	82.35	18.18	48.28
R:WO	0	1	17	0.00	0.00	0.00
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	0	0	7	100.00	0.00	0.00
U:CONJ	1	0	4	100.00	20.00	55.56
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	5	0	84	100.00	5.62	22.94
U:NOUN	1	0	9	100.00	10.00	35.71
U:NOUN:POSS	0	0	5	100.00	0.00	0.00
U:OTHER	1	0	8	100.00	11.11	38.46
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	4	0	19	100.00	17.39	51.28
U:PRON	2	0	9	100.00	18.18	52.63
U:PUNCT	22	42	7	34.38	75.86	38.60
U:VERB	2	0	7	100.00	22.22	58.82
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	4	0	7	100.00	36.36	74.07
UNK	7	0	40	100.00	14.89	46.67

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	135	6	371	95.74	26.68	63.08
R	640	158	1111	80.20	36.55	64.74
U	54	38	230	58.70	19.01	41.41
UNK	25	0	81	100.00	23.58	60.68

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	1	19	50.00	5.00	17.86
ADJ:FORM	0	0	4	100.00	0.00	0.00
ADV	5	0	33	100.00	13.16	43.10
CONJ	5	2	10	71.43	33.33	58.14
CONTR	0	0	3	100.00	0.00	0.00
DET	55	37	208	59.78	20.91	43.58
MORPH	20	3	60	86.96	25.00	58.14
NOUN	12	0	56	100.00	17.65	51.72
NOUN:INFL	5	2	2	71.43	71.43	71.43
NOUN:NUM	70	35	57	66.67	55.12	63.99
NOUN:POSS	1	0	14	100.00	6.67	26.32
ORTH	19	4	195	82.61	8.88	31.05
OTHER	169	17	423	90.86	28.55	63.25
PART	3	1	6	75.00	33.33	60.00
PREP	88	21	115	80.73	43.35	68.86
PRON	23	12	46	65.71	33.33	55.02
PUNCT	100	44	153	69.44	39.53	60.31
SPELL	93	1	14	98.94	86.92	96.27
UNK	25	0	81	100.00	23.58	60.68
VERB	21	2	119	91.30	15.00	45.26
VERB:FORM	46	12	42	79.31	52.27	71.88
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	62	4	14	93.94	81.58	91.18
VERB:TENSE	24	1	98	96.00	19.67	54.05
WO	4	3	20	57.14	16.67	38.46

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	3	0	8	100.00	27.27	65.22
M:CONJ	2	0	5	100.00	28.57	66.67
M:DET	15	0	91	100.00	14.15	45.18
M:NOUN	0	0	7	100.00	0.00	0.00
M:NOUN:POSS	1	0	4	100.00	20.00	55.56
M:OTHER	10	0	34	100.00	22.73	59.52
M:PREP	9	0	38	100.00	19.15	54.22
M:PRON	8	0	26	100.00	23.53	60.61
M:PUNCT	71	6	113	92.21	38.59	72.15
M:VERB	3	0	25	100.00	10.71	37.50
M:VERB:FORM	9	0	2	100.00	81.82	95.74
M:VERB:TENSE	4	0	16	100.00	20.00	55.56
R:ADJ	1	1	13	50.00	7.14	22.73
R:ADJ:FORM	0	0	4	100.00	0.00	0.00
R:ADV	2	0	13	100.00	13.33	43.48
R:CONJ	0	2	0	0.00	100.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	35	37	21	48.61	62.50	50.87
R:MORPH	20	3	60	86.96	25.00	58.14
R:NOUN	11	0	33	100.00	25.00	62.50
R:NOUN:INFL	5	2	2	71.43	71.43	71.43
R:NOUN:NUM	70	35	57	66.67	55.12	63.99
R:NOUN:POSS	0	0	6	100.00	0.00	0.00
R:ORTH	19	4	195	82.61	8.88	31.05
R:OTHER	154	17	361	90.06	29.90	64.22
R:PART	2	1	4	66.67	33.33	55.56
R:PREP	71	21	53	77.17	57.26	72.15
R:PRON	13	12	12	52.00	52.00	52.00
R:PUNCT	6	0	32	100.00	15.79	48.39
R:SPELL	93	1	14	98.94	86.92	96.27
R:VERB	16	2	81	88.89	16.49	47.34
R:VERB:FORM	37	12	38	75.51	49.33	68.27
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	62	4	14	93.94	81.58	91.18
R:VERB:TENSE	16	1	76	94.12	17.39	50.00
R:WO	4	3	20	57.14	16.67	38.46
U:ADJ	0	0	4	100.00	0.00	0.00
U:ADV	0	0	12	100.00	0.00	0.00
U:CONJ	3	0	5	100.00	37.50	75.00
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	5	0	96	100.00	4.95	20.66
U:NOUN	1	0	16	100.00	5.88	23.81
U:NOUN:POSS	0	0	4	100.00	0.00	0.00
U:OTHER	5	0	28	100.00	15.15	47.17
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	8	0	24	100.00	25.00	62.50
U:PRON	2	0	8	100.00	20.00	55.56
U:PUNCT	23	38	8	37.70	74.19	41.82
U:VERB	2	0	13	100.00	13.33	43.48
U:VERB:FORM	0	0	2	100.00	0.00	0.00
U:VERB:TENSE	4	0	6	100.00	40.00	76.92
UNK	25	0	81	100.00	23.58	60.68

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	381	406	1032	48.41	26.96	41.77
Span-level detection	499	289	1008	63.32	33.11	53.55
Token-level detection	600	220	1304	73.17	31.51	57.87

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	42	9	274	82.35	13.29	40.38
R	310	358	645	46.41	32.46	42.74
U	29	39	113	42.65	20.42	35.02

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	0	10	100.00	0.00	0.00
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	0	0	15	100.00	0.00	0.00
CONJ	0	19	9	0.00	0.00	0.00
CONTR	0	0	2	100.00	0.00	0.00
DET	29	64	153	31.18	15.93	26.17
MORPH	4	6	33	40.00	10.81	25.97
NOUN	2	1	29	66.67	6.45	23.26
NOUN:INFL	0	3	0	0.00	100.00	0.00
NOUN:NUM	58	67	20	46.40	74.36	50.17
NOUN:POSS	0	0	14	100.00	0.00	0.00
ORTH	5	15	72	25.00	6.49	15.92
OTHER	9	32	191	21.95	4.50	12.36
PART	1	3	7	25.00	12.50	20.83
PREP	64	72	95	47.06	40.25	45.52
PRON	7	16	33	30.43	17.50	26.52
PUNCT	71	49	111	59.17	39.01	53.63
SPELL	51	16	23	76.12	68.92	74.56
VERB	1	7	67	12.50	1.47	5.00
VERB:FORM	31	18	35	63.27	46.97	59.16
VERB:SVA	41	12	8	77.36	83.67	78.54
VERB:TENSE	7	6	66	53.85	9.59	28.00
WO	0	0	37	100.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	0	4	100.00	0.00	0.00
M:CONJ	0	0	7	100.00	0.00	0.00
M:DET	0	0	87	100.00	0.00	0.00
M:NOUN	0	0	2	100.00	0.00	0.00
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:OTHER	0	0	12	100.00	0.00	0.00
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	0	0	25	100.00	0.00	0.00
M:PRON	0	0	20	100.00	0.00	0.00
M:PUNCT	42	9	85	82.35	33.07	63.44
M:VERB	0	0	9	100.00	0.00	0.00
M:VERB:FORM	0	0	1	100.00	0.00	0.00
M:VERB:TENSE	0	0	14	100.00	0.00	0.00
R:ADJ	0	0	9	100.00	0.00	0.00
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	0	0	7	100.00	0.00	0.00
R:CONJ	0	19	1	0.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	29	64	25	31.18	53.70	34.04
R:MORPH	4	6	33	40.00	10.81	25.97
R:NOUN	2	1	25	66.67	7.41	25.64
R:NOUN:INFL	0	3	0	0.00	100.00	0.00
R:NOUN:NUM	58	67	20	46.40	74.36	50.17
R:NOUN:POSS	0	0	4	100.00	0.00	0.00
R:ORTH	5	15	72	25.00	6.49	15.92
R:OTHER	9	32	167	21.95	5.11	13.24
R:PART	1	3	4	25.00	20.00	23.81
R:PREP	64	72	47	47.06	57.66	48.85
R:PRON	7	16	7	30.43	50.00	33.02
R:PUNCT	0	1	22	0.00	0.00	0.00
R:SPELL	51	16	23	76.12	68.92	74.56
R:VERB	1	7	51	12.50	1.92	5.95
R:VERB:FORM	31	18	32	63.27	49.21	59.85
R:VERB:SVA	41	12	8	77.36	83.67	78.54
R:VERB:TENSE	7	6	48	53.85	12.73	32.71
R:WO	0	0	37	100.00	0.00	0.00
U:ADV	0	0	4	100.00	0.00	0.00
U:CONJ	0	0	1	100.00	0.00	0.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	0	0	41	100.00	0.00	0.00
U:NOUN	0	0	2	100.00	0.00	0.00
U:NOUN:POSS	0	0	5	100.00	0.00	0.00
U:OTHER	0	0	12	100.00	0.00	0.00
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	0	0	23	100.00	0.00	0.00
U:PRON	0	0	6	100.00	0.00	0.00
U:PUNCT	29	39	4	42.65	87.88	47.54
U:VERB	0	0	7	100.00	0.00	0.00
U:VERB:FORM	0	0	2	100.00	0.00	0.00
U:VERB:TENSE	0	0	4	100.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	47	5	268	90.38	14.92	44.93
R	409	250	609	62.06	40.18	55.97
U	42	34	118	55.26	26.25	45.26
UNK	1	0	13	100.00	7.14	27.78

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	12	100.00	7.69	29.41
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	0	0	15	100.00	0.00	0.00
CONJ	1	19	8	5.00	11.11	5.62
CONTR	0	0	2	100.00	0.00	0.00
DET	43	47	145	47.78	22.87	39.23
MORPH	9	2	27	81.82	25.00	56.25
NOUN	11	1	36	91.67	23.40	57.89
NOUN:INFL	0	2	0	0.00	100.00	0.00
NOUN:NUM	58	53	20	52.25	74.36	55.56
NOUN:POSS	0	0	15	100.00	0.00	0.00
ORTH	12	12	71	50.00	14.46	33.52
OTHER	38	22	189	63.33	16.74	40.69
PART	2	3	9	40.00	18.18	32.26
PREP	83	54	81	60.58	50.61	58.29
PRON	8	14	32	36.36	20.00	31.25
PUNCT	72	40	107	64.29	40.22	57.42
SPELL	59	1	14	98.33	80.82	94.25
UNK	1	0	13	100.00	7.14	27.78
VERB	16	4	66	80.00	19.51	49.38
VERB:FORM	31	8	36	79.49	46.27	69.51
VERB:SVA	41	4	9	91.11	82.00	89.13
VERB:TENSE	13	3	63	81.25	17.11	46.43
WO	0	0	36	100.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	0	4	100.00	0.00	0.00
M:CONJ	1	0	5	100.00	16.67	50.00
M:DET	0	0	84	100.00	0.00	0.00
M:NOUN	1	0	2	100.00	33.33	71.43
M:NOUN:POSS	0	0	6	100.00	0.00	0.00
M:OTHER	0	0	14	100.00	0.00	0.00
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	1	0	24	100.00	4.00	17.24
M:PRON	0	0	20	100.00	0.00	0.00
M:PUNCT	43	5	82	89.58	34.40	67.82
M:VERB	1	0	10	100.00	9.09	33.33
M:VERB:FORM	0	0	1	100.00	0.00	0.00
M:VERB:TENSE	0	0	13	100.00	0.00	0.00
R:ADJ	1	0	10	100.00	9.09	33.33
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	0	0	7	100.00	0.00	0.00
R:CONJ	0	19	2	0.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	37	47	22	44.05	62.71	46.84
R:MORPH	9	2	27	81.82	25.00	56.25
R:NOUN	9	1	30	90.00	23.08	56.96
R:NOUN:INFL	0	2	0	0.00	100.00	0.00
R:NOUN:NUM	58	53	20	52.25	74.36	55.56
R:NOUN:POSS	0	0	4	100.00	0.00	0.00
R:ORTH	12	12	71	50.00	14.46	33.52
R:OTHER	38	22	160	63.33	19.19	43.38
R:PART	2	3	5	40.00	28.57	37.04
R:PREP	79	54	37	59.40	68.10	60.96
R:PRON	7	14	7	33.33	50.00	35.71
R:PUNCT	2	1	20	66.67	9.09	29.41
R:SPELL	59	1	14	98.33	80.82	94.25
R:VERB	12	4	48	75.00	20.00	48.39
R:VERB:FORM	31	8	33	79.49	48.44	70.45
R:VERB:SVA	41	4	9	91.11	82.00	89.13
R:VERB:TENSE	12	3	44	80.00	21.43	51.72
R:WO	0	0	36	100.00	0.00	0.00
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	0	4	100.00	0.00	0.00
U:CONJ	0	0	1	100.00	0.00	0.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	6	0	39	100.00	13.33	43.48
U:NOUN	1	0	4	100.00	20.00	55.56
U:NOUN:POSS	0	0	5	100.00	0.00	0.00
U:OTHER	0	0	15	100.00	0.00	0.00
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	3	0	20	100.00	13.04	42.86
U:PRON	1	0	5	100.00	16.67	50.00
U:PUNCT	27	34	5	44.26	84.38	48.91
U:VERB	3	0	8	100.00	27.27	65.22
U:VERB:FORM	0	0	2	100.00	0.00	0.00
U:VERB:TENSE	1	0	6	100.00	14.29	45.45
UNK	1	0	13	100.00	7.14	27.78

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	118	2	310	98.33	27.57	64.98
R	425	186	796	69.56	34.81	57.98
U	51	32	179	61.45	22.17	45.37
UNK	6	0	19	100.00	24.00	61.22

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	0	15	100.00	16.67	50.00
ADJ:FORM	0	0	3	100.00	0.00	0.00
ADV	1	0	20	100.00	4.76	20.00
CONJ	6	2	9	75.00	40.00	63.83
CONTR	0	0	2	100.00	0.00	0.00
DET	47	39	152	54.65	23.62	43.28
MORPH	9	2	30	81.82	23.08	54.22
NOUN	13	1	36	92.86	26.53	61.90
NOUN:INFL	0	2	0	0.00	100.00	0.00
NOUN:NUM	56	45	22	55.45	71.79	58.09
NOUN:POSS	3	0	18	100.00	14.29	45.45
ORTH	16	11	85	59.26	15.84	38.28
OTHER	63	16	319	79.75	16.49	45.13
PART	0	1	8	0.00	0.00	0.00
PREP	87	42	98	67.44	47.03	62.05
PRON	10	13	36	43.48	21.74	36.23
PUNCT	115	35	130	76.67	46.94	68.05
SPELL	57	0	15	100.00	79.17	95.00
UNK	6	0	19	100.00	24.00	61.22
VERB	18	3	97	85.71	15.65	45.23
VERB:FORM	29	4	41	87.88	41.43	71.78
VERB:SVA	38	3	13	92.68	74.51	88.37
VERB:TENSE	19	1	79	95.00	19.39	53.37
WO	4	0	57	100.00	6.56	25.97

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	0	1	100.00	66.67	90.91
M:ADV	1	0	7	100.00	12.50	41.67
M:CONJ	6	0	4	100.00	60.00	88.24
M:DET	4	0	90	100.00	4.26	18.18
M:NOUN	2	0	3	100.00	40.00	76.92
M:NOUN:POSS	2	0	5	100.00	28.57	66.67
M:OTHER	3	0	20	100.00	13.04	42.86
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	7	0	27	100.00	20.59	56.45
M:PRON	2	0	21	100.00	8.70	32.26
M:PUNCT	83	2	94	97.65	46.89	80.27
M:VERB	2	0	18	100.00	10.00	35.71
M:VERB:FORM	0	0	2	100.00	0.00	0.00
M:VERB:TENSE	4	0	16	100.00	20.00	55.56
R:ADJ	1	0	13	100.00	7.14	27.78
R:ADJ:FORM	0	0	3	100.00	0.00	0.00
R:ADV	0	0	7	100.00	0.00	0.00
R:CONJ	0	2	4	0.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	35	39	20	47.30	63.64	49.86
R:MORPH	9	2	30	81.82	23.08	54.22
R:NOUN	9	1	30	90.00	23.08	56.96
R:NOUN:INFL	0	2	0	0.00	100.00	0.00
R:NOUN:NUM	56	45	22	55.45	71.79	58.09
R:NOUN:POSS	1	0	7	100.00	12.50	41.67
R:ORTH	16	11	85	59.26	15.84	38.28
R:OTHER	56	16	244	77.78	18.67	47.62
R:PART	0	1	4	0.00	0.00	0.00
R:PREP	76	42	46	64.41	62.30	63.97
R:PRON	7	13	9	35.00	43.75	36.46
R:PUNCT	4	1	31	80.00	11.43	36.36
R:SPELL	57	0	15	100.00	79.17	95.00
R:VERB	13	3	65	81.25	16.67	45.77
R:VERB:FORM	29	4	36	87.88	44.62	73.60
R:VERB:SVA	38	3	13	92.68	74.51	88.37
R:VERB:TENSE	14	1	54	93.33	20.59	54.69
R:WO	4	0	57	100.00	6.56	25.97
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	0	6	100.00	0.00	0.00
U:CONJ	0	0	1	100.00	0.00	0.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	8	0	42	100.00	16.00	48.78
U:NOUN	2	0	3	100.00	40.00	76.92
U:NOUN:POSS	0	0	6	100.00	0.00	0.00
U:OTHER	4	0	55	100.00	6.78	26.67
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	4	0	25	100.00	13.79	44.44
U:PRON	1	0	6	100.00	14.29	45.45
U:PUNCT	28	32	5	46.67	84.85	51.28
U:VERB	3	0	14	100.00	17.65	51.72
U:VERB:FORM	0	0	3	100.00	0.00	0.00
U:VERB:TENSE	1	0	9	100.00	10.00	35.71
UNK	6	0	19	100.00	24.00	61.22

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	191	318	373	37.52	33.87	36.73
Span-level detection	242	267	377	47.54	39.10	45.57
Token-level detection	294	223	437	56.87	40.22	52.52

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	29	8	105	78.38	21.64	51.42
R	130	254	216	33.85	37.57	34.54
U	32	56	52	36.36	38.10	36.70

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	1	5	0.00	0.00	0.00
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	0	0	4	100.00	0.00	0.00
CONJ	0	12	4	0.00	0.00	0.00
CONTR	0	0	3	100.00	0.00	0.00
DET	13	46	67	22.03	16.25	20.57
MORPH	5	3	11	62.50	31.25	52.08
NOUN	0	1	15	0.00	0.00	0.00
NOUN:INFL	0	1	1	0.00	0.00	0.00
NOUN:NUM	25	49	11	33.78	69.44	37.65
NOUN:POSS	0	0	5	100.00	0.00	0.00
ORTH	0	14	33	0.00	0.00	0.00
OTHER	2	23	56	8.00	3.45	6.33
PART	2	2	1	50.00	66.67	52.63
PREP	29	56	42	34.12	40.85	35.28
PRON	5	8	9	38.46	35.71	37.88
PUNCT	61	64	36	48.80	62.89	51.09
SPELL	27	11	10	71.05	72.97	71.43
VERB	0	0	14	100.00	0.00	0.00
VERB:FORM	9	18	8	33.33	52.94	36.00
VERB:SVA	9	5	1	64.29	90.00	68.18
VERB:TENSE	4	4	24	50.00	14.29	33.33
WO	0	0	11	100.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	0	0	3	100.00	0.00	0.00
M:DET	0	0	34	100.00	0.00	0.00
M:NOUN	0	0	2	100.00	0.00	0.00
M:OTHER	0	0	7	100.00	0.00	0.00
M:PREP	0	0	16	100.00	0.00	0.00
M:PRON	0	0	5	100.00	0.00	0.00
M:PUNCT	29	8	31	78.38	48.33	69.71
M:VERB	0	0	2	100.00	0.00	0.00
M:VERB:FORM	0	0	1	100.00	0.00	0.00
M:VERB:TENSE	0	0	2	100.00	0.00	0.00
R:ADJ	0	1	3	0.00	0.00	0.00
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	0	0	1	100.00	0.00	0.00
R:CONJ	0	12	1	0.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	13	46	5	22.03	72.22	25.59
R:MORPH	5	3	11	62.50	31.25	52.08
R:NOUN	0	1	9	0.00	0.00	0.00
R:NOUN:INFL	0	1	1	0.00	0.00	0.00
R:NOUN:NUM	25	49	11	33.78	69.44	37.65
R:NOUN:POSS	0	0	4	100.00	0.00	0.00
R:ORTH	0	14	33	0.00	0.00	0.00
R:OTHER	2	23	46	8.00	4.17	6.76
R:PART	2	2	1	50.00	66.67	52.63
R:PREP	29	56	21	34.12	58.00	37.18
R:PRON	5	8	2	38.46	71.43	42.37
R:PUNCT	0	0	5	100.00	0.00	0.00
R:SPELL	27	11	10	71.05	72.97	71.43
R:VERB	0	0	11	100.00	0.00	0.00
R:VERB:FORM	9	18	7	33.33	56.25	36.29
R:VERB:SVA	9	5	1	64.29	90.00	68.18
R:VERB:TENSE	4	4	19	50.00	17.39	36.36
R:WO	0	0	11	100.00	0.00	0.00
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	0	2	100.00	0.00	0.00
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	0	0	28	100.00	0.00	0.00
U:NOUN	0	0	4	100.00	0.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	0	0	3	100.00	0.00	0.00
U:PREP	0	0	5	100.00	0.00	0.00
U:PRON	0	0	2	100.00	0.00	0.00
U:PUNCT	32	56	0	36.36	100.00	41.67
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	0	0	3	100.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	31	6	111	83.78	21.83	53.45
R	174	212	212	45.08	45.08	45.08
U	37	49	51	43.02	42.05	42.82
UNK	0	0	3	100.00	0.00	0.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	1	6	0.00	0.00	0.00
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	0	0	5	100.00	0.00	0.00
CONJ	0	12	5	0.00	0.00	0.00
CONTR	0	0	3	100.00	0.00	0.00
DET	17	40	69	29.82	19.77	27.07
MORPH	7	2	12	77.78	36.84	63.64
NOUN	1	0	17	100.00	5.56	22.73
NOUN:INFL	2	0	1	100.00	66.67	90.91
NOUN:NUM	24	48	12	33.33	66.67	37.04
NOUN:POSS	0	0	5	100.00	0.00	0.00
ORTH	2	13	37	13.33	5.13	10.10
OTHER	16	20	49	44.44	24.62	38.28
PART	2	2	2	50.00	50.00	50.00
PREP	41	45	35	47.67	53.95	48.81
PRON	5	7	8	41.67	38.46	40.98
PUNCT	67	55	44	54.92	60.36	55.93
SPELL	32	3	5	91.43	86.49	90.40
UNK	0	0	3	100.00	0.00	0.00
VERB	2	0	15	100.00	11.76	40.00
VERB:FORM	8	13	8	38.10	50.00	40.00
VERB:SVA	10	2	1	83.33	90.91	84.75
VERB:TENSE	6	4	23	60.00	20.69	43.48
WO	0	0	10	100.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	0	0	4	100.00	0.00	0.00
M:DET	0	0	36	100.00	0.00	0.00
M:NOUN	0	0	2	100.00	0.00	0.00
M:OTHER	0	0	8	100.00	0.00	0.00
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	1	0	14	100.00	6.67	26.32
M:PRON	0	0	4	100.00	0.00	0.00
M:PUNCT	30	6	35	83.33	46.15	71.77
M:VERB	0	0	2	100.00	0.00	0.00
M:VERB:FORM	0	0	1	100.00	0.00	0.00
M:VERB:TENSE	0	0	2	100.00	0.00	0.00
R:ADJ	0	1	4	0.00	0.00	0.00
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	0	0	2	100.00	0.00	0.00
R:CONJ	0	12	1	0.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	17	40	4	29.82	80.95	34.14
R:MORPH	7	2	12	77.78	36.84	63.64
R:NOUN	1	0	11	100.00	8.33	31.25
R:NOUN:INFL	2	0	1	100.00	66.67	90.91
R:NOUN:NUM	24	48	12	33.33	66.67	37.04
R:NOUN:POSS	0	0	4	100.00	0.00	0.00
R:ORTH	2	13	37	13.33	5.13	10.10
R:OTHER	16	20	39	44.44	29.09	40.20
R:PART	2	2	1	50.00	66.67	52.63
R:PREP	36	45	17	44.44	67.92	47.75
R:PRON	5	7	2	41.67	71.43	45.45
R:PUNCT	5	0	8	100.00	38.46	75.76
R:SPELL	32	3	5	91.43	86.49	90.40
R:VERB	2	0	12	100.00	14.29	45.45
R:VERB:FORM	8	13	7	38.10	53.33	40.40
R:VERB:SVA	10	2	1	83.33	90.91	84.75
R:VERB:TENSE	5	4	19	55.56	20.83	41.67
R:WO	0	0	10	100.00	0.00	0.00
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	0	2	100.00	0.00	0.00
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	0	0	29	100.00	0.00	0.00
U:NOUN	0	0	4	100.00	0.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	0	0	2	100.00	0.00	0.00
U:PREP	4	0	4	100.00	50.00	83.33
U:PRON	0	0	2	100.00	0.00	0.00
U:PUNCT	32	49	1	39.51	96.97	44.82
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	1	0	2	100.00	33.33	71.43
UNK	0	0	3	100.00	0.00	0.00

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	69	3	121	95.83	36.32	72.18
R	183	171	245	51.69	42.76	49.62
U	41	49	68	45.56	37.61	43.71
UNK	1	0	3	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	1	9	0.00	0.00	0.00
ADJ:FORM	0	0	3	100.00	0.00	0.00
ADV	0	0	8	100.00	0.00	0.00
CONJ	2	3	4	40.00	33.33	38.46
CONTR	0	0	4	100.00	0.00	0.00
DET	21	38	71	35.59	22.83	32.01
MORPH	7	1	11	87.50	38.89	70.00
NOUN	1	0	17	100.00	5.56	22.73
NOUN:INFL	2	0	1	100.00	66.67	90.91
NOUN:NUM	24	43	13	35.82	64.86	39.34
NOUN:POSS	1	0	6	100.00	14.29	45.45
ORTH	5	13	39	27.78	11.36	21.55
OTHER	27	12	79	69.23	25.47	51.53
PART	2	2	1	50.00	66.67	52.63
PREP	44	36	40	55.00	52.38	54.46
PRON	8	7	6	53.33	57.14	54.05
PUNCT	88	52	54	62.86	61.97	62.68
SPELL	32	2	5	94.12	86.49	92.49
UNK	1	0	3	100.00	25.00	62.50
VERB	3	0	18	100.00	14.29	45.45
VERB:FORM	10	8	9	55.56	52.63	54.95
VERB:SVA	10	2	2	83.33	83.33	83.33
VERB:TENSE	6	3	27	66.67	18.18	43.48
WO	0	0	7	100.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	3	100.00	0.00	0.00
M:ADV	0	0	2	100.00	0.00	0.00
M:CONJ	2	0	3	100.00	40.00	76.92
M:DET	4	0	35	100.00	10.26	36.36
M:NOUN	1	0	2	100.00	33.33	71.43
M:NOUN:POSS	1	0	0	100.00	100.00	100.00
M:OTHER	2	0	7	100.00	22.22	58.82
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	4	0	15	100.00	21.05	57.14
M:PRON	2	0	3	100.00	40.00	76.92
M:PUNCT	51	3	43	94.44	54.26	82.26
M:VERB	0	0	3	100.00	0.00	0.00
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	0	0	4	100.00	0.00	0.00
R:ADJ	0	1	3	0.00	0.00	0.00
R:ADJ:FORM	0	0	3	100.00	0.00	0.00
R:ADV	0	0	2	100.00	0.00	0.00
R:CONJ	0	3	1	0.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	15	38	4	28.30	78.95	32.47
R:MORPH	7	1	11	87.50	38.89	70.00
R:NOUN	0	0	11	100.00	0.00	0.00
R:NOUN:INFL	2	0	1	100.00	66.67	90.91
R:NOUN:NUM	24	43	13	35.82	64.86	39.34
R:NOUN:POSS	0	0	5	100.00	0.00	0.00
R:ORTH	5	13	39	27.78	11.36	21.55
R:OTHER	24	12	63	66.67	27.59	51.95
R:PART	2	2	0	50.00	100.00	55.56
R:PREP	36	36	18	50.00	66.67	52.63
R:PRON	5	7	2	41.67	71.43	45.45
R:PUNCT	5	0	10	100.00	33.33	71.43
R:SPELL	32	2	5	94.12	86.49	92.49
R:VERB	3	0	14	100.00	17.65	51.72
R:VERB:FORM	8	8	9	50.00	47.06	49.38
R:VERB:SVA	10	2	2	83.33	83.33	83.33
R:VERB:TENSE	5	3	21	62.50	19.23	43.10
R:WO	0	0	7	100.00	0.00	0.00
U:ADJ	0	0	3	100.00	0.00	0.00
U:ADV	0	0	4	100.00	0.00	0.00
U:CONTR	0	0	3	100.00	0.00	0.00
U:DET	2	0	32	100.00	5.88	23.81
U:NOUN	0	0	4	100.00	0.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	1	0	9	100.00	10.00	35.71
U:PREP	4	0	7	100.00	36.36	74.07
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	32	49	1	39.51	96.97	44.82
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	1	0	2	100.00	33.33	71.43
UNK	1	0	3	100.00	25.00	62.50

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	242	378	252	39.03	48.99	40.69
Span-level detection	287	333	252	46.29	53.25	47.53
Token-level detection	320	305	311	51.20	50.71	51.10

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	57	4	52	93.44	52.29	80.74
R	164	324	185	33.61	46.99	35.64
U	21	50	15	29.58	58.33	32.81

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	4	4	20.00	20.00	20.00
ADV	0	2	0	0.00	100.00	0.00
CONJ	1	4	1	20.00	50.00	22.73
CONTR	0	0	1	100.00	0.00	0.00
DET	4	90	8	4.26	33.33	5.15
MORPH	2	6	4	25.00	33.33	26.32
NOUN	3	1	7	75.00	30.00	57.69
NOUN:INFL	1	0	10	100.00	9.09	33.33
NOUN:NUM	24	62	7	27.91	77.42	32.00
NOUN:POSS	0	0	15	100.00	0.00	0.00
ORTH	0	6	47	0.00	0.00	0.00
OTHER	9	32	39	21.95	18.75	21.23
PART	0	2	1	0.00	0.00	0.00
PREP	20	65	11	23.53	64.52	26.95
PRON	4	11	2	26.67	66.67	30.30
PUNCT	78	54	47	59.09	62.40	59.72
SPELL	74	10	21	88.10	77.89	85.85
VERB	3	0	12	100.00	20.00	55.56
VERB:FORM	5	18	2	21.74	71.43	25.25
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	6	7	2	46.15	75.00	50.00
VERB:TENSE	4	3	8	57.14	33.33	50.00
WO	0	1	2	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	0	0	1	100.00	0.00	0.00
M:DET	0	0	6	100.00	0.00	0.00
M:NOUN	0	0	2	100.00	0.00	0.00
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:PREP	0	0	1	100.00	0.00	0.00
M:PRON	0	0	2	100.00	0.00	0.00
M:PUNCT	57	4	32	93.44	64.04	85.59
M:VERB	0	0	3	100.00	0.00	0.00
R:ADJ	1	4	4	20.00	20.00	20.00
R:ADV	0	2	0	0.00	100.00	0.00
R:CONJ	1	4	0	20.00	100.00	23.81
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	4	90	1	4.26	80.00	5.25
R:MORPH	2	6	4	25.00	33.33	26.32
R:NOUN	3	1	5	75.00	37.50	62.50
R:NOUN:INFL	1	0	10	100.00	9.09	33.33
R:NOUN:NUM	24	62	7	27.91	77.42	32.00
R:NOUN:POSS	0	0	10	100.00	0.00	0.00
R:ORTH	0	6	47	0.00	0.00	0.00
R:OTHER	9	32	39	21.95	18.75	21.23
R:PART	0	2	0	0.00	100.00	0.00
R:PREP	20	65	6	23.53	76.92	27.32
R:PRON	4	11	0	26.67	100.00	31.25
R:PUNCT	0	0	11	100.00	0.00	0.00
R:SPELL	74	10	21	88.10	77.89	85.85
R:VERB	3	0	7	100.00	30.00	68.18
R:VERB:FORM	5	18	1	21.74	83.33	25.51
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	6	7	2	46.15	75.00	50.00
R:VERB:TENSE	4	3	6	57.14	40.00	52.63
R:WO	0	1	2	0.00	0.00	0.00
U:DET	0	0	1	100.00	0.00	0.00
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	0	0	4	100.00	0.00	0.00
U:PUNCT	21	50	4	29.58	84.00	33.98
U:VERB	0	0	2	100.00	0.00	0.00
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	0	0	2	100.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	57	4	61	93.44	48.31	78.73
R	207	282	176	42.33	54.05	44.25
U	23	47	13	32.86	63.89	36.39
UNK	0	0	2	100.00	0.00	0.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	3	5	25.00	16.67	22.73
ADV	0	2	0	0.00	100.00	0.00
CONJ	1	4	3	20.00	25.00	20.83
CONTR	0	0	1	100.00	0.00	0.00
DET	6	86	9	6.52	40.00	7.83
MORPH	2	6	4	25.00	33.33	26.32
NOUN	5	1	8	83.33	38.46	67.57
NOUN:INFL	1	0	10	100.00	9.09	33.33
NOUN:NUM	22	53	6	29.33	78.57	33.54
NOUN:POSS	7	0	11	100.00	38.89	76.09
ORTH	6	6	47	50.00	11.32	29.70
OTHER	22	27	36	44.90	37.93	43.31
PART	0	2	0	0.00	100.00	0.00
PREP	27	57	10	32.14	72.97	36.19
PRON	5	9	2	35.71	71.43	39.68
PUNCT	81	51	55	61.36	59.56	60.99
SPELL	78	1	17	98.73	82.11	94.89
UNK	0	0	2	100.00	0.00	0.00
VERB	3	0	12	100.00	20.00	55.56
VERB:FORM	6	17	2	26.09	75.00	30.00
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	7	5	2	58.33	77.78	61.40
VERB:TENSE	4	2	7	66.67	36.36	57.14
WO	0	1	2	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	0	0	2	100.00	0.00	0.00
M:DET	0	0	6	100.00	0.00	0.00
M:NOUN	0	0	2	100.00	0.00	0.00
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:PREP	0	0	3	100.00	0.00	0.00
M:PRON	0	0	2	100.00	0.00	0.00
M:PUNCT	57	4	38	93.44	60.00	84.07
M:VERB	0	0	3	100.00	0.00	0.00
R:ADJ	1	3	5	25.00	16.67	22.73
R:ADV	0	2	0	0.00	100.00	0.00
R:CONJ	1	4	0	20.00	100.00	23.81
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	6	86	1	6.52	85.71	8.00
R:MORPH	2	6	4	25.00	33.33	26.32
R:NOUN	5	1	6	83.33	45.45	71.43
R:NOUN:INFL	1	0	10	100.00	9.09	33.33
R:NOUN:NUM	22	53	6	29.33	78.57	33.54
R:NOUN:POSS	7	0	6	100.00	53.85	85.37
R:ORTH	6	6	47	50.00	11.32	29.70
R:OTHER	22	27	36	44.90	37.93	43.31
R:PART	0	2	0	0.00	100.00	0.00
R:PREP	26	57	5	31.33	83.87	35.81
R:PRON	5	9	0	35.71	100.00	40.98
R:PUNCT	3	0	13	100.00	18.75	53.57
R:SPELL	78	1	17	98.73	82.11	94.89
R:VERB	3	0	7	100.00	30.00	68.18
R:VERB:FORM	5	17	2	22.73	71.43	26.32
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	7	5	2	58.33	77.78	61.40
R:VERB:TENSE	4	2	5	66.67	44.44	60.61
R:WO	0	1	2	0.00	0.00	0.00
U:CONJ	0	0	1	100.00	0.00	0.00
U:DET	0	0	2	100.00	0.00	0.00
U:PREP	1	0	2	100.00	33.33	71.43
U:PUNCT	21	47	4	30.88	84.00	35.35
U:VERB	0	0	2	100.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	0	0	2	100.00	0.00	0.00
UNK	0	0	2	100.00	0.00	0.00

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	77	4	71	95.06	52.03	81.57
R	216	256	221	45.76	49.43	46.45
U	26	45	18	36.62	59.09	39.63
UNK	1	0	1	100.00	50.00	83.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	3	6	25.00	14.29	21.74
ADV	0	2	0	0.00	100.00	0.00
CONJ	1	3	3	25.00	25.00	25.00
CONTR	0	0	3	100.00	0.00	0.00
DET	9	82	11	9.89	45.00	11.72
MORPH	2	6	5	25.00	28.57	25.64
NOUN	6	1	10	85.71	37.50	68.18
NOUN:INFL	1	0	10	100.00	9.09	33.33
NOUN:NUM	22	48	9	31.43	70.97	35.37
NOUN:POSS	7	0	14	100.00	33.33	71.43
ORTH	10	6	60	62.50	14.29	37.31
OTHER	28	20	50	58.33	35.90	51.85
PART	0	2	0	0.00	100.00	0.00
PREP	29	53	12	35.37	70.73	39.30
PRON	6	8	1	42.86	85.71	47.62
PUNCT	96	49	69	66.21	58.18	64.43
SPELL	77	0	17	100.00	81.91	95.77
UNK	1	0	1	100.00	50.00	83.33
VERB	3	0	13	100.00	18.75	53.57
VERB:FORM	7	14	2	33.33	77.78	37.63
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	7	4	3	63.64	70.00	64.81
VERB:TENSE	4	2	9	66.67	30.77	54.05
WO	0	2	2	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	1	0	2	100.00	33.33	71.43
M:DET	0	0	7	100.00	0.00	0.00
M:NOUN	1	0	2	100.00	33.33	71.43
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:PREP	2	0	3	100.00	40.00	76.92
M:PRON	1	0	1	100.00	50.00	83.33
M:PUNCT	72	4	48	94.74	60.00	84.91
M:VERB	0	0	3	100.00	0.00	0.00
R:ADJ	1	3	5	25.00	16.67	22.73
R:ADV	0	2	0	0.00	100.00	0.00
R:CONJ	0	3	0	0.00	100.00	0.00
R:CONTR	0	0	3	100.00	0.00	0.00
R:DET	8	82	2	8.89	80.00	10.81
R:MORPH	2	6	5	25.00	28.57	25.64
R:NOUN	4	1	7	80.00	36.36	64.52
R:NOUN:INFL	1	0	10	100.00	9.09	33.33
R:NOUN:NUM	22	48	9	31.43	70.97	35.37
R:NOUN:POSS	7	0	9	100.00	43.75	79.55
R:ORTH	10	6	60	62.50	14.29	37.31
R:OTHER	27	20	46	57.45	36.99	51.72
R:PART	0	2	0	0.00	100.00	0.00
R:PREP	26	53	7	32.91	78.79	37.25
R:PRON	5	8	0	38.46	100.00	43.86
R:PUNCT	3	0	17	100.00	15.00	46.88
R:SPELL	77	0	17	100.00	81.91	95.77
R:VERB	3	0	8	100.00	27.27	65.22
R:VERB:FORM	6	14	2	30.00	75.00	34.09
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	7	4	3	63.64	70.00	64.81
R:VERB:TENSE	4	2	8	66.67	33.33	55.56
R:WO	0	2	2	0.00	0.00	0.00
U:ADJ	0	0	1	100.00	0.00	0.00
U:CONJ	0	0	1	100.00	0.00	0.00
U:DET	1	0	2	100.00	33.33	71.43
U:NOUN	1	0	1	100.00	50.00	83.33
U:OTHER	1	0	4	100.00	20.00	55.56
U:PREP	1	0	2	100.00	33.33	71.43
U:PUNCT	21	45	4	31.82	84.00	36.33
U:VERB	0	0	2	100.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	0	0	1	100.00	0.00	0.00
UNK	1	0	1	100.00	50.00	83.33

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:47:45+00:00
Competition submission:	5
Competition phase:	3 - Open phase

Detailed results

Submission information

Results