BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	2929	1459	2502	66.75	53.93	63.72
Span-level detection	3403	997	2283	77.34	59.85	73.07
Token-level detection	4220	692	2630	85.91	61.61	79.63

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	1026	487	509	67.81	66.84	67.62
R	1593	808	1754	66.35	47.59	61.50
U	310	164	239	65.40	56.47	63.39

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	17	14	28	54.84	37.78	50.30
ADJ:FORM	6	3	4	66.67	60.00	65.22
ADV	32	25	38	56.14	45.71	53.69
CONJ	7	11	18	38.89	28.00	36.08
CONTR	14	6	0	70.00	100.00	74.47
DET	409	177	240	69.80	63.02	68.33
MORPH	89	27	61	76.72	59.33	72.48
NOUN	35	62	91	36.08	27.78	34.05
NOUN:INFL	5	2	15	71.43	25.00	52.08
NOUN:NUM	185	75	74	71.15	71.43	71.21
NOUN:POSS	28	9	26	75.68	51.85	69.31
ORTH	208	25	183	89.27	53.20	78.61
OTHER	164	236	546	41.00	23.10	35.50
PART	25	10	8	71.43	75.76	72.25
PREP	248	156	208	61.39	54.39	59.85
PRON	66	32	78	67.35	45.83	61.57
PUNCT	720	269	280	72.80	72.00	72.64
SPELL	162	36	149	81.82	52.09	73.44
VERB	63	73	178	46.32	26.14	40.13
VERB:FORM	147	53	54	73.50	73.13	73.43
VERB:INFL	5	0	3	100.00	62.50	89.29
VERB:SVA	128	35	28	78.53	82.05	79.21
VERB:TENSE	125	88	147	58.69	45.96	55.60
WO	41	35	45	53.95	47.67	52.56

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	2	5	60.00	37.50	53.57
M:ADV	6	8	14	42.86	30.00	39.47
M:CONJ	4	9	12	30.77	25.00	29.41
M:CONTR	1	3	0	25.00	100.00	29.41
M:DET	211	90	92	70.10	69.64	70.01
M:NOUN	2	12	8	14.29	20.00	15.15
M:NOUN:POSS	8	5	6	61.54	57.14	60.61
M:OTHER	28	46	38	37.84	42.42	38.67
M:PART	4	1	0	80.00	100.00	83.33
M:PREP	61	45	46	57.55	57.01	57.44
M:PRON	38	22	37	63.33	50.67	60.32
M:PUNCT	600	205	207	74.53	74.35	74.50
M:VERB	16	17	21	48.48	43.24	47.34
M:VERB:FORM	15	3	2	83.33	88.24	84.27
M:VERB:TENSE	29	19	21	60.42	58.00	59.92
R:ADJ	11	9	18	55.00	37.93	50.46
R:ADJ:FORM	6	3	4	66.67	60.00	65.22
R:ADV	13	6	12	68.42	52.00	64.36
R:CONJ	1	0	2	100.00	33.33	71.43
R:CONTR	5	1	0	83.33	100.00	86.21
R:DET	46	29	65	61.33	41.44	55.96
R:MORPH	89	27	61	76.72	59.33	72.48
R:NOUN	30	37	71	44.78	29.70	40.65
R:NOUN:INFL	5	2	15	71.43	25.00	52.08
R:NOUN:NUM	185	75	74	71.15	71.43	71.21
R:NOUN:POSS	11	2	15	84.62	42.31	70.51
R:ORTH	208	25	183	89.27	53.20	78.61
R:OTHER	127	169	491	42.91	20.55	35.24
R:PART	18	9	6	66.67	75.00	68.18
R:PREP	147	93	130	61.25	53.07	59.42
R:PRON	18	6	29	75.00	38.30	62.94
R:PUNCT	88	53	46	62.41	65.67	63.04
R:SPELL	162	36	149	81.82	52.09	73.44
R:VERB	39	44	140	46.99	21.79	38.16
R:VERB:FORM	128	50	50	71.91	71.91	71.91
R:VERB:INFL	5	0	3	100.00	62.50	89.29
R:VERB:SVA	128	35	28	78.53	82.05	79.21
R:VERB:TENSE	82	62	117	56.94	41.21	52.90
R:WO	41	35	45	53.95	47.67	52.56
U:ADJ	3	3	5	50.00	37.50	46.88
U:ADV	13	11	12	54.17	52.00	53.72
U:CONJ	2	2	4	50.00	33.33	45.45
U:CONTR	8	2	0	80.00	100.00	83.33
U:DET	152	58	83	72.38	64.68	70.70
U:NOUN	3	13	12	18.75	20.00	18.99
U:NOUN:POSS	9	2	5	81.82	64.29	77.59
U:OTHER	9	21	17	30.00	34.62	30.82
U:PART	3	0	2	100.00	60.00	88.24
U:PREP	40	18	32	68.97	55.56	65.79
U:PRON	10	4	12	71.43	45.45	64.10
U:PUNCT	32	11	27	74.42	54.24	69.26
U:VERB	8	12	17	40.00	32.00	38.10
U:VERB:FORM	4	0	2	100.00	66.67	90.91
U:VERB:TENSE	14	7	9	66.67	60.87	65.42

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	1137	378	446	75.05	71.83	74.38
R	1912	485	1522	79.77	55.68	73.41
U	342	134	244	71.85	58.36	68.67
UNK	12	0	71	100.00	14.46	45.80

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	25	9	29	73.53	46.30	65.79
ADJ:FORM	4	4	5	50.00	44.44	48.78
ADV	34	22	40	60.71	45.95	57.05
CONJ	12	8	18	60.00	40.00	54.55
CONTR	12	4	0	75.00	100.00	78.95
DET	448	141	213	76.06	67.78	74.25
MORPH	95	14	62	87.16	60.51	80.10
NOUN	49	34	84	59.04	36.84	52.69
NOUN:INFL	8	1	11	88.89	42.11	72.73
NOUN:NUM	189	58	60	76.52	75.90	76.39
NOUN:POSS	29	8	25	78.38	53.70	71.78
ORTH	235	18	153	92.89	60.57	83.93
OTHER	327	122	443	72.83	42.47	63.72
PART	27	8	12	77.14	69.23	75.42
PREP	287	102	190	73.78	60.17	70.59
PRON	86	22	68	79.63	55.84	73.38
PUNCT	758	228	267	76.88	73.95	76.27
SPELL	198	3	109	98.51	64.50	89.11
UNK	12	0	71	100.00	14.46	45.80
VERB	105	42	157	71.43	40.08	61.76
VERB:FORM	144	34	56	80.90	72.00	78.95
VERB:INFL	6	0	2	100.00	75.00	93.75
VERB:SVA	133	22	27	85.81	83.13	85.26
VERB:TENSE	146	63	136	69.86	51.77	65.30
WO	34	30	45	53.12	43.04	50.75

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	4	2	6	66.67	40.00	58.82
M:ADV	7	7	14	50.00	33.33	45.45
M:CONJ	7	7	12	50.00	36.84	46.67
M:CONTR	0	2	0	0.00	100.00	0.00
M:DET	231	67	75	77.52	75.49	77.10
M:NOUN	6	8	7	42.86	46.15	43.48
M:NOUN:POSS	8	4	7	66.67	53.33	63.49
M:OTHER	48	26	33	64.86	59.26	63.66
M:PART	5	1	2	83.33	71.43	80.65
M:PREP	74	31	38	70.48	66.07	69.55
M:PRON	51	15	28	77.27	64.56	74.34
M:PUNCT	624	178	188	77.81	76.85	77.61
M:VERB	24	12	17	66.67	58.54	64.86
M:VERB:FORM	16	2	1	88.89	94.12	89.89
M:VERB:TENSE	32	16	18	66.67	64.00	66.12
R:ADJ	18	5	18	78.26	50.00	70.31
R:ADJ:FORM	4	4	5	50.00	44.44	48.78
R:ADV	14	3	13	82.35	51.85	73.68
R:CONJ	1	0	1	100.00	50.00	83.33
R:CONTR	4	1	0	80.00	100.00	83.33
R:DET	54	26	63	67.50	46.15	61.78
R:MORPH	95	14	62	87.16	60.51	80.10
R:NOUN	39	15	63	72.22	38.24	61.32
R:NOUN:INFL	8	1	11	88.89	42.11	72.73
R:NOUN:NUM	189	58	60	76.52	75.90	76.39
R:NOUN:POSS	12	2	13	85.71	48.00	74.07
R:ORTH	235	18	153	92.89	60.57	83.93
R:OTHER	268	75	389	78.13	40.79	66.04
R:PART	19	7	7	73.08	73.08	73.08
R:PREP	171	58	123	74.67	58.16	70.66
R:PRON	22	4	26	84.62	45.83	72.37
R:PUNCT	98	42	44	70.00	69.01	69.80
R:SPELL	198	3	109	98.51	64.50	89.11
R:VERB	71	21	126	77.17	36.04	62.83
R:VERB:FORM	124	32	53	79.49	70.06	77.40
R:VERB:INFL	6	0	2	100.00	75.00	93.75
R:VERB:SVA	133	22	27	85.81	83.13	85.26
R:VERB:TENSE	95	44	109	68.35	46.57	62.50
R:WO	34	30	45	53.12	43.04	50.75
U:ADJ	3	2	5	60.00	37.50	53.57
U:ADV	13	12	13	52.00	50.00	51.59
U:CONJ	4	1	5	80.00	44.44	68.97
U:CONTR	8	1	0	88.89	100.00	90.91
U:DET	163	48	75	77.25	68.49	75.32
U:NOUN	4	11	14	26.67	22.22	25.64
U:NOUN:POSS	9	2	5	81.82	64.29	77.59
U:OTHER	11	21	21	34.38	34.38	34.38
U:PART	3	0	3	100.00	50.00	83.33
U:PREP	42	13	29	76.36	59.15	72.16
U:PRON	13	3	14	81.25	48.15	71.43
U:PUNCT	36	8	35	81.82	50.70	72.87
U:VERB	10	9	14	52.63	41.67	50.00
U:VERB:FORM	4	0	2	100.00	66.67	90.91
U:VERB:TENSE	19	3	9	86.36	67.86	81.90
UNK	12	0	71	100.00	14.46	45.80

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	1261	238	461	84.12	73.23	81.69
R	2509	360	1782	87.45	58.47	79.56
U	409	94	311	81.31	56.81	74.85
UNK	41	0	76	100.00	35.04	72.95

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	31	7	28	81.58	52.54	73.46
ADJ:FORM	6	3	5	66.67	54.55	63.83
ADV	44	10	42	81.48	51.16	72.85
CONJ	19	4	18	82.61	51.35	73.64
CONTR	11	3	4	78.57	73.33	77.46
DET	468	103	218	81.96	68.22	78.79
MORPH	95	5	55	95.00	63.33	86.36
NOUN	64	20	99	76.19	39.26	64.13
NOUN:INFL	8	1	11	88.89	42.11	72.73
NOUN:NUM	186	39	65	82.67	74.10	80.80
NOUN:POSS	41	4	30	91.11	57.75	81.67
ORTH	331	13	161	96.22	67.28	88.60
OTHER	622	119	641	83.94	49.25	73.57
PART	22	2	9	91.67	70.97	86.61
PREP	308	69	201	81.70	60.51	76.35
PRON	99	13	55	88.39	64.29	82.23
PUNCT	895	151	281	85.56	76.11	83.49
SPELL	204	0	105	100.00	66.02	90.67
UNK	41	0	76	100.00	35.04	72.95
VERB	144	26	194	84.71	42.60	70.73
VERB:FORM	155	18	56	89.60	73.46	85.83
VERB:INFL	6	0	2	100.00	75.00	93.75
VERB:SVA	132	13	27	91.03	83.02	89.31
VERB:TENSE	182	44	166	80.53	52.30	72.68
WO	106	25	81	80.92	56.68	74.54

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	4	1	5	80.00	44.44	68.97
M:ADV	11	3	11	78.57	50.00	70.51
M:CONJ	15	2	10	88.24	60.00	80.65
M:CONTR	0	2	0	0.00	100.00	0.00
M:DET	238	37	76	86.55	75.80	84.16
M:NOUN	9	6	12	60.00	42.86	55.56
M:NOUN:POSS	9	4	7	69.23	56.25	66.18
M:OTHER	47	21	35	69.12	57.32	66.38
M:PART	6	0	1	100.00	85.71	96.77
M:PREP	78	16	44	82.98	63.93	78.31
M:PRON	60	8	19	88.24	75.95	85.47
M:PUNCT	699	124	193	84.93	78.36	83.53
M:VERB	29	7	26	80.56	52.73	72.86
M:VERB:FORM	19	0	1	100.00	95.00	98.96
M:VERB:TENSE	37	7	21	84.09	63.79	79.06
R:ADJ	23	4	16	85.19	58.97	78.23
R:ADJ:FORM	6	3	5	66.67	54.55	63.83
R:ADV	16	3	17	84.21	48.48	73.39
R:CONJ	0	1	6	0.00	0.00	0.00
R:CONTR	4	0	2	100.00	66.67	90.91
R:DET	59	20	60	74.68	49.58	67.82
R:MORPH	95	5	55	95.00	63.33	86.36
R:NOUN	50	10	71	83.33	41.32	69.25
R:NOUN:INFL	8	1	11	88.89	42.11	72.73
R:NOUN:NUM	186	39	65	82.67	74.10	80.80
R:NOUN:POSS	23	0	16	100.00	58.97	87.79
R:ORTH	331	13	161	96.22	67.28	88.60
R:OTHER	542	80	540	87.14	50.09	75.91
R:PART	14	2	5	87.50	73.68	84.34
R:PREP	187	46	124	80.26	60.13	75.22
R:PRON	25	2	25	92.59	50.00	79.11
R:PUNCT	135	24	53	84.91	71.81	81.92
R:SPELL	204	0	105	100.00	66.02	90.67
R:VERB	98	15	149	86.73	39.68	70.10
R:VERB:FORM	132	18	52	88.00	71.74	84.18
R:VERB:INFL	6	0	2	100.00	75.00	93.75
R:VERB:SVA	132	13	27	91.03	83.02	89.31
R:VERB:TENSE	127	36	134	77.91	48.66	69.55
R:WO	106	25	81	80.92	56.68	74.54
U:ADJ	4	2	7	66.67	36.36	57.14
U:ADV	17	4	14	80.95	54.84	73.91
U:CONJ	4	1	2	80.00	66.67	76.92
U:CONTR	7	1	2	87.50	77.78	85.37
U:DET	171	46	82	78.80	67.59	76.27
U:NOUN	5	4	16	55.56	23.81	43.86
U:NOUN:POSS	9	0	7	100.00	56.25	86.54
U:OTHER	33	18	66	64.71	33.33	54.46
U:PART	2	0	3	100.00	40.00	76.92
U:PREP	43	7	33	86.00	56.58	77.90
U:PRON	14	3	11	82.35	56.00	75.27
U:PUNCT	61	3	35	95.31	63.54	86.65
U:VERB	17	4	19	80.95	47.22	70.83
U:VERB:FORM	4	0	3	100.00	57.14	86.96
U:VERB:TENSE	18	1	11	94.74	62.07	85.71
UNK	41	0	76	100.00	35.04	72.95

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1263	663	1141	65.58	52.54	62.48
Span-level detection	1509	421	1002	78.19	60.10	73.75
Token-level detection	1926	229	1134	89.37	62.94	82.45

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	377	232	231	61.90	62.01	61.93
R	761	366	796	67.52	48.88	62.74
U	125	65	114	65.79	52.30	62.56

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	4	10	42.86	23.08	36.59
ADJ:FORM	3	2	2	60.00	60.00	60.00
ADV	14	12	19	53.85	42.42	51.09
CONJ	3	3	8	50.00	27.27	42.86
CONTR	7	4	0	63.64	100.00	68.63
DET	169	76	117	68.98	59.09	66.75
MORPH	49	19	33	72.06	59.76	69.21
NOUN	11	28	46	28.21	19.30	25.82
NOUN:INFL	4	1	3	80.00	57.14	74.07
NOUN:NUM	94	39	38	70.68	71.21	70.78
NOUN:POSS	9	1	5	90.00	64.29	83.33
ORTH	118	11	92	91.47	56.19	81.27
OTHER	79	121	281	39.50	21.94	34.05
PART	14	5	3	73.68	82.35	75.27
PREP	105	57	88	64.81	54.40	62.43
PRON	36	15	46	70.59	43.90	62.94
PUNCT	233	117	111	66.57	67.73	66.80
SPELL	76	20	33	79.17	69.72	77.08
VERB	30	35	84	46.15	26.32	40.11
VERB:FORM	72	23	28	75.79	72.00	75.00
VERB:INFL	2	0	1	100.00	66.67	90.91
VERB:SVA	65	17	14	79.27	82.28	79.85
VERB:TENSE	56	40	67	58.33	45.53	55.23
WO	11	13	12	45.83	47.83	46.22

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	1	100.00	50.00	83.33
M:ADV	2	5	7	28.57	22.22	27.03
M:CONJ	1	2	5	33.33	16.67	27.78
M:CONTR	1	3	0	25.00	100.00	29.41
M:DET	81	45	42	64.29	65.85	64.59
M:NOUN	1	5	3	16.67	25.00	17.86
M:NOUN:POSS	2	0	2	100.00	50.00	83.33
M:OTHER	20	26	19	43.48	51.28	44.84
M:PART	2	1	0	66.67	100.00	71.43
M:PREP	31	19	21	62.00	59.62	61.51
M:PRON	20	12	20	62.50	50.00	59.52
M:PUNCT	183	92	89	66.55	67.28	66.69
M:VERB	7	9	13	43.75	35.00	41.67
M:VERB:FORM	11	3	1	78.57	91.67	80.88
M:VERB:TENSE	14	10	8	58.33	63.64	59.32
R:ADJ	0	2	7	0.00	0.00	0.00
R:ADJ:FORM	3	2	2	60.00	60.00	60.00
R:ADV	6	2	6	75.00	50.00	68.18
R:CONJ	1	0	0	100.00	100.00	100.00
R:CONTR	2	0	0	100.00	100.00	100.00
R:DET	20	14	24	58.82	45.45	55.56
R:MORPH	49	19	33	72.06	59.76	69.21
R:NOUN	9	16	35	36.00	20.45	31.25
R:NOUN:INFL	4	1	3	80.00	57.14	74.07
R:NOUN:NUM	94	39	38	70.68	71.21	70.78
R:NOUN:POSS	3	1	2	75.00	60.00	71.43
R:ORTH	118	11	92	91.47	56.19	81.27
R:OTHER	59	86	256	40.69	18.73	32.96
R:PART	11	4	2	73.33	84.62	75.34
R:PREP	56	32	54	63.64	50.91	60.61
R:PRON	12	1	18	92.31	40.00	73.17
R:PUNCT	44	21	16	67.69	73.33	68.75
R:SPELL	76	20	33	79.17	69.72	77.08
R:VERB	17	18	63	48.57	21.25	38.64
R:VERB:FORM	60	20	27	75.00	68.97	73.71
R:VERB:INFL	2	0	1	100.00	66.67	90.91
R:VERB:SVA	65	17	14	79.27	82.28	79.85
R:VERB:TENSE	39	27	58	59.09	40.21	54.02
R:WO	11	13	12	45.83	47.83	46.22
U:ADJ	2	2	2	50.00	50.00	50.00
U:ADV	6	5	6	54.55	50.00	53.57
U:CONJ	1	1	3	50.00	25.00	41.67
U:CONTR	4	1	0	80.00	100.00	83.33
U:DET	68	17	51	80.00	57.14	74.07
U:NOUN	1	7	8	12.50	11.11	12.20
U:NOUN:POSS	4	0	1	100.00	80.00	95.24
U:OTHER	0	9	6	0.00	0.00	0.00
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	18	6	13	75.00	58.06	70.87
U:PRON	4	2	8	66.67	33.33	55.56
U:PUNCT	6	4	6	60.00	50.00	57.69
U:VERB	6	8	8	42.86	42.86	42.86
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	3	3	1	50.00	75.00	53.57

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	433	172	184	71.57	70.18	71.29
R	921	197	660	82.38	58.25	76.08
U	148	52	106	74.00	58.27	70.21
UNK	7	0	52	100.00	11.86	40.23

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	3	11	66.67	35.29	56.60
ADJ:FORM	2	2	3	50.00	40.00	47.62
ADV	13	11	18	54.17	41.94	51.18
CONJ	7	2	9	77.78	43.75	67.31
CONTR	5	3	0	62.50	100.00	67.57
DET	196	58	95	77.17	67.35	74.98
MORPH	56	10	34	84.85	62.22	79.10
NOUN	15	12	40	55.56	27.27	46.01
NOUN:INFL	6	1	0	85.71	100.00	88.24
NOUN:NUM	98	30	30	76.56	76.56	76.56
NOUN:POSS	9	1	5	90.00	64.29	83.33
ORTH	134	6	64	95.71	67.68	88.39
OTHER	171	57	216	75.00	44.19	65.82
PART	14	3	4	82.35	77.78	81.40
PREP	128	29	77	81.53	62.44	76.83
PRON	44	10	40	81.48	52.38	73.33
PUNCT	241	99	99	70.88	70.88	70.88
SPELL	90	2	16	97.83	84.91	94.94
UNK	7	0	52	100.00	11.86	40.23
VERB	52	19	73	73.24	41.60	63.57
VERB:FORM	69	15	28	82.14	71.13	79.68
VERB:INFL	2	0	1	100.00	66.67	90.91
VERB:SVA	67	9	14	88.16	82.72	87.01
VERB:TENSE	68	28	61	70.83	52.71	66.28
WO	9	11	12	45.00	42.86	44.55

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	1	100.00	50.00	83.33
M:ADV	2	4	7	33.33	22.22	30.30
M:CONJ	3	2	5	60.00	37.50	53.57
M:CONTR	0	2	0	0.00	100.00	0.00
M:DET	94	35	30	72.87	75.81	73.44
M:NOUN	2	3	2	40.00	50.00	41.67
M:NOUN:POSS	2	0	3	100.00	40.00	76.92
M:OTHER	28	15	16	65.12	63.64	64.81
M:PART	2	1	0	66.67	100.00	71.43
M:PREP	40	11	17	78.43	70.18	76.63
M:PRON	25	8	16	75.76	60.98	72.25
M:PUNCT	191	76	73	71.54	72.35	71.70
M:VERB	14	4	9	77.78	60.87	73.68
M:VERB:FORM	12	2	1	85.71	92.31	86.96
M:VERB:TENSE	17	9	4	65.38	80.95	68.00
R:ADJ	3	2	8	60.00	27.27	48.39
R:ADJ:FORM	2	2	3	50.00	40.00	47.62
R:ADV	6	1	7	85.71	46.15	73.17
R:CONJ	1	0	0	100.00	100.00	100.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	23	12	25	65.71	47.92	61.17
R:MORPH	56	10	34	84.85	62.22	79.10
R:NOUN	12	3	29	80.00	29.27	59.41
R:NOUN:INFL	6	1	0	85.71	100.00	88.24
R:NOUN:NUM	98	30	30	76.56	76.56	76.56
R:NOUN:POSS	3	1	1	75.00	75.00	75.00
R:ORTH	134	6	64	95.71	67.68	88.39
R:OTHER	141	33	192	81.03	42.34	68.51
R:PART	11	2	3	84.62	78.57	83.33
R:PREP	67	14	50	82.72	57.26	75.96
R:PRON	13	1	16	92.86	44.83	76.47
R:PUNCT	44	19	16	69.84	73.33	70.51
R:SPELL	90	2	16	97.83	84.91	94.94
R:VERB	32	8	57	80.00	35.96	64.26
R:VERB:FORM	56	13	27	81.16	67.47	77.99
R:VERB:INFL	2	0	1	100.00	66.67	90.91
R:VERB:SVA	67	9	14	88.16	82.72	87.01
R:VERB:TENSE	44	17	55	72.13	44.44	64.14
R:WO	9	11	12	45.00	42.86	44.55
U:ADJ	2	1	2	66.67	50.00	62.50
U:ADV	5	6	4	45.45	55.56	47.17
U:CONJ	3	0	4	100.00	42.86	78.95
U:CONTR	4	1	0	80.00	100.00	83.33
U:DET	79	11	40	87.78	66.39	82.46
U:NOUN	1	6	9	14.29	10.00	13.16
U:NOUN:POSS	4	0	1	100.00	80.00	95.24
U:OTHER	2	9	8	18.18	20.00	18.52
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	21	4	10	84.00	67.74	80.15
U:PRON	6	1	8	85.71	42.86	71.43
U:PUNCT	6	4	10	60.00	37.50	53.57
U:VERB	6	7	7	46.15	46.15	46.15
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	7	2	2	77.78	77.78	77.78
UNK	7	0	52	100.00	11.86	40.23

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	499	98	173	83.58	74.26	81.54
R	1205	106	775	91.91	60.86	83.40
U	190	25	129	88.37	59.56	80.58
UNK	32	0	57	100.00	35.96	73.73

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	8	2	9	80.00	47.06	70.18
ADJ:FORM	3	2	2	60.00	60.00	60.00
ADV	20	5	20	80.00	50.00	71.43
CONJ	9	2	7	81.82	56.25	75.00
CONTR	5	3	1	62.50	83.33	65.79
DET	212	39	100	84.46	67.95	80.55
MORPH	54	3	30	94.74	64.29	86.54
NOUN	23	6	49	79.31	31.94	61.17
NOUN:INFL	6	1	0	85.71	100.00	88.24
NOUN:NUM	98	19	32	83.76	75.38	81.94
NOUN:POSS	15	0	7	100.00	68.18	91.46
ORTH	168	6	64	96.55	72.41	90.52
OTHER	317	32	307	90.83	50.80	78.47
PART	12	0	4	100.00	75.00	93.75
PREP	139	14	81	90.85	63.18	83.53
PRON	53	4	28	92.98	65.43	85.76
PUNCT	313	56	101	84.82	75.60	82.80
SPELL	90	0	17	100.00	84.11	96.36
UNK	32	0	57	100.00	35.96	73.73
VERB	75	9	94	89.29	44.38	74.26
VERB:FORM	77	6	25	92.77	75.49	88.71
VERB:INFL	2	0	1	100.00	66.67	90.91
VERB:SVA	71	3	13	95.95	84.52	93.42
VERB:TENSE	91	13	63	87.50	59.09	79.82
WO	33	4	22	89.19	60.00	81.28

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	1	100.00	50.00	83.33
M:ADV	7	2	6	77.78	53.85	71.43
M:CONJ	6	1	3	85.71	66.67	81.08
M:CONTR	0	2	0	0.00	100.00	0.00
M:DET	97	21	30	82.20	76.38	80.97
M:NOUN	4	2	3	66.67	57.14	64.52
M:NOUN:POSS	2	0	2	100.00	50.00	83.33
M:OTHER	25	11	15	69.44	62.50	67.93
M:PART	2	0	0	100.00	100.00	100.00
M:PREP	42	4	18	91.30	70.00	86.07
M:PRON	31	3	9	91.18	77.50	88.07
M:PUNCT	232	48	65	82.86	78.11	81.86
M:VERB	16	1	15	94.12	51.61	80.81
M:VERB:FORM	14	0	1	100.00	93.33	98.59
M:VERB:TENSE	20	3	5	86.96	80.00	85.47
R:ADJ	4	1	6	80.00	40.00	66.67
R:ADJ:FORM	3	2	2	60.00	60.00	60.00
R:ADV	6	1	9	85.71	40.00	69.77
R:CONJ	0	1	2	0.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	25	9	25	73.53	50.00	67.20
R:MORPH	54	3	30	94.74	64.29	86.54
R:NOUN	17	2	34	89.47	33.33	66.93
R:NOUN:INFL	6	1	0	85.71	100.00	88.24
R:NOUN:NUM	98	19	32	83.76	75.38	81.94
R:NOUN:POSS	9	0	2	100.00	81.82	95.74
R:ORTH	168	6	64	96.55	72.41	90.52
R:OTHER	280	19	273	93.65	50.63	80.05
R:PART	9	0	3	100.00	75.00	93.75
R:PREP	77	8	51	90.59	60.16	82.26
R:PRON	17	0	13	100.00	56.67	86.73
R:PUNCT	60	6	26	90.91	69.77	85.71
R:SPELL	90	0	17	100.00	84.11	96.36
R:VERB	49	5	72	90.74	40.50	72.70
R:VERB:FORM	62	6	23	91.18	72.94	86.83
R:VERB:INFL	2	0	1	100.00	66.67	90.91
R:VERB:SVA	71	3	13	95.95	84.52	93.42
R:VERB:TENSE	64	10	55	86.49	53.78	77.11
R:WO	33	4	22	89.19	60.00	81.28
U:ADJ	3	1	2	75.00	60.00	71.43
U:ADV	7	2	5	77.78	58.33	72.92
U:CONJ	3	0	2	100.00	60.00	88.24
U:CONTR	4	1	1	80.00	80.00	80.00
U:DET	90	9	45	90.91	66.67	84.75
U:NOUN	2	2	12	50.00	14.29	33.33
U:NOUN:POSS	4	0	3	100.00	57.14	86.96
U:OTHER	12	2	19	85.71	38.71	68.97
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	20	2	12	90.91	62.50	83.33
U:PRON	5	1	6	83.33	45.45	71.43
U:PUNCT	21	2	10	91.30	67.74	85.37
U:VERB	10	3	7	76.92	58.82	72.46
U:VERB:FORM	1	0	1	100.00	50.00	83.33
U:VERB:TENSE	7	0	3	100.00	70.00	92.11
UNK	32	0	57	100.00	35.96	73.73

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	930	433	834	68.23	52.72	64.44
Span-level detection	1078	291	783	78.74	57.93	73.46
Token-level detection	1327	229	926	85.28	58.90	78.27

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	342	141	175	70.81	66.15	69.82
R	481	245	578	66.25	45.42	60.69
U	107	47	81	69.48	56.91	66.54

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	8	5	9	61.54	47.06	57.97
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	12	8	17	60.00	41.38	55.05
CONJ	3	5	8	37.50	27.27	34.88
CONTR	3	1	0	75.00	100.00	78.95
DET	145	42	84	77.54	63.32	74.21
MORPH	24	6	15	80.00	61.54	75.47
NOUN	19	17	29	52.78	39.58	49.48
NOUN:NUM	54	22	21	71.05	72.00	71.24
NOUN:POSS	9	2	6	81.82	60.00	76.27
ORTH	40	7	43	85.11	48.19	73.80
OTHER	43	77	194	35.83	18.14	29.99
PART	8	4	4	66.67	66.67	66.67
PREP	92	52	77	63.89	54.44	61.74
PRON	20	7	23	74.07	46.51	66.23
PUNCT	227	80	95	73.94	70.50	73.23
SPELL	38	5	33	88.37	53.52	78.19
VERB	25	32	66	43.86	27.47	39.18
VERB:FORM	51	17	20	75.00	71.83	74.34
VERB:SVA	49	8	11	85.96	81.67	85.07
VERB:TENSE	40	22	55	64.52	42.11	58.31
WO	17	13	24	56.67	41.46	52.80

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	2	3	50.00	40.00	47.62
M:ADV	3	2	7	60.00	30.00	50.00
M:CONJ	3	5	6	37.50	33.33	36.59
M:DET	83	22	34	79.05	70.94	77.28
M:NOUN	1	5	2	16.67	33.33	18.52
M:NOUN:POSS	3	1	1	75.00	75.00	75.00
M:OTHER	6	16	13	27.27	31.58	28.04
M:PART	2	0	0	100.00	100.00	100.00
M:PREP	16	17	17	48.48	48.48	48.48
M:PRON	15	4	11	78.95	57.69	73.53
M:PUNCT	191	57	67	77.02	74.03	76.40
M:VERB	8	5	4	61.54	66.67	62.50
M:VERB:FORM	1	0	1	100.00	50.00	83.33
M:VERB:TENSE	8	5	9	61.54	47.06	57.97
R:ADJ	5	2	4	71.43	55.56	67.57
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	5	4	4	55.56	55.56	55.56
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	17	5	33	77.27	34.00	61.59
R:MORPH	24	6	15	80.00	61.54	75.47
R:NOUN	16	7	24	69.57	40.00	60.61
R:NOUN:NUM	54	22	21	71.05	72.00	71.24
R:NOUN:POSS	3	0	2	100.00	60.00	88.24
R:ORTH	40	7	43	85.11	48.19	73.80
R:OTHER	29	53	172	35.37	14.43	27.41
R:PART	5	4	3	55.56	62.50	56.82
R:PREP	58	30	50	65.91	53.70	63.04
R:PRON	1	2	9	33.33	10.00	22.73
R:PUNCT	26	20	17	56.52	60.47	57.27
R:SPELL	38	5	33	88.37	53.52	78.19
R:VERB	16	23	55	41.03	22.54	35.24
R:VERB:FORM	48	17	17	73.85	73.85	73.85
R:VERB:SVA	49	8	11	85.96	81.67	85.07
R:VERB:TENSE	26	15	40	63.41	39.39	56.52
R:WO	17	13	24	56.67	41.46	52.80
U:ADJ	1	1	2	50.00	33.33	45.45
U:ADV	4	2	6	66.67	40.00	58.82
U:CONJ	0	0	1	100.00	0.00	0.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	45	15	17	75.00	72.58	74.50
U:NOUN	2	5	3	28.57	40.00	30.30
U:NOUN:POSS	3	1	3	75.00	50.00	68.18
U:OTHER	8	8	9	50.00	47.06	49.38
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	18	5	10	78.26	64.29	75.00
U:PRON	4	1	3	80.00	57.14	74.07
U:PUNCT	10	3	11	76.92	47.62	68.49
U:VERB	1	4	7	20.00	12.50	17.86
U:VERB:FORM	2	0	2	100.00	50.00	83.33
U:VERB:TENSE	6	2	6	75.00	50.00	68.18

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	384	103	160	78.85	70.59	77.05
R	575	153	521	78.98	52.46	71.73
U	116	35	89	76.82	56.59	71.69
UNK	3	0	13	100.00	18.75	53.57

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	11	4	10	73.33	52.38	67.90
ADJ:FORM	2	2	0	50.00	100.00	55.56
ADV	15	6	19	71.43	44.12	63.56
CONJ	4	3	8	57.14	33.33	50.00
CONTR	3	1	0	75.00	100.00	78.95
DET	153	31	77	83.15	66.52	79.19
MORPH	23	2	14	92.00	62.16	83.94
NOUN	24	14	28	63.16	46.15	58.82
NOUN:NUM	56	16	18	77.78	75.68	77.35
NOUN:POSS	9	1	5	90.00	64.29	83.33
ORTH	45	6	46	88.24	49.45	76.27
OTHER	89	46	161	65.93	35.60	56.33
PART	10	4	7	71.43	58.82	68.49
PREP	103	37	74	73.57	58.19	69.88
PRON	28	3	21	90.32	57.14	80.92
PUNCT	251	60	92	80.71	73.18	79.08
SPELL	44	0	27	100.00	61.97	89.07
UNK	3	0	13	100.00	18.75	53.57
VERB	43	18	58	70.49	42.57	62.32
VERB:FORM	51	9	21	85.00	70.83	81.73
VERB:SVA	49	5	10	90.74	83.05	89.09
VERB:TENSE	47	13	50	78.33	48.45	69.73
WO	15	10	24	60.00	38.46	53.96

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	2	4	60.00	42.86	55.56
M:ADV	4	2	7	66.67	36.36	57.14
M:CONJ	4	3	6	57.14	40.00	52.63
M:DET	87	14	30	86.14	74.36	83.49
M:NOUN	3	4	1	42.86	75.00	46.88
M:NOUN:POSS	3	0	1	100.00	75.00	93.75
M:OTHER	14	9	10	60.87	58.33	60.34
M:PART	3	0	1	100.00	75.00	93.75
M:PREP	19	13	14	59.38	57.58	59.01
M:PRON	21	2	8	91.30	72.41	86.78
M:PUNCT	205	46	64	81.67	76.21	80.52
M:VERB	9	5	4	64.29	69.23	65.22
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	8	3	10	72.73	44.44	64.52
R:ADJ	7	1	4	87.50	63.64	81.40
R:ADJ:FORM	2	2	0	50.00	100.00	55.56
R:ADV	6	2	3	75.00	66.67	73.17
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	21	5	30	80.77	41.18	67.74
R:MORPH	23	2	14	92.00	62.16	83.94
R:NOUN	18	6	23	75.00	43.90	65.69
R:NOUN:NUM	56	16	18	77.78	75.68	77.35
R:NOUN:POSS	3	0	1	100.00	75.00	93.75
R:ORTH	45	6	46	88.24	49.45	76.27
R:OTHER	67	29	141	69.79	32.21	56.59
R:PART	6	4	4	60.00	60.00	60.00
R:PREP	66	21	50	75.86	56.90	71.12
R:PRON	2	0	8	100.00	20.00	55.56
R:PUNCT	33	13	14	71.74	70.21	71.43
R:SPELL	44	0	27	100.00	61.97	89.07
R:VERB	31	11	49	73.81	38.75	62.50
R:VERB:FORM	48	9	19	84.21	71.64	81.36
R:VERB:SVA	49	5	10	90.74	83.05	89.09
R:VERB:TENSE	32	10	35	76.19	47.76	68.09
R:WO	15	10	24	60.00	38.46	53.96
U:ADJ	1	1	2	50.00	33.33	45.45
U:ADV	5	2	9	71.43	35.71	59.52
U:CONJ	0	0	1	100.00	0.00	0.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	45	12	17	78.95	72.58	77.59
U:NOUN	3	4	4	42.86	42.86	42.86
U:NOUN:POSS	3	1	3	75.00	50.00	68.18
U:OTHER	8	8	10	50.00	44.44	48.78
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	18	3	10	85.71	64.29	80.36
U:PRON	5	1	5	83.33	50.00	73.53
U:PUNCT	13	1	14	92.86	48.15	78.31
U:VERB	3	2	5	60.00	37.50	53.57
U:VERB:FORM	2	0	2	100.00	50.00	83.33
U:VERB:TENSE	7	0	5	100.00	58.33	87.50
UNK	3	0	13	100.00	18.75	53.57

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	414	60	174	87.34	70.41	83.33
R	775	142	619	84.51	55.60	76.55
U	134	27	124	83.23	51.94	74.28
UNK	4	0	9	100.00	30.77	68.97

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	15	3	10	83.33	60.00	77.32
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	17	3	18	85.00	48.57	73.91
CONJ	6	0	10	100.00	37.50	75.00
CONTR	2	0	0	100.00	100.00	100.00
DET	154	21	78	88.00	66.38	82.62
MORPH	24	0	15	100.00	61.54	88.89
NOUN	29	7	32	80.56	47.54	70.73
NOUN:NUM	53	13	20	80.30	72.60	78.64
NOUN:POSS	12	0	6	100.00	66.67	90.91
ORTH	81	3	47	96.43	63.28	87.28
OTHER	186	67	234	73.52	44.29	64.94
PART	7	2	4	77.78	63.64	74.47
PREP	112	26	78	81.16	58.95	75.47
PRON	30	2	21	93.75	58.82	83.80
PUNCT	287	40	92	87.77	75.73	85.06
SPELL	46	0	25	100.00	64.79	90.20
UNK	4	0	9	100.00	30.77	68.97
VERB	56	12	73	82.35	43.41	69.83
VERB:FORM	50	5	23	90.91	68.49	85.32
VERB:SVA	45	4	10	91.84	81.82	89.64
VERB:TENSE	58	7	74	89.23	43.94	73.98
WO	50	13	47	79.37	51.55	71.63

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	1	2	75.00	60.00	71.43
M:ADV	3	1	5	75.00	37.50	62.50
M:CONJ	6	0	6	100.00	50.00	83.33
M:DET	88	4	33	95.65	72.73	89.98
M:NOUN	3	3	4	50.00	42.86	48.39
M:NOUN:POSS	3	0	2	100.00	60.00	88.24
M:OTHER	15	8	12	65.22	55.56	63.03
M:PART	3	0	0	100.00	100.00	100.00
M:PREP	21	8	17	72.41	55.26	68.18
M:PRON	21	1	7	95.45	75.00	90.52
M:PUNCT	224	30	66	88.19	77.24	85.76
M:VERB	12	3	7	80.00	63.16	75.95
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	11	1	13	91.67	45.83	76.39
R:ADJ	11	1	6	91.67	64.71	84.62
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	7	2	6	77.78	53.85	71.43
R:CONJ	0	0	4	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	24	4	26	85.71	48.00	74.07
R:MORPH	24	0	15	100.00	61.54	88.89
R:NOUN	24	3	24	88.89	50.00	76.92
R:NOUN:NUM	53	13	20	80.30	72.60	78.64
R:NOUN:POSS	6	0	1	100.00	85.71	96.77
R:ORTH	81	3	47	96.43	63.28	87.28
R:OTHER	151	50	183	75.12	45.21	66.34
R:PART	3	2	2	60.00	60.00	60.00
R:PREP	71	17	49	80.68	59.17	75.21
R:PRON	2	0	10	100.00	16.67	50.00
R:PUNCT	47	10	13	82.46	78.33	81.60
R:SPELL	46	0	25	100.00	64.79	90.20
R:VERB	38	8	56	82.61	40.43	68.35
R:VERB:FORM	47	5	21	90.38	69.12	85.14
R:VERB:SVA	45	4	10	91.84	81.82	89.64
R:VERB:TENSE	41	6	54	87.23	43.16	72.44
R:WO	50	13	47	79.37	51.55	71.63
U:ADJ	1	1	2	50.00	33.33	45.45
U:ADV	7	0	7	100.00	50.00	83.33
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	42	13	19	76.36	68.85	74.73
U:NOUN	2	1	4	66.67	33.33	55.56
U:NOUN:POSS	3	0	3	100.00	50.00	83.33
U:OTHER	20	9	39	68.97	33.90	57.14
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	20	1	12	95.24	62.50	86.21
U:PRON	7	1	4	87.50	63.64	81.40
U:PUNCT	16	0	13	100.00	55.17	86.02
U:VERB	6	1	10	85.71	37.50	68.18
U:VERB:FORM	2	0	2	100.00	50.00	83.33
U:VERB:TENSE	6	0	7	100.00	46.15	81.08
UNK	4	0	9	100.00	30.77	68.97

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	438	190	276	69.75	61.34	67.89
Span-level detection	488	142	264	77.46	64.89	74.57
Token-level detection	579	109	316	84.16	64.69	79.38

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	184	63	62	74.49	74.80	74.55
R	196	103	186	65.55	51.31	62.10
U	58	24	28	70.73	67.44	70.05

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	3	7	50.00	30.00	44.12
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	4	3	2	57.14	66.67	58.82
CONJ	0	0	2	100.00	0.00	0.00
CONTR	4	0	0	100.00	100.00	100.00
DET	75	30	34	71.43	68.81	70.89
MORPH	13	0	10	100.00	56.52	86.67
NOUN	3	10	9	23.08	25.00	23.44
NOUN:INFL	1	1	1	50.00	50.00	50.00
NOUN:NUM	23	7	10	76.67	69.70	75.16
NOUN:POSS	3	2	4	60.00	42.86	55.56
ORTH	28	5	12	84.85	70.00	81.40
OTHER	23	21	36	52.27	38.98	48.94
PART	2	0	1	100.00	66.67	90.91
PREP	43	29	31	59.72	58.11	59.39
PRON	6	5	6	54.55	50.00	53.57
PUNCT	134	34	30	79.76	81.71	80.14
SPELL	12	4	25	75.00	32.43	59.41
VERB	3	2	19	60.00	13.64	35.71
VERB:FORM	15	6	4	71.43	78.95	72.82
VERB:SVA	8	5	1	61.54	88.89	65.57
VERB:TENSE	24	16	22	60.00	52.17	58.25
WO	11	7	8	61.11	57.89	60.44

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	1	1	0	50.00	100.00	55.56
M:CONJ	0	0	1	100.00	0.00	0.00
M:DET	39	15	14	72.22	73.58	72.49
M:NOUN	0	1	1	0.00	0.00	0.00
M:NOUN:POSS	0	1	0	0.00	100.00	0.00
M:OTHER	2	3	6	40.00	25.00	35.71
M:PREP	12	5	8	70.59	60.00	68.18
M:PRON	2	3	4	40.00	33.33	38.46
M:PUNCT	118	28	21	80.82	84.89	81.60
M:VERB	0	2	2	0.00	0.00	0.00
M:VERB:FORM	3	0	0	100.00	100.00	100.00
M:VERB:TENSE	7	4	4	63.64	63.64	63.64
R:ADJ	3	3	5	50.00	37.50	46.88
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	2	0	0	100.00	100.00	100.00
R:DET	8	4	8	66.67	50.00	62.50
R:MORPH	13	0	10	100.00	56.52	86.67
R:NOUN	3	8	7	27.27	30.00	27.78
R:NOUN:INFL	1	1	1	50.00	50.00	50.00
R:NOUN:NUM	23	7	10	76.67	69.70	75.16
R:NOUN:POSS	1	0	4	100.00	20.00	55.56
R:ORTH	28	5	12	84.85	70.00	81.40
R:OTHER	20	17	29	54.05	40.82	50.76
R:PART	2	0	1	100.00	66.67	90.91
R:PREP	27	20	16	57.45	62.79	58.44
R:PRON	2	1	1	66.67	66.67	66.67
R:PUNCT	5	4	6	55.56	45.45	53.19
R:SPELL	12	4	25	75.00	32.43	59.41
R:VERB	3	0	16	100.00	15.79	48.39
R:VERB:FORM	11	6	4	64.71	73.33	66.27
R:VERB:SVA	8	5	1	61.54	88.89	65.57
R:VERB:TENSE	12	11	17	52.17	41.38	49.59
R:WO	11	7	8	61.11	57.89	60.44
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	2	2	0	50.00	100.00	55.56
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	28	11	12	71.79	70.00	71.43
U:NOUN	0	1	1	0.00	0.00	0.00
U:NOUN:POSS	2	1	0	66.67	100.00	71.43
U:OTHER	1	1	1	50.00	50.00	50.00
U:PREP	4	4	7	50.00	36.36	46.51
U:PRON	2	1	1	66.67	66.67	66.67
U:PUNCT	11	2	3	84.62	78.57	83.33
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	5	1	1	83.33	83.33	83.33

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	195	54	61	78.31	76.17	77.88
R	234	68	168	77.48	58.21	72.67
U	58	20	32	74.36	64.44	72.14
UNK	1	0	3	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	1	8	75.00	27.27	55.56
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	4	3	3	57.14	57.14	57.14
CONJ	0	0	1	100.00	0.00	0.00
CONTR	4	0	0	100.00	100.00	100.00
DET	79	23	35	77.45	69.30	75.67
MORPH	14	0	11	100.00	56.00	86.42
NOUN	7	4	9	63.64	43.75	58.33
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	22	5	8	81.48	73.33	79.71
NOUN:POSS	3	2	4	60.00	42.86	55.56
ORTH	30	4	12	88.24	71.43	84.27
OTHER	38	12	33	76.00	53.52	70.11
PART	2	0	1	100.00	66.67	90.91
PREP	49	19	28	72.06	63.64	70.20
PRON	9	5	5	64.29	64.29	64.29
PUNCT	137	34	32	80.12	81.07	80.30
SPELL	21	1	16	95.45	56.76	84.00
UNK	1	0	3	100.00	25.00	62.50
VERB	4	2	17	66.67	19.05	44.44
VERB:FORM	15	4	5	78.95	75.00	78.12
VERB:SVA	10	3	1	76.92	90.91	79.37
VERB:TENSE	26	13	22	66.67	54.17	63.73
WO	8	7	8	53.33	50.00	52.63

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	1	1	0	50.00	100.00	55.56
M:CONJ	0	0	1	100.00	0.00	0.00
M:DET	42	11	13	79.25	76.36	78.65
M:NOUN	1	0	2	100.00	33.33	71.43
M:NOUN:POSS	0	1	0	0.00	100.00	0.00
M:OTHER	4	1	6	80.00	40.00	66.67
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	14	3	6	82.35	70.00	79.55
M:PRON	3	3	3	50.00	50.00	50.00
M:PUNCT	120	28	22	81.08	84.51	81.74
M:VERB	0	2	2	0.00	0.00	0.00
M:VERB:FORM	3	0	0	100.00	100.00	100.00
M:VERB:TENSE	7	4	4	63.64	63.64	63.64
R:ADJ	3	1	6	75.00	33.33	60.00
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	3	100.00	25.00	62.50
R:CONTR	2	0	0	100.00	100.00	100.00
R:DET	9	3	8	75.00	52.94	69.23
R:MORPH	14	0	11	100.00	56.00	86.42
R:NOUN	6	3	6	66.67	50.00	62.50
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	22	5	8	81.48	73.33	79.71
R:NOUN:POSS	1	0	4	100.00	20.00	55.56
R:ORTH	30	4	12	88.24	71.43	84.27
R:OTHER	33	10	25	76.74	56.90	71.74
R:PART	2	0	0	100.00	100.00	100.00
R:PREP	32	13	14	71.11	69.57	70.80
R:PRON	4	1	1	80.00	80.00	80.00
R:PUNCT	5	4	7	55.56	41.67	52.08
R:SPELL	21	1	16	95.45	56.76	84.00
R:VERB	4	0	14	100.00	22.22	58.82
R:VERB:FORM	11	4	5	73.33	68.75	72.37
R:VERB:SVA	10	3	1	76.92	90.91	79.37
R:VERB:TENSE	14	9	17	60.87	45.16	56.91
R:WO	8	7	8	53.33	50.00	52.63
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	2	2	0	50.00	100.00	55.56
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	28	9	14	75.68	66.67	73.68
U:NOUN	0	1	1	0.00	0.00	0.00
U:NOUN:POSS	2	1	0	66.67	100.00	71.43
U:OTHER	1	1	2	50.00	33.33	45.45
U:PREP	3	3	8	50.00	27.27	42.86
U:PRON	2	1	1	66.67	66.67	66.67
U:PUNCT	12	2	3	85.71	80.00	84.51
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	5	0	1	100.00	83.33	96.15
UNK	1	0	3	100.00	25.00	62.50

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	212	44	68	82.81	75.71	81.29
R	301	46	204	86.74	59.60	79.50
U	63	19	37	76.83	63.00	73.60
UNK	3	0	7	100.00	30.00	68.18

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	1	8	75.00	27.27	55.56
ADJ:FORM	0	0	3	100.00	0.00	0.00
ADV	5	2	4	71.43	55.56	67.57
CONJ	2	0	1	100.00	66.67	90.91
CONTR	4	0	1	100.00	80.00	95.24
DET	81	20	32	80.20	71.68	78.34
MORPH	14	0	9	100.00	60.87	88.61
NOUN	8	2	9	80.00	47.06	70.18
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	21	1	9	95.45	70.00	88.98
NOUN:POSS	5	1	5	83.33	50.00	73.53
ORTH	40	2	11	95.24	78.43	91.32
OTHER	68	11	65	86.08	51.13	75.72
PART	3	0	1	100.00	75.00	93.75
PREP	49	18	32	73.13	60.49	70.20
PRON	10	5	5	66.67	66.67	66.67
PUNCT	157	26	34	85.79	82.20	85.05
SPELL	22	0	14	100.00	61.11	88.71
UNK	3	0	7	100.00	30.00	68.18
VERB	7	1	21	87.50	25.00	58.33
VERB:FORM	18	1	6	94.74	75.00	90.00
VERB:SVA	10	2	1	83.33	90.91	84.75
VERB:TENSE	28	11	26	71.79	51.85	66.67
WO	19	5	12	79.17	61.29	74.80

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	1	0	0	100.00	100.00	100.00
M:CONJ	2	0	1	100.00	66.67	90.91
M:DET	45	9	11	83.33	80.36	82.72
M:NOUN	1	0	2	100.00	33.33	71.43
M:NOUN:POSS	1	1	0	50.00	100.00	55.56
M:OTHER	4	1	8	80.00	33.33	62.50
M:PART	1	0	1	100.00	50.00	83.33
M:PREP	14	3	8	82.35	63.64	77.78
M:PRON	4	3	3	57.14	57.14	57.14
M:PUNCT	129	23	26	84.87	83.23	84.53
M:VERB	0	1	3	0.00	0.00	0.00
M:VERB:FORM	4	0	0	100.00	100.00	100.00
M:VERB:TENSE	6	3	3	66.67	66.67	66.67
R:ADJ	3	1	4	75.00	42.86	65.22
R:ADJ:FORM	0	0	3	100.00	0.00	0.00
R:ADV	2	0	2	100.00	50.00	83.33
R:CONTR	2	0	0	100.00	100.00	100.00
R:DET	9	2	8	81.82	52.94	73.77
R:MORPH	14	0	9	100.00	60.87	88.61
R:NOUN	6	1	7	85.71	46.15	73.17
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	21	1	9	95.45	70.00	88.98
R:NOUN:POSS	2	0	5	100.00	28.57	66.67
R:ORTH	40	2	11	95.24	78.43	91.32
R:OTHER	63	8	51	88.73	55.26	79.15
R:PART	2	0	0	100.00	100.00	100.00
R:PREP	32	12	16	72.73	66.67	71.43
R:PRON	4	1	1	80.00	80.00	80.00
R:PUNCT	11	2	5	84.62	68.75	80.88
R:SPELL	22	0	14	100.00	61.11	88.71
R:VERB	7	0	17	100.00	29.17	67.31
R:VERB:FORM	13	1	6	92.86	68.42	86.67
R:VERB:SVA	10	2	1	83.33	90.91	84.75
R:VERB:TENSE	17	8	23	68.00	42.50	60.71
R:WO	19	5	12	79.17	61.29	74.80
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	2	2	2	50.00	50.00	50.00
U:CONTR	2	0	1	100.00	66.67	90.91
U:DET	27	9	13	75.00	67.50	73.37
U:NOUN	1	1	0	50.00	100.00	55.56
U:NOUN:POSS	2	0	0	100.00	100.00	100.00
U:OTHER	1	2	6	33.33	14.29	26.32
U:PREP	3	3	8	50.00	27.27	42.86
U:PRON	2	1	1	66.67	66.67	66.67
U:PUNCT	17	1	3	94.44	85.00	92.39
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	5	0	0	100.00	100.00	100.00
UNK	3	0	7	100.00	30.00	68.18

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	298	173	251	63.27	54.28	61.24
Span-level detection	328	143	234	69.64	58.36	67.05
Token-level detection	388	125	254	75.63	60.44	72.01

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	123	51	41	70.69	75.00	71.51
R	155	94	194	62.25	44.41	57.62
U	20	28	16	41.67	55.56	43.86

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	2	2	60.00	60.00	60.00
ADV	2	2	0	50.00	100.00	55.56
CONJ	1	3	0	25.00	100.00	29.41
CONTR	0	1	0	0.00	100.00	0.00
DET	20	29	5	40.82	80.00	45.25
MORPH	3	2	3	60.00	50.00	57.69
NOUN	2	7	7	22.22	22.22	22.22
NOUN:INFL	0	0	11	100.00	0.00	0.00
NOUN:NUM	14	7	5	66.67	73.68	67.96
NOUN:POSS	7	4	11	63.64	38.89	56.45
ORTH	22	2	36	91.67	37.93	71.43
OTHER	19	17	35	52.78	35.19	47.98
PART	1	1	0	50.00	100.00	55.56
PREP	8	18	12	30.77	40.00	32.26
PRON	4	5	3	44.44	57.14	46.51
PUNCT	126	38	44	76.83	74.12	76.27
SPELL	36	7	58	83.72	38.30	67.67
VERB	5	4	9	55.56	35.71	50.00
VERB:FORM	9	7	2	56.25	81.82	60.00
VERB:INFL	3	0	2	100.00	60.00	88.24
VERB:SVA	6	5	2	54.55	75.00	57.69
VERB:TENSE	5	10	3	33.33	62.50	36.76
WO	2	2	1	50.00	66.67	52.63

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	0	2	0	0.00	100.00	0.00
M:DET	8	8	2	50.00	80.00	54.05
M:NOUN	0	1	2	0.00	0.00	0.00
M:NOUN:POSS	3	3	3	50.00	50.00	50.00
M:OTHER	0	1	0	0.00	100.00	0.00
M:PREP	2	4	0	33.33	100.00	38.46
M:PRON	1	3	2	25.00	33.33	26.32
M:PUNCT	108	28	30	79.41	78.26	79.18
M:VERB	1	1	2	50.00	33.33	45.45
R:ADJ	3	2	2	60.00	60.00	60.00
R:ADV	1	0	0	100.00	100.00	100.00
R:DET	1	6	0	14.29	100.00	17.24
R:MORPH	3	2	3	60.00	50.00	57.69
R:NOUN	2	6	5	25.00	28.57	25.64
R:NOUN:INFL	0	0	11	100.00	0.00	0.00
R:NOUN:NUM	14	7	5	66.67	73.68	67.96
R:NOUN:POSS	4	1	7	80.00	36.36	64.52
R:ORTH	22	2	36	91.67	37.93	71.43
R:OTHER	19	13	34	59.38	35.85	52.49
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	6	11	10	35.29	37.50	35.71
R:PRON	3	2	1	60.00	75.00	62.50
R:PUNCT	13	8	7	61.90	65.00	62.50
R:SPELL	36	7	58	83.72	38.30	67.67
R:VERB	3	3	6	50.00	33.33	45.45
R:VERB:FORM	9	7	2	56.25	81.82	60.00
R:VERB:INFL	3	0	2	100.00	60.00	88.24
R:VERB:SVA	6	5	2	54.55	75.00	57.69
R:VERB:TENSE	5	9	2	35.71	71.43	39.68
R:WO	2	2	1	50.00	66.67	52.63
U:ADV	1	2	0	33.33	100.00	38.46
U:CONJ	1	1	0	50.00	100.00	55.56
U:CONTR	0	1	0	0.00	100.00	0.00
U:DET	11	15	3	42.31	78.57	46.61
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	0	3	1	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	0	3	2	0.00	0.00	0.00
U:PUNCT	5	2	7	71.43	41.67	62.50
U:VERB	1	0	1	100.00	50.00	83.33
U:VERB:TENSE	0	1	1	0.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	125	49	41	71.84	75.30	72.51
R	182	67	173	73.09	51.27	67.36
U	20	27	17	42.55	54.05	44.44
UNK	1	0	3	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	1	0	83.33	100.00	86.21
ADV	2	2	0	50.00	100.00	55.56
CONJ	1	3	0	25.00	100.00	29.41
DET	20	29	6	40.82	76.92	45.05
MORPH	2	2	3	50.00	40.00	47.62
NOUN	3	4	7	42.86	30.00	39.47
NOUN:INFL	0	0	11	100.00	0.00	0.00
NOUN:NUM	13	7	4	65.00	76.47	67.01
NOUN:POSS	8	4	11	66.67	42.11	59.70
ORTH	26	2	31	92.86	45.61	76.92
OTHER	29	7	33	80.56	46.77	70.39
PART	1	1	0	50.00	100.00	55.56
PREP	7	17	11	29.17	38.89	30.70
PRON	5	4	2	55.56	71.43	58.14
PUNCT	129	35	44	78.66	74.57	77.80
SPELL	43	0	50	100.00	46.24	81.13
UNK	1	0	3	100.00	25.00	62.50
VERB	6	3	9	66.67	40.00	58.82
VERB:FORM	9	6	2	60.00	81.82	63.38
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	7	5	2	58.33	77.78	61.40
VERB:TENSE	5	9	3	35.71	62.50	39.06
WO	2	2	1	50.00	66.67	52.63

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	0	2	0	0.00	100.00	0.00
M:DET	8	7	2	53.33	80.00	57.14
M:NOUN	0	1	2	0.00	0.00	0.00
M:NOUN:POSS	3	3	3	50.00	50.00	50.00
M:OTHER	2	1	1	66.67	66.67	66.67
M:PREP	1	4	1	20.00	50.00	22.73
M:PRON	2	2	1	50.00	66.67	52.63
M:PUNCT	108	28	29	79.41	78.83	79.30
M:VERB	1	1	2	50.00	33.33	45.45
R:ADJ	5	1	0	83.33	100.00	86.21
R:ADV	1	0	0	100.00	100.00	100.00
R:DET	1	6	0	14.29	100.00	17.24
R:MORPH	2	2	3	50.00	40.00	47.62
R:NOUN	3	3	5	50.00	37.50	46.88
R:NOUN:INFL	0	0	11	100.00	0.00	0.00
R:NOUN:NUM	13	7	4	65.00	76.47	67.01
R:NOUN:POSS	5	1	7	83.33	41.67	69.44
R:ORTH	26	2	31	92.86	45.61	76.92
R:OTHER	27	3	31	90.00	46.55	75.84
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	6	10	9	37.50	40.00	37.97
R:PRON	3	2	1	60.00	75.00	62.50
R:PUNCT	16	6	7	72.73	69.57	72.07
R:SPELL	43	0	50	100.00	46.24	81.13
R:VERB	4	2	6	66.67	40.00	58.82
R:VERB:FORM	9	6	2	60.00	81.82	63.38
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	7	5	2	58.33	77.78	61.40
R:VERB:TENSE	5	8	2	38.46	71.43	42.37
R:WO	2	2	1	50.00	66.67	52.63
U:ADV	1	2	0	33.33	100.00	38.46
U:CONJ	1	1	0	50.00	100.00	55.56
U:DET	11	16	4	40.74	73.33	44.72
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	0	3	1	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	0	3	1	0.00	0.00	0.00
U:PUNCT	5	1	8	83.33	38.46	67.57
U:VERB	1	0	1	100.00	50.00	83.33
U:VERB:TENSE	0	1	1	0.00	0.00	0.00
UNK	1	0	3	100.00	25.00	62.50

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	136	36	46	79.07	74.73	78.16
R	228	66	184	77.55	55.34	71.79
U	22	23	21	48.89	51.16	49.33
UNK	2	0	3	100.00	40.00	76.92

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	1	1	83.33	83.33	83.33
ADV	2	0	0	100.00	100.00	100.00
CONJ	2	2	0	50.00	100.00	55.56
CONTR	0	0	2	100.00	0.00	0.00
DET	21	23	8	47.73	72.41	51.22
MORPH	3	2	1	60.00	75.00	62.50
NOUN	4	5	9	44.44	30.77	40.82
NOUN:INFL	0	0	11	100.00	0.00	0.00
NOUN:NUM	14	6	4	70.00	77.78	71.43
NOUN:POSS	9	3	12	75.00	42.86	65.22
ORTH	42	2	39	95.45	51.85	81.71
OTHER	51	9	35	85.00	59.30	78.22
PREP	8	11	10	42.11	44.44	42.55
PRON	6	2	1	75.00	85.71	76.92
PUNCT	138	29	54	82.63	71.88	80.23
SPELL	46	0	49	100.00	48.42	82.44
UNK	2	0	3	100.00	40.00	76.92
VERB	6	4	6	60.00	50.00	57.69
VERB:FORM	10	6	2	62.50	83.33	65.79
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	6	4	3	60.00	66.67	61.22
VERB:TENSE	5	13	3	27.78	62.50	31.25
WO	4	3	0	57.14	100.00	62.50

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	1	1	0	50.00	100.00	55.56
M:DET	8	3	2	72.73	80.00	74.07
M:NOUN	1	1	3	50.00	25.00	41.67
M:NOUN:POSS	3	3	3	50.00	50.00	50.00
M:OTHER	3	1	0	75.00	100.00	78.95
M:PREP	1	1	1	50.00	50.00	50.00
M:PRON	4	1	0	80.00	100.00	83.33
M:PUNCT	114	23	36	83.21	76.00	81.66
M:VERB	1	2	1	33.33	50.00	35.71
R:ADJ	5	1	0	83.33	100.00	86.21
R:ADV	1	0	0	100.00	100.00	100.00
R:CONTR	0	0	2	100.00	0.00	0.00
R:DET	1	5	1	16.67	50.00	19.23
R:MORPH	3	2	1	60.00	75.00	62.50
R:NOUN	3	4	6	42.86	33.33	40.54
R:NOUN:INFL	0	0	11	100.00	0.00	0.00
R:NOUN:NUM	14	6	4	70.00	77.78	71.43
R:NOUN:POSS	6	0	8	100.00	42.86	78.95
R:ORTH	42	2	39	95.45	51.85	81.71
R:OTHER	48	3	33	94.12	59.26	84.21
R:PREP	7	9	8	43.75	46.67	44.30
R:PRON	2	1	1	66.67	66.67	66.67
R:PUNCT	17	6	9	73.91	65.38	72.03
R:SPELL	46	0	49	100.00	48.42	82.44
R:VERB	4	2	4	66.67	50.00	62.50
R:VERB:FORM	10	6	2	62.50	83.33	65.79
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	6	4	3	60.00	66.67	61.22
R:VERB:TENSE	5	12	2	29.41	71.43	33.33
R:WO	4	3	0	57.14	100.00	62.50
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	1	0	0	100.00	100.00	100.00
U:CONJ	1	1	0	50.00	100.00	55.56
U:DET	12	15	5	44.44	70.59	48.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	0	5	2	0.00	0.00	0.00
U:PREP	0	1	1	0.00	0.00	0.00
U:PUNCT	7	0	9	100.00	43.75	79.55
U:VERB	1	0	1	100.00	50.00	83.33
U:VERB:TENSE	0	1	1	0.00	0.00	0.00
UNK	2	0	3	100.00	40.00	76.92

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:43:26+00:00
Competition submission:	6
Competition phase:	3 - Open phase

Detailed results

Submission information

Results