BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1760	2161	2678	44.89	39.66	43.73
Span-level detection	2304	1620	2530	58.72	47.66	56.11
Token-level detection	3051	1952	3145	60.98	49.24	58.21

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	234	206	688	53.18	25.38	43.62
R	1350	1609	1706	45.62	44.18	45.33
U	176	346	284	33.72	38.26	34.54

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	10	54	21	15.62	32.26	17.42
ADJ:FORM	4	2	4	66.67	50.00	62.50
ADV	25	21	31	54.35	44.64	52.08
CONJ	3	8	17	27.27	15.00	23.44
CONTR	7	1	6	87.50	53.85	77.78
DET	219	159	326	57.94	40.18	53.23
MORPH	81	158	69	33.89	54.00	36.62
NOUN	24	183	84	11.59	22.22	12.82
NOUN:INFL	17	2	4	89.47	80.95	87.63
NOUN:NUM	171	137	82	55.52	67.59	57.58
NOUN:POSS	13	3	37	81.25	26.00	57.02
ORTH	212	142	164	59.89	56.38	59.15
OTHER	83	392	579	17.47	12.54	16.20
PART	19	11	12	63.33	61.29	62.91
PREP	138	121	242	53.28	36.32	48.73
PRON	32	44	92	42.11	25.81	37.38
PUNCT	64	133	361	32.49	15.06	26.38
SPELL	242	131	81	64.88	74.92	66.67
VERB	36	69	158	34.29	18.56	29.32
VERB:FORM	135	150	56	47.37	70.68	50.71
VERB:INFL	5	0	3	100.00	62.50	89.29
VERB:SVA	117	91	38	56.25	75.48	59.27
VERB:TENSE	87	134	150	39.37	36.71	38.80
WO	16	15	61	51.61	20.78	39.80

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	2	3	33.33	25.00	31.25
M:ADV	3	4	13	42.86	18.75	34.09
M:CONJ	3	6	9	33.33	25.00	31.25
M:CONTR	1	0	0	100.00	100.00	100.00
M:DET	113	72	143	61.08	44.14	56.73
M:NOUN	0	7	9	0.00	0.00	0.00
M:NOUN:POSS	3	0	12	100.00	20.00	55.56
M:OTHER	1	32	51	3.03	1.92	2.72
M:PART	0	0	4	100.00	0.00	0.00
M:PREP	23	29	65	44.23	26.14	38.85
M:PRON	20	10	45	66.67	30.77	54.05
M:PUNCT	40	19	273	67.80	12.78	36.43
M:VERB	6	11	26	35.29	18.75	30.00
M:VERB:FORM	10	7	5	58.82	66.67	60.24
M:VERB:TENSE	10	7	30	58.82	25.00	46.30
R:ADJ	8	38	16	17.39	33.33	19.23
R:ADJ:FORM	4	2	4	66.67	50.00	62.50
R:ADV	10	7	11	58.82	47.62	56.18
R:CONJ	0	2	4	0.00	0.00	0.00
R:CONTR	3	1	2	75.00	60.00	71.43
R:DET	33	44	65	42.86	33.67	40.64
R:MORPH	81	158	69	33.89	54.00	36.62
R:NOUN	21	144	66	12.73	24.14	14.06
R:NOUN:INFL	17	2	4	89.47	80.95	87.63
R:NOUN:NUM	171	137	82	55.52	67.59	57.58
R:NOUN:POSS	5	3	19	62.50	20.83	44.64
R:ORTH	212	142	164	59.89	56.38	59.15
R:OTHER	74	265	511	21.83	12.65	19.06
R:PART	16	10	6	61.54	72.73	63.49
R:PREP	86	63	140	57.72	38.05	52.31
R:PRON	5	29	34	14.71	12.82	14.29
R:PUNCT	9	32	58	21.95	13.43	19.48
R:SPELL	242	131	81	64.88	74.92	66.67
R:VERB	26	36	115	41.94	18.44	33.42
R:VERB:FORM	121	138	48	46.72	71.60	50.21
R:VERB:INFL	5	0	3	100.00	62.50	89.29
R:VERB:SVA	117	91	38	56.25	75.48	59.27
R:VERB:TENSE	68	119	105	36.36	39.31	36.92
R:WO	16	15	61	51.61	20.78	39.80
U:ADJ	1	14	2	6.67	33.33	7.94
U:ADV	12	10	7	54.55	63.16	56.07
U:CONJ	0	0	4	100.00	0.00	0.00
U:CONTR	3	0	4	100.00	42.86	78.95
U:DET	73	43	118	62.93	38.22	55.73
U:NOUN	3	32	9	8.57	25.00	9.87
U:NOUN:POSS	5	0	6	100.00	45.45	80.65
U:OTHER	8	95	17	7.77	32.00	9.15
U:PART	3	1	2	75.00	60.00	71.43
U:PREP	29	29	37	50.00	43.94	48.66
U:PRON	7	5	13	58.33	35.00	51.47
U:PUNCT	15	82	30	15.46	33.33	17.32
U:VERB	4	22	17	15.38	19.05	16.00
U:VERB:FORM	4	5	3	44.44	57.14	46.51
U:VERB:TENSE	9	8	15	52.94	37.50	48.91

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	277	168	678	62.25	29.01	50.64
R	1801	1164	1502	60.74	54.53	59.39
U	201	288	291	41.10	40.85	41.05
UNK	25	0	59	100.00	29.76	67.93

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	23	42	24	35.38	48.94	37.46
ADJ:FORM	5	1	5	83.33	50.00	73.53
ADV	28	16	35	63.64	44.44	58.58
CONJ	6	7	22	46.15	21.43	37.50
CONTR	5	1	5	83.33	50.00	73.53
DET	243	137	325	63.95	42.78	58.19
MORPH	98	116	60	45.79	62.03	48.32
NOUN	52	148	85	26.00	37.96	27.75
NOUN:INFL	17	1	3	94.44	85.00	92.39
NOUN:NUM	171	109	70	61.07	70.95	62.82
NOUN:POSS	19	2	33	90.48	36.54	69.85
ORTH	278	113	132	71.10	67.80	70.42
OTHER	234	304	509	43.49	31.49	40.41
PART	21	10	13	67.74	61.76	66.46
PREP	157	95	238	62.30	39.75	55.95
PRON	39	35	88	52.70	30.71	46.10
PUNCT	106	104	373	50.48	22.13	40.18
SPELL	301	29	20	91.21	93.77	91.71
UNK	25	0	59	100.00	29.76	67.93
VERB	90	46	145	66.18	38.30	57.77
VERB:FORM	134	119	48	52.96	73.63	56.11
VERB:INFL	6	0	3	100.00	66.67	90.91
VERB:SVA	124	66	29	65.26	81.05	67.91
VERB:TENSE	106	105	150	50.24	41.41	48.18
WO	16	14	56	53.33	22.22	41.67

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	2	4	33.33	20.00	29.41
M:ADV	2	4	10	33.33	16.67	27.78
M:CONJ	4	6	13	40.00	23.53	35.09
M:DET	130	59	137	68.78	48.69	63.54
M:NOUN	4	5	9	44.44	30.77	40.82
M:NOUN:POSS	3	0	12	100.00	20.00	55.56
M:OTHER	4	25	47	13.79	7.84	11.98
M:PART	0	0	5	100.00	0.00	0.00
M:PREP	25	27	66	48.08	27.47	41.81
M:PRON	20	8	45	71.43	30.77	56.50
M:PUNCT	52	14	280	78.79	15.66	43.62
M:VERB	11	6	19	64.71	36.67	56.12
M:VERB:FORM	10	7	4	58.82	71.43	60.98
M:VERB:TENSE	11	5	27	68.75	28.95	53.92
R:ADJ	18	32	17	36.00	51.43	38.30
R:ADJ:FORM	5	1	5	83.33	50.00	73.53
R:ADV	15	3	14	83.33	51.72	74.26
R:CONJ	0	1	5	0.00	0.00	0.00
R:CONTR	3	0	1	100.00	75.00	93.75
R:DET	37	39	68	48.68	35.24	45.23
R:MORPH	98	116	60	45.79	62.03	48.32
R:NOUN	42	119	65	26.09	39.25	27.96
R:NOUN:INFL	17	1	3	94.44	85.00	92.39
R:NOUN:NUM	171	109	70	61.07	70.95	62.82
R:NOUN:POSS	11	2	15	84.62	42.31	70.51
R:ORTH	278	113	132	71.10	67.80	70.42
R:OTHER	221	188	443	54.03	33.28	48.04
R:PART	18	9	6	66.67	75.00	68.18
R:PREP	102	46	140	68.92	42.15	61.15
R:PRON	8	22	30	26.67	21.05	25.32
R:PUNCT	37	31	60	54.41	38.14	50.14
R:SPELL	301	29	20	91.21	93.77	91.71
R:VERB	71	23	109	75.53	39.44	63.85
R:VERB:FORM	120	107	42	52.86	74.07	56.07
R:VERB:INFL	6	0	3	100.00	66.67	90.91
R:VERB:SVA	124	66	29	65.26	81.05	67.91
R:VERB:TENSE	82	93	109	46.86	42.93	46.02
R:WO	16	14	56	53.33	22.22	41.67
U:ADJ	4	8	3	33.33	57.14	36.36
U:ADV	11	9	11	55.00	50.00	53.92
U:CONJ	2	0	4	100.00	33.33	71.43
U:CONTR	2	1	4	66.67	33.33	55.56
U:DET	76	39	120	66.09	38.78	57.93
U:NOUN	6	24	11	20.00	35.29	21.90
U:NOUN:POSS	5	0	6	100.00	45.45	80.65
U:OTHER	9	91	19	9.00	32.14	10.51
U:PART	3	1	2	75.00	60.00	71.43
U:PREP	30	22	32	57.69	48.39	55.56
U:PRON	11	5	13	68.75	45.83	62.50
U:PUNCT	17	59	33	22.37	34.00	24.01
U:VERB	8	17	17	32.00	32.00	32.00
U:VERB:FORM	4	5	2	44.44	66.67	47.62
U:VERB:TENSE	13	7	14	65.00	48.15	60.75
UNK	25	0	59	100.00	29.76	67.93

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	451	110	716	80.39	38.65	66.11
R	2297	1116	1970	67.30	53.83	64.09
U	253	726	381	25.84	39.91	27.80
UNK	50	0	78	100.00	39.06	76.22

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	28	37	31	43.08	47.46	43.89
ADJ:FORM	8	1	7	88.89	53.33	78.43
ADV	37	11	45	77.08	45.12	67.52
CONJ	13	6	21	68.42	38.24	59.09
CONTR	5	0	7	100.00	41.67	78.12
DET	279	114	335	70.99	45.44	63.82
MORPH	106	96	61	52.48	63.47	54.36
NOUN	68	125	101	35.23	40.24	36.13
NOUN:INFL	17	1	2	94.44	89.47	93.41
NOUN:NUM	170	89	78	65.64	68.55	66.20
NOUN:POSS	26	2	41	92.86	38.81	72.63
ORTH	353	138	146	71.89	70.74	71.66
OTHER	520	782	838	39.94	38.29	39.60
PART	18	7	14	72.00	56.25	68.18
PREP	183	80	266	69.58	40.76	60.96
PRON	54	27	90	66.67	37.50	57.69
PUNCT	212	105	417	66.88	33.70	55.88
SPELL	308	16	14	95.06	95.65	95.18
UNK	50	0	78	100.00	39.06	76.22
VERB	105	34	179	75.54	36.97	62.50
VERB:FORM	145	96	61	60.17	70.39	61.97
VERB:INFL	8	0	1	100.00	88.89	97.56
VERB:SVA	123	61	33	66.85	78.85	68.95
VERB:TENSE	142	103	177	57.96	44.51	54.66
WO	73	21	102	77.66	41.71	66.24

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	1	5	66.67	28.57	52.63
M:ADV	7	3	13	70.00	35.00	58.33
M:CONJ	11	5	13	68.75	45.83	62.50
M:DET	156	41	134	79.19	53.79	72.36
M:NOUN	4	4	16	50.00	20.00	38.46
M:NOUN:POSS	4	0	11	100.00	26.67	64.52
M:OTHER	12	18	49	40.00	19.67	33.15
M:PART	2	0	4	100.00	33.33	71.43
M:PREP	44	16	68	73.33	39.29	62.50
M:PRON	30	6	40	83.33	42.86	70.09
M:PUNCT	127	11	305	92.03	29.40	64.53
M:VERB	15	1	25	93.75	37.50	72.12
M:VERB:FORM	12	2	6	85.71	66.67	81.08
M:VERB:TENSE	25	2	27	92.59	48.08	78.13
R:ADJ	22	29	20	43.14	52.38	44.72
R:ADJ:FORM	8	1	7	88.89	53.33	78.43
R:ADV	19	1	17	95.00	52.78	81.90
R:CONJ	0	1	4	0.00	0.00	0.00
R:CONTR	3	0	3	100.00	50.00	83.33
R:DET	38	35	72	52.05	34.55	47.26
R:MORPH	106	96	61	52.48	63.47	54.36
R:NOUN	55	103	73	34.81	42.97	36.18
R:NOUN:INFL	17	1	2	94.44	89.47	93.41
R:NOUN:NUM	170	89	78	65.64	68.55	66.20
R:NOUN:POSS	15	2	22	88.24	40.54	71.43
R:ORTH	353	138	146	71.89	70.74	71.66
R:OTHER	473	222	719	68.06	39.68	59.54
R:PART	13	6	7	68.42	65.00	67.71
R:PREP	105	42	154	71.43	40.54	61.98
R:PRON	12	17	31	41.38	27.91	37.74
R:PUNCT	63	30	79	67.74	44.37	61.28
R:SPELL	308	16	14	95.06	95.65	95.18
R:VERB	80	21	135	79.21	37.21	64.62
R:VERB:FORM	128	90	52	58.72	71.11	60.84
R:VERB:INFL	8	0	1	100.00	88.89	97.56
R:VERB:SVA	123	61	33	66.85	78.85	68.95
R:VERB:TENSE	105	94	138	52.76	43.21	50.53
R:WO	73	21	102	77.66	41.71	66.24
U:ADJ	4	7	6	36.36	40.00	37.04
U:ADV	11	7	15	61.11	42.31	56.12
U:CONJ	2	0	4	100.00	33.33	71.43
U:CONTR	2	0	4	100.00	33.33	71.43
U:DET	85	38	129	69.11	39.72	60.20
U:NOUN	9	18	12	33.33	42.86	34.88
U:NOUN:POSS	7	0	8	100.00	46.67	81.40
U:OTHER	35	542	70	6.07	33.33	7.25
U:PART	3	1	3	75.00	50.00	68.18
U:PREP	34	22	44	60.71	43.59	56.29
U:PRON	12	4	19	75.00	38.71	63.16
U:PUNCT	22	64	33	25.58	40.00	27.57
U:VERB	10	12	19	45.45	34.48	42.74
U:VERB:FORM	5	4	3	55.56	62.50	56.82
U:VERB:TENSE	12	7	12	63.16	50.00	60.00
UNK	50	0	78	100.00	39.06	76.22

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	790	668	1263	54.18	38.48	50.10
Span-level detection	1044	415	1170	71.56	47.15	64.84
Token-level detection	1358	407	1426	76.94	48.78	68.98

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	107	76	308	58.47	25.78	46.64
R	614	491	818	55.57	42.88	52.46
U	69	101	137	40.59	33.50	38.94

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	22	8	12.00	27.27	13.51
ADJ:FORM	2	0	1	100.00	66.67	90.91
ADV	13	8	13	61.90	50.00	59.09
CONJ	0	3	7	0.00	0.00	0.00
CONTR	3	0	4	100.00	42.86	78.95
DET	95	47	161	66.90	37.11	57.65
MORPH	47	22	37	68.12	55.95	65.28
NOUN	5	60	39	7.69	11.36	8.22
NOUN:INFL	6	0	1	100.00	85.71	96.77
NOUN:NUM	86	39	40	68.80	68.25	68.69
NOUN:POSS	5	1	8	83.33	38.46	67.57
ORTH	102	48	93	68.00	52.31	64.15
OTHER	36	116	308	23.68	10.47	18.91
PART	8	4	3	66.67	72.73	67.80
PREP	55	29	107	65.48	33.95	55.22
PRON	18	15	50	54.55	26.47	45.00
PUNCT	24	44	148	35.29	13.95	27.03
SPELL	87	58	28	60.00	75.65	62.59
VERB	19	23	73	45.24	20.65	36.54
VERB:FORM	72	51	21	58.54	77.42	61.54
VERB:INFL	2	0	1	100.00	66.67	90.91
VERB:SVA	62	31	19	66.67	76.54	68.43
VERB:TENSE	32	45	78	41.56	29.09	38.28
WO	8	2	15	80.00	34.78	63.49

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	2	1	33.33	50.00	35.71
M:ADV	1	2	6	33.33	14.29	26.32
M:CONJ	0	2	2	0.00	0.00	0.00
M:CONTR	1	0	0	100.00	100.00	100.00
M:DET	48	20	62	70.59	43.64	62.83
M:NOUN	0	3	4	0.00	0.00	0.00
M:NOUN:POSS	1	0	4	100.00	20.00	55.56
M:OTHER	1	14	25	6.67	3.85	5.81
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	15	10	29	60.00	34.09	52.08
M:PRON	11	2	23	84.62	32.35	63.95
M:PUNCT	15	9	117	62.50	11.36	32.89
M:VERB	2	5	14	28.57	12.50	22.73
M:VERB:FORM	9	6	3	60.00	75.00	62.50
M:VERB:TENSE	2	1	17	66.67	10.53	32.26
R:ADJ	1	18	6	5.26	14.29	6.02
R:ADJ:FORM	2	0	1	100.00	66.67	90.91
R:ADV	6	1	5	85.71	54.55	76.92
R:CONJ	0	1	1	0.00	0.00	0.00
R:CONTR	2	0	1	100.00	66.67	90.91
R:DET	12	12	30	50.00	28.57	43.48
R:MORPH	47	22	37	68.12	55.95	65.28
R:NOUN	4	44	30	8.33	11.76	8.85
R:NOUN:INFL	6	0	1	100.00	85.71	96.77
R:NOUN:NUM	86	39	40	68.80	68.25	68.69
R:NOUN:POSS	1	1	4	50.00	20.00	38.46
R:ORTH	102	48	93	68.00	52.31	64.15
R:OTHER	34	79	278	30.09	10.90	22.25
R:PART	7	4	1	63.64	87.50	67.31
R:PREP	31	12	60	72.09	34.07	58.94
R:PRON	3	11	20	21.43	13.04	18.99
R:PUNCT	4	13	22	23.53	15.38	21.28
R:SPELL	87	58	28	60.00	75.65	62.59
R:VERB	14	9	53	60.87	20.90	44.03
R:VERB:FORM	63	44	17	58.88	78.75	62.01
R:VERB:INFL	2	0	1	100.00	66.67	90.91
R:VERB:SVA	62	31	19	66.67	76.54	68.43
R:VERB:TENSE	30	42	55	41.67	35.29	40.21
R:WO	8	2	15	80.00	34.78	63.49
U:ADJ	1	2	1	33.33	50.00	35.71
U:ADV	6	5	2	54.55	75.00	57.69
U:CONJ	0	0	4	100.00	0.00	0.00
U:CONTR	0	0	3	100.00	0.00	0.00
U:DET	35	15	69	70.00	33.65	57.57
U:NOUN	1	13	5	7.14	16.67	8.06
U:NOUN:POSS	3	0	0	100.00	100.00	100.00
U:OTHER	1	23	5	4.17	16.67	4.90
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	9	7	18	56.25	33.33	49.45
U:PRON	4	2	7	66.67	36.36	57.14
U:PUNCT	5	22	9	18.52	35.71	20.49
U:VERB	3	9	6	25.00	33.33	26.32
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	0	2	6	0.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	125	63	291	66.49	30.05	53.51
R	817	281	698	74.41	53.93	69.16
U	88	71	136	55.35	39.29	51.16
UNK	14	0	45	100.00	23.73	60.87

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	8	17	10	32.00	44.44	33.90
ADJ:FORM	3	0	2	100.00	60.00	88.24
ADV	14	6	17	70.00	45.16	63.06
CONJ	2	2	8	50.00	20.00	38.46
CONTR	1	0	4	100.00	20.00	55.56
DET	107	39	155	73.29	40.84	63.24
MORPH	56	9	32	86.15	63.64	80.46
NOUN	17	45	37	27.42	31.48	28.15
NOUN:INFL	5	0	1	100.00	83.33	96.15
NOUN:NUM	80	28	36	74.07	68.97	72.99
NOUN:POSS	6	0	7	100.00	46.15	81.08
ORTH	135	36	59	78.95	69.59	76.88
OTHER	122	73	252	62.56	32.62	52.86
PART	9	3	4	75.00	69.23	73.77
PREP	66	16	108	80.49	37.93	65.74
PRON	24	9	48	72.73	33.33	58.82
PUNCT	41	30	148	57.75	21.69	43.34
SPELL	102	13	8	88.70	92.73	89.47
UNK	14	0	45	100.00	23.73	60.87
VERB	49	9	67	84.48	42.24	70.40
VERB:FORM	69	35	18	66.35	79.31	68.59
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	61	14	15	81.33	80.26	81.12
VERB:TENSE	42	29	74	59.15	36.21	52.50
WO	8	2	14	80.00	36.36	64.52

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	2	1	33.33	50.00	35.71
M:ADV	1	2	4	33.33	20.00	29.41
M:CONJ	1	2	3	33.33	25.00	31.25
M:DET	54	18	58	75.00	48.21	67.50
M:NOUN	0	3	3	0.00	0.00	0.00
M:NOUN:POSS	1	0	4	100.00	20.00	55.56
M:OTHER	3	11	23	21.43	11.54	18.29
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	17	8	29	68.00	36.96	58.22
M:PRON	11	2	23	84.62	32.35	63.95
M:PUNCT	19	6	118	76.00	13.87	40.08
M:VERB	6	2	8	75.00	42.86	65.22
M:VERB:FORM	9	6	2	60.00	81.82	63.38
M:VERB:TENSE	2	1	14	66.67	12.50	35.71
R:ADJ	4	15	8	21.05	33.33	22.73
R:ADJ:FORM	3	0	2	100.00	60.00	88.24
R:ADV	8	0	8	100.00	50.00	83.33
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	0	1	100.00	50.00	83.33
R:DET	15	9	32	62.50	31.91	52.45
R:MORPH	56	9	32	86.15	63.64	80.46
R:NOUN	13	33	29	28.26	30.95	28.76
R:NOUN:INFL	5	0	1	100.00	83.33	96.15
R:NOUN:NUM	80	28	36	74.07	68.97	72.99
R:NOUN:POSS	2	0	3	100.00	40.00	76.92
R:ORTH	135	36	59	78.95	69.59	76.88
R:OTHER	117	40	225	74.52	34.21	60.31
R:PART	8	3	2	72.73	80.00	74.07
R:PREP	39	5	63	88.64	38.24	70.14
R:PRON	6	5	17	54.55	26.09	44.78
R:PUNCT	17	12	19	58.62	47.22	55.92
R:SPELL	102	13	8	88.70	92.73	89.47
R:VERB	37	2	51	94.87	42.05	75.82
R:VERB:FORM	60	28	15	68.18	80.00	70.26
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	61	14	15	81.33	80.26	81.12
R:VERB:TENSE	37	27	56	57.81	39.78	53.01
R:WO	8	2	14	80.00	36.36	64.52
U:ADJ	3	0	1	100.00	75.00	93.75
U:ADV	5	4	5	55.56	50.00	54.35
U:CONJ	1	0	4	100.00	20.00	55.56
U:CONTR	0	0	3	100.00	0.00	0.00
U:DET	38	12	65	76.00	36.89	62.71
U:NOUN	4	9	5	30.77	44.44	32.79
U:NOUN:POSS	3	0	0	100.00	100.00	100.00
U:OTHER	2	22	4	8.33	33.33	9.80
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	10	3	16	76.92	38.46	64.10
U:PRON	7	2	8	77.78	46.67	68.63
U:PUNCT	5	12	11	29.41	31.25	29.76
U:VERB	6	5	8	54.55	42.86	51.72
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	3	1	4	75.00	42.86	65.22
UNK	14	0	45	100.00	23.73	60.87

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	198	35	296	84.98	40.08	69.42
R	1013	245	913	80.52	52.60	72.79
U	119	127	167	48.37	41.61	46.85
UNK	28	0	50	100.00	35.90	73.68

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	10	16	11	38.46	47.62	40.00
ADJ:FORM	5	0	3	100.00	62.50	89.29
ADV	19	4	23	82.61	45.24	70.90
CONJ	4	2	7	66.67	36.36	57.14
CONTR	1	0	3	100.00	25.00	62.50
DET	129	25	160	83.77	44.64	71.27
MORPH	59	5	36	92.19	62.11	84.05
NOUN	25	32	45	43.86	35.71	41.95
NOUN:INFL	6	0	0	100.00	100.00	100.00
NOUN:NUM	79	19	38	80.61	67.52	77.60
NOUN:POSS	8	0	10	100.00	44.44	80.00
ORTH	154	33	56	82.35	73.33	80.38
OTHER	253	164	394	60.67	39.10	54.64
PART	8	1	7	88.89	53.33	78.43
PREP	77	7	121	91.67	38.89	72.10
PRON	32	4	48	88.89	40.00	71.43
PUNCT	75	28	162	72.82	31.65	57.78
SPELL	106	5	5	95.50	95.50	95.50
UNK	28	0	50	100.00	35.90	73.68
VERB	56	1	89	98.25	38.62	75.07
VERB:FORM	73	21	28	77.66	72.28	76.52
VERB:INFL	4	0	0	100.00	100.00	100.00
VERB:SVA	61	12	17	83.56	78.21	82.43
VERB:TENSE	60	26	81	69.77	42.55	61.86
WO	26	2	32	92.86	44.83	76.47

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	1	50.00	50.00	50.00
M:ADV	4	1	6	80.00	40.00	66.67
M:CONJ	3	2	3	60.00	50.00	57.69
M:DET	66	10	57	86.84	53.66	77.28
M:NOUN	0	2	7	0.00	0.00	0.00
M:NOUN:POSS	0	0	3	100.00	0.00	0.00
M:OTHER	5	10	22	33.33	18.52	28.74
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	28	4	28	87.50	50.00	76.09
M:PRON	17	1	19	94.44	47.22	78.70
M:PUNCT	48	3	121	94.12	28.40	64.34
M:VERB	8	0	12	100.00	40.00	76.92
M:VERB:FORM	10	1	4	90.91	71.43	86.21
M:VERB:TENSE	8	0	12	100.00	40.00	76.92
R:ADJ	6	15	10	28.57	37.50	30.00
R:ADJ:FORM	5	0	3	100.00	62.50	89.29
R:ADV	10	0	10	100.00	50.00	83.33
R:CONTR	1	0	1	100.00	50.00	83.33
R:DET	17	6	34	73.91	33.33	59.44
R:MORPH	59	5	36	92.19	62.11	84.05
R:NOUN	19	25	31	43.18	38.00	42.04
R:NOUN:INFL	6	0	0	100.00	100.00	100.00
R:NOUN:NUM	79	19	38	80.61	67.52	77.60
R:NOUN:POSS	5	0	5	100.00	50.00	83.33
R:ORTH	154	33	56	82.35	73.33	80.38
R:OTHER	233	61	351	79.25	39.90	66.19
R:PART	7	1	4	87.50	63.64	81.40
R:PREP	38	2	71	95.00	34.86	70.63
R:PRON	7	2	18	77.78	28.00	57.38
R:PUNCT	18	13	32	58.06	36.00	51.72
R:SPELL	106	5	5	95.50	95.50	95.50
R:VERB	39	0	70	100.00	35.78	73.58
R:VERB:FORM	63	19	22	76.83	74.12	76.27
R:VERB:INFL	4	0	0	100.00	100.00	100.00
R:VERB:SVA	61	12	17	83.56	78.21	82.43
R:VERB:TENSE	50	25	67	66.67	42.74	59.95
R:WO	26	2	32	92.86	44.83	76.47
U:ADJ	3	0	0	100.00	100.00	100.00
U:ADV	5	3	7	62.50	41.67	56.82
U:CONJ	1	0	4	100.00	20.00	55.56
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	46	9	69	83.64	40.00	68.66
U:NOUN	6	5	7	54.55	46.15	52.63
U:NOUN:POSS	3	0	2	100.00	60.00	88.24
U:OTHER	15	93	21	13.89	41.67	16.03
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	11	1	22	91.67	33.33	67.90
U:PRON	8	1	11	88.89	42.11	72.73
U:PUNCT	9	12	9	42.86	50.00	44.12
U:VERB	9	1	7	90.00	56.25	80.36
U:VERB:FORM	0	1	2	0.00	0.00	0.00
U:VERB:TENSE	2	1	2	66.67	50.00	62.50
UNK	28	0	50	100.00	35.90	73.68

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	529	662	900	44.42	37.02	42.71
Span-level detection	695	497	879	58.31	44.16	54.79
Token-level detection	956	636	1094	60.05	46.63	56.78

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	81	83	246	49.39	24.77	41.20
R	382	490	562	43.81	40.47	43.10
U	66	89	92	42.58	41.77	42.42

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	14	7	12.50	22.22	13.70
ADJ:FORM	2	1	1	66.67	66.67	66.67
ADV	8	6	13	57.14	38.10	51.95
CONJ	3	1	6	75.00	33.33	60.00
CONTR	2	0	1	100.00	66.67	90.91
DET	81	51	115	61.36	41.33	55.94
MORPH	18	59	22	23.38	45.00	25.86
NOUN	8	52	28	13.33	22.22	14.49
NOUN:NUM	50	40	22	55.56	69.44	57.87
NOUN:POSS	6	0	7	100.00	46.15	81.08
ORTH	39	38	37	50.65	51.32	50.78
OTHER	17	148	190	10.30	8.21	9.80
PART	8	3	7	72.73	53.33	67.80
PREP	56	43	89	56.57	38.62	51.76
PRON	9	18	32	33.33	21.95	30.20
PUNCT	22	35	116	38.60	15.94	30.05
SPELL	62	33	13	65.26	82.67	68.13
VERB	9	24	68	27.27	11.69	21.53
VERB:FORM	45	36	28	55.56	61.64	56.68
VERB:SVA	39	10	14	79.59	73.58	78.31
VERB:TENSE	39	43	51	47.56	43.33	46.65
WO	4	7	33	36.36	10.81	24.69

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	1	2	6	33.33	14.29	26.32
M:CONJ	3	1	5	75.00	37.50	62.50
M:DET	42	25	58	62.69	42.00	57.07
M:NOUN	0	3	1	0.00	0.00	0.00
M:NOUN:POSS	1	0	3	100.00	25.00	62.50
M:OTHER	0	15	18	0.00	0.00	0.00
M:PART	0	0	3	100.00	0.00	0.00
M:PREP	4	14	25	22.22	13.79	19.80
M:PRON	5	6	18	45.45	21.74	37.31
M:PUNCT	14	8	90	63.64	13.46	36.46
M:VERB	3	4	8	42.86	27.27	38.46
M:VERB:FORM	0	0	1	100.00	0.00	0.00
M:VERB:TENSE	8	5	9	61.54	47.06	57.97
R:ADJ	2	9	6	18.18	25.00	19.23
R:ADJ:FORM	2	1	1	66.67	66.67	66.67
R:ADV	4	3	4	57.14	50.00	55.56
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	14	16	29	46.67	32.56	42.94
R:MORPH	18	59	22	23.38	45.00	25.86
R:NOUN	7	40	23	14.89	23.33	16.06
R:NOUN:NUM	50	40	22	55.56	69.44	57.87
R:NOUN:POSS	4	0	0	100.00	100.00	100.00
R:ORTH	39	38	37	50.65	51.32	50.78
R:OTHER	15	106	161	12.40	8.52	11.36
R:PART	7	3	3	70.00	70.00	70.00
R:PREP	34	24	53	58.62	39.08	53.29
R:PRON	1	10	9	9.09	10.00	9.26
R:PUNCT	3	8	19	27.27	13.64	22.73
R:SPELL	62	33	13	65.26	82.67	68.13
R:VERB	5	12	51	29.41	8.93	20.16
R:VERB:FORM	43	34	26	55.84	62.32	57.03
R:VERB:SVA	39	10	14	79.59	73.58	78.31
R:VERB:TENSE	28	37	35	43.08	44.44	43.34
R:WO	4	7	33	36.36	10.81	24.69
U:ADJ	0	5	0	0.00	100.00	0.00
U:ADV	3	1	3	75.00	50.00	68.18
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	25	10	28	71.43	47.17	64.77
U:NOUN	1	9	4	10.00	20.00	11.11
U:NOUN:POSS	1	0	4	100.00	20.00	55.56
U:OTHER	2	27	11	6.90	15.38	7.75
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	18	5	11	78.26	62.07	74.38
U:PRON	3	2	5	60.00	37.50	53.57
U:PUNCT	5	19	7	20.83	41.67	23.15
U:VERB	1	8	9	11.11	10.00	10.87
U:VERB:FORM	2	2	1	50.00	66.67	52.63
U:VERB:TENSE	3	1	7	75.00	30.00	57.69

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	102	61	251	62.58	28.90	50.75
R	511	359	522	58.74	49.47	56.61
U	74	77	97	49.01	43.27	47.74
UNK	8	0	9	100.00	47.06	81.63

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	8	12	9	40.00	47.06	41.24
ADJ:FORM	2	0	1	100.00	66.67	90.91
ADV	10	6	15	62.50	40.00	56.18
CONJ	4	1	9	80.00	30.77	60.61
CONTR	1	1	1	50.00	50.00	50.00
DET	92	38	114	70.77	44.66	63.36
MORPH	18	40	20	31.03	47.37	33.33
NOUN	21	43	29	32.81	42.00	34.31
NOUN:NUM	57	29	16	66.28	78.08	68.35
NOUN:POSS	6	0	7	100.00	46.15	81.08
ORTH	61	30	39	67.03	61.00	65.73
OTHER	55	117	182	31.98	23.21	29.73
PART	8	3	7	72.73	53.33	67.80
PREP	62	36	86	63.27	41.89	57.41
PRON	10	15	30	40.00	25.00	35.71
PUNCT	38	26	126	59.38	23.17	45.24
SPELL	71	8	2	89.87	97.26	91.26
UNK	8	0	9	100.00	47.06	81.63
VERB	25	18	62	58.14	28.74	48.26
VERB:FORM	45	26	24	63.38	65.22	63.74
VERB:SVA	46	8	9	85.19	83.64	84.87
VERB:TENSE	43	33	52	56.58	45.26	53.88
WO	4	7	30	36.36	11.76	25.64

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	1	2	6	33.33	14.29	26.32
M:CONJ	3	1	7	75.00	30.00	57.69
M:DET	52	15	55	77.61	48.60	69.33
M:NOUN	3	1	2	75.00	60.00	71.43
M:NOUN:POSS	1	0	3	100.00	25.00	62.50
M:OTHER	1	12	16	7.69	5.88	7.25
M:PART	0	0	3	100.00	0.00	0.00
M:PREP	4	14	26	22.22	13.33	19.61
M:PRON	5	4	18	55.56	21.74	42.37
M:PUNCT	19	6	98	76.00	16.24	43.78
M:VERB	4	3	7	57.14	36.36	51.28
M:VERB:FORM	0	0	1	100.00	0.00	0.00
M:VERB:TENSE	9	3	7	75.00	56.25	70.31
R:ADJ	7	8	6	46.67	53.85	47.95
R:ADJ:FORM	2	0	1	100.00	66.67	90.91
R:ADV	5	3	5	62.50	50.00	59.52
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	15	14	29	51.72	34.09	46.87
R:MORPH	18	40	20	31.03	47.37	33.33
R:NOUN	16	33	21	32.65	43.24	34.33
R:NOUN:NUM	57	29	16	66.28	78.08	68.35
R:NOUN:POSS	4	0	0	100.00	100.00	100.00
R:ORTH	61	30	39	67.03	61.00	65.73
R:OTHER	52	80	152	39.39	25.49	35.52
R:PART	7	3	3	70.00	70.00	70.00
R:PREP	40	18	51	68.97	43.96	61.92
R:PRON	1	9	8	10.00	11.11	10.20
R:PUNCT	11	8	21	57.89	34.38	50.93
R:SPELL	71	8	2	89.87	97.26	91.26
R:VERB	19	8	48	70.37	28.36	54.29
R:VERB:FORM	43	24	22	64.18	66.15	64.56
R:VERB:SVA	46	8	9	85.19	83.64	84.87
R:VERB:TENSE	31	29	37	51.67	45.59	50.32
R:WO	4	7	30	36.36	11.76	25.64
U:ADJ	1	4	1	20.00	50.00	22.73
U:ADV	4	1	4	80.00	50.00	71.43
U:CONJ	1	0	0	100.00	100.00	100.00
U:CONTR	0	1	1	0.00	0.00	0.00
U:DET	25	9	30	73.53	45.45	65.45
U:NOUN	2	9	6	18.18	25.00	19.23
U:NOUN:POSS	1	0	4	100.00	20.00	55.56
U:OTHER	2	25	14	7.41	12.50	8.06
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	18	4	9	81.82	66.67	78.26
U:PRON	4	2	4	66.67	50.00	62.50
U:PUNCT	8	12	7	40.00	53.33	42.11
U:VERB	2	7	7	22.22	22.22	22.22
U:VERB:FORM	2	2	1	50.00	66.67	52.63
U:VERB:TENSE	3	1	8	75.00	27.27	55.56
UNK	8	0	9	100.00	47.06	81.63

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	156	37	259	80.83	37.59	65.71
R	700	341	675	67.24	50.91	63.19
U	85	258	137	24.78	38.29	26.66
UNK	15	0	23	100.00	39.47	76.53

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	11	10	10	52.38	52.38	52.38
ADJ:FORM	2	0	1	100.00	66.67	90.91
ADV	11	3	15	78.57	42.31	67.07
CONJ	6	1	10	85.71	37.50	68.18
CONTR	1	0	1	100.00	50.00	83.33
DET	103	29	118	78.03	46.61	68.76
MORPH	22	32	18	40.74	55.00	42.97
NOUN	28	36	34	43.75	45.16	44.03
NOUN:NUM	57	22	18	72.15	76.00	72.89
NOUN:POSS	9	0	8	100.00	52.94	84.91
ORTH	86	33	41	72.27	67.72	71.31
OTHER	158	314	304	33.47	34.20	33.62
PART	7	2	5	77.78	58.33	72.92
PREP	71	30	95	70.30	42.77	62.28
PRON	13	13	33	50.00	28.26	43.33
PUNCT	66	25	131	72.53	33.50	58.82
SPELL	71	4	1	94.67	98.61	95.43
UNK	15	0	23	100.00	39.47	76.53
VERB	31	11	70	73.81	30.69	57.62
VERB:FORM	49	21	24	70.00	67.12	69.41
VERB:SVA	45	9	11	83.33	80.36	82.72
VERB:TENSE	57	31	66	64.77	46.34	60.00
WO	37	10	57	78.72	39.36	65.60

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	2	100.00	33.33	71.43
M:ADV	2	2	6	50.00	25.00	41.67
M:CONJ	5	1	7	83.33	41.67	69.44
M:DET	63	7	55	90.00	53.39	79.15
M:NOUN	3	1	4	75.00	42.86	65.22
M:NOUN:POSS	2	0	3	100.00	40.00	76.92
M:OTHER	5	6	18	45.45	21.74	37.31
M:PART	2	0	2	100.00	50.00	83.33
M:PREP	8	9	29	47.06	21.62	38.10
M:PRON	7	3	17	70.00	29.17	54.69
M:PUNCT	37	6	98	86.05	27.41	60.26
M:VERB	6	0	7	100.00	46.15	81.08
M:VERB:FORM	1	0	1	100.00	50.00	83.33
M:VERB:TENSE	14	2	10	87.50	58.33	79.55
R:ADJ	9	7	6	56.25	60.00	56.96
R:ADJ:FORM	2	0	1	100.00	66.67	90.91
R:ADV	6	1	5	85.71	54.55	76.92
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	14	14	30	50.00	31.82	44.87
R:MORPH	22	32	18	40.74	55.00	42.97
R:NOUN	22	27	26	44.90	45.83	45.08
R:NOUN:NUM	57	22	18	72.15	76.00	72.89
R:NOUN:POSS	5	0	1	100.00	83.33	96.15
R:ORTH	86	33	41	72.27	67.72	71.31
R:OTHER	143	93	244	60.59	36.95	53.72
R:PART	4	2	2	66.67	66.67	66.67
R:PREP	43	17	54	71.67	44.33	63.80
R:PRON	2	8	10	20.00	16.67	19.23
R:PUNCT	21	8	24	72.41	46.67	65.22
R:SPELL	71	4	1	94.67	98.61	95.43
R:VERB	24	7	54	77.42	30.77	59.41
R:VERB:FORM	46	19	22	70.77	67.65	70.12
R:VERB:SVA	45	9	11	83.33	80.36	82.72
R:VERB:TENSE	40	28	47	58.82	45.98	55.71
R:WO	37	10	57	78.72	39.36	65.60
U:ADJ	1	3	2	25.00	33.33	26.32
U:ADV	3	0	4	100.00	42.86	78.95
U:CONJ	1	0	0	100.00	100.00	100.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	26	8	33	76.47	44.07	66.67
U:NOUN	3	8	4	27.27	42.86	29.41
U:NOUN:POSS	2	0	4	100.00	33.33	71.43
U:OTHER	10	215	42	4.44	19.23	5.25
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	20	4	12	83.33	62.50	78.12
U:PRON	4	2	6	66.67	40.00	58.82
U:PUNCT	8	11	9	42.11	47.06	43.01
U:VERB	1	4	9	20.00	10.00	16.67
U:VERB:FORM	2	2	1	50.00	66.67	52.63
U:VERB:TENSE	3	1	9	75.00	25.00	53.57
UNK	15	0	23	100.00	39.47	76.53

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	231	361	301	39.02	43.42	39.83
Span-level detection	293	300	280	49.41	51.13	49.75
Token-level detection	381	377	366	50.26	51.00	50.41

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	32	24	89	57.14	26.45	46.38
R	168	279	176	37.58	48.84	39.40
U	31	58	36	34.83	46.27	36.64

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	7	5	12.50	16.67	13.16
ADJ:FORM	0	1	2	0.00	0.00	0.00
ADV	2	2	3	50.00	40.00	47.62
CONJ	0	3	4	0.00	0.00	0.00
CONTR	2	1	1	66.67	66.67	66.67
DET	34	22	47	60.71	41.98	55.74
MORPH	10	37	10	21.28	50.00	24.04
NOUN	6	34	9	15.00	40.00	17.14
NOUN:INFL	1	0	1	100.00	50.00	83.33
NOUN:NUM	22	17	16	56.41	57.89	56.70
NOUN:POSS	1	1	6	50.00	14.29	33.33
ORTH	30	19	13	61.22	69.77	62.76
OTHER	18	55	46	24.66	28.12	25.28
PART	2	2	2	50.00	50.00	50.00
PREP	23	20	32	53.49	41.82	50.66
PRON	4	8	6	33.33	40.00	34.48
PUNCT	10	33	41	23.26	19.61	22.42
SPELL	25	18	13	58.14	65.79	59.52
VERB	2	6	10	25.00	16.67	22.73
VERB:FORM	14	36	3	28.00	82.35	32.26
VERB:SVA	8	11	2	42.11	80.00	46.51
VERB:TENSE	13	27	17	32.50	43.33	34.21
WO	3	1	12	75.00	20.00	48.39

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	1	0	0	100.00	100.00	100.00
M:CONJ	0	2	2	0.00	0.00	0.00
M:DET	17	12	22	58.62	43.59	54.84
M:NOUN	0	1	2	0.00	0.00	0.00
M:OTHER	0	3	8	0.00	0.00	0.00
M:PREP	3	2	11	60.00	21.43	44.12
M:PRON	3	1	3	75.00	50.00	68.18
M:PUNCT	7	2	33	77.78	17.50	46.05
M:VERB	0	0	2	100.00	0.00	0.00
M:VERB:FORM	1	0	1	100.00	50.00	83.33
M:VERB:TENSE	0	1	4	0.00	0.00	0.00
R:ADJ	1	5	3	16.67	25.00	17.86
R:ADJ:FORM	0	1	2	0.00	0.00	0.00
R:ADV	0	0	1	100.00	0.00	0.00
R:CONJ	0	1	2	0.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	5	3	6	62.50	45.45	58.14
R:MORPH	10	37	10	21.28	50.00	24.04
R:NOUN	5	31	7	13.89	41.67	16.03
R:NOUN:INFL	1	0	1	100.00	50.00	83.33
R:NOUN:NUM	22	17	16	56.41	57.89	56.70
R:NOUN:POSS	0	1	5	0.00	0.00	0.00
R:ORTH	30	19	13	61.22	69.77	62.76
R:OTHER	15	40	37	27.27	28.85	27.57
R:PART	2	2	2	50.00	50.00	50.00
R:PREP	18	14	16	56.25	52.94	55.56
R:PRON	1	6	2	14.29	33.33	16.13
R:PUNCT	1	6	4	14.29	20.00	15.15
R:SPELL	25	18	13	58.14	65.79	59.52
R:VERB	2	6	7	25.00	22.22	24.39
R:VERB:FORM	11	35	2	23.91	84.62	27.92
R:VERB:SVA	8	11	2	42.11	80.00	46.51
R:VERB:TENSE	8	24	12	25.00	40.00	27.03
R:WO	3	1	12	75.00	20.00	48.39
U:ADJ	0	2	1	0.00	0.00	0.00
U:ADV	1	2	2	33.33	33.33	33.33
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	12	7	19	63.16	38.71	56.07
U:NOUN	1	2	0	33.33	100.00	38.46
U:NOUN:POSS	1	0	1	100.00	50.00	83.33
U:OTHER	3	12	1	20.00	75.00	23.44
U:PREP	2	4	5	33.33	28.57	32.26
U:PRON	0	1	1	0.00	0.00	0.00
U:PUNCT	2	25	4	7.41	33.33	8.77
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:FORM	2	1	0	66.67	100.00	71.43
U:VERB:TENSE	5	2	1	71.43	83.33	73.53

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	34	23	88	59.65	27.87	48.57
R	227	226	151	50.11	60.05	51.83
U	30	51	39	37.04	43.48	38.17
UNK	2	0	2	100.00	50.00	83.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	6	5	14.29	16.67	14.71
ADJ:FORM	0	1	2	0.00	0.00	0.00
ADV	1	2	3	33.33	25.00	31.25
CONJ	0	3	5	0.00	0.00	0.00
CONTR	3	0	0	100.00	100.00	100.00
DET	34	22	51	60.71	40.00	55.02
MORPH	14	32	8	30.43	63.64	33.98
NOUN	9	27	11	25.00	45.00	27.44
NOUN:INFL	3	0	0	100.00	100.00	100.00
NOUN:NUM	23	14	15	62.16	60.53	61.83
NOUN:POSS	2	1	5	66.67	28.57	52.63
ORTH	37	14	8	72.55	82.22	74.30
OTHER	31	46	43	40.26	41.89	40.58
PART	3	2	2	60.00	60.00	60.00
PREP	24	16	31	60.00	43.64	55.81
PRON	4	8	6	33.33	40.00	34.48
PUNCT	17	28	39	37.78	30.36	36.02
SPELL	37	6	1	86.05	97.37	88.10
UNK	2	0	2	100.00	50.00	83.33
VERB	5	6	9	45.45	35.71	43.10
VERB:FORM	15	32	3	31.91	83.33	36.41
VERB:SVA	9	9	2	50.00	81.82	54.22
VERB:TENSE	16	25	18	39.02	47.06	40.40
WO	3	0	11	100.00	21.43	57.69

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:CONJ	0	2	3	0.00	0.00	0.00
M:DET	17	12	23	58.62	42.50	54.49
M:NOUN	1	1	2	50.00	33.33	45.45
M:OTHER	0	2	8	0.00	0.00	0.00
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	3	2	10	60.00	23.08	45.45
M:PRON	3	1	3	75.00	50.00	68.18
M:PUNCT	9	2	29	81.82	23.68	54.88
M:VERB	0	0	2	100.00	0.00	0.00
M:VERB:FORM	1	0	1	100.00	50.00	83.33
M:VERB:TENSE	0	1	5	0.00	0.00	0.00
R:ADJ	1	4	3	20.00	25.00	20.83
R:ADJ:FORM	0	1	2	0.00	0.00	0.00
R:ADV	0	0	1	100.00	0.00	0.00
R:CONJ	0	1	2	0.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	5	3	6	62.50	45.45	58.14
R:MORPH	14	32	8	30.43	63.64	33.98
R:NOUN	8	25	9	24.24	47.06	26.85
R:NOUN:INFL	3	0	0	100.00	100.00	100.00
R:NOUN:NUM	23	14	15	62.16	60.53	61.83
R:NOUN:POSS	1	1	4	50.00	20.00	38.46
R:ORTH	37	14	8	72.55	82.22	74.30
R:OTHER	28	32	34	46.67	45.16	46.36
R:PART	3	2	1	60.00	75.00	62.50
R:PREP	19	11	16	63.33	54.29	61.29
R:PRON	1	6	2	14.29	33.33	16.13
R:PUNCT	7	6	6	53.85	53.85	53.85
R:SPELL	37	6	1	86.05	97.37	88.10
R:VERB	5	6	6	45.45	45.45	45.45
R:VERB:FORM	12	31	2	27.91	85.71	32.26
R:VERB:SVA	9	9	2	50.00	81.82	54.22
R:VERB:TENSE	10	22	12	31.25	45.45	33.33
R:WO	3	0	11	100.00	21.43	57.69
U:ADJ	0	2	1	0.00	0.00	0.00
U:ADV	1	2	2	33.33	33.33	33.33
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	12	7	22	63.16	35.29	54.55
U:NOUN	0	1	0	0.00	100.00	0.00
U:NOUN:POSS	1	0	1	100.00	50.00	83.33
U:OTHER	3	12	1	20.00	75.00	23.44
U:PREP	2	3	5	40.00	28.57	37.04
U:PRON	0	1	1	0.00	0.00	0.00
U:PUNCT	1	20	4	4.76	20.00	5.62
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:FORM	2	1	0	66.67	100.00	71.43
U:VERB:TENSE	6	2	1	75.00	85.71	76.92
UNK	2	0	2	100.00	50.00	83.33

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	61	20	99	75.31	38.12	63.02
R	281	220	213	56.09	56.88	56.24
U	35	137	49	20.35	41.67	22.67
UNK	4	0	5	100.00	44.44	80.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	5	9	0.00	0.00	0.00
ADJ:FORM	0	1	3	0.00	0.00	0.00
ADV	4	1	7	80.00	36.36	64.52
CONJ	2	2	4	50.00	33.33	45.45
CONTR	3	0	1	100.00	75.00	93.75
DET	38	20	51	65.52	42.70	59.19
MORPH	16	28	7	36.36	69.57	40.20
NOUN	9	23	11	28.12	45.00	30.41
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	23	11	18	67.65	56.10	64.97
NOUN:POSS	4	1	7	80.00	36.36	64.52
ORTH	51	24	15	68.00	77.27	69.67
OTHER	53	133	82	28.49	39.26	30.15
PART	2	2	2	50.00	50.00	50.00
PREP	28	16	34	63.64	45.16	58.82
PRON	6	7	6	46.15	50.00	46.88
PUNCT	37	28	51	56.92	42.05	53.16
SPELL	39	5	0	88.64	100.00	90.70
UNK	4	0	5	100.00	44.44	80.00
VERB	7	6	12	53.85	36.84	49.30
VERB:FORM	16	29	7	35.56	69.57	39.41
VERB:SVA	9	9	2	50.00	81.82	54.22
VERB:TENSE	20	26	19	43.48	51.28	44.84
WO	8	0	13	100.00	38.10	75.47

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	1	0	1	100.00	50.00	83.33
M:CONJ	2	1	3	66.67	40.00	58.82
M:DET	21	11	21	65.62	50.00	61.76
M:NOUN	1	1	2	50.00	33.33	45.45
M:NOUN:POSS	1	0	0	100.00	100.00	100.00
M:OTHER	2	2	9	50.00	18.18	37.04
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	6	2	9	75.00	40.00	63.83
M:PRON	4	1	3	80.00	57.14	74.07
M:PUNCT	19	2	40	90.48	32.20	66.43
M:VERB	0	0	3	100.00	0.00	0.00
M:VERB:FORM	1	0	1	100.00	50.00	83.33
M:VERB:TENSE	3	0	4	100.00	42.86	78.95
R:ADJ	0	3	4	0.00	0.00	0.00
R:ADJ:FORM	0	1	3	0.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONJ	0	1	1	0.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	5	2	7	71.43	41.67	62.50
R:MORPH	16	28	7	36.36	69.57	40.20
R:NOUN	8	21	8	27.59	50.00	30.30
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	23	11	18	67.65	56.10	64.97
R:NOUN:POSS	1	1	6	50.00	14.29	33.33
R:ORTH	51	24	15	68.00	77.27	69.67
R:OTHER	46	34	69	57.50	40.00	52.87
R:PART	2	2	1	50.00	66.67	52.63
R:PREP	20	11	19	64.52	51.28	61.35
R:PRON	2	5	1	28.57	66.67	32.26
R:PUNCT	16	4	8	80.00	66.67	76.92
R:SPELL	39	5	0	88.64	100.00	90.70
R:VERB	7	6	8	53.85	46.67	52.24
R:VERB:FORM	13	28	6	31.71	68.42	35.52
R:VERB:SVA	9	9	2	50.00	81.82	54.22
R:VERB:TENSE	11	24	15	31.43	42.31	33.13
R:WO	8	0	13	100.00	38.10	75.47
U:ADJ	0	2	3	0.00	0.00	0.00
U:ADV	2	1	4	66.67	33.33	55.56
U:CONTR	2	0	1	100.00	66.67	90.91
U:DET	12	7	23	63.16	34.29	54.05
U:NOUN	0	1	1	0.00	0.00	0.00
U:NOUN:POSS	2	0	1	100.00	66.67	90.91
U:OTHER	5	97	4	4.90	55.56	6.00
U:PREP	2	3	6	40.00	25.00	35.71
U:PRON	0	1	2	0.00	0.00	0.00
U:PUNCT	2	22	3	8.33	40.00	9.90
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:FORM	2	1	0	66.67	100.00	71.43
U:VERB:TENSE	6	2	0	75.00	100.00	78.95
UNK	4	0	5	100.00	44.44	80.00

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	210	470	214	30.88	49.53	33.40
Span-level detection	272	408	201	40.00	57.51	42.59
Token-level detection	356	532	259	40.09	57.89	42.72

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	14	23	45	37.84	23.73	33.82
R	186	349	150	34.77	55.36	37.56
U	10	98	19	9.26	34.48	10.85

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	4	11	1	26.67	80.00	30.77
ADV	2	5	2	28.57	50.00	31.25
CONJ	0	1	0	0.00	100.00	0.00
DET	9	39	3	18.75	75.00	22.06
MORPH	6	40	0	13.04	100.00	15.79
NOUN	5	37	8	11.90	38.46	13.81
NOUN:INFL	10	2	2	83.33	83.33	83.33
NOUN:NUM	13	41	4	24.07	76.47	27.90
NOUN:POSS	1	1	16	50.00	5.88	20.00
ORTH	41	37	21	52.56	66.13	54.81
OTHER	12	73	35	14.12	25.53	15.50
PART	1	2	0	33.33	100.00	38.46
PREP	4	29	14	12.12	22.22	13.33
PRON	1	3	4	25.00	20.00	23.81
PUNCT	8	21	56	27.59	12.50	22.22
SPELL	68	22	27	75.56	71.58	74.73
VERB	6	16	7	27.27	46.15	29.70
VERB:FORM	4	27	4	12.90	50.00	15.15
VERB:INFL	3	0	2	100.00	60.00	88.24
VERB:SVA	8	39	3	17.02	72.73	20.10
VERB:TENSE	3	19	4	13.64	42.86	15.79
WO	1	5	1	16.67	50.00	19.23

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	0	1	0	0.00	100.00	0.00
M:DET	6	15	1	28.57	85.71	32.97
M:NOUN	0	0	2	100.00	0.00	0.00
M:NOUN:POSS	1	0	5	100.00	16.67	50.00
M:PREP	1	3	0	25.00	100.00	29.41
M:PRON	1	1	1	50.00	50.00	50.00
M:PUNCT	4	0	33	100.00	10.81	37.74
M:VERB	1	2	2	33.33	33.33	33.33
M:VERB:FORM	0	1	0	0.00	100.00	0.00
R:ADJ	4	6	1	40.00	80.00	44.44
R:ADV	0	3	1	0.00	0.00	0.00
R:DET	2	13	0	13.33	100.00	16.13
R:MORPH	6	40	0	13.04	100.00	15.79
R:NOUN	5	29	6	14.71	45.45	17.01
R:NOUN:INFL	10	2	2	83.33	83.33	83.33
R:NOUN:NUM	13	41	4	24.07	76.47	27.90
R:NOUN:POSS	0	1	10	0.00	0.00	0.00
R:ORTH	41	37	21	52.56	66.13	54.81
R:OTHER	10	40	35	20.00	22.22	20.41
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	3	13	11	18.75	21.43	19.23
R:PRON	0	2	3	0.00	0.00	0.00
R:PUNCT	1	5	13	16.67	7.14	13.16
R:SPELL	68	22	27	75.56	71.58	74.73
R:VERB	5	9	4	35.71	55.56	38.46
R:VERB:FORM	4	25	3	13.79	57.14	16.26
R:VERB:INFL	3	0	2	100.00	60.00	88.24
R:VERB:SVA	8	39	3	17.02	72.73	20.10
R:VERB:TENSE	2	16	3	11.11	40.00	12.99
R:WO	1	5	1	16.67	50.00	19.23
U:ADJ	0	5	0	0.00	100.00	0.00
U:ADV	2	2	0	50.00	100.00	55.56
U:DET	1	11	2	8.33	33.33	9.80
U:NOUN	0	8	0	0.00	100.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	2	33	0	5.71	100.00	7.04
U:PART	1	1	0	50.00	100.00	55.56
U:PREP	0	13	3	0.00	0.00	0.00
U:PUNCT	3	16	10	15.79	23.08	16.85
U:VERB	0	5	1	0.00	0.00	0.00
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	1	3	1	25.00	50.00	27.78

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	16	21	48	43.24	25.00	37.74
R	246	298	131	45.22	65.25	48.18
U	9	89	19	9.18	32.14	10.71
UNK	1	0	3	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	7	0	46.15	100.00	51.72
ADV	3	2	0	60.00	100.00	65.22
CONJ	0	1	0	0.00	100.00	0.00
DET	10	38	5	20.83	66.67	24.15
MORPH	10	35	0	22.22	100.00	26.32
NOUN	5	33	8	13.16	38.46	15.15
NOUN:INFL	9	1	2	90.00	81.82	88.24
NOUN:NUM	11	38	3	22.45	78.57	26.19
NOUN:POSS	5	1	14	83.33	26.32	58.14
ORTH	45	33	26	57.69	63.38	58.75
OTHER	26	68	32	27.66	44.83	29.95
PART	1	2	0	33.33	100.00	38.46
PREP	5	27	13	15.62	27.78	17.12
PRON	1	3	4	25.00	20.00	23.81
PUNCT	10	20	60	33.33	14.29	26.32
SPELL	91	2	9	97.85	91.00	96.40
UNK	1	0	3	100.00	25.00	62.50
VERB	11	13	7	45.83	61.11	48.25
VERB:FORM	5	26	3	16.13	62.50	18.94
VERB:INFL	3	0	2	100.00	60.00	88.24
VERB:SVA	8	35	3	18.60	72.73	21.86
VERB:TENSE	5	18	6	21.74	45.45	24.27
WO	1	5	1	16.67	50.00	19.23

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	0	1	0	0.00	100.00	0.00
M:DET	7	14	1	33.33	87.50	38.04
M:NOUN	0	0	2	100.00	0.00	0.00
M:NOUN:POSS	1	0	5	100.00	16.67	50.00
M:PREP	1	3	1	25.00	50.00	27.78
M:PRON	1	1	1	50.00	50.00	50.00
M:PUNCT	5	0	35	100.00	12.50	41.67
M:VERB	1	1	2	50.00	33.33	45.45
M:VERB:FORM	0	1	0	0.00	100.00	0.00
M:VERB:TENSE	0	0	1	100.00	0.00	0.00
R:ADJ	6	5	0	54.55	100.00	60.00
R:ADV	2	0	0	100.00	100.00	100.00
R:DET	2	13	1	13.33	66.67	15.87
R:MORPH	10	35	0	22.22	100.00	26.32
R:NOUN	5	28	6	15.15	45.45	17.48
R:NOUN:INFL	9	1	2	90.00	81.82	88.24
R:NOUN:NUM	11	38	3	22.45	78.57	26.19
R:NOUN:POSS	4	1	8	80.00	33.33	62.50
R:ORTH	45	33	26	57.69	63.38	58.75
R:OTHER	24	36	32	40.00	42.86	40.54
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	4	12	10	25.00	28.57	25.64
R:PRON	0	2	3	0.00	0.00	0.00
R:PUNCT	2	5	14	28.57	12.50	22.73
R:SPELL	91	2	9	97.85	91.00	96.40
R:VERB	10	7	4	58.82	71.43	60.98
R:VERB:FORM	5	24	3	17.24	62.50	20.16
R:VERB:INFL	3	0	2	100.00	60.00	88.24
R:VERB:SVA	8	35	3	18.60	72.73	21.86
R:VERB:TENSE	4	15	4	21.05	50.00	23.81
R:WO	1	5	1	16.67	50.00	19.23
U:ADJ	0	2	0	0.00	100.00	0.00
U:ADV	1	2	0	33.33	100.00	38.46
U:DET	1	11	3	8.33	25.00	9.62
U:NOUN	0	5	0	0.00	100.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	2	32	0	5.88	100.00	7.25
U:PART	1	1	0	50.00	100.00	55.56
U:PREP	0	12	2	0.00	0.00	0.00
U:PUNCT	3	15	11	16.67	21.43	17.44
U:VERB	0	5	1	0.00	0.00	0.00
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	1	3	1	25.00	50.00	27.78
UNK	1	0	3	100.00	25.00	62.50

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	36	18	62	66.67	36.73	57.32
R	303	310	169	49.43	64.19	51.81
U	14	204	28	6.42	33.33	7.66
UNK	3	0	0	100.00	100.00	100.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	7	6	1	53.85	87.50	58.33
ADJ:FORM	1	0	0	100.00	100.00	100.00
ADV	3	3	0	50.00	100.00	55.56
CONJ	1	1	0	50.00	100.00	55.56
CONTR	0	0	2	100.00	0.00	0.00
DET	9	40	6	18.37	60.00	21.33
MORPH	9	31	0	22.50	100.00	26.63
NOUN	6	34	11	15.00	35.29	16.95
NOUN:INFL	9	1	2	90.00	81.82	88.24
NOUN:NUM	11	37	4	22.92	73.33	26.57
NOUN:POSS	5	1	16	83.33	23.81	55.56
ORTH	62	48	34	56.36	64.58	57.84
OTHER	56	171	58	24.67	49.12	27.40
PART	1	2	0	33.33	100.00	38.46
PREP	7	27	16	20.59	30.43	22.01
PRON	3	3	3	50.00	50.00	50.00
PUNCT	34	24	73	58.62	31.78	50.15
SPELL	92	2	8	97.87	92.00	96.64
UNK	3	0	0	100.00	100.00	100.00
VERB	11	16	8	40.74	57.89	43.31
VERB:FORM	7	25	2	21.88	77.78	25.55
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	8	31	3	20.51	72.73	23.95
VERB:TENSE	5	20	11	20.00	31.25	21.55
WO	2	9	0	18.18	100.00	21.74

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	1	1	0	50.00	100.00	55.56
M:DET	6	13	1	31.58	85.71	36.14
M:NOUN	0	0	3	100.00	0.00	0.00
M:NOUN:POSS	1	0	5	100.00	16.67	50.00
M:PREP	2	1	2	66.67	50.00	62.50
M:PRON	2	1	1	66.67	66.67	66.67
M:PUNCT	23	0	46	100.00	33.33	71.43
M:VERB	1	1	3	50.00	25.00	41.67
M:VERB:FORM	0	1	0	0.00	100.00	0.00
M:VERB:TENSE	0	0	1	100.00	0.00	0.00
R:ADJ	7	4	0	63.64	100.00	68.63
R:ADJ:FORM	1	0	0	100.00	100.00	100.00
R:ADV	2	0	0	100.00	100.00	100.00
R:CONTR	0	0	2	100.00	0.00	0.00
R:DET	2	13	1	13.33	66.67	15.87
R:MORPH	9	31	0	22.50	100.00	26.63
R:NOUN	6	30	8	16.67	42.86	18.99
R:NOUN:INFL	9	1	2	90.00	81.82	88.24
R:NOUN:NUM	11	37	4	22.92	73.33	26.57
R:NOUN:POSS	4	1	10	80.00	28.57	58.82
R:ORTH	62	48	34	56.36	64.58	57.84
R:OTHER	51	34	55	60.00	48.11	57.17
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	4	12	10	25.00	28.57	25.64
R:PRON	1	2	2	33.33	33.33	33.33
R:PUNCT	8	5	15	61.54	34.78	53.33
R:SPELL	92	2	8	97.87	92.00	96.64
R:VERB	10	8	3	55.56	76.92	58.82
R:VERB:FORM	6	24	2	20.00	75.00	23.44
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	8	31	3	20.51	72.73	23.95
R:VERB:TENSE	4	17	9	19.05	30.77	20.62
R:WO	2	9	0	18.18	100.00	21.74
U:ADJ	0	2	1	0.00	0.00	0.00
U:ADV	1	3	0	25.00	100.00	29.41
U:DET	1	14	4	6.67	20.00	7.69
U:NOUN	0	4	0	0.00	100.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	5	137	3	3.52	62.50	4.34
U:PART	1	1	0	50.00	100.00	55.56
U:PREP	1	14	4	6.67	20.00	7.69
U:PUNCT	3	19	12	13.64	20.00	14.56
U:VERB	0	7	2	0.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	1	3	1	25.00	50.00	27.78
UNK	3	0	0	100.00	100.00	100.00

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:44:31+00:00
Competition submission:	19
Competition phase:	3 - Open phase

Detailed results

Submission information

Results