BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1814	1450	2956	55.58	38.03	50.88
Span-level detection	2274	992	2849	69.63	44.39	62.52
Token-level detection	2666	750	3443	78.04	43.64	67.42

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	229	187	806	55.05	22.13	42.42
R	1349	991	1865	57.65	41.97	53.64
U	236	272	285	46.46	45.30	46.22

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	1	29	0.00	0.00	0.00
ADJ:FORM	2	10	6	16.67	25.00	17.86
ADV	0	2	41	0.00	0.00	0.00
CONJ	7	32	20	17.95	25.93	19.13
CONTR	3	5	7	37.50	30.00	35.71
DET	113	103	404	52.31	21.86	40.91
MORPH	29	35	105	45.31	21.64	37.18
NOUN	4	9	92	30.77	4.17	13.51
NOUN:INFL	16	1	2	94.12	88.89	93.02
NOUN:NUM	222	170	69	56.63	76.29	59.71
NOUN:POSS	20	20	31	50.00	39.22	47.39
ORTH	228	60	175	79.17	56.58	73.31
OTHER	20	85	660	19.05	2.94	9.09
PART	15	13	16	53.57	48.39	52.45
PREP	226	218	238	50.90	48.71	50.45
PRON	12	26	107	31.58	10.08	22.14
PUNCT	309	267	365	53.65	45.85	51.88
SPELL	263	136	61	65.91	81.17	68.49
VERB	3	24	196	11.11	1.51	4.89
VERB:FORM	129	89	70	59.17	64.82	60.22
VERB:INFL	7	0	1	100.00	87.50	97.22
VERB:SVA	104	13	38	88.89	73.24	85.25
VERB:TENSE	81	118	156	40.70	34.18	39.21
WO	1	13	67	7.14	1.47	4.03

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	4	100.00	0.00	0.00
M:ADV	0	0	7	100.00	0.00	0.00
M:CONJ	2	10	11	16.67	15.38	16.39
M:CONTR	1	4	0	20.00	100.00	23.81
M:DET	0	0	222	100.00	0.00	0.00
M:NOUN	0	0	9	100.00	0.00	0.00
M:NOUN:POSS	3	6	11	33.33	21.43	30.00
M:OTHER	0	0	53	100.00	0.00	0.00
M:PART	0	0	4	100.00	0.00	0.00
M:PREP	0	0	86	100.00	0.00	0.00
M:PRON	0	0	54	100.00	0.00	0.00
M:PUNCT	223	167	273	57.18	44.96	54.23
M:VERB	0	0	26	100.00	0.00	0.00
M:VERB:FORM	0	0	11	100.00	0.00	0.00
M:VERB:TENSE	0	0	35	100.00	0.00	0.00
R:ADJ	0	1	23	0.00	0.00	0.00
R:ADJ:FORM	2	10	6	16.67	25.00	17.86
R:ADV	0	0	19	100.00	0.00	0.00
R:CONJ	0	0	5	100.00	0.00	0.00
R:CONTR	0	0	4	100.00	0.00	0.00
R:DET	39	41	71	48.75	35.45	45.35
R:MORPH	29	35	105	45.31	21.64	37.18
R:NOUN	4	9	71	30.77	5.33	15.75
R:NOUN:INFL	16	1	2	94.12	88.89	93.02
R:NOUN:NUM	222	170	69	56.63	76.29	59.71
R:NOUN:POSS	9	5	15	64.29	37.50	56.25
R:ORTH	228	60	175	79.17	56.58	73.31
R:OTHER	17	79	590	17.71	2.80	8.58
R:PART	14	13	6	51.85	70.00	54.69
R:PREP	185	173	110	51.68	62.71	53.56
R:PRON	0	2	42	0.00	0.00	0.00
R:PUNCT	14	43	65	24.56	17.72	22.80
R:SPELL	263	136	61	65.91	81.17	68.49
R:VERB	0	3	156	0.00	0.00	0.00
R:VERB:FORM	121	84	55	59.02	68.75	60.74
R:VERB:INFL	7	0	1	100.00	87.50	97.22
R:VERB:SVA	104	13	38	88.89	73.24	85.25
R:VERB:TENSE	74	100	109	42.53	40.44	42.09
R:WO	1	13	67	7.14	1.47	4.03
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	0	2	15	0.00	0.00	0.00
U:CONJ	5	22	4	18.52	55.56	21.37
U:CONTR	2	1	3	66.67	40.00	58.82
U:DET	74	62	111	54.41	40.00	50.75
U:NOUN	0	0	12	100.00	0.00	0.00
U:NOUN:POSS	8	9	5	47.06	61.54	49.38
U:OTHER	3	6	17	33.33	15.00	26.79
U:PART	1	0	6	100.00	14.29	45.45
U:PREP	41	45	42	47.67	49.40	48.01
U:PRON	12	24	11	33.33	52.17	35.93
U:PUNCT	72	57	27	55.81	72.73	58.54
U:VERB	3	21	14	12.50	17.65	13.27
U:VERB:FORM	8	5	4	61.54	66.67	62.50
U:VERB:TENSE	7	18	12	28.00	36.84	29.41

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	266	154	795	63.33	25.07	48.52
R	1727	608	1702	73.96	50.36	67.62
U	260	230	303	53.06	46.18	51.53
UNK	21	0	49	100.00	30.00	68.18

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	0	35	100.00	14.63	46.15
ADJ:FORM	3	7	7	30.00	30.00	30.00
ADV	2	2	47	50.00	4.08	15.38
CONJ	12	29	17	29.27	41.38	31.09
CONTR	4	2	6	66.67	40.00	58.82
DET	131	84	404	60.93	24.49	46.95
MORPH	36	19	99	65.45	26.67	50.70
NOUN	24	4	95	85.71	20.17	51.95
NOUN:INFL	19	1	1	95.00	95.00	95.00
NOUN:NUM	211	130	72	61.88	74.56	64.06
NOUN:POSS	24	13	29	64.86	45.28	59.70
ORTH	273	53	169	83.74	61.76	78.18
OTHER	169	35	606	82.84	21.81	53.11
PART	20	9	13	68.97	60.61	67.11
PREP	275	151	216	64.55	56.01	62.64
PRON	14	18	104	43.75	11.86	28.46
PUNCT	343	227	369	60.18	48.17	57.32
SPELL	300	35	20	89.55	93.75	90.36
UNK	21	0	49	100.00	30.00	68.18
VERB	42	15	179	73.68	19.00	46.77
VERB:FORM	129	55	64	70.11	66.84	69.43
VERB:INFL	7	0	1	100.00	87.50	97.22
VERB:SVA	116	10	28	92.06	80.56	89.51
VERB:TENSE	92	80	154	53.49	37.40	49.25
WO	1	13	65	7.14	1.52	4.10

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	6	100.00	14.29	45.45
M:ADV	1	0	11	100.00	8.33	31.25
M:CONJ	7	9	9	43.75	43.75	43.75
M:CONTR	0	2	0	0.00	100.00	0.00
M:DET	6	0	214	100.00	2.73	12.30
M:NOUN	0	0	9	100.00	0.00	0.00
M:NOUN:POSS	3	5	12	37.50	20.00	31.91
M:OTHER	7	0	53	100.00	11.67	39.77
M:PART	0	0	4	100.00	0.00	0.00
M:PREP	4	0	83	100.00	4.60	19.42
M:PRON	0	0	53	100.00	0.00	0.00
M:PUNCT	229	138	268	62.40	46.08	58.27
M:VERB	6	0	24	100.00	20.00	55.56
M:VERB:FORM	0	0	11	100.00	0.00	0.00
M:VERB:TENSE	2	0	38	100.00	5.00	20.83
R:ADJ	4	0	27	100.00	12.90	42.55
R:ADJ:FORM	3	7	7	30.00	30.00	30.00
R:ADV	0	0	22	100.00	0.00	0.00
R:CONJ	0	0	4	100.00	0.00	0.00
R:CONTR	2	0	3	100.00	40.00	76.92
R:DET	51	31	64	62.20	44.35	57.56
R:MORPH	36	19	99	65.45	26.67	50.70
R:NOUN	22	4	71	84.62	23.66	55.84
R:NOUN:INFL	19	1	1	95.00	95.00	95.00
R:NOUN:NUM	211	130	72	61.88	74.56	64.06
R:NOUN:POSS	12	1	12	92.31	50.00	78.95
R:ORTH	273	53	169	83.74	61.76	78.18
R:OTHER	158	30	529	84.04	23.00	54.90
R:PART	19	9	4	67.86	82.61	70.37
R:PREP	225	113	102	66.57	68.81	67.00
R:PRON	3	1	41	75.00	6.82	25.00
R:PUNCT	33	37	70	47.14	32.04	43.08
R:SPELL	300	35	20	89.55	93.75	90.36
R:VERB	29	1	138	96.67	17.37	50.52
R:VERB:FORM	122	50	51	70.93	70.52	70.85
R:VERB:INFL	7	0	1	100.00	87.50	97.22
R:VERB:SVA	116	10	28	92.06	80.56	89.51
R:VERB:TENSE	81	63	102	56.25	44.26	53.36
R:WO	1	13	65	7.14	1.52	4.10
U:ADJ	1	0	2	100.00	33.33	71.43
U:ADV	1	2	14	33.33	6.67	18.52
U:CONJ	5	20	4	20.00	55.56	22.94
U:CONTR	2	0	3	100.00	40.00	76.92
U:DET	74	53	126	58.27	37.00	52.26
U:NOUN	2	0	15	100.00	11.76	40.00
U:NOUN:POSS	9	7	5	56.25	64.29	57.69
U:OTHER	4	5	24	44.44	14.29	31.25
U:PART	1	0	5	100.00	16.67	50.00
U:PREP	46	38	31	54.76	59.74	55.69
U:PRON	11	17	10	39.29	52.38	41.35
U:PUNCT	81	52	31	60.90	72.32	62.89
U:VERB	7	14	17	33.33	29.17	32.41
U:VERB:FORM	7	5	2	58.33	77.78	61.40
U:VERB:TENSE	9	17	14	34.62	39.13	35.43
UNK	21	0	49	100.00	30.00	68.18

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	410	96	844	81.03	32.70	62.54
R	1913	469	2076	80.31	47.96	70.76
U	298	185	433	61.70	40.77	55.95
UNK	45	0	90	100.00	33.33	71.43

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	0	46	100.00	11.54	39.47
ADJ:FORM	4	5	7	44.44	36.36	42.55
ADV	6	2	63	75.00	8.70	29.70
CONJ	19	18	19	51.35	50.00	51.08
CONTR	3	0	11	100.00	21.43	57.69
DET	165	69	415	70.51	28.45	54.42
MORPH	38	14	102	73.08	27.14	54.60
NOUN	26	4	112	86.67	18.84	50.39
NOUN:INFL	18	1	1	94.74	94.74	94.74
NOUN:NUM	208	96	74	68.42	73.76	69.43
NOUN:POSS	32	8	39	80.00	45.07	69.26
ORTH	317	40	191	88.80	62.40	81.87
OTHER	320	32	847	90.91	27.42	62.14
PART	16	5	14	76.19	53.33	70.18
PREP	271	124	240	68.61	53.03	64.80
PRON	34	14	103	70.83	24.82	51.67
PUNCT	408	168	416	70.83	49.51	65.22
SPELL	297	21	21	93.40	93.40	93.40
UNK	45	0	90	100.00	33.33	71.43
VERB	59	13	227	81.94	20.63	51.39
VERB:FORM	125	31	69	80.13	64.43	76.41
VERB:INFL	6	0	0	100.00	100.00	100.00
VERB:SVA	114	6	34	95.00	77.03	90.76
VERB:TENSE	106	67	193	61.27	35.45	53.48
WO	23	12	109	65.71	17.42	42.28

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	7	100.00	12.50	41.67
M:ADV	4	0	18	100.00	18.18	52.63
M:CONJ	12	1	8	92.31	60.00	83.33
M:DET	36	0	211	100.00	14.57	46.04
M:NOUN	3	0	16	100.00	15.79	48.39
M:NOUN:POSS	5	4	12	55.56	29.41	47.17
M:OTHER	19	0	58	100.00	24.68	62.09
M:PART	1	0	5	100.00	16.67	50.00
M:PREP	16	0	88	100.00	15.38	47.62
M:PRON	17	0	45	100.00	27.42	65.38
M:PUNCT	276	91	294	75.20	48.42	67.71
M:VERB	13	0	35	100.00	27.08	65.00
M:VERB:FORM	2	0	10	100.00	16.67	50.00
M:VERB:TENSE	5	0	37	100.00	11.90	40.32
R:ADJ	5	0	31	100.00	13.89	44.64
R:ADJ:FORM	4	5	7	44.44	36.36	42.55
R:ADV	1	0	21	100.00	4.55	19.23
R:CONJ	1	0	6	100.00	14.29	45.45
R:CONTR	2	0	5	100.00	28.57	66.67
R:DET	48	27	69	64.00	41.03	57.55
R:MORPH	38	14	102	73.08	27.14	54.60
R:NOUN	18	4	74	81.82	19.57	50.00
R:NOUN:INFL	18	1	1	94.74	94.74	94.74
R:NOUN:NUM	208	96	74	68.42	73.76	69.43
R:NOUN:POSS	18	1	17	94.74	51.43	81.08
R:ORTH	317	40	191	88.80	62.40	81.87
R:OTHER	280	27	699	91.21	28.60	63.43
R:PART	14	5	4	73.68	77.78	74.47
R:PREP	211	97	109	68.51	65.94	67.98
R:PRON	5	1	43	83.33	10.42	34.72
R:PUNCT	36	34	96	51.43	27.27	43.69
R:SPELL	297	21	21	93.40	93.40	93.40
R:VERB	38	0	167	100.00	18.54	53.22
R:VERB:FORM	116	27	56	81.12	67.44	77.96
R:VERB:INFL	6	0	0	100.00	100.00	100.00
R:VERB:SVA	114	6	34	95.00	77.03	90.76
R:VERB:TENSE	95	51	140	65.07	40.43	58.00
R:WO	23	12	109	65.71	17.42	42.28
U:ADJ	0	0	8	100.00	0.00	0.00
U:ADV	1	2	24	33.33	4.00	13.51
U:CONJ	6	17	5	26.09	54.55	29.13
U:CONTR	1	0	6	100.00	14.29	45.45
U:DET	81	42	135	65.85	37.50	57.20
U:NOUN	5	0	22	100.00	18.52	53.19
U:NOUN:POSS	9	3	10	75.00	47.37	67.16
U:OTHER	21	5	90	80.77	18.92	48.84
U:PART	1	0	5	100.00	16.67	50.00
U:PREP	44	27	43	61.97	50.57	59.30
U:PRON	12	13	15	48.00	44.44	47.24
U:PUNCT	96	43	26	69.06	78.69	70.80
U:VERB	8	13	25	38.10	24.24	34.19
U:VERB:FORM	7	4	3	63.64	70.00	64.81
U:VERB:TENSE	6	16	16	27.27	27.27	27.27
UNK	45	0	90	100.00	33.33	71.43

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	706	533	1396	56.98	33.59	50.01
Span-level detection	931	308	1308	75.14	41.58	64.70
Token-level detection	1121	180	1544	86.16	42.06	71.23

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	62	77	351	44.60	15.01	31.99
R	574	379	907	60.23	38.76	54.22
U	70	77	138	47.62	33.65	43.97

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	1	9	0.00	0.00	0.00
ADJ:FORM	2	4	2	33.33	50.00	35.71
ADV	0	0	22	100.00	0.00	0.00
CONJ	3	12	9	20.00	25.00	20.83
CONTR	2	2	1	50.00	66.67	52.63
DET	40	25	184	61.54	17.86	41.32
MORPH	14	14	60	50.00	18.92	37.63
NOUN	1	2	38	33.33	2.56	9.80
NOUN:INFL	5	0	1	100.00	83.33	96.15
NOUN:NUM	103	68	38	60.23	73.05	62.42
NOUN:POSS	7	7	7	50.00	50.00	50.00
ORTH	121	20	72	85.82	62.69	79.92
OTHER	4	28	367	12.50	1.08	4.01
PART	7	5	5	58.33	58.33	58.33
PREP	73	67	114	52.14	39.04	48.86
PRON	5	9	62	35.71	7.46	20.33
PUNCT	74	91	145	44.85	33.79	42.09
SPELL	90	69	21	56.60	81.08	60.24
VERB	1	8	91	11.11	1.09	3.91
VERB:FORM	61	44	34	58.10	64.21	59.22
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	53	4	22	92.98	70.67	87.46
VERB:TENSE	36	51	74	41.38	32.73	39.30
WO	1	2	17	33.33	5.56	16.67

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	0	3	100.00	0.00	0.00
M:CONJ	0	7	3	0.00	0.00	0.00
M:CONTR	1	2	0	33.33	100.00	38.46
M:DET	0	0	88	100.00	0.00	0.00
M:NOUN	0	0	2	100.00	0.00	0.00
M:NOUN:POSS	0	3	4	0.00	0.00	0.00
M:OTHER	0	0	29	100.00	0.00	0.00
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	0	0	42	100.00	0.00	0.00
M:PRON	0	0	29	100.00	0.00	0.00
M:PUNCT	61	65	110	48.41	35.67	45.19
M:VERB	0	0	13	100.00	0.00	0.00
M:VERB:FORM	0	0	9	100.00	0.00	0.00
M:VERB:TENSE	0	0	17	100.00	0.00	0.00
R:ADJ	0	1	7	0.00	0.00	0.00
R:ADJ:FORM	2	4	2	33.33	50.00	35.71
R:ADV	0	0	10	100.00	0.00	0.00
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	13	9	32	59.09	28.89	48.87
R:MORPH	14	14	60	50.00	18.92	37.63
R:NOUN	1	2	28	33.33	3.45	12.20
R:NOUN:INFL	5	0	1	100.00	83.33	96.15
R:NOUN:NUM	103	68	38	60.23	73.05	62.42
R:NOUN:POSS	3	3	2	50.00	60.00	51.72
R:ORTH	121	20	72	85.82	62.69	79.92
R:OTHER	3	26	331	10.34	0.90	3.33
R:PART	7	5	1	58.33	87.50	62.50
R:PREP	58	47	54	55.24	51.79	54.51
R:PRON	0	0	25	100.00	0.00	0.00
R:PUNCT	2	14	28	12.50	6.67	10.64
R:SPELL	90	69	21	56.60	81.08	60.24
R:VERB	0	1	73	0.00	0.00	0.00
R:VERB:FORM	60	43	24	58.25	71.43	60.48
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	53	4	22	92.98	70.67	87.46
R:VERB:TENSE	35	47	54	42.68	39.33	41.97
R:WO	1	2	17	33.33	5.56	16.67
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	0	9	100.00	0.00	0.00
U:CONJ	3	5	3	37.50	50.00	39.47
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	27	16	64	62.79	29.67	51.33
U:NOUN	0	0	8	100.00	0.00	0.00
U:NOUN:POSS	4	1	1	80.00	80.00	80.00
U:OTHER	1	2	7	33.33	12.50	25.00
U:PART	0	0	3	100.00	0.00	0.00
U:PREP	15	20	18	42.86	45.45	43.35
U:PRON	5	9	8	35.71	38.46	36.23
U:PUNCT	11	12	7	47.83	61.11	50.00
U:VERB	1	7	5	12.50	16.67	13.16
U:VERB:FORM	1	1	1	50.00	50.00	50.00
U:VERB:TENSE	1	4	3	20.00	25.00	20.83

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	80	60	334	57.14	19.32	41.07
R	759	188	781	80.15	49.29	71.23
U	82	60	157	57.75	34.31	50.81
UNK	10	0	36	100.00	21.74	58.14

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	0	11	100.00	21.43	57.69
ADJ:FORM	1	3	3	25.00	25.00	25.00
ADV	1	0	24	100.00	4.00	17.24
CONJ	4	10	9	28.57	30.77	28.99
CONTR	2	1	0	66.67	100.00	71.43
DET	48	17	186	73.85	20.51	48.58
MORPH	19	8	57	70.37	25.00	51.63
NOUN	11	0	35	100.00	23.91	61.11
NOUN:INFL	6	0	1	100.00	85.71	96.77
NOUN:NUM	95	48	39	66.43	70.90	67.28
NOUN:POSS	10	4	6	71.43	62.50	69.44
ORTH	146	14	53	91.25	73.37	87.01
OTHER	90	11	318	89.11	22.06	55.42
PART	9	3	4	75.00	69.23	73.77
PREP	93	38	101	70.99	47.94	64.76
PRON	7	5	60	58.33	10.45	30.43
PUNCT	83	75	135	52.53	38.07	48.82
SPELL	107	13	4	89.17	96.40	90.52
UNK	10	0	36	100.00	21.74	58.14
VERB	22	4	85	84.62	20.56	52.13
VERB:FORM	59	21	31	73.75	65.56	71.95
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	61	3	13	95.31	82.43	92.42
VERB:TENSE	40	28	74	58.82	35.09	51.81
WO	1	2	22	33.33	4.35	14.29

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	1	0	6	100.00	14.29	45.45
M:CONJ	1	6	4	14.29	20.00	15.15
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	3	0	81	100.00	3.57	15.62
M:NOUN	0	0	1	100.00	0.00	0.00
M:NOUN:POSS	0	3	5	0.00	0.00	0.00
M:OTHER	6	0	29	100.00	17.14	50.85
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	1	0	39	100.00	2.50	11.36
M:PRON	0	0	28	100.00	0.00	0.00
M:PUNCT	63	50	96	55.75	39.62	51.55
M:VERB	4	0	12	100.00	25.00	62.50
M:VERB:FORM	0	0	9	100.00	0.00	0.00
M:VERB:TENSE	1	0	21	100.00	4.55	19.23
R:ADJ	2	0	8	100.00	20.00	55.56
R:ADJ:FORM	1	3	3	25.00	25.00	25.00
R:ADV	0	0	11	100.00	0.00	0.00
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	16	5	31	76.19	34.04	61.07
R:MORPH	19	8	57	70.37	25.00	51.63
R:NOUN	10	0	25	100.00	28.57	66.67
R:NOUN:INFL	6	0	1	100.00	85.71	96.77
R:NOUN:NUM	95	48	39	66.43	70.90	67.28
R:NOUN:POSS	5	0	0	100.00	100.00	100.00
R:ORTH	146	14	53	91.25	73.37	87.01
R:OTHER	83	9	278	90.22	22.99	56.93
R:PART	9	3	1	75.00	90.00	77.59
R:PREP	77	22	48	77.78	61.60	73.90
R:PRON	2	0	24	100.00	7.69	29.41
R:PUNCT	6	13	27	31.58	18.18	27.52
R:SPELL	107	13	4	89.17	96.40	90.52
R:VERB	15	0	64	100.00	18.99	53.96
R:VERB:FORM	58	20	21	74.36	73.42	74.17
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	61	3	13	95.31	82.43	92.42
R:VERB:TENSE	36	25	48	59.02	42.86	54.88
R:WO	1	2	22	33.33	4.35	14.29
U:ADJ	1	0	1	100.00	50.00	83.33
U:ADV	0	0	7	100.00	0.00	0.00
U:CONJ	3	4	3	42.86	50.00	44.12
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	29	12	74	70.73	28.16	54.31
U:NOUN	1	0	9	100.00	10.00	35.71
U:NOUN:POSS	5	1	1	83.33	83.33	83.33
U:OTHER	1	2	11	33.33	8.33	20.83
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	15	16	14	48.39	51.72	49.02
U:PRON	5	5	8	50.00	38.46	47.17
U:PUNCT	14	12	12	53.85	53.85	53.85
U:VERB	3	4	9	42.86	25.00	37.50
U:VERB:FORM	1	1	1	50.00	50.00	50.00
U:VERB:TENSE	3	3	5	50.00	37.50	46.88
UNK	10	0	36	100.00	21.74	58.14

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	157	27	348	85.33	31.09	63.26
R	838	110	937	88.40	47.21	75.26
U	100	43	206	69.93	32.68	56.95
UNK	26	0	53	100.00	32.91	71.04

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	0	13	100.00	18.75	53.57
ADJ:FORM	1	3	2	25.00	33.33	26.32
ADV	4	0	31	100.00	11.43	39.22
CONJ	8	4	8	66.67	50.00	62.50
CONTR	2	0	2	100.00	50.00	83.33
DET	67	8	192	89.33	25.87	59.93
MORPH	19	3	58	86.36	24.68	57.58
NOUN	11	0	54	100.00	16.92	50.46
NOUN:INFL	5	0	1	100.00	83.33	96.15
NOUN:NUM	92	28	35	76.67	72.44	75.78
NOUN:POSS	13	3	9	81.25	59.09	75.58
ORTH	157	9	60	94.58	72.35	89.10
OTHER	167	8	410	95.43	28.94	65.39
PART	7	2	6	77.78	53.85	71.43
PREP	94	24	114	79.66	45.19	69.12
PRON	21	5	56	80.77	27.27	58.01
PUNCT	114	47	155	70.81	42.38	62.43
SPELL	105	4	5	96.33	95.45	96.15
UNK	26	0	53	100.00	32.91	71.04
VERB	29	3	118	90.62	19.73	52.73
VERB:FORM	56	7	31	88.89	64.37	82.60
VERB:INFL	2	0	0	100.00	100.00	100.00
VERB:SVA	61	1	16	98.39	79.22	93.85
VERB:TENSE	50	20	87	71.43	36.50	59.95
WO	7	1	28	87.50	20.00	52.24

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	3	0	10	100.00	23.08	60.00
M:CONJ	5	1	2	83.33	71.43	80.65
M:DET	19	0	80	100.00	19.19	54.29
M:NOUN	1	0	6	100.00	14.29	45.45
M:NOUN:POSS	0	3	4	0.00	0.00	0.00
M:OTHER	12	0	29	100.00	29.27	67.42
M:PART	1	0	2	100.00	33.33	71.43
M:PREP	7	0	43	100.00	14.00	44.87
M:PRON	12	0	21	100.00	36.36	74.07
M:PUNCT	86	23	107	78.90	44.56	68.36
M:VERB	6	0	18	100.00	25.00	62.50
M:VERB:FORM	2	0	8	100.00	20.00	55.56
M:VERB:TENSE	3	0	17	100.00	15.00	46.88
R:ADJ	3	0	10	100.00	23.08	60.00
R:ADJ:FORM	1	3	2	25.00	33.33	26.32
R:ADV	1	0	9	100.00	10.00	35.71
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	16	3	35	84.21	31.37	62.99
R:MORPH	19	3	58	86.36	24.68	57.58
R:NOUN	8	0	33	100.00	19.51	54.79
R:NOUN:INFL	5	0	1	100.00	83.33	96.15
R:NOUN:NUM	92	28	35	76.67	72.44	75.78
R:NOUN:POSS	8	0	0	100.00	100.00	100.00
R:ORTH	157	9	60	94.58	72.35	89.10
R:OTHER	148	6	355	96.10	29.42	66.13
R:PART	6	2	2	75.00	75.00	75.00
R:PREP	68	14	52	82.93	56.67	75.89
R:PRON	3	0	23	100.00	11.54	39.47
R:PUNCT	10	12	40	45.45	20.00	36.23
R:SPELL	105	4	5	96.33	95.45	96.15
R:VERB	20	0	86	100.00	18.87	53.76
R:VERB:FORM	53	7	21	88.33	71.62	84.39
R:VERB:INFL	2	0	0	100.00	100.00	100.00
R:VERB:SVA	61	1	16	98.39	79.22	93.85
R:VERB:TENSE	44	17	64	72.13	40.74	62.50
R:WO	7	1	28	87.50	20.00	52.24
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	0	0	12	100.00	0.00	0.00
U:CONJ	3	3	4	50.00	42.86	48.39
U:CONTR	1	0	2	100.00	33.33	71.43
U:DET	32	5	77	86.49	29.36	62.26
U:NOUN	2	0	15	100.00	11.76	40.00
U:NOUN:POSS	5	0	5	100.00	50.00	83.33
U:OTHER	7	2	26	77.78	21.21	50.72
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	19	10	19	65.52	50.00	61.69
U:PRON	6	5	12	54.55	33.33	48.39
U:PUNCT	18	12	8	60.00	69.23	61.64
U:VERB	3	3	14	50.00	17.65	36.59
U:VERB:FORM	1	0	2	100.00	33.33	71.43
U:VERB:TENSE	3	3	6	50.00	33.33	45.45
UNK	26	0	53	100.00	32.91	71.04

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	507	392	977	56.40	34.16	49.90
Span-level detection	634	267	966	70.37	39.62	60.91
Token-level detection	740	207	1202	78.14	38.11	64.57

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	58	58	286	50.00	16.86	35.89
R	370	259	601	58.82	38.11	53.05
U	79	75	90	51.30	46.75	50.32

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	0	9	100.00	0.00	0.00
ADJ:FORM	0	3	2	0.00	0.00	0.00
ADV	0	0	15	100.00	0.00	0.00
CONJ	2	11	9	15.38	18.18	15.87
CONTR	1	1	2	50.00	33.33	45.45
DET	38	20	145	65.52	20.77	45.78
MORPH	8	10	27	44.44	22.86	37.38
NOUN	2	5	33	28.57	5.71	15.87
NOUN:NUM	63	46	15	57.80	80.77	61.28
NOUN:POSS	4	7	10	36.36	28.57	34.48
ORTH	33	15	49	68.75	40.24	60.22
OTHER	9	26	200	25.71	4.31	12.89
PART	5	4	8	55.56	38.46	51.02
PREP	82	57	80	58.99	50.62	57.10
PRON	6	8	30	42.86	16.67	32.61
PUNCT	78	80	119	49.37	39.59	47.04
SPELL	61	27	15	69.32	80.26	71.26
VERB	1	8	75	11.11	1.32	4.46
VERB:FORM	47	22	27	68.12	63.51	67.14
VERB:SVA	37	6	11	86.05	77.08	84.09
VERB:TENSE	30	33	56	47.62	34.88	44.38
WO	0	3	40	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	0	3	100.00	0.00	0.00
M:CONJ	2	3	6	40.00	25.00	35.71
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	0	0	90	100.00	0.00	0.00
M:NOUN	0	0	3	100.00	0.00	0.00
M:NOUN:POSS	2	1	3	66.67	40.00	58.82
M:OTHER	0	0	17	100.00	0.00	0.00
M:PART	0	0	3	100.00	0.00	0.00
M:PREP	0	0	28	100.00	0.00	0.00
M:PRON	0	0	18	100.00	0.00	0.00
M:PUNCT	54	53	89	50.47	37.76	47.29
M:VERB	0	0	8	100.00	0.00	0.00
M:VERB:FORM	0	0	1	100.00	0.00	0.00
M:VERB:TENSE	0	0	16	100.00	0.00	0.00
R:ADJ	0	0	8	100.00	0.00	0.00
R:ADJ:FORM	0	3	2	0.00	0.00	0.00
R:ADV	0	0	8	100.00	0.00	0.00
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	19	9	24	67.86	44.19	61.29
R:MORPH	8	10	27	44.44	22.86	37.38
R:NOUN	2	5	28	28.57	6.67	17.24
R:NOUN:NUM	63	46	15	57.80	80.77	61.28
R:NOUN:POSS	0	2	4	0.00	0.00	0.00
R:ORTH	33	15	49	68.75	40.24	60.22
R:OTHER	7	23	175	23.33	3.85	11.59
R:PART	5	4	4	55.56	55.56	55.56
R:PREP	65	47	39	58.04	62.50	58.88
R:PRON	0	1	10	0.00	0.00	0.00
R:PUNCT	3	11	20	21.43	13.04	18.99
R:SPELL	61	27	15	69.32	80.26	71.26
R:VERB	0	2	60	0.00	0.00	0.00
R:VERB:FORM	42	19	24	68.85	63.64	67.74
R:VERB:SVA	37	6	11	86.05	77.08	84.09
R:VERB:TENSE	25	26	35	49.02	41.67	47.35
R:WO	0	3	40	0.00	0.00	0.00
U:ADV	0	0	4	100.00	0.00	0.00
U:CONJ	0	8	1	0.00	0.00	0.00
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	19	11	31	63.33	38.00	55.88
U:NOUN	0	0	2	100.00	0.00	0.00
U:NOUN:POSS	2	4	3	33.33	40.00	34.48
U:OTHER	2	3	8	40.00	20.00	33.33
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	17	10	13	62.96	56.67	61.59
U:PRON	6	7	2	46.15	75.00	50.00
U:PUNCT	21	16	10	56.76	67.74	58.66
U:VERB	1	6	7	14.29	12.50	13.89
U:VERB:FORM	5	3	2	62.50	71.43	64.10
U:VERB:TENSE	5	7	5	41.67	50.00	43.10

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	73	45	287	61.86	20.28	43.87
R	474	161	577	74.65	45.10	66.00
U	83	61	93	57.64	47.16	55.19
UNK	4	0	9	100.00	30.77	68.97

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	0	12	100.00	20.00	55.56
ADJ:FORM	1	3	2	25.00	33.33	26.32
ADV	1	0	18	100.00	5.26	21.74
CONJ	4	11	6	26.67	40.00	28.57
CONTR	1	0	3	100.00	25.00	62.50
DET	44	14	147	75.86	23.04	52.01
MORPH	9	3	27	75.00	25.00	53.57
NOUN	9	4	35	69.23	20.45	46.88
NOUN:NUM	63	33	17	65.62	78.75	67.89
NOUN:POSS	4	4	9	50.00	30.77	44.44
ORTH	41	15	53	73.21	43.62	64.47
OTHER	48	9	197	84.21	19.59	50.74
PART	6	4	7	60.00	46.15	56.60
PREP	94	40	78	70.15	54.65	66.38
PRON	5	6	29	45.45	14.71	32.05
PUNCT	92	63	123	59.35	42.79	55.09
SPELL	66	7	6	90.41	91.67	90.66
UNK	4	0	9	100.00	30.77	68.97
VERB	15	3	66	83.33	18.52	49.02
VERB:FORM	49	16	25	75.38	66.22	73.35
VERB:SVA	40	5	8	88.89	83.33	87.72
VERB:TENSE	35	24	54	59.32	39.33	53.85
WO	0	3	35	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	2	100.00	33.33	71.43
M:ADV	0	0	4	100.00	0.00	0.00
M:CONJ	4	3	3	57.14	57.14	57.14
M:DET	2	0	92	100.00	2.13	9.80
M:NOUN	0	0	3	100.00	0.00	0.00
M:NOUN:POSS	2	1	3	66.67	40.00	58.82
M:OTHER	0	0	17	100.00	0.00	0.00
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	2	0	27	100.00	6.90	27.03
M:PRON	0	0	18	100.00	0.00	0.00
M:PUNCT	59	41	93	59.00	38.82	53.44
M:VERB	2	0	7	100.00	22.22	58.82
M:VERB:FORM	0	0	1	100.00	0.00	0.00
M:VERB:TENSE	1	0	15	100.00	6.25	25.00
R:ADJ	2	0	10	100.00	16.67	50.00
R:ADJ:FORM	1	3	2	25.00	33.33	26.32
R:ADV	0	0	9	100.00	0.00	0.00
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	0	0	2	100.00	0.00	0.00
R:DET	24	6	21	80.00	53.33	72.73
R:MORPH	9	3	27	75.00	25.00	53.57
R:NOUN	8	4	28	66.67	22.22	47.62
R:NOUN:NUM	63	33	17	65.62	78.75	67.89
R:NOUN:POSS	0	1	3	0.00	0.00	0.00
R:ORTH	41	15	53	73.21	43.62	64.47
R:OTHER	45	6	171	88.24	20.83	53.57
R:PART	6	4	3	60.00	66.67	61.22
R:PREP	76	31	39	71.03	66.09	69.98
R:PRON	0	0	10	100.00	0.00	0.00
R:PUNCT	9	9	21	50.00	30.00	44.12
R:SPELL	66	7	6	90.41	91.67	90.66
R:VERB	10	1	53	90.91	15.87	46.73
R:VERB:FORM	45	13	23	77.59	66.18	75.00
R:VERB:SVA	40	5	8	88.89	83.33	87.72
R:VERB:TENSE	29	17	34	63.04	46.03	58.70
R:WO	0	3	35	0.00	0.00	0.00
U:ADV	1	0	5	100.00	16.67	50.00
U:CONJ	0	8	1	0.00	0.00	0.00
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	18	8	34	69.23	34.62	57.69
U:NOUN	1	0	4	100.00	20.00	55.56
U:NOUN:POSS	2	2	3	50.00	40.00	47.62
U:OTHER	3	3	9	50.00	25.00	41.67
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	16	9	12	64.00	57.14	62.50
U:PRON	5	6	1	45.45	83.33	50.00
U:PUNCT	24	13	9	64.86	72.73	66.30
U:VERB	3	2	6	60.00	33.33	51.72
U:VERB:FORM	4	3	1	57.14	80.00	60.61
U:VERB:TENSE	5	7	5	41.67	50.00	43.10
UNK	4	0	9	100.00	30.77	68.97

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	108	30	308	78.26	25.96	55.79
R	531	132	706	80.09	42.93	68.27
U	92	45	157	67.15	36.95	57.72
UNK	9	0	31	100.00	22.50	59.21

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	0	15	100.00	16.67	50.00
ADJ:FORM	1	2	1	33.33	50.00	35.71
ADV	2	0	25	100.00	7.41	28.57
CONJ	6	7	9	46.15	40.00	44.78
CONTR	0	0	3	100.00	0.00	0.00
DET	55	12	147	82.09	27.23	58.51
MORPH	10	3	29	76.92	25.64	54.95
NOUN	10	4	30	71.43	25.00	52.08
NOUN:NUM	63	25	21	71.59	75.00	72.25
NOUN:POSS	6	2	12	75.00	33.33	60.00
ORTH	55	9	55	85.94	50.00	75.14
OTHER	93	8	301	92.08	23.60	58.27
PART	4	1	6	80.00	40.00	66.67
PREP	90	36	89	71.43	50.28	65.89
PRON	11	4	31	73.33	26.19	53.92
PUNCT	101	47	137	68.24	42.44	60.84
SPELL	65	5	6	92.86	91.55	92.59
UNK	9	0	31	100.00	22.50	59.21
VERB	22	2	79	91.67	21.78	55.84
VERB:FORM	47	10	29	82.46	61.84	77.30
VERB:SVA	39	3	11	92.86	78.00	89.45
VERB:TENSE	37	21	73	63.79	33.64	54.09
WO	11	6	62	64.71	15.07	39.01

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	2	100.00	33.33	71.43
M:ADV	1	0	7	100.00	12.50	41.67
M:CONJ	4	0	4	100.00	50.00	83.33
M:DET	12	0	91	100.00	11.65	39.74
M:NOUN	1	0	3	100.00	25.00	62.50
M:NOUN:POSS	2	1	4	66.67	33.33	55.56
M:OTHER	4	0	21	100.00	16.00	48.78
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	5	0	28	100.00	15.15	47.17
M:PRON	5	0	16	100.00	23.81	60.98
M:PUNCT	66	29	100	69.47	39.76	60.44
M:VERB	5	0	11	100.00	31.25	69.44
M:VERB:FORM	0	0	1	100.00	0.00	0.00
M:VERB:TENSE	2	0	18	100.00	10.00	35.71
R:ADJ	2	0	12	100.00	14.29	45.45
R:ADJ:FORM	1	2	1	33.33	50.00	35.71
R:ADV	0	0	10	100.00	0.00	0.00
R:CONJ	1	0	4	100.00	20.00	55.56
R:CONTR	0	0	2	100.00	0.00	0.00
R:DET	22	6	21	78.57	51.16	70.97
R:MORPH	10	3	29	76.92	25.64	54.95
R:NOUN	8	4	22	66.67	26.67	51.28
R:NOUN:NUM	63	25	21	71.59	75.00	72.25
R:NOUN:POSS	2	1	4	66.67	33.33	55.56
R:ORTH	55	9	55	85.94	50.00	75.14
R:OTHER	77	5	226	93.90	25.41	61.01
R:PART	4	1	2	80.00	66.67	76.92
R:PREP	73	30	43	70.87	62.93	69.13
R:PRON	1	0	13	100.00	7.14	27.78
R:PUNCT	9	10	28	47.37	24.32	39.82
R:SPELL	65	5	6	92.86	91.55	92.59
R:VERB	13	0	59	100.00	18.06	52.42
R:VERB:FORM	43	7	27	86.00	61.43	79.63
R:VERB:SVA	39	3	11	92.86	78.00	89.45
R:VERB:TENSE	32	15	48	68.09	40.00	59.70
R:WO	11	6	62	64.71	15.07	39.01
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	1	0	8	100.00	11.11	38.46
U:CONJ	1	7	1	12.50	50.00	14.71
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	21	6	35	77.78	37.50	64.02
U:NOUN	1	0	5	100.00	16.67	50.00
U:NOUN:POSS	2	0	4	100.00	33.33	71.43
U:OTHER	12	3	54	80.00	18.18	47.62
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	12	6	18	66.67	40.00	58.82
U:PRON	5	4	2	55.56	71.43	58.14
U:PUNCT	26	8	9	76.47	74.29	76.02
U:VERB	4	2	9	66.67	30.77	54.05
U:VERB:FORM	4	3	1	57.14	80.00	60.61
U:VERB:TENSE	3	6	7	33.33	30.00	32.61
UNK	9	0	31	100.00	22.50	59.21

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	278	221	319	55.71	46.57	53.61
Span-level detection	333	166	324	66.73	50.68	62.76
Token-level detection	380	140	386	73.08	49.61	66.76

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	38	17	107	69.09	26.21	52.05
R	186	143	173	56.53	51.81	55.52
U	54	61	39	46.96	58.06	48.82

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	0	6	100.00	0.00	0.00
ADJ:FORM	0	1	2	0.00	0.00	0.00
ADV	0	1	4	0.00	0.00	0.00
CONJ	1	4	1	20.00	50.00	22.73
CONTR	0	0	3	100.00	0.00	0.00
DET	28	22	67	56.00	29.47	47.46
MORPH	5	5	13	50.00	27.78	43.10
NOUN	0	1	11	0.00	0.00	0.00
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	33	18	9	64.71	78.57	67.07
NOUN:POSS	2	3	4	40.00	33.33	38.46
ORTH	35	7	14	83.33	71.43	80.65
OTHER	4	11	48	26.67	7.69	17.86
PART	2	2	2	50.00	50.00	50.00
PREP	46	38	33	54.76	58.23	55.42
PRON	1	5	10	16.67	9.09	14.29
PUNCT	58	43	34	57.43	63.04	58.47
SPELL	33	21	5	61.11	86.84	64.96
VERB	0	3	18	0.00	0.00	0.00
VERB:FORM	11	8	7	57.89	61.11	58.51
VERB:SVA	7	0	2	100.00	77.78	94.59
VERB:TENSE	11	21	17	34.38	39.29	35.26
WO	0	7	9	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	0	0	1	100.00	0.00	0.00
M:DET	0	0	40	100.00	0.00	0.00
M:NOUN	0	0	2	100.00	0.00	0.00
M:OTHER	0	0	6	100.00	0.00	0.00
M:PREP	0	0	16	100.00	0.00	0.00
M:PRON	0	0	5	100.00	0.00	0.00
M:PUNCT	38	17	29	69.09	56.72	66.20
M:VERB	0	0	2	100.00	0.00	0.00
M:VERB:FORM	0	0	1	100.00	0.00	0.00
M:VERB:TENSE	0	0	2	100.00	0.00	0.00
R:ADJ	0	0	3	100.00	0.00	0.00
R:ADJ:FORM	0	1	2	0.00	0.00	0.00
R:ADV	0	0	1	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	6	7	11	46.15	35.29	43.48
R:MORPH	5	5	13	50.00	27.78	43.10
R:NOUN	0	1	7	0.00	0.00	0.00
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	33	18	9	64.71	78.57	67.07
R:NOUN:POSS	0	0	3	100.00	0.00	0.00
R:ORTH	35	7	14	83.33	71.43	80.65
R:OTHER	4	11	41	26.67	8.89	19.05
R:PART	1	2	1	33.33	50.00	35.71
R:PREP	40	33	10	54.79	80.00	58.48
R:PRON	0	0	4	100.00	0.00	0.00
R:PUNCT	2	8	3	20.00	40.00	22.22
R:SPELL	33	21	5	61.11	86.84	64.96
R:VERB	0	0	15	100.00	0.00	0.00
R:VERB:FORM	9	8	6	52.94	60.00	54.22
R:VERB:SVA	7	0	2	100.00	77.78	94.59
R:VERB:TENSE	10	14	13	41.67	43.48	42.02
R:WO	0	7	9	0.00	0.00	0.00
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	1	2	0.00	0.00	0.00
U:CONJ	1	4	0	20.00	100.00	23.81
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	22	15	16	59.46	57.89	59.14
U:NOUN	0	0	2	100.00	0.00	0.00
U:NOUN:POSS	2	3	1	40.00	66.67	43.48
U:OTHER	0	0	1	100.00	0.00	0.00
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	6	5	7	54.55	46.15	52.63
U:PRON	1	5	1	16.67	50.00	19.23
U:PUNCT	18	18	2	50.00	90.00	54.88
U:VERB	0	3	1	0.00	0.00	0.00
U:VERB:FORM	2	0	0	100.00	100.00	100.00
U:VERB:TENSE	1	7	2	12.50	33.33	14.29

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	40	16	109	71.43	26.85	53.62
R	231	96	174	70.64	57.04	67.43
U	59	54	38	52.21	60.82	53.73
UNK	3	0	3	100.00	50.00	83.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	0	7	100.00	0.00	0.00
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	0	1	5	0.00	0.00	0.00
CONJ	1	3	1	25.00	50.00	27.78
CONTR	0	0	3	100.00	0.00	0.00
DET	31	18	65	63.27	32.29	53.08
MORPH	6	2	12	75.00	33.33	60.00
NOUN	1	0	14	100.00	6.67	26.32
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	32	15	10	68.09	76.19	69.57
NOUN:POSS	2	3	4	40.00	33.33	38.46
ORTH	41	6	18	87.23	69.49	83.00
OTHER	16	5	50	76.19	24.24	53.33
PART	4	0	1	100.00	80.00	95.24
PREP	57	27	29	67.86	66.28	67.54
PRON	2	3	10	40.00	16.67	31.25
PUNCT	64	39	39	62.14	62.14	62.14
SPELL	38	12	0	76.00	100.00	79.83
UNK	3	0	3	100.00	50.00	83.33
VERB	2	3	17	40.00	10.53	25.64
VERB:FORM	11	6	7	64.71	61.11	63.95
VERB:SVA	8	0	3	100.00	72.73	93.02
VERB:TENSE	12	16	17	42.86	41.38	42.55
WO	0	7	7	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	0	0	1	100.00	0.00	0.00
M:DET	1	0	37	100.00	2.63	11.90
M:NOUN	0	0	3	100.00	0.00	0.00
M:OTHER	0	0	6	100.00	0.00	0.00
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	1	0	16	100.00	5.88	23.81
M:PRON	0	0	5	100.00	0.00	0.00
M:PUNCT	38	16	32	70.37	54.29	66.43
M:VERB	0	0	2	100.00	0.00	0.00
M:VERB:FORM	0	0	1	100.00	0.00	0.00
M:VERB:TENSE	0	0	2	100.00	0.00	0.00
R:ADJ	0	0	4	100.00	0.00	0.00
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	0	0	2	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	9	5	10	64.29	47.37	60.00
R:MORPH	6	2	12	75.00	33.33	60.00
R:NOUN	1	0	9	100.00	10.00	35.71
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	32	15	10	68.09	76.19	69.57
R:NOUN:POSS	0	0	3	100.00	0.00	0.00
R:ORTH	41	6	18	87.23	69.49	83.00
R:OTHER	16	5	42	76.19	27.59	56.34
R:PART	3	0	0	100.00	100.00	100.00
R:PREP	45	22	10	67.16	81.82	69.66
R:PRON	1	0	4	100.00	20.00	55.56
R:PUNCT	7	7	4	50.00	63.64	52.24
R:SPELL	38	12	0	76.00	100.00	79.83
R:VERB	2	0	14	100.00	12.50	41.67
R:VERB:FORM	9	6	6	60.00	60.00	60.00
R:VERB:SVA	8	0	3	100.00	72.73	93.02
R:VERB:TENSE	11	9	13	55.00	45.83	52.88
R:WO	0	7	7	0.00	0.00	0.00
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	1	2	0.00	0.00	0.00
U:CONJ	1	3	0	25.00	100.00	29.41
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	21	13	18	61.76	53.85	60.00
U:NOUN	0	0	2	100.00	0.00	0.00
U:NOUN:POSS	2	3	1	40.00	66.67	43.48
U:OTHER	0	0	2	100.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	11	5	3	68.75	78.57	70.51
U:PRON	1	3	1	25.00	50.00	27.78
U:PUNCT	19	16	3	54.29	86.36	58.64
U:VERB	0	3	1	0.00	0.00	0.00
U:VERB:FORM	2	0	0	100.00	100.00	100.00
U:VERB:TENSE	1	7	2	12.50	33.33	14.29
UNK	3	0	3	100.00	50.00	83.33

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	57	12	120	82.61	32.20	62.91
R	252	78	213	76.36	54.19	70.59
U	66	50	48	56.90	57.89	57.09
UNK	5	0	5	100.00	50.00	83.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	0	9	100.00	0.00	0.00
ADJ:FORM	0	0	3	100.00	0.00	0.00
ADV	0	1	7	0.00	0.00	0.00
CONJ	2	2	1	50.00	66.67	52.63
CONTR	0	0	4	100.00	0.00	0.00
DET	33	16	65	67.35	33.67	56.12
MORPH	7	2	11	77.78	38.89	64.81
NOUN	0	0	16	100.00	0.00	0.00
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	31	13	11	70.45	73.81	71.10
NOUN:POSS	5	2	5	71.43	50.00	65.79
ORTH	44	4	20	91.67	68.75	85.94
OTHER	33	5	77	86.84	30.00	62.98
PART	4	0	1	100.00	80.00	95.24
PREP	56	24	28	70.00	66.67	69.31
PRON	2	3	11	40.00	15.38	30.30
PUNCT	79	35	48	69.30	62.20	67.75
SPELL	38	9	0	80.85	100.00	84.07
UNK	5	0	5	100.00	50.00	83.33
VERB	3	3	18	50.00	14.29	33.33
VERB:FORM	12	3	8	80.00	60.00	75.00
VERB:SVA	7	0	3	100.00	70.00	92.11
VERB:TENSE	14	15	22	48.28	38.89	46.05
WO	3	3	13	50.00	18.75	37.50

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	4	100.00	0.00	0.00
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	1	0	1	100.00	50.00	83.33
M:DET	4	0	35	100.00	10.26	36.36
M:NOUN	0	0	3	100.00	0.00	0.00
M:NOUN:POSS	2	0	0	100.00	100.00	100.00
M:OTHER	2	0	7	100.00	22.22	58.82
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	2	0	16	100.00	11.11	38.46
M:PRON	0	0	6	100.00	0.00	0.00
M:PUNCT	46	12	40	79.31	53.49	72.33
M:VERB	0	0	3	100.00	0.00	0.00
M:VERB:FORM	0	0	1	100.00	0.00	0.00
M:VERB:TENSE	0	0	2	100.00	0.00	0.00
R:ADJ	0	0	3	100.00	0.00	0.00
R:ADJ:FORM	0	0	3	100.00	0.00	0.00
R:ADV	0	0	2	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	8	4	9	66.67	47.06	61.54
R:MORPH	7	2	11	77.78	38.89	64.81
R:NOUN	0	0	11	100.00	0.00	0.00
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	31	13	11	70.45	73.81	71.10
R:NOUN:POSS	1	0	4	100.00	20.00	55.56
R:ORTH	44	4	20	91.67	68.75	85.94
R:OTHER	30	5	65	85.71	31.58	63.83
R:PART	3	0	0	100.00	100.00	100.00
R:PREP	44	20	9	68.75	83.02	71.20
R:PRON	1	0	4	100.00	20.00	55.56
R:PUNCT	6	7	5	46.15	54.55	47.62
R:SPELL	38	9	0	80.85	100.00	84.07
R:VERB	3	0	14	100.00	17.65	51.72
R:VERB:FORM	10	3	7	76.92	58.82	72.46
R:VERB:SVA	7	0	3	100.00	70.00	92.11
R:VERB:TENSE	14	8	18	63.64	43.75	58.33
R:WO	3	3	13	50.00	18.75	37.50
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	0	1	4	0.00	0.00	0.00
U:CONJ	1	2	0	33.33	100.00	38.46
U:CONTR	0	0	3	100.00	0.00	0.00
U:DET	21	12	21	63.64	50.00	60.34
U:NOUN	0	0	2	100.00	0.00	0.00
U:NOUN:POSS	2	2	1	50.00	66.67	52.63
U:OTHER	1	0	5	100.00	16.67	50.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	10	4	3	71.43	76.92	72.46
U:PRON	1	3	1	25.00	50.00	27.78
U:PUNCT	27	16	3	62.79	90.00	66.83
U:VERB	0	3	1	0.00	0.00	0.00
U:VERB:FORM	2	0	0	100.00	100.00	100.00
U:VERB:TENSE	0	7	2	0.00	0.00	0.00
UNK	5	0	5	100.00	50.00	83.33

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	323	304	264	51.52	55.03	52.18
Span-level detection	376	251	251	59.97	59.97	59.97
Token-level detection	425	223	311	65.59	57.74	63.85

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	71	35	62	66.98	53.38	63.73
R	219	210	184	51.05	54.34	51.68
U	33	59	18	35.87	64.71	39.38

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	0	5	100.00	0.00	0.00
ADJ:FORM	0	2	0	0.00	100.00	0.00
ADV	0	1	0	0.00	100.00	0.00
CONJ	1	5	1	16.67	50.00	19.23
CONTR	0	2	1	0.00	0.00	0.00
DET	7	36	8	16.28	46.67	18.72
MORPH	2	6	5	25.00	28.57	25.64
NOUN	1	1	10	50.00	9.09	26.32
NOUN:INFL	10	1	1	90.91	90.91	90.91
NOUN:NUM	23	38	7	37.70	76.67	41.97
NOUN:POSS	7	3	10	70.00	41.18	61.40
ORTH	39	18	40	68.42	49.37	63.52
OTHER	3	20	45	13.04	6.25	10.71
PART	1	2	1	33.33	50.00	35.71
PREP	25	56	11	30.86	69.44	34.72
PRON	0	4	5	0.00	0.00	0.00
PUNCT	99	53	67	65.13	59.64	63.95
SPELL	79	19	20	80.61	79.80	80.45
VERB	1	5	12	16.67	7.69	13.51
VERB:FORM	10	15	2	40.00	83.33	44.64
VERB:INFL	4	0	0	100.00	100.00	100.00
VERB:SVA	7	3	3	70.00	70.00	70.00
VERB:TENSE	4	13	9	23.53	30.77	24.69
WO	0	1	1	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	0	0	1	100.00	0.00	0.00
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	0	0	4	100.00	0.00	0.00
M:NOUN	0	0	2	100.00	0.00	0.00
M:NOUN:POSS	1	2	4	33.33	20.00	29.41
M:OTHER	0	0	1	100.00	0.00	0.00
M:PRON	0	0	2	100.00	0.00	0.00
M:PUNCT	70	32	45	68.63	60.87	66.92
M:VERB	0	0	3	100.00	0.00	0.00
R:ADJ	0	0	5	100.00	0.00	0.00
R:ADJ:FORM	0	2	0	0.00	100.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	1	16	4	5.88	20.00	6.85
R:MORPH	2	6	5	25.00	28.57	25.64
R:NOUN	1	1	8	50.00	11.11	29.41
R:NOUN:INFL	10	1	1	90.91	90.91	90.91
R:NOUN:NUM	23	38	7	37.70	76.67	41.97
R:NOUN:POSS	6	0	6	100.00	50.00	83.33
R:ORTH	39	18	40	68.42	49.37	63.52
R:OTHER	3	19	43	13.64	6.52	11.19
R:PART	1	2	0	33.33	100.00	38.46
R:PREP	22	46	7	32.35	75.86	36.54
R:PRON	0	1	3	0.00	0.00	0.00
R:PUNCT	7	10	14	41.18	33.33	39.33
R:SPELL	79	19	20	80.61	79.80	80.45
R:VERB	0	0	8	100.00	0.00	0.00
R:VERB:FORM	10	14	1	41.67	90.91	46.73
R:VERB:INFL	4	0	0	100.00	100.00	100.00
R:VERB:SVA	7	3	3	70.00	70.00	70.00
R:VERB:TENSE	4	13	7	23.53	36.36	25.32
R:WO	0	1	1	0.00	0.00	0.00
U:ADV	0	1	0	0.00	100.00	0.00
U:CONJ	1	5	0	16.67	100.00	20.00
U:CONTR	0	1	0	0.00	100.00	0.00
U:DET	6	20	0	23.08	100.00	27.27
U:NOUN:POSS	0	1	0	0.00	100.00	0.00
U:OTHER	0	1	1	0.00	0.00	0.00
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	3	10	4	23.08	42.86	25.42
U:PRON	0	3	0	0.00	100.00	0.00
U:PUNCT	22	11	8	66.67	73.33	67.90
U:VERB	1	5	1	16.67	50.00	19.23
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	0	0	2	100.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	73	33	65	68.87	52.90	64.95
R	263	163	170	61.74	60.74	61.53
U	36	55	15	39.56	70.59	43.37
UNK	4	0	1	100.00	80.00	95.24

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	0	5	100.00	0.00	0.00
ADJ:FORM	1	1	0	50.00	100.00	55.56
ADV	0	1	0	0.00	100.00	0.00
CONJ	3	5	1	37.50	75.00	41.67
CONTR	1	1	0	50.00	100.00	55.56
DET	8	35	6	18.60	57.14	21.51
MORPH	2	6	3	25.00	40.00	27.03
NOUN	3	0	11	100.00	21.43	57.69
NOUN:INFL	11	1	0	91.67	100.00	93.22
NOUN:NUM	21	34	6	38.18	77.78	42.51
NOUN:POSS	8	2	10	80.00	44.44	68.97
ORTH	45	18	45	71.43	50.00	65.79
OTHER	15	10	41	60.00	26.79	48.08
PART	1	2	1	33.33	50.00	35.71
PREP	31	46	8	40.26	79.49	44.67
PRON	0	4	5	0.00	0.00	0.00
PUNCT	104	50	72	67.53	59.09	65.66
SPELL	89	3	10	96.74	89.90	95.29
UNK	4	0	1	100.00	80.00	95.24
VERB	3	5	11	37.50	21.43	32.61
VERB:FORM	10	12	1	45.45	90.91	50.51
VERB:INFL	4	0	0	100.00	100.00	100.00
VERB:SVA	7	2	4	77.78	63.64	74.47
VERB:TENSE	5	12	9	29.41	35.71	30.49
WO	0	1	1	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	2	0	1	100.00	66.67	90.91
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	0	0	4	100.00	0.00	0.00
M:NOUN	0	0	2	100.00	0.00	0.00
M:NOUN:POSS	1	1	4	50.00	20.00	38.46
M:OTHER	1	0	1	100.00	50.00	83.33
M:PREP	0	0	1	100.00	0.00	0.00
M:PRON	0	0	2	100.00	0.00	0.00
M:PUNCT	69	31	47	69.00	59.48	66.86
M:VERB	0	0	3	100.00	0.00	0.00
R:ADJ	0	0	5	100.00	0.00	0.00
R:ADJ:FORM	1	1	0	50.00	100.00	55.56
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	2	15	2	11.76	50.00	13.89
R:MORPH	2	6	3	25.00	40.00	27.03
R:NOUN	3	0	9	100.00	25.00	62.50
R:NOUN:INFL	11	1	0	91.67	100.00	93.22
R:NOUN:NUM	21	34	6	38.18	77.78	42.51
R:NOUN:POSS	7	0	6	100.00	53.85	85.37
R:ORTH	45	18	45	71.43	50.00	65.79
R:OTHER	14	10	38	58.33	26.92	47.30
R:PART	1	2	0	33.33	100.00	38.46
R:PREP	27	38	5	41.54	84.38	46.23
R:PRON	0	1	3	0.00	0.00	0.00
R:PUNCT	11	8	18	57.89	37.93	52.38
R:SPELL	89	3	10	96.74	89.90	95.29
R:VERB	2	0	7	100.00	22.22	58.82
R:VERB:FORM	10	11	1	47.62	90.91	52.63
R:VERB:INFL	4	0	0	100.00	100.00	100.00
R:VERB:SVA	7	2	4	77.78	63.64	74.47
R:VERB:TENSE	5	12	7	29.41	41.67	31.25
R:WO	0	1	1	0.00	0.00	0.00
U:ADV	0	1	0	0.00	100.00	0.00
U:CONJ	1	5	0	16.67	100.00	20.00
U:DET	6	20	0	23.08	100.00	27.27
U:NOUN:POSS	0	1	0	0.00	100.00	0.00
U:OTHER	0	0	2	100.00	0.00	0.00
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	4	8	2	33.33	66.67	37.04
U:PRON	0	3	0	0.00	100.00	0.00
U:PUNCT	24	11	7	68.57	77.42	70.18
U:VERB	1	5	1	16.67	50.00	19.23
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	0	0	2	100.00	0.00	0.00
UNK	4	0	1	100.00	80.00	95.24

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	88	27	68	76.52	56.41	71.43
R	292	149	220	66.21	57.03	64.15
U	40	47	22	45.98	64.52	48.78
UNK	5	0	1	100.00	83.33	96.15

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	0	9	100.00	0.00	0.00
ADJ:FORM	2	0	1	100.00	66.67	90.91
ADV	0	1	0	0.00	100.00	0.00
CONJ	3	5	1	37.50	75.00	41.67
CONTR	1	0	2	100.00	33.33	71.43
DET	10	33	11	23.26	47.62	25.91
MORPH	2	6	4	25.00	33.33	26.32
NOUN	5	0	12	100.00	29.41	67.57
NOUN:INFL	11	1	0	91.67	100.00	93.22
NOUN:NUM	22	30	7	42.31	75.86	46.41
NOUN:POSS	8	1	13	88.89	38.10	70.18
ORTH	61	18	56	77.22	52.14	70.44
OTHER	27	11	59	71.05	31.40	56.72
PART	1	2	1	33.33	50.00	35.71
PREP	31	40	9	43.66	77.50	47.84
PRON	0	2	5	0.00	0.00	0.00
PUNCT	114	39	76	74.51	60.00	71.07
SPELL	89	3	10	96.74	89.90	95.29
UNK	5	0	1	100.00	83.33	96.15
VERB	5	5	12	50.00	29.41	43.86
VERB:FORM	10	11	1	47.62	90.91	52.63
VERB:INFL	4	0	0	100.00	100.00	100.00
VERB:SVA	7	2	4	77.78	63.64	74.47
VERB:TENSE	5	11	11	31.25	31.25	31.25
WO	2	2	6	50.00	25.00	41.67

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	2	0	1	100.00	66.67	90.91
M:DET	1	0	5	100.00	16.67	50.00
M:NOUN	1	0	4	100.00	20.00	55.56
M:NOUN:POSS	1	0	4	100.00	20.00	55.56
M:OTHER	1	0	1	100.00	50.00	83.33
M:PREP	2	0	1	100.00	66.67	90.91
M:PRON	0	0	2	100.00	0.00	0.00
M:PUNCT	78	27	47	74.29	62.40	71.56
M:VERB	2	0	3	100.00	40.00	76.92
R:ADJ	0	0	6	100.00	0.00	0.00
R:ADJ:FORM	2	0	1	100.00	66.67	90.91
R:CONTR	1	0	2	100.00	33.33	71.43
R:DET	2	14	4	12.50	33.33	14.29
R:MORPH	2	6	4	25.00	33.33	26.32
R:NOUN	2	0	8	100.00	20.00	55.56
R:NOUN:INFL	11	1	0	91.67	100.00	93.22
R:NOUN:NUM	22	30	7	42.31	75.86	46.41
R:NOUN:POSS	7	0	9	100.00	43.75	79.55
R:ORTH	61	18	56	77.22	52.14	70.44
R:OTHER	25	11	53	69.44	32.05	56.31
R:PART	1	2	0	33.33	100.00	38.46
R:PREP	26	33	5	44.07	83.87	48.69
R:PRON	0	1	3	0.00	0.00	0.00
R:PUNCT	11	5	23	68.75	32.35	56.12
R:SPELL	89	3	10	96.74	89.90	95.29
R:VERB	2	0	8	100.00	20.00	55.56
R:VERB:FORM	10	10	1	50.00	90.91	54.95
R:VERB:INFL	4	0	0	100.00	100.00	100.00
R:VERB:SVA	7	2	4	77.78	63.64	74.47
R:VERB:TENSE	5	11	10	31.25	33.33	31.65
R:WO	2	2	6	50.00	25.00	41.67
U:ADJ	0	0	3	100.00	0.00	0.00
U:ADV	0	1	0	0.00	100.00	0.00
U:CONJ	1	5	0	16.67	100.00	20.00
U:DET	7	19	2	26.92	77.78	30.97
U:NOUN	2	0	0	100.00	100.00	100.00
U:NOUN:POSS	0	1	0	0.00	100.00	0.00
U:OTHER	1	0	5	100.00	16.67	50.00
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	3	7	3	30.00	50.00	32.61
U:PRON	0	1	0	0.00	100.00	0.00
U:PUNCT	25	7	6	78.12	80.65	78.62
U:VERB	1	5	1	16.67	50.00	19.23
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	0	0	1	100.00	0.00	0.00
UNK	5	0	1	100.00	83.33	96.15

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:47:23+00:00
Competition submission:	2
Competition phase:	3 - Open phase

Detailed results

Submission information

Results