BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	2589	1078	2484	70.60	51.03	65.57
Span-level detection	2900	773	2340	78.95	55.34	72.75
Token-level detection	3558	586	2677	85.86	57.06	77.99

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	692	266	570	72.23	54.83	67.92
R	1539	578	1709	72.70	47.38	65.68
U	358	234	205	60.47	63.59	61.07

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	15	10	24	60.00	38.46	53.96
ADJ:FORM	7	1	3	87.50	70.00	83.33
ADV	32	32	38	50.00	45.71	49.08
CONJ	9	7	15	56.25	37.50	51.14
CONTR	12	1	1	92.31	92.31	92.31
DET	384	157	245	70.98	61.05	68.74
MORPH	93	36	71	72.09	56.71	68.38
NOUN	32	41	93	43.84	25.60	38.37
NOUN:INFL	13	1	4	92.86	76.47	89.04
NOUN:NUM	184	59	75	75.72	71.04	74.74
NOUN:POSS	26	5	32	83.87	44.83	71.43
ORTH	148	21	218	87.57	40.44	71.02
OTHER	179	161	493	52.65	26.64	44.05
PART	19	7	9	73.08	67.86	71.97
PREP	233	124	207	65.27	52.95	62.37
PRON	78	30	66	72.22	54.17	67.71
PUNCT	410	109	348	79.00	54.09	72.34
SPELL	192	32	121	85.71	61.34	79.40
VERB	66	59	158	52.80	29.46	45.58
VERB:FORM	154	48	50	76.24	75.49	76.09
VERB:INFL	5	0	3	100.00	62.50	89.29
VERB:SVA	137	44	25	75.69	84.57	77.31
VERB:TENSE	122	69	135	63.87	47.47	59.75
WO	39	24	50	61.90	43.82	57.18

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	5	4	3	55.56	62.50	56.82
M:ADV	6	15	19	28.57	24.00	27.52
M:CONJ	7	4	8	63.64	46.67	59.32
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	184	55	113	76.99	61.95	73.42
M:NOUN	2	9	8	18.18	20.00	18.52
M:NOUN:POSS	6	3	10	66.67	37.50	57.69
M:OTHER	20	23	32	46.51	38.46	44.64
M:PART	2	1	2	66.67	50.00	62.50
M:PREP	54	38	48	58.70	52.94	57.45
M:PRON	45	23	28	66.18	61.64	65.22
M:PUNCT	303	53	259	85.11	53.91	76.28
M:VERB	18	19	17	48.65	51.43	49.18
M:VERB:FORM	15	6	4	71.43	78.95	72.82
M:VERB:TENSE	25	12	19	67.57	56.82	65.10
R:ADJ	6	2	19	75.00	24.00	52.63
R:ADJ:FORM	7	1	3	87.50	70.00	83.33
R:ADV	11	3	13	78.57	45.83	68.75
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	3	0	1	100.00	75.00	93.75
R:DET	45	23	58	66.18	43.69	60.00
R:MORPH	93	36	71	72.09	56.71	68.38
R:NOUN	22	21	78	51.16	22.00	40.44
R:NOUN:INFL	13	1	4	92.86	76.47	89.04
R:NOUN:NUM	184	59	75	75.72	71.04	74.74
R:NOUN:POSS	9	1	17	90.00	34.62	68.18
R:ORTH	148	21	218	87.57	40.44	71.02
R:OTHER	140	99	446	58.58	23.89	45.40
R:PART	15	6	5	71.43	75.00	72.12
R:PREP	121	47	135	72.02	47.27	65.19
R:PRON	23	5	25	82.14	47.92	71.88
R:PUNCT	79	43	56	64.75	58.52	63.40
R:SPELL	192	32	121	85.71	61.34	79.40
R:VERB	36	24	128	60.00	21.95	44.55
R:VERB:FORM	133	36	44	78.70	75.14	77.96
R:VERB:INFL	5	0	3	100.00	62.50	89.29
R:VERB:SVA	137	44	25	75.69	84.57	77.31
R:VERB:TENSE	78	50	111	60.94	41.27	55.63
R:WO	39	24	50	61.90	43.82	57.18
U:ADJ	4	4	2	50.00	66.67	52.63
U:ADV	15	14	6	51.72	71.43	54.74
U:CONJ	2	3	4	40.00	33.33	38.46
U:CONTR	9	0	0	100.00	100.00	100.00
U:DET	155	79	74	66.24	67.69	66.52
U:NOUN	8	11	7	42.11	53.33	43.96
U:NOUN:POSS	11	1	5	91.67	68.75	85.94
U:OTHER	19	39	15	32.76	55.88	35.71
U:PART	2	0	2	100.00	50.00	83.33
U:PREP	58	39	24	59.79	70.73	61.70
U:PRON	10	2	13	83.33	43.48	70.42
U:PUNCT	28	13	33	68.29	45.90	62.22
U:VERB	12	16	13	42.86	48.00	43.80
U:VERB:FORM	6	6	2	50.00	75.00	53.57
U:VERB:TENSE	19	7	5	73.08	79.17	74.22

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	752	204	515	78.66	59.35	73.86
R	1772	363	1544	83.00	53.44	74.73
U	359	206	219	63.54	62.11	63.25
UNK	17	0	62	100.00	21.52	57.82

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	19	7	30	73.08	38.78	62.09
ADJ:FORM	7	1	3	87.50	70.00	83.33
ADV	35	30	33	53.85	51.47	53.35
CONJ	9	5	18	64.29	33.33	54.22
CONTR	11	1	1	91.67	91.67	91.67
DET	405	135	239	75.00	62.89	72.22
MORPH	95	21	64	81.90	59.75	76.24
NOUN	44	30	92	59.46	32.35	50.93
NOUN:INFL	13	0	4	100.00	76.47	94.20
NOUN:NUM	176	45	70	79.64	71.54	77.88
NOUN:POSS	29	5	29	85.29	50.00	74.74
ORTH	159	13	201	92.44	44.17	75.86
OTHER	315	95	426	76.83	42.51	66.15
PART	21	7	9	75.00	70.00	73.94
PREP	255	92	202	73.49	55.80	69.11
PRON	83	23	61	78.30	57.64	73.06
PUNCT	435	89	311	83.02	58.31	76.53
SPELL	203	9	103	95.75	66.34	87.95
UNK	17	0	62	100.00	21.52	57.82
VERB	99	46	150	68.28	39.76	59.71
VERB:FORM	147	33	42	81.67	77.78	80.86
VERB:INFL	5	0	3	100.00	62.50	89.29
VERB:SVA	146	24	17	85.88	89.57	86.60
VERB:TENSE	135	41	121	76.70	52.73	70.31
WO	37	21	49	63.79	43.02	58.18

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	6	2	4	75.00	60.00	71.43
M:ADV	8	13	12	38.10	40.00	38.46
M:CONJ	7	2	10	77.78	41.18	66.04
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	201	42	103	82.72	66.12	78.76
M:NOUN	6	6	8	50.00	42.86	48.39
M:NOUN:POSS	6	3	8	66.67	42.86	60.00
M:OTHER	32	16	33	66.67	49.23	62.26
M:PART	2	1	3	66.67	40.00	58.82
M:PREP	57	32	49	64.04	53.77	61.69
M:PRON	48	17	24	73.85	66.67	72.29
M:PUNCT	316	40	232	88.76	57.66	80.12
M:VERB	24	14	12	63.16	66.67	63.83
M:VERB:FORM	13	7	1	65.00	92.86	69.15
M:VERB:TENSE	26	8	16	76.47	61.90	73.03
R:ADJ	10	1	21	90.91	32.26	66.67
R:ADJ:FORM	7	1	3	87.50	70.00	83.33
R:ADV	11	3	15	78.57	42.31	67.07
R:CONJ	0	0	4	100.00	0.00	0.00
R:CONTR	2	0	1	100.00	66.67	90.91
R:DET	54	22	60	71.05	47.37	64.59
R:MORPH	95	21	64	81.90	59.75	76.24
R:NOUN	30	14	71	68.18	29.70	54.15
R:NOUN:INFL	13	0	4	100.00	76.47	94.20
R:NOUN:NUM	176	45	70	79.64	71.54	77.88
R:NOUN:POSS	14	0	15	100.00	48.28	82.35
R:ORTH	159	13	201	92.44	44.17	75.86
R:OTHER	260	44	378	85.53	40.75	70.12
R:PART	17	6	4	73.91	80.95	75.22
R:PREP	142	31	132	82.08	51.82	73.50
R:PRON	24	4	26	85.71	48.00	74.07
R:PUNCT	83	36	44	69.75	65.35	68.82
R:SPELL	203	9	103	95.75	66.34	87.95
R:VERB	65	18	121	78.31	34.95	62.74
R:VERB:FORM	129	20	39	86.58	76.79	84.42
R:VERB:INFL	5	0	3	100.00	62.50	89.29
R:VERB:SVA	146	24	17	85.88	89.57	86.60
R:VERB:TENSE	90	30	99	75.00	47.62	67.26
R:WO	37	21	49	63.79	43.02	58.18
U:ADJ	3	4	5	42.86	37.50	41.67
U:ADV	16	14	6	53.33	72.73	56.34
U:CONJ	2	3	4	40.00	33.33	38.46
U:CONTR	9	0	0	100.00	100.00	100.00
U:DET	150	71	76	67.87	66.37	67.57
U:NOUN	8	10	13	44.44	38.10	43.01
U:NOUN:POSS	9	2	6	81.82	60.00	76.27
U:OTHER	23	35	15	39.66	60.53	42.59
U:PART	2	0	2	100.00	50.00	83.33
U:PREP	56	29	21	65.88	72.73	67.15
U:PRON	11	2	11	84.62	50.00	74.32
U:PUNCT	36	13	35	73.47	50.70	67.42
U:VERB	10	14	17	41.67	37.04	40.65
U:VERB:FORM	5	6	2	45.45	71.43	49.02
U:VERB:TENSE	19	3	6	86.36	76.00	84.07
UNK	17	0	62	100.00	21.52	57.82

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	887	138	552	86.54	61.64	80.07
R	2210	261	1743	89.44	55.91	79.86
U	424	187	304	69.39	58.24	66.83
UNK	37	0	78	100.00	32.17	70.34

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	19	4	36	82.61	34.55	64.63
ADJ:FORM	8	1	7	88.89	53.33	78.43
ADV	40	19	44	67.80	47.62	62.50
CONJ	17	3	15	85.00	53.12	75.89
CONTR	10	1	4	90.91	71.43	86.21
DET	427	106	243	80.11	63.73	76.20
MORPH	95	11	63	89.62	60.13	81.62
NOUN	53	21	96	71.62	35.57	59.55
NOUN:INFL	13	0	4	100.00	76.47	94.20
NOUN:NUM	173	27	73	86.50	70.33	82.70
NOUN:POSS	42	3	31	93.33	57.53	83.00
ORTH	222	6	214	97.37	50.92	82.34
OTHER	583	99	609	85.48	48.91	74.36
PART	15	2	8	88.24	65.22	82.42
PREP	266	70	210	79.17	55.88	73.08
PRON	98	18	54	84.48	64.47	79.55
PUNCT	550	71	332	88.57	62.36	81.70
SPELL	203	4	107	98.07	65.48	89.19
UNK	37	0	78	100.00	32.17	70.34
VERB	121	26	168	82.31	41.87	68.99
VERB:FORM	149	22	45	87.13	76.80	84.85
VERB:INFL	5	0	3	100.00	62.50	89.29
VERB:SVA	147	17	18	89.63	89.09	89.52
VERB:TENSE	160	35	147	82.05	52.12	73.60
WO	105	20	68	84.00	60.69	78.01

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	6	1	6	85.71	50.00	75.00
M:ADV	13	10	12	56.52	52.00	55.56
M:CONJ	15	1	9	93.75	62.50	85.23
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	216	23	102	90.38	67.92	84.77
M:NOUN	7	6	13	53.85	35.00	48.61
M:NOUN:POSS	7	3	9	70.00	43.75	62.50
M:OTHER	39	11	39	78.00	50.00	70.14
M:PART	2	0	2	100.00	50.00	83.33
M:PREP	72	19	49	79.12	59.50	74.23
M:PRON	57	13	26	81.43	68.67	78.51
M:PUNCT	379	35	247	91.55	60.54	83.04
M:VERB	28	9	22	75.68	56.00	70.71
M:VERB:FORM	14	2	1	87.50	93.33	88.61
M:VERB:TENSE	32	4	15	88.89	68.09	83.77
R:ADJ	9	1	23	90.00	28.12	62.50
R:ADJ:FORM	8	1	7	88.89	53.33	78.43
R:ADV	11	3	19	78.57	36.67	63.95
R:CONJ	0	0	4	100.00	0.00	0.00
R:CONTR	2	0	2	100.00	50.00	83.33
R:DET	54	17	59	76.06	47.79	68.01
R:MORPH	95	11	63	89.62	60.13	81.62
R:NOUN	39	10	69	79.59	36.11	64.14
R:NOUN:INFL	13	0	4	100.00	76.47	94.20
R:NOUN:NUM	173	27	73	86.50	70.33	82.70
R:NOUN:POSS	22	0	15	100.00	59.46	88.00
R:ORTH	222	6	214	97.37	50.92	82.34
R:OTHER	489	32	506	93.86	49.15	79.41
R:PART	11	2	3	84.62	78.57	83.33
R:PREP	137	28	136	83.03	50.18	73.42
R:PRON	28	4	18	87.50	60.87	80.46
R:PUNCT	119	25	46	82.64	72.12	80.30
R:SPELL	203	4	107	98.07	65.48	89.19
R:VERB	79	11	123	87.78	39.11	70.28
R:VERB:FORM	131	13	41	90.97	76.16	87.57
R:VERB:INFL	5	0	3	100.00	62.50	89.29
R:VERB:SVA	147	17	18	89.63	89.09	89.52
R:VERB:TENSE	108	29	122	78.83	46.96	69.41
R:WO	105	20	68	84.00	60.69	78.01
U:ADJ	4	2	7	66.67	36.36	57.14
U:ADV	16	6	13	72.73	55.17	68.38
U:CONJ	2	2	2	50.00	50.00	50.00
U:CONTR	8	0	2	100.00	80.00	95.24
U:DET	157	66	82	70.40	65.69	69.41
U:NOUN	7	5	14	58.33	33.33	50.72
U:NOUN:POSS	13	0	7	100.00	65.00	90.28
U:OTHER	55	56	64	49.55	46.22	48.85
U:PART	2	0	3	100.00	40.00	76.92
U:PREP	57	23	25	71.25	69.51	70.90
U:PRON	13	1	10	92.86	56.52	82.28
U:PUNCT	52	11	39	82.54	57.14	75.80
U:VERB	14	6	23	70.00	37.84	59.83
U:VERB:FORM	4	7	3	36.36	57.14	39.22
U:VERB:TENSE	20	2	10	90.91	66.67	84.75
UNK	37	0	78	100.00	32.17	70.34

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1154	404	1126	74.07	50.61	67.79
Span-level detection	1310	250	1057	83.97	55.34	76.10
Token-level detection	1623	138	1173	92.16	58.05	82.47

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	250	107	252	70.03	49.80	64.77
R	755	237	786	76.11	48.99	68.52
U	149	60	88	71.29	62.87	69.43

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	7	3	7	70.00	50.00	64.81
ADJ:FORM	4	0	1	100.00	80.00	95.24
ADV	16	10	17	61.54	48.48	58.39
CONJ	5	1	5	83.33	50.00	73.53
CONTR	7	1	0	87.50	100.00	89.74
DET	161	43	111	78.92	59.19	73.99
MORPH	54	11	41	83.08	56.84	76.06
NOUN	13	14	45	48.15	22.41	39.16
NOUN:INFL	5	1	0	83.33	100.00	86.21
NOUN:NUM	97	25	36	79.51	72.93	78.10
NOUN:POSS	10	0	6	100.00	62.50	89.29
ORTH	89	9	117	90.82	43.20	74.41
OTHER	92	69	246	57.14	27.22	46.84
PART	12	1	3	92.31	80.00	89.55
PREP	100	44	81	69.44	55.25	66.05
PRON	42	12	40	77.78	51.22	70.47
PUNCT	98	40	149	71.01	39.68	61.33
SPELL	81	14	33	85.26	71.05	81.98
VERB	41	26	75	61.19	35.34	53.39
VERB:FORM	83	17	20	83.00	80.58	82.50
VERB:INFL	3	0	0	100.00	100.00	100.00
VERB:SVA	69	20	12	77.53	85.19	78.95
VERB:TENSE	55	35	63	61.11	46.61	57.53
WO	10	8	18	55.56	35.71	50.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	2	1	50.00	66.67	52.63
M:ADV	2	7	10	22.22	16.67	20.83
M:CONJ	4	1	2	80.00	66.67	76.92
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	77	17	42	81.91	64.71	77.78
M:NOUN	1	2	3	33.33	25.00	31.25
M:NOUN:POSS	2	0	3	100.00	40.00	76.92
M:OTHER	14	11	16	56.00	46.67	53.85
M:PART	1	0	0	100.00	100.00	100.00
M:PREP	27	13	19	67.50	58.70	65.53
M:PRON	23	9	16	71.88	58.97	68.86
M:PUNCT	63	22	117	74.12	35.00	60.58
M:VERB	10	11	11	47.62	47.62	47.62
M:VERB:FORM	12	5	3	70.59	80.00	72.29
M:VERB:TENSE	12	6	9	66.67	57.14	64.52
R:ADJ	3	0	5	100.00	37.50	75.00
R:ADJ:FORM	4	0	1	100.00	80.00	95.24
R:ADV	7	0	6	100.00	53.85	85.37
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	2	0	0	100.00	100.00	100.00
R:DET	17	9	24	65.38	41.46	58.62
R:MORPH	54	11	41	83.08	56.84	76.06
R:NOUN	9	7	38	56.25	19.15	40.54
R:NOUN:INFL	5	1	0	83.33	100.00	86.21
R:NOUN:NUM	97	25	36	79.51	72.93	78.10
R:NOUN:POSS	3	0	3	100.00	50.00	83.33
R:ORTH	89	9	117	90.82	43.20	74.41
R:OTHER	72	51	224	58.54	24.32	45.69
R:PART	10	1	2	90.91	83.33	89.29
R:PREP	44	18	58	70.97	43.14	62.86
R:PRON	14	1	16	93.33	46.67	77.78
R:PUNCT	31	18	21	63.27	59.62	62.50
R:SPELL	81	14	33	85.26	71.05	81.98
R:VERB	23	9	59	71.88	28.05	54.76
R:VERB:FORM	70	9	17	88.61	80.46	86.85
R:VERB:INFL	3	0	0	100.00	100.00	100.00
R:VERB:SVA	69	20	12	77.53	85.19	78.95
R:VERB:TENSE	38	26	54	59.38	41.30	54.60
R:WO	10	8	18	55.56	35.71	50.00
U:ADJ	2	1	1	66.67	66.67	66.67
U:ADV	7	3	1	70.00	87.50	72.92
U:CONJ	1	0	2	100.00	33.33	71.43
U:CONTR	5	0	0	100.00	100.00	100.00
U:DET	67	17	45	79.76	59.82	74.78
U:NOUN	3	5	4	37.50	42.86	38.46
U:NOUN:POSS	5	0	0	100.00	100.00	100.00
U:OTHER	6	7	6	46.15	50.00	46.88
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	29	13	4	69.05	87.88	72.14
U:PRON	5	2	8	71.43	38.46	60.98
U:PUNCT	4	0	11	100.00	26.67	64.52
U:VERB	8	6	5	57.14	61.54	57.97
U:VERB:FORM	1	3	0	25.00	100.00	29.41
U:VERB:TENSE	5	3	0	62.50	100.00	67.57

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	281	71	211	79.83	57.11	73.95
R	869	127	703	87.25	55.28	78.20
U	150	52	99	74.26	60.24	70.96
UNK	10	0	44	100.00	18.52	53.19

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	8	2	11	80.00	42.11	67.80
ADJ:FORM	4	0	1	100.00	80.00	95.24
ADV	18	9	12	66.67	60.00	65.22
CONJ	4	0	6	100.00	40.00	76.92
CONTR	6	1	0	85.71	100.00	88.24
DET	168	39	111	81.16	60.22	75.88
MORPH	55	5	37	91.67	59.78	82.83
NOUN	16	11	43	59.26	27.12	47.90
NOUN:INFL	5	0	0	100.00	100.00	100.00
NOUN:NUM	91	15	33	85.85	73.39	83.03
NOUN:POSS	10	1	5	90.91	66.67	84.75
ORTH	93	6	102	93.94	47.69	78.68
OTHER	174	30	209	85.29	45.43	72.56
PART	12	1	3	92.31	80.00	89.55
PREP	115	27	82	80.99	58.38	75.16
PRON	47	10	36	82.46	56.63	75.56
PUNCT	107	25	127	81.06	45.73	70.21
SPELL	83	5	25	94.32	76.85	90.22
UNK	10	0	44	100.00	18.52	53.19
VERB	55	17	75	76.39	42.31	65.79
VERB:FORM	77	14	16	84.62	82.80	84.25
VERB:INFL	3	0	0	100.00	100.00	100.00
VERB:SVA	73	10	7	87.95	91.25	88.59
VERB:TENSE	64	16	55	80.00	53.78	72.89
WO	12	6	17	66.67	41.38	59.41

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	1	1	75.00	75.00	75.00
M:ADV	4	6	4	40.00	50.00	41.67
M:CONJ	3	0	3	100.00	50.00	83.33
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	83	15	41	84.69	66.94	80.43
M:NOUN	3	0	1	100.00	75.00	93.75
M:NOUN:POSS	2	0	2	100.00	50.00	83.33
M:OTHER	21	5	15	80.77	58.33	75.00
M:PART	1	0	0	100.00	100.00	100.00
M:PREP	31	9	19	77.50	62.00	73.81
M:PRON	26	7	13	78.79	66.67	76.02
M:PUNCT	67	10	98	87.01	40.61	70.82
M:VERB	14	7	7	66.67	66.67	66.67
M:VERB:FORM	10	6	1	62.50	90.91	66.67
M:VERB:TENSE	13	4	6	76.47	68.42	74.71
R:ADJ	4	0	6	100.00	40.00	76.92
R:ADJ:FORM	4	0	1	100.00	80.00	95.24
R:ADV	7	0	7	100.00	50.00	83.33
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	20	9	25	68.97	44.44	62.11
R:MORPH	55	5	37	91.67	59.78	82.83
R:NOUN	10	6	36	62.50	21.74	45.45
R:NOUN:INFL	5	0	0	100.00	100.00	100.00
R:NOUN:NUM	91	15	33	85.85	73.39	83.03
R:NOUN:POSS	5	0	2	100.00	71.43	92.59
R:ORTH	93	6	102	93.94	47.69	78.68
R:OTHER	144	18	187	88.89	43.50	73.54
R:PART	10	1	2	90.91	83.33	89.29
R:PREP	53	9	61	85.48	46.49	73.20
R:PRON	15	1	16	93.75	48.39	78.95
R:PUNCT	33	15	16	68.75	67.35	68.46
R:SPELL	83	5	25	94.32	76.85	90.22
R:VERB	36	5	59	87.80	37.89	69.50
R:VERB:FORM	66	5	15	92.96	81.48	90.41
R:VERB:INFL	3	0	0	100.00	100.00	100.00
R:VERB:SVA	73	10	7	87.95	91.25	88.59
R:VERB:TENSE	46	11	48	80.70	48.94	71.43
R:WO	12	6	17	66.67	41.38	59.41
U:ADJ	1	1	4	50.00	20.00	38.46
U:ADV	7	3	1	70.00	87.50	72.92
U:CONJ	1	0	2	100.00	33.33	71.43
U:CONTR	5	0	0	100.00	100.00	100.00
U:DET	65	15	45	81.25	59.09	75.58
U:NOUN	3	5	6	37.50	33.33	36.59
U:NOUN:POSS	3	1	1	75.00	75.00	75.00
U:OTHER	9	7	7	56.25	56.25	56.25
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	31	9	2	77.50	93.94	80.31
U:PRON	6	2	7	75.00	46.15	66.67
U:PUNCT	7	0	13	100.00	35.00	72.92
U:VERB	5	5	9	50.00	35.71	46.30
U:VERB:FORM	1	3	0	25.00	100.00	29.41
U:VERB:TENSE	5	1	1	83.33	83.33	83.33
UNK	10	0	44	100.00	18.52	53.19

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	357	33	224	91.54	61.45	83.37
R	1049	66	767	94.08	57.76	83.57
U	189	39	123	82.89	60.58	77.21
UNK	28	0	59	100.00	32.18	70.35

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	8	0	12	100.00	40.00	76.92
ADJ:FORM	4	0	4	100.00	50.00	83.33
ADV	22	7	15	75.86	59.46	71.90
CONJ	6	0	5	100.00	54.55	85.71
CONTR	6	1	1	85.71	85.71	85.71
DET	192	24	117	88.89	62.14	81.84
MORPH	55	0	34	100.00	61.80	89.00
NOUN	23	4	48	85.19	32.39	64.25
NOUN:INFL	5	0	0	100.00	100.00	100.00
NOUN:NUM	91	5	32	94.79	73.98	89.74
NOUN:POSS	16	0	5	100.00	76.19	94.12
ORTH	107	1	94	99.07	53.23	84.52
OTHER	291	26	287	91.80	50.35	78.82
PART	9	0	4	100.00	69.23	91.84
PREP	125	16	88	88.65	58.69	80.44
PRON	58	5	24	92.06	70.73	86.83
PUNCT	162	14	131	92.05	55.29	81.24
SPELL	82	0	27	100.00	75.23	93.82
UNK	28	0	59	100.00	32.18	70.35
VERB	69	5	77	93.24	47.26	78.05
VERB:FORM	75	9	16	89.29	82.42	87.82
VERB:INFL	3	0	0	100.00	100.00	100.00
VERB:SVA	75	6	7	92.59	91.46	92.36
VERB:TENSE	79	10	68	88.76	53.74	78.53
WO	32	5	18	86.49	64.00	80.81

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	0	1	100.00	66.67	90.91
M:ADV	7	5	4	58.33	63.64	59.32
M:CONJ	5	0	3	100.00	62.50	89.29
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	96	6	42	94.12	69.57	87.91
M:NOUN	3	0	4	100.00	42.86	78.95
M:NOUN:POSS	2	0	2	100.00	50.00	83.33
M:OTHER	25	2	17	92.59	59.52	83.33
M:PART	1	0	0	100.00	100.00	100.00
M:PREP	40	4	16	90.91	71.43	86.21
M:PRON	32	4	13	88.89	71.11	84.66
M:PUNCT	103	7	104	93.64	49.76	79.60
M:VERB	15	2	11	88.24	57.69	79.79
M:VERB:FORM	10	1	1	90.91	90.91	90.91
M:VERB:TENSE	16	1	6	94.12	72.73	88.89
R:ADJ	5	0	8	100.00	38.46	75.76
R:ADJ:FORM	4	0	4	100.00	50.00	83.33
R:ADV	6	0	9	100.00	40.00	76.92
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	20	5	27	80.00	42.55	68.03
R:MORPH	55	0	34	100.00	61.80	89.00
R:NOUN	18	3	36	85.71	33.33	65.22
R:NOUN:INFL	5	0	0	100.00	100.00	100.00
R:NOUN:NUM	91	5	32	94.79	73.98	89.74
R:NOUN:POSS	8	0	1	100.00	88.89	97.56
R:ORTH	107	1	94	99.07	53.23	84.52
R:OTHER	248	12	248	95.38	50.00	80.73
R:PART	7	0	2	100.00	77.78	94.59
R:PREP	51	7	68	87.93	42.86	72.65
R:PRON	18	0	8	100.00	69.23	91.84
R:PUNCT	44	7	15	86.27	74.58	83.65
R:SPELL	82	0	27	100.00	75.23	93.82
R:VERB	47	1	56	97.92	45.63	79.66
R:VERB:FORM	64	5	14	92.75	82.05	90.40
R:VERB:INFL	3	0	0	100.00	100.00	100.00
R:VERB:SVA	75	6	7	92.59	91.46	92.36
R:VERB:TENSE	58	9	59	86.57	49.57	75.32
R:WO	32	5	18	86.49	64.00	80.81
U:ADJ	1	0	3	100.00	25.00	62.50
U:ADV	9	2	2	81.82	81.82	81.82
U:CONJ	1	0	2	100.00	33.33	71.43
U:CONTR	5	0	1	100.00	83.33	96.15
U:DET	76	13	48	85.39	61.29	79.17
U:NOUN	2	1	8	66.67	20.00	45.45
U:NOUN:POSS	6	0	2	100.00	75.00	93.75
U:OTHER	18	12	22	60.00	45.00	56.25
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	34	5	4	87.18	89.47	87.63
U:PRON	8	1	3	88.89	72.73	85.11
U:PUNCT	15	0	12	100.00	55.56	86.21
U:VERB	7	2	10	77.78	41.18	66.04
U:VERB:FORM	1	3	1	25.00	50.00	27.78
U:VERB:TENSE	5	0	3	100.00	62.50	89.29
UNK	28	0	59	100.00	32.18	70.35

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	792	311	803	71.80	49.66	65.92
Span-level detection	886	221	756	80.04	53.96	72.98
Token-level detection	1075	175	903	86.00	54.35	77.03

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	232	77	183	75.08	55.90	70.26
R	444	159	549	73.63	44.71	65.20
U	116	75	71	60.73	62.03	60.99

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	5	10	37.50	23.08	33.33
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	12	9	17	57.14	41.38	53.10
CONJ	2	4	6	33.33	25.00	31.25
CONTR	3	0	0	100.00	100.00	100.00
DET	133	48	90	73.48	59.64	70.22
MORPH	22	12	15	64.71	59.46	63.58
NOUN	12	10	30	54.55	28.57	46.15
NOUN:NUM	53	15	20	77.94	72.60	76.81
NOUN:POSS	5	1	9	83.33	35.71	65.79
ORTH	31	8	41	79.49	43.06	67.98
OTHER	43	44	175	49.43	19.72	37.99
PART	6	4	5	60.00	54.55	58.82
PREP	81	35	74	69.83	52.26	65.43
PRON	24	12	19	66.67	55.81	64.17
PUNCT	135	29	102	82.32	56.96	75.59
SPELL	47	7	24	87.04	66.20	81.88
VERB	18	16	63	52.94	22.22	41.47
VERB:FORM	50	18	23	73.53	68.49	72.46
VERB:SVA	47	10	10	82.46	82.46	82.46
VERB:TENSE	46	17	48	73.02	48.94	66.47
WO	16	6	22	72.73	42.11	63.49

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	2	50.00	33.33	45.45
M:ADV	4	4	7	50.00	36.36	46.51
M:CONJ	2	2	4	50.00	33.33	45.45
M:DET	67	21	47	76.14	58.77	71.89
M:NOUN	1	3	2	25.00	33.33	26.32
M:NOUN:POSS	1	0	3	100.00	25.00	62.50
M:OTHER	4	6	10	40.00	28.57	37.04
M:PART	1	1	2	50.00	33.33	45.45
M:PREP	17	11	15	60.71	53.12	59.03
M:PRON	18	9	8	66.67	69.23	67.16
M:PUNCT	98	13	74	88.29	56.98	79.55
M:VERB	6	3	2	66.67	75.00	68.18
M:VERB:FORM	1	1	0	50.00	100.00	55.56
M:VERB:TENSE	11	2	7	84.62	61.11	78.57
R:ADJ	1	1	8	50.00	11.11	29.41
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	3	1	6	75.00	33.33	60.00
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	20	3	27	86.96	42.55	71.94
R:MORPH	22	12	15	64.71	59.46	63.58
R:NOUN	7	5	26	58.33	21.21	43.21
R:NOUN:NUM	53	15	20	77.94	72.60	76.81
R:NOUN:POSS	2	0	2	100.00	50.00	83.33
R:ORTH	31	8	41	79.49	43.06	67.98
R:OTHER	31	23	158	57.41	16.40	38.27
R:PART	5	3	2	62.50	71.43	64.10
R:PREP	44	14	46	75.86	48.89	68.32
R:PRON	2	3	7	40.00	22.22	34.48
R:PUNCT	28	12	21	70.00	57.14	66.99
R:SPELL	47	7	24	87.04	66.20	81.88
R:VERB	9	7	54	56.25	14.29	35.43
R:VERB:FORM	45	14	21	76.27	68.18	74.50
R:VERB:SVA	47	10	10	82.46	82.46	82.46
R:VERB:TENSE	27	14	38	65.85	41.54	58.95
R:WO	16	6	22	72.73	42.11	63.49
U:ADJ	1	3	0	25.00	100.00	29.41
U:ADV	5	4	4	55.56	55.56	55.56
U:CONJ	0	2	1	0.00	0.00	0.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	46	24	16	65.71	74.19	67.25
U:NOUN	4	2	2	66.67	66.67	66.67
U:NOUN:POSS	2	1	4	66.67	33.33	55.56
U:OTHER	8	15	7	34.78	53.33	37.38
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	20	10	13	66.67	60.61	65.36
U:PRON	4	0	4	100.00	50.00	83.33
U:PUNCT	9	4	7	69.23	56.25	66.18
U:VERB	3	6	7	33.33	30.00	32.61
U:VERB:FORM	4	3	2	57.14	66.67	58.82
U:VERB:TENSE	8	1	3	88.89	72.73	85.11

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	253	59	174	81.09	59.25	75.52
R	512	98	495	83.93	50.84	74.27
U	116	64	72	64.44	61.70	63.88
UNK	5	0	15	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	5	12	50.00	29.41	43.86
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	13	9	17	59.09	43.33	55.08
CONJ	2	3	8	40.00	20.00	33.33
CONTR	3	0	0	100.00	100.00	100.00
DET	140	38	85	78.65	62.22	74.71
MORPH	22	6	13	78.57	62.86	74.83
NOUN	18	8	29	69.23	38.30	59.60
NOUN:NUM	53	12	18	81.54	74.65	80.06
NOUN:POSS	6	1	10	85.71	37.50	68.18
ORTH	34	3	41	91.89	45.33	76.23
OTHER	77	29	155	72.64	33.19	58.69
PART	7	4	5	63.64	58.33	62.50
PREP	87	26	73	76.99	54.37	71.08
PRON	24	7	17	77.42	58.54	72.73
PUNCT	145	26	94	84.80	60.67	78.55
SPELL	47	2	21	95.92	69.12	89.02
UNK	5	0	15	100.00	25.00	62.50
VERB	33	12	55	73.33	37.50	61.57
VERB:FORM	49	9	20	84.48	71.01	81.40
VERB:SVA	50	5	5	90.91	90.91	90.91
VERB:TENSE	48	10	41	82.76	53.93	74.77
WO	15	5	22	75.00	40.54	64.10

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	2	50.00	33.33	45.45
M:ADV	4	4	6	50.00	40.00	47.62
M:CONJ	2	1	5	66.67	28.57	52.63
M:DET	76	13	39	85.39	66.09	80.68
M:NOUN	3	2	2	60.00	60.00	60.00
M:NOUN:POSS	1	0	3	100.00	25.00	62.50
M:OTHER	8	6	11	57.14	42.11	53.33
M:PART	1	1	2	50.00	33.33	45.45
M:PREP	16	11	18	59.26	47.06	56.34
M:PRON	18	5	7	78.26	72.00	76.92
M:PUNCT	104	12	71	89.66	59.43	81.38
M:VERB	7	2	1	77.78	87.50	79.55
M:VERB:FORM	1	1	0	50.00	100.00	55.56
M:VERB:TENSE	11	0	7	100.00	61.11	88.71
R:ADJ	3	1	10	75.00	23.08	51.72
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	3	1	7	75.00	30.00	57.69
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	22	3	29	88.00	43.14	72.85
R:MORPH	22	6	13	78.57	62.86	74.83
R:NOUN	11	4	22	73.33	33.33	59.14
R:NOUN:NUM	53	12	18	81.54	74.65	80.06
R:NOUN:POSS	3	0	3	100.00	50.00	83.33
R:ORTH	34	3	41	91.89	45.33	76.23
R:OTHER	60	11	138	84.51	30.30	62.24
R:PART	6	3	2	66.67	75.00	68.18
R:PREP	52	9	43	85.25	54.74	76.70
R:PRON	2	2	7	50.00	22.22	40.00
R:PUNCT	29	10	15	74.36	65.91	72.50
R:SPELL	47	2	21	95.92	69.12	89.02
R:VERB	22	5	48	81.48	31.43	61.80
R:VERB:FORM	45	5	18	90.00	71.43	85.55
R:VERB:SVA	50	5	5	90.91	90.91	90.91
R:VERB:TENSE	29	10	31	74.36	48.33	67.13
R:WO	15	5	22	75.00	40.54	64.10
U:ADJ	1	3	0	25.00	100.00	29.41
U:ADV	6	4	4	60.00	60.00	60.00
U:CONJ	0	2	1	0.00	0.00	0.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	42	22	17	65.62	71.19	66.67
U:NOUN	4	2	5	66.67	44.44	60.61
U:NOUN:POSS	2	1	4	66.67	33.33	55.56
U:OTHER	9	12	6	42.86	60.00	45.45
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	19	6	12	76.00	61.29	72.52
U:PRON	4	0	3	100.00	57.14	86.96
U:PUNCT	12	4	8	75.00	60.00	71.43
U:VERB	4	5	6	44.44	40.00	43.48
U:VERB:FORM	3	3	2	50.00	60.00	51.72
U:VERB:TENSE	8	0	3	100.00	72.73	93.02
UNK	5	0	15	100.00	25.00	62.50

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	276	40	190	87.34	59.23	79.77
R	660	77	574	89.55	53.48	78.91
U	134	58	125	69.79	51.74	65.24
UNK	5	0	14	100.00	26.32	64.10

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	4	14	60.00	30.00	50.00
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	14	5	21	73.68	40.00	63.06
CONJ	5	2	8	71.43	38.46	60.98
CONTR	2	0	0	100.00	100.00	100.00
DET	139	31	85	81.76	62.05	76.88
MORPH	22	3	16	88.00	57.89	79.71
NOUN	21	8	27	72.41	43.75	64.02
NOUN:NUM	51	8	19	86.44	72.86	83.33
NOUN:POSS	9	0	15	100.00	37.50	75.00
ORTH	61	2	44	96.83	58.10	85.43
OTHER	165	32	237	83.76	41.04	69.33
PART	5	2	3	71.43	62.50	69.44
PREP	88	17	73	83.81	54.66	75.73
PRON	25	6	23	80.65	52.08	72.67
PUNCT	169	21	93	88.95	64.50	82.68
SPELL	47	2	22	95.92	68.12	88.68
UNK	5	0	14	100.00	26.32	64.10
VERB	37	6	71	86.05	34.26	66.07
VERB:FORM	50	7	23	87.72	68.49	83.06
VERB:SVA	50	4	5	92.59	90.91	92.25
VERB:TENSE	56	9	53	86.15	51.38	75.88
WO	45	5	37	90.00	54.88	79.79

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	2	50.00	33.33	45.45
M:ADV	6	3	5	66.67	54.55	63.83
M:CONJ	5	1	5	83.33	50.00	73.53
M:DET	76	7	37	91.57	67.26	85.39
M:NOUN	4	2	4	66.67	50.00	62.50
M:NOUN:POSS	1	0	5	100.00	16.67	50.00
M:OTHER	9	4	15	69.23	37.50	59.21
M:PART	1	0	1	100.00	50.00	83.33
M:PREP	19	5	19	79.17	50.00	70.90
M:PRON	18	4	10	81.82	64.29	77.59
M:PUNCT	113	11	72	91.13	61.08	82.97
M:VERB	9	1	8	90.00	52.94	78.95
M:VERB:FORM	2	1	0	66.67	100.00	71.43
M:VERB:TENSE	12	0	7	100.00	63.16	89.55
R:ADJ	3	1	11	75.00	21.43	50.00
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	3	1	9	75.00	25.00	53.57
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	24	3	26	88.89	48.00	75.95
R:MORPH	22	3	16	88.00	57.89	79.71
R:NOUN	13	4	19	76.47	40.62	65.00
R:NOUN:NUM	51	8	19	86.44	72.86	83.33
R:NOUN:POSS	5	0	6	100.00	45.45	80.65
R:ORTH	61	2	44	96.83	58.10	85.43
R:OTHER	128	10	184	92.75	41.03	74.07
R:PART	3	2	1	60.00	75.00	62.50
R:PREP	51	8	40	86.44	56.04	77.98
R:PRON	3	2	8	60.00	27.27	48.39
R:PUNCT	42	7	11	85.71	79.25	84.34
R:SPELL	47	2	22	95.92	68.12	88.68
R:VERB	23	3	52	88.46	30.67	64.25
R:VERB:FORM	46	2	21	95.83	68.66	88.80
R:VERB:SVA	50	4	5	92.59	90.91	92.25
R:VERB:TENSE	36	9	40	80.00	47.37	70.31
R:WO	45	5	37	90.00	54.88	79.79
U:ADJ	2	2	1	50.00	66.67	52.63
U:ADV	5	1	7	83.33	41.67	69.44
U:CONJ	0	1	0	0.00	100.00	0.00
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	39	21	22	65.00	63.93	64.78
U:NOUN	4	2	4	66.67	50.00	62.50
U:NOUN:POSS	3	0	4	100.00	42.86	78.95
U:OTHER	28	18	38	60.87	42.42	56.00
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	18	4	14	81.82	56.25	75.00
U:PRON	4	0	5	100.00	44.44	80.00
U:PUNCT	14	3	10	82.35	58.33	76.09
U:VERB	5	2	11	71.43	31.25	56.82
U:VERB:FORM	2	4	2	33.33	50.00	35.71
U:VERB:TENSE	8	0	6	100.00	57.14	86.96
UNK	5	0	14	100.00	26.32	64.10

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	350	150	304	70.00	53.52	65.94
Span-level detection	378	122	292	75.60	56.42	70.79
Token-level detection	467	95	330	83.10	58.59	76.68

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	119	36	80	76.77	59.80	72.65
R	172	80	191	68.25	47.38	62.73
U	59	34	33	63.44	64.13	63.58

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	0	4	100.00	42.86	78.95
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	2	5	3	28.57	40.00	30.30
CONJ	0	1	2	0.00	0.00	0.00
CONTR	2	0	1	100.00	66.67	90.91
DET	71	24	37	74.74	65.74	72.75
MORPH	11	9	13	55.00	45.83	52.88
NOUN	3	10	11	23.08	21.43	22.73
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	20	6	12	76.92	62.50	73.53
NOUN:POSS	5	0	4	100.00	55.56	86.21
ORTH	14	2	21	87.50	40.00	70.71
OTHER	23	16	44	58.97	34.33	51.57
PART	0	1	1	0.00	0.00	0.00
PREP	38	24	40	61.29	48.72	58.28
PRON	7	4	6	63.64	53.85	61.40
PUNCT	78	17	40	82.11	66.10	78.31
SPELL	21	4	16	84.00	56.76	76.64
VERB	2	5	12	28.57	14.29	23.81
VERB:FORM	14	5	5	73.68	73.68	73.68
VERB:SVA	8	3	3	72.73	72.73	72.73
VERB:TENSE	17	8	18	68.00	48.57	62.96
WO	10	6	9	62.50	52.63	60.24

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	0	100.00	100.00	100.00
M:ADV	0	2	1	0.00	0.00	0.00
M:CONJ	0	1	1	0.00	0.00	0.00
M:DET	34	7	20	82.93	62.96	77.98
M:NOUN	0	3	1	0.00	0.00	0.00
M:OTHER	2	2	6	50.00	25.00	41.67
M:PREP	8	8	14	50.00	36.36	46.51
M:PRON	3	3	3	50.00	50.00	50.00
M:PUNCT	66	9	29	88.00	69.47	83.54
M:VERB	1	0	1	100.00	50.00	83.33
M:VERB:FORM	2	0	1	100.00	66.67	90.91
M:VERB:TENSE	2	1	3	66.67	40.00	58.82
R:ADJ	2	0	3	100.00	40.00	76.92
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	1	100.00	50.00	83.33
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	6	4	6	60.00	50.00	57.69
R:MORPH	11	9	13	55.00	45.83	52.88
R:NOUN	2	5	9	28.57	18.18	25.64
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	20	6	12	76.92	62.50	73.53
R:NOUN:POSS	1	0	4	100.00	20.00	55.56
R:ORTH	14	2	21	87.50	40.00	70.71
R:OTHER	18	8	36	69.23	33.33	56.96
R:PART	0	1	1	0.00	0.00	0.00
R:PREP	25	11	20	69.44	55.56	66.14
R:PRON	3	1	2	75.00	60.00	71.43
R:PUNCT	7	6	3	53.85	70.00	56.45
R:SPELL	21	4	16	84.00	56.76	76.64
R:VERB	1	3	10	25.00	9.09	18.52
R:VERB:FORM	11	5	4	68.75	73.33	69.62
R:VERB:SVA	8	3	3	72.73	72.73	72.73
R:VERB:TENSE	10	6	14	62.50	41.67	56.82
R:WO	10	6	9	62.50	52.63	60.24
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	1	3	1	25.00	50.00	27.78
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	31	13	11	70.45	73.81	71.10
U:NOUN	1	2	1	33.33	50.00	35.71
U:NOUN:POSS	4	0	0	100.00	100.00	100.00
U:OTHER	3	6	2	33.33	60.00	36.59
U:PREP	5	5	6	50.00	45.45	49.02
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	5	2	8	71.43	38.46	60.98
U:VERB	0	2	1	0.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	5	1	1	83.33	83.33	83.33

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	123	32	80	79.35	60.59	74.73
R	195	63	176	75.58	52.56	69.49
U	60	27	35	68.97	63.16	67.72
UNK	0	0	1	100.00	0.00	0.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	0	5	100.00	37.50	75.00
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	2	5	3	28.57	40.00	30.30
CONJ	1	1	2	50.00	33.33	45.45
CONTR	2	0	1	100.00	66.67	90.91
DET	77	20	35	79.38	68.75	77.00
MORPH	12	7	13	63.16	48.00	59.41
NOUN	6	6	13	50.00	31.58	44.78
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	19	5	12	79.17	61.29	74.80
NOUN:POSS	5	0	4	100.00	55.56	86.21
ORTH	14	2	20	87.50	41.18	71.43
OTHER	37	12	38	75.51	49.33	68.27
PART	1	1	1	50.00	50.00	50.00
PREP	39	19	36	67.24	52.00	63.52
PRON	6	4	7	60.00	46.15	56.60
PUNCT	79	17	40	82.29	66.39	78.53
SPELL	25	1	11	96.15	69.44	89.29
UNK	0	0	1	100.00	0.00	0.00
VERB	2	5	12	28.57	14.29	23.81
VERB:FORM	14	4	4	77.78	77.78	77.78
VERB:SVA	8	1	4	88.89	66.67	83.33
VERB:TENSE	18	6	19	75.00	48.65	67.67
WO	7	6	9	53.85	43.75	51.47

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	1	100.00	50.00	83.33
M:ADV	0	2	1	0.00	0.00	0.00
M:CONJ	1	1	1	50.00	50.00	50.00
M:DET	35	6	19	85.37	64.81	80.28
M:NOUN	0	3	3	0.00	0.00	0.00
M:OTHER	3	1	6	75.00	33.33	60.00
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	8	6	12	57.14	40.00	52.63
M:PRON	3	3	3	50.00	50.00	50.00
M:PUNCT	67	9	29	88.16	69.79	83.75
M:VERB	1	0	1	100.00	50.00	83.33
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	2	1	3	66.67	40.00	58.82
R:ADJ	2	0	3	100.00	40.00	76.92
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	1	100.00	50.00	83.33
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	10	3	4	76.92	71.43	75.76
R:MORPH	12	7	13	63.16	48.00	59.41
R:NOUN	5	2	8	71.43	38.46	60.98
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	19	5	12	79.17	61.29	74.80
R:NOUN:POSS	1	0	4	100.00	20.00	55.56
R:ORTH	14	2	20	87.50	41.18	71.43
R:OTHER	31	6	30	83.78	50.82	74.16
R:PART	1	1	0	50.00	100.00	55.56
R:PREP	27	10	18	72.97	60.00	69.95
R:PRON	2	1	3	66.67	40.00	58.82
R:PUNCT	6	6	3	50.00	66.67	52.63
R:SPELL	25	1	11	96.15	69.44	89.29
R:VERB	1	3	10	25.00	9.09	18.52
R:VERB:FORM	11	4	4	73.33	73.33	73.33
R:VERB:SVA	8	1	4	88.89	66.67	83.33
R:VERB:TENSE	11	5	15	68.75	42.31	61.11
R:WO	7	6	9	53.85	43.75	51.47
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	1	3	1	25.00	50.00	27.78
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	32	11	12	74.42	72.73	74.07
U:NOUN	1	1	2	50.00	33.33	45.45
U:NOUN:POSS	4	0	0	100.00	100.00	100.00
U:OTHER	3	5	2	37.50	60.00	40.54
U:PREP	4	3	6	57.14	40.00	52.63
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	6	2	8	75.00	42.86	65.22
U:VERB	0	2	1	0.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	5	0	1	100.00	83.33	96.15
UNK	0	0	1	100.00	0.00	0.00

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	145	27	89	84.30	61.97	78.63
R	258	43	199	85.71	56.46	77.66
U	63	25	39	71.59	61.76	69.38
UNK	1	0	3	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	0	7	100.00	22.22	58.82
ADJ:FORM	0	0	3	100.00	0.00	0.00
ADV	1	3	5	25.00	16.67	22.73
CONJ	2	0	2	100.00	50.00	83.33
CONTR	2	0	2	100.00	50.00	83.33
DET	76	16	32	82.61	70.37	79.83
MORPH	12	5	12	70.59	50.00	65.22
NOUN	5	5	11	50.00	31.25	44.64
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	18	2	16	90.00	52.94	78.95
NOUN:POSS	7	0	3	100.00	70.00	92.11
ORTH	23	1	24	95.83	48.94	80.42
OTHER	75	10	53	88.24	58.59	80.13
PART	1	0	1	100.00	50.00	83.33
PREP	39	18	37	68.42	51.32	64.14
PRON	8	5	7	61.54	53.33	59.70
PUNCT	103	15	48	87.29	68.21	82.66
SPELL	26	1	11	96.30	70.27	89.66
UNK	1	0	3	100.00	25.00	62.50
VERB	4	3	13	57.14	23.53	44.44
VERB:FORM	15	2	5	88.24	75.00	85.23
VERB:SVA	7	1	5	87.50	58.33	79.55
VERB:TENSE	18	5	21	78.26	46.15	68.70
WO	21	3	9	87.50	70.00	83.33

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	0	3	100.00	40.00	76.92
M:ADV	0	1	1	0.00	0.00	0.00
M:CONJ	2	0	1	100.00	66.67	90.91
M:DET	38	5	18	88.37	67.86	83.33
M:NOUN	0	3	2	0.00	0.00	0.00
M:NOUN:POSS	1	0	0	100.00	100.00	100.00
M:OTHER	4	1	7	80.00	36.36	64.52
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	9	6	13	60.00	40.91	54.88
M:PRON	5	3	3	62.50	62.50	62.50
M:PUNCT	78	8	36	90.70	68.42	85.15
M:VERB	1	0	2	100.00	33.33	71.43
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	3	0	2	100.00	60.00	88.24
R:ADJ	0	0	2	100.00	0.00	0.00
R:ADJ:FORM	0	0	3	100.00	0.00	0.00
R:ADV	1	0	1	100.00	50.00	83.33
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	8	2	4	80.00	66.67	76.92
R:MORPH	12	5	12	70.59	50.00	65.22
R:NOUN	4	1	7	80.00	36.36	64.52
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	18	2	16	90.00	52.94	78.95
R:NOUN:POSS	2	0	3	100.00	40.00	76.92
R:ORTH	23	1	24	95.83	48.94	80.42
R:OTHER	66	1	42	98.51	61.11	87.77
R:PART	1	0	0	100.00	100.00	100.00
R:PREP	26	9	18	74.29	59.09	70.65
R:PRON	2	2	2	50.00	50.00	50.00
R:PUNCT	15	5	4	75.00	78.95	75.76
R:SPELL	26	1	11	96.30	70.27	89.66
R:VERB	3	3	10	50.00	23.08	40.54
R:VERB:FORM	12	2	5	85.71	70.59	82.19
R:VERB:SVA	7	1	5	87.50	58.33	79.55
R:VERB:TENSE	10	5	19	66.67	34.48	56.18
R:WO	21	3	9	87.50	70.00	83.33
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	0	2	3	0.00	0.00	0.00
U:CONTR	2	0	1	100.00	66.67	90.91
U:DET	30	9	10	76.92	75.00	76.53
U:NOUN	1	1	2	50.00	33.33	45.45
U:NOUN:POSS	4	0	0	100.00	100.00	100.00
U:OTHER	5	8	4	38.46	55.56	40.98
U:PREP	4	3	6	57.14	40.00	52.63
U:PRON	1	0	2	100.00	33.33	71.43
U:PUNCT	10	2	8	83.33	55.56	75.76
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	5	0	0	100.00	100.00	100.00
UNK	1	0	3	100.00	25.00	62.50

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	293	213	251	57.91	53.86	57.05
Span-level detection	326	180	235	64.43	58.11	63.06
Token-level detection	393	178	271	68.83	59.19	66.66

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	91	46	55	66.42	62.33	65.56
R	168	102	183	62.22	47.86	58.70
U	34	65	13	34.34	72.34	38.37

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	2	3	50.00	40.00	47.62
ADV	2	8	1	20.00	66.67	23.26
CONJ	2	1	2	66.67	50.00	62.50
DET	19	42	7	31.15	73.08	35.19
MORPH	6	4	2	60.00	75.00	62.50
NOUN	4	7	7	36.36	36.36	36.36
NOUN:INFL	7	0	4	100.00	63.64	89.74
NOUN:NUM	14	13	7	51.85	66.67	54.26
NOUN:POSS	6	4	13	60.00	31.58	50.85
ORTH	14	2	39	87.50	26.42	59.83
OTHER	21	32	28	39.62	42.86	40.23
PART	1	1	0	50.00	100.00	55.56
PREP	14	21	12	40.00	53.85	42.17
PRON	5	2	1	71.43	83.33	73.53
PUNCT	99	23	57	81.15	63.46	76.86
SPELL	43	7	48	86.00	47.25	73.88
VERB	5	12	8	29.41	38.46	30.86
VERB:FORM	7	8	2	46.67	77.78	50.72
VERB:INFL	2	0	3	100.00	40.00	76.92
VERB:SVA	13	11	0	54.17	100.00	59.63
VERB:TENSE	4	9	6	30.77	40.00	32.26
WO	3	4	1	42.86	75.00	46.88

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	0	50.00	100.00	55.56
M:ADV	0	2	1	0.00	0.00	0.00
M:CONJ	1	0	1	100.00	50.00	83.33
M:DET	6	10	4	37.50	60.00	40.54
M:NOUN	0	1	2	0.00	0.00	0.00
M:NOUN:POSS	3	3	4	50.00	42.86	48.39
M:OTHER	0	4	0	0.00	100.00	0.00
M:PREP	2	6	0	25.00	100.00	29.41
M:PRON	1	2	1	33.33	50.00	35.71
M:PUNCT	76	9	39	89.41	66.09	83.52
M:VERB	1	5	3	16.67	25.00	17.86
M:VERB:TENSE	0	3	0	0.00	100.00	0.00
R:ADJ	0	1	3	0.00	0.00	0.00
R:ADV	0	2	0	0.00	100.00	0.00
R:DET	2	7	1	22.22	66.67	25.64
R:MORPH	6	4	2	60.00	75.00	62.50
R:NOUN	4	4	5	50.00	44.44	48.78
R:NOUN:INFL	7	0	4	100.00	63.64	89.74
R:NOUN:NUM	14	13	7	51.85	66.67	54.26
R:NOUN:POSS	3	1	8	75.00	27.27	55.56
R:ORTH	14	2	39	87.50	26.42	59.83
R:OTHER	19	17	28	52.78	40.43	49.74
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	8	4	11	66.67	42.11	59.70
R:PRON	4	0	0	100.00	100.00	100.00
R:PUNCT	13	7	11	65.00	54.17	62.50
R:SPELL	43	7	48	86.00	47.25	73.88
R:VERB	3	5	5	37.50	37.50	37.50
R:VERB:FORM	7	8	2	46.67	77.78	50.72
R:VERB:INFL	2	0	3	100.00	40.00	76.92
R:VERB:SVA	13	11	0	54.17	100.00	59.63
R:VERB:TENSE	3	4	5	42.86	37.50	41.67
R:WO	3	4	1	42.86	75.00	46.88
U:ADJ	1	0	0	100.00	100.00	100.00
U:ADV	2	4	0	33.33	100.00	38.46
U:CONJ	1	1	1	50.00	50.00	50.00
U:DET	11	25	2	30.56	84.62	35.03
U:NOUN	0	2	0	0.00	100.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	2	11	0	15.38	100.00	18.52
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	4	11	1	26.67	80.00	30.77
U:PUNCT	10	7	7	58.82	58.82	58.82
U:VERB	1	2	0	33.33	100.00	38.46
U:VERB:TENSE	1	2	1	33.33	50.00	35.71

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	95	42	50	69.34	65.52	68.54
R	196	75	170	72.32	53.55	67.59
U	33	63	13	34.38	71.74	38.37
UNK	2	0	2	100.00	50.00	83.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	0	2	100.00	60.00	88.24
ADV	2	7	1	22.22	66.67	25.64
CONJ	2	1	2	66.67	50.00	62.50
DET	20	38	8	34.48	71.43	38.46
MORPH	6	3	1	66.67	85.71	69.77
NOUN	4	5	7	44.44	36.36	42.55
NOUN:INFL	7	0	4	100.00	63.64	89.74
NOUN:NUM	13	13	7	50.00	65.00	52.42
NOUN:POSS	8	3	10	72.73	44.44	64.52
ORTH	18	2	38	90.00	32.14	66.18
OTHER	27	24	24	52.94	52.94	52.94
PART	1	1	0	50.00	100.00	55.56
PREP	14	20	11	41.18	56.00	43.48
PRON	6	2	1	75.00	85.71	76.92
PUNCT	104	21	50	83.20	67.53	79.51
SPELL	48	1	46	97.96	51.06	82.76
UNK	2	0	2	100.00	50.00	83.33
VERB	9	12	8	42.86	52.94	44.55
VERB:FORM	7	6	2	53.85	77.78	57.38
VERB:INFL	2	0	3	100.00	40.00	76.92
VERB:SVA	15	8	1	65.22	93.75	69.44
VERB:TENSE	5	9	6	35.71	45.45	37.31
WO	3	4	1	42.86	75.00	46.88

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	0	100.00	100.00	100.00
M:ADV	0	1	1	0.00	0.00	0.00
M:CONJ	1	0	1	100.00	50.00	83.33
M:DET	7	8	4	46.67	63.64	49.30
M:NOUN	0	1	2	0.00	0.00	0.00
M:NOUN:POSS	3	3	3	50.00	50.00	50.00
M:OTHER	0	4	1	0.00	0.00	0.00
M:PREP	2	6	0	25.00	100.00	29.41
M:PRON	1	2	1	33.33	50.00	35.71
M:PUNCT	78	9	34	89.66	69.64	84.78
M:VERB	2	5	3	28.57	40.00	30.30
M:VERB:TENSE	0	3	0	0.00	100.00	0.00
R:ADJ	1	0	2	100.00	33.33	71.43
R:ADV	0	2	0	0.00	100.00	0.00
R:DET	2	7	2	22.22	50.00	25.00
R:MORPH	6	3	1	66.67	85.71	69.77
R:NOUN	4	2	5	66.67	44.44	60.61
R:NOUN:INFL	7	0	4	100.00	63.64	89.74
R:NOUN:NUM	13	13	7	50.00	65.00	52.42
R:NOUN:POSS	5	0	6	100.00	45.45	80.65
R:ORTH	18	2	38	90.00	32.14	66.18
R:OTHER	25	9	23	73.53	52.08	67.93
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	10	3	10	76.92	50.00	69.44
R:PRON	5	0	0	100.00	100.00	100.00
R:PUNCT	15	5	10	75.00	60.00	71.43
R:SPELL	48	1	46	97.96	51.06	82.76
R:VERB	6	5	4	54.55	60.00	55.56
R:VERB:FORM	7	6	2	53.85	77.78	57.38
R:VERB:INFL	2	0	3	100.00	40.00	76.92
R:VERB:SVA	15	8	1	65.22	93.75	69.44
R:VERB:TENSE	4	4	5	50.00	44.44	48.78
R:WO	3	4	1	42.86	75.00	46.88
U:ADJ	1	0	0	100.00	100.00	100.00
U:ADV	2	4	0	33.33	100.00	38.46
U:CONJ	1	1	1	50.00	50.00	50.00
U:DET	11	23	2	32.35	84.62	36.91
U:NOUN	0	2	0	0.00	100.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	2	11	0	15.38	100.00	18.52
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	2	11	1	15.38	66.67	18.18
U:PUNCT	11	7	6	61.11	64.71	61.80
U:VERB	1	2	1	33.33	50.00	35.71
U:VERB:TENSE	1	2	1	33.33	50.00	35.71
UNK	2	0	2	100.00	50.00	83.33

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	109	38	49	74.15	68.99	73.06
R	243	75	203	76.42	54.48	70.72
U	38	65	17	36.89	69.09	40.69
UNK	3	0	2	100.00	60.00	88.24

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	0	3	100.00	50.00	83.33
ADJ:FORM	1	0	0	100.00	100.00	100.00
ADV	3	4	3	42.86	50.00	44.12
CONJ	4	1	0	80.00	100.00	83.33
CONTR	0	0	1	100.00	0.00	0.00
DET	20	35	9	36.36	68.97	40.16
MORPH	6	3	1	66.67	85.71	69.77
NOUN	4	4	10	50.00	28.57	43.48
NOUN:INFL	7	0	4	100.00	63.64	89.74
NOUN:NUM	13	12	6	52.00	68.42	54.62
NOUN:POSS	10	3	8	76.92	55.56	71.43
ORTH	31	2	52	93.94	37.35	72.09
OTHER	52	31	32	62.65	61.90	62.50
PREP	14	19	12	42.42	53.85	44.30
PRON	7	2	0	77.78	100.00	81.40
PUNCT	116	21	60	84.67	65.91	80.11
SPELL	48	1	47	97.96	50.53	82.47
UNK	3	0	2	100.00	60.00	88.24
VERB	11	12	7	47.83	61.11	50.00
VERB:FORM	9	4	1	69.23	90.00	72.58
VERB:INFL	2	0	3	100.00	40.00	76.92
VERB:SVA	15	6	1	71.43	93.75	75.00
VERB:TENSE	7	11	5	38.89	58.33	41.67
WO	7	7	4	50.00	63.64	52.24

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	0	100.00	100.00	100.00
M:ADV	0	1	2	0.00	0.00	0.00
M:CONJ	3	0	0	100.00	100.00	100.00
M:DET	6	5	5	54.55	54.55	54.55
M:NOUN	0	1	3	0.00	0.00	0.00
M:NOUN:POSS	3	3	2	50.00	60.00	51.72
M:OTHER	1	4	0	20.00	100.00	23.81
M:PREP	4	4	1	50.00	80.00	54.05
M:PRON	2	2	0	50.00	100.00	55.56
M:PUNCT	85	9	35	90.43	70.83	85.69
M:VERB	3	6	1	33.33	75.00	37.50
M:VERB:TENSE	1	3	0	25.00	100.00	29.41
R:ADJ	1	0	2	100.00	33.33	71.43
R:ADJ:FORM	1	0	0	100.00	100.00	100.00
R:ADV	1	2	0	33.33	100.00	38.46
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	2	7	2	22.22	50.00	25.00
R:MORPH	6	3	1	66.67	85.71	69.77
R:NOUN	4	2	7	66.67	36.36	57.14
R:NOUN:INFL	7	0	4	100.00	63.64	89.74
R:NOUN:NUM	13	12	6	52.00	68.42	54.62
R:NOUN:POSS	7	0	5	100.00	58.33	87.50
R:ORTH	31	2	52	93.94	37.35	72.09
R:OTHER	47	9	32	83.93	59.49	77.56
R:PREP	9	4	10	69.23	47.37	63.38
R:PRON	5	0	0	100.00	100.00	100.00
R:PUNCT	18	6	16	75.00	52.94	69.23
R:SPELL	48	1	47	97.96	50.53	82.47
R:VERB	6	4	5	60.00	54.55	58.82
R:VERB:FORM	9	4	1	69.23	90.00	72.58
R:VERB:INFL	2	0	3	100.00	40.00	76.92
R:VERB:SVA	15	6	1	71.43	93.75	75.00
R:VERB:TENSE	4	6	4	40.00	50.00	41.67
R:WO	7	7	4	50.00	63.64	52.24
U:ADJ	1	0	1	100.00	50.00	83.33
U:ADV	2	1	1	66.67	66.67	66.67
U:CONJ	1	1	0	50.00	100.00	55.56
U:DET	12	23	2	34.29	85.71	38.96
U:NOUN	0	1	0	0.00	100.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	4	18	0	18.18	100.00	21.74
U:PREP	1	11	1	8.33	50.00	10.00
U:PUNCT	13	6	9	68.42	59.09	66.33
U:VERB	2	2	1	50.00	66.67	52.63
U:VERB:TENSE	2	2	1	50.00	66.67	52.63
UNK	3	0	2	100.00	60.00	88.24

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:45:52+00:00
Competition submission:	4
Competition phase:	3 - Open phase

Detailed results

Submission information

Results