BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1638	4314	3486	27.52	31.97	28.31
Span-level detection	2328	3628	3347	39.09	41.02	39.46
Token-level detection	3016	3207	4204	48.47	41.77	46.96

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	948	1741	664	35.25	58.81	38.32
R	562	2018	2471	21.78	18.53	21.04
U	128	555	351	18.74	26.72	19.93

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	65	37	1.52	2.63	1.66
ADJ:FORM	3	5	6	37.50	33.33	36.59
ADV	7	105	46	6.25	13.21	6.99
CONJ	7	33	13	17.50	35.00	19.44
CONTR	0	6	11	0.00	0.00	0.00
DET	180	527	388	25.46	31.69	26.50
MORPH	20	46	120	30.30	14.29	24.75
NOUN	7	448	101	1.54	6.48	1.82
NOUN:INFL	5	10	13	33.33	27.78	32.05
NOUN:NUM	72	101	166	41.62	30.25	38.71
NOUN:POSS	1	0	44	100.00	2.22	10.20
ORTH	136	133	268	50.56	33.66	45.95
OTHER	21	850	684	2.41	2.98	2.51
PART	3	5	15	37.50	16.67	30.00
PREP	80	373	315	17.66	20.25	18.12
PRON	23	100	81	18.70	22.12	19.30
PUNCT	766	1020	387	42.89	66.44	46.16
SPELL	210	111	109	65.42	65.83	65.50
VERB	19	186	186	9.27	9.27	9.27
VERB:FORM	41	98	124	29.50	24.85	28.43
VERB:INFL	3	0	5	100.00	37.50	75.00
VERB:SVA	11	4	111	73.33	9.02	30.22
VERB:TENSE	19	84	204	18.45	8.52	14.96
WO	3	4	52	42.86	5.45	18.07

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	7	0.00	0.00	0.00
M:ADV	3	32	13	8.57	18.75	9.62
M:CONJ	4	29	6	12.12	40.00	14.08
M:DET	142	426	142	25.00	50.00	27.78
M:NOUN	1	35	13	2.78	7.14	3.16
M:NOUN:POSS	1	0	12	100.00	7.69	29.41
M:OTHER	3	39	42	7.14	6.67	7.04
M:PART	0	4	3	0.00	0.00	0.00
M:PREP	40	289	65	12.16	38.10	14.07
M:PRON	15	52	40	22.39	27.27	23.22
M:PUNCT	705	693	258	50.43	73.21	53.78
M:VERB	11	44	24	20.00	31.43	21.57
M:VERB:FORM	18	72	1	20.00	94.74	23.75
M:VERB:TENSE	5	24	38	17.24	11.63	15.72
R:ADJ	1	48	27	2.04	3.57	2.23
R:ADJ:FORM	3	5	6	37.50	33.33	36.59
R:ADV	0	27	20	0.00	0.00	0.00
R:CONJ	0	1	4	0.00	0.00	0.00
R:CONTR	0	6	4	0.00	0.00	0.00
R:DET	12	53	101	18.46	10.62	16.09
R:MORPH	20	46	120	30.30	14.29	24.75
R:NOUN	4	372	74	1.06	5.13	1.26
R:NOUN:INFL	5	10	13	33.33	27.78	32.05
R:NOUN:NUM	72	101	166	41.62	30.25	38.71
R:NOUN:POSS	0	0	23	100.00	0.00	0.00
R:ORTH	136	133	268	50.56	33.66	45.95
R:OTHER	16	781	613	2.01	2.54	2.10
R:PART	1	1	8	50.00	11.11	29.41
R:PREP	20	29	196	40.82	9.26	24.27
R:PRON	4	14	30	22.22	11.76	18.87
R:PUNCT	3	86	100	3.37	2.91	3.27
R:SPELL	210	111	109	65.42	65.83	65.50
R:VERB	4	116	149	3.33	2.61	3.16
R:VERB:FORM	23	20	120	53.49	16.08	36.51
R:VERB:INFL	3	0	5	100.00	37.50	75.00
R:VERB:SVA	11	4	111	73.33	9.02	30.22
R:VERB:TENSE	11	50	152	18.03	6.75	13.51
R:WO	3	4	52	42.86	5.45	18.07
U:ADJ	0	15	3	0.00	0.00	0.00
U:ADV	4	46	13	8.00	23.53	9.22
U:CONJ	3	3	3	50.00	50.00	50.00
U:CONTR	0	0	7	100.00	0.00	0.00
U:DET	26	48	145	35.14	15.20	27.84
U:NOUN	2	41	14	4.65	12.50	5.32
U:NOUN:POSS	0	0	9	100.00	0.00	0.00
U:OTHER	2	30	29	6.25	6.45	6.29
U:PART	2	0	4	100.00	33.33	71.43
U:PREP	20	55	54	26.67	27.03	26.74
U:PRON	4	34	11	10.53	26.67	11.98
U:PUNCT	58	241	29	19.40	66.67	22.60
U:VERB	4	26	13	13.33	23.53	14.60
U:VERB:FORM	0	6	3	0.00	0.00	0.00
U:VERB:TENSE	3	10	14	23.08	17.65	21.74

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	1114	1579	641	41.37	63.48	44.46
R	1035	1553	2277	39.99	31.25	37.87
U	155	496	367	23.81	29.69	24.79
UNK	24	0	62	100.00	27.91	65.93

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	11	56	41	16.42	21.15	17.19
ADJ:FORM	3	4	7	42.86	30.00	39.47
ADV	20	93	47	17.70	29.85	19.27
CONJ	13	24	15	35.14	46.43	36.93
CONTR	1	6	11	14.29	8.33	12.50
DET	228	478	382	32.29	37.38	33.20
MORPH	40	36	109	52.63	26.85	44.15
NOUN	38	376	92	9.18	29.23	10.64
NOUN:INFL	13	0	5	100.00	72.22	92.86
NOUN:NUM	85	88	158	49.13	34.98	45.45
NOUN:POSS	6	0	41	100.00	12.77	42.25
ORTH	243	87	230	73.64	51.37	67.76
OTHER	177	700	632	20.18	21.88	20.50
PART	6	5	16	54.55	27.27	45.45
PREP	128	323	298	28.38	30.05	28.70
PRON	41	80	84	33.88	32.80	33.66
PUNCT	820	945	392	46.46	67.66	49.56
SPELL	274	17	49	94.16	84.83	92.13
UNK	24	0	62	100.00	27.91	65.93
VERB	50	144	187	25.77	21.10	24.68
VERB:FORM	49	88	128	35.77	27.68	33.79
VERB:INFL	5	0	4	100.00	55.56	86.21
VERB:SVA	21	4	111	84.00	15.91	45.26
VERB:TENSE	29	70	198	29.29	12.78	23.27
WO	3	4	48	42.86	5.88	18.99

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	7	0.00	0.00	0.00
M:ADV	7	31	14	18.42	33.33	20.23
M:CONJ	10	20	8	33.33	55.56	36.23
M:DET	179	386	133	31.68	57.37	34.80
M:NOUN	4	34	11	10.53	26.67	11.98
M:NOUN:POSS	4	0	10	100.00	28.57	66.67
M:OTHER	34	27	42	55.74	44.74	53.12
M:PART	2	4	5	33.33	28.57	32.26
M:PREP	61	263	56	18.83	52.14	21.59
M:PRON	29	46	43	38.67	40.28	38.98
M:PUNCT	735	646	259	53.22	73.94	56.38
M:VERB	22	34	20	39.29	52.38	41.35
M:VERB:FORM	18	67	0	21.18	100.00	25.14
M:VERB:TENSE	9	19	33	32.14	21.43	29.22
R:ADJ	10	42	28	19.23	26.32	20.33
R:ADJ:FORM	3	4	7	42.86	30.00	39.47
R:ADV	8	21	20	27.59	28.57	27.78
R:CONJ	0	1	3	0.00	0.00	0.00
R:CONTR	1	6	3	14.29	25.00	15.62
R:DET	18	48	99	27.27	15.38	23.62
R:MORPH	40	36	109	52.63	26.85	44.15
R:NOUN	28	309	70	8.31	28.57	9.68
R:NOUN:INFL	13	0	5	100.00	72.22	92.86
R:NOUN:NUM	85	88	158	49.13	34.98	45.45
R:NOUN:POSS	2	0	22	100.00	8.33	31.25
R:ORTH	243	87	230	73.64	51.37	67.76
R:OTHER	139	647	556	17.68	20.00	18.10
R:PART	3	1	7	75.00	30.00	57.69
R:PREP	46	15	194	75.41	19.17	47.52
R:PRON	8	9	27	47.06	22.86	38.83
R:PUNCT	16	69	101	18.82	13.68	17.51
R:SPELL	274	17	49	94.16	84.83	92.13
R:VERB	23	89	152	20.54	13.14	18.46
R:VERB:FORM	31	15	126	67.39	19.75	45.45
R:VERB:INFL	5	0	4	100.00	55.56	86.21
R:VERB:SVA	21	4	111	84.00	15.91	45.26
R:VERB:TENSE	15	41	148	26.79	9.20	19.38
R:WO	3	4	48	42.86	5.88	18.99
U:ADJ	1	12	6	7.69	14.29	8.47
U:ADV	5	41	13	10.87	27.78	12.38
U:CONJ	3	3	4	50.00	42.86	48.39
U:CONTR	0	0	8	100.00	0.00	0.00
U:DET	31	44	150	41.33	17.13	32.22
U:NOUN	6	33	11	15.38	35.29	17.34
U:NOUN:POSS	0	0	9	100.00	0.00	0.00
U:OTHER	4	26	34	13.33	10.53	12.66
U:PART	1	0	4	100.00	20.00	55.56
U:PREP	21	45	48	31.82	30.43	31.53
U:PRON	4	25	14	13.79	22.22	14.93
U:PUNCT	69	230	32	23.08	68.32	26.60
U:VERB	5	21	15	19.23	25.00	20.16
U:VERB:FORM	0	6	2	0.00	0.00	0.00
U:VERB:TENSE	5	10	17	33.33	22.73	30.49
UNK	24	0	62	100.00	27.91	65.93

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	1234	1275	676	49.18	64.61	51.65
R	1514	1485	2878	50.48	34.47	46.19
U	219	447	522	32.88	29.55	32.16
UNK	49	0	128	100.00	27.68	65.68

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	17	50	50	25.37	25.37	25.37
ADJ:FORM	5	4	8	55.56	38.46	51.02
ADV	26	77	67	25.24	27.96	25.74
CONJ	24	17	18	58.54	57.14	58.25
CONTR	1	6	16	14.29	5.88	11.11
DET	283	388	409	42.18	40.90	41.91
MORPH	52	35	100	59.77	34.21	52.00
NOUN	52	356	110	12.75	32.10	14.49
NOUN:INFL	13	0	5	100.00	72.22	92.86
NOUN:NUM	102	81	163	55.74	38.49	51.15
NOUN:POSS	8	0	54	100.00	12.90	42.55
ORTH	292	76	276	79.35	51.41	71.57
OTHER	458	686	1059	40.03	30.19	37.58
PART	7	4	20	63.64	25.93	49.30
PREP	150	272	328	35.55	31.38	34.63
PRON	54	64	85	45.76	38.85	44.19
PUNCT	886	836	415	51.45	68.10	54.10
SPELL	272	11	48	96.11	85.00	93.66
UNK	49	0	128	100.00	27.68	65.68
VERB	66	128	238	34.02	21.71	30.56
VERB:FORM	73	54	132	57.48	35.61	51.19
VERB:INFL	5	0	4	100.00	55.56	86.21
VERB:SVA	37	3	110	92.50	25.17	60.26
VERB:TENSE	44	56	249	44.00	15.02	31.75
WO	40	3	112	93.02	26.32	61.73

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	9	0.00	0.00	0.00
M:ADV	8	24	25	25.00	24.24	24.84
M:CONJ	16	13	9	55.17	64.00	56.74
M:DET	209	300	136	41.06	60.58	43.89
M:NOUN	6	30	19	16.67	24.00	17.75
M:NOUN:POSS	7	0	9	100.00	43.75	79.55
M:OTHER	41	24	55	63.08	42.71	57.58
M:PART	1	3	6	25.00	14.29	21.74
M:PREP	69	223	57	23.63	54.76	26.66
M:PRON	33	33	41	50.00	44.59	48.82
M:PUNCT	789	549	245	58.97	76.31	61.78
M:VERB	24	26	27	48.00	47.06	47.81
M:VERB:FORM	18	37	1	32.73	94.74	37.66
M:VERB:TENSE	13	11	37	54.17	26.00	44.52
R:ADJ	15	39	35	27.78	30.00	28.20
R:ADJ:FORM	5	4	8	55.56	38.46	51.02
R:ADV	8	21	22	27.59	26.67	27.40
R:CONJ	3	1	4	75.00	42.86	65.22
R:CONTR	1	6	6	14.29	14.29	14.29
R:DET	25	45	100	35.71	20.00	30.86
R:MORPH	52	35	100	59.77	34.21	52.00
R:NOUN	37	295	74	11.14	33.33	12.86
R:NOUN:INFL	13	0	5	100.00	72.22	92.86
R:NOUN:NUM	102	81	163	55.74	38.49	51.15
R:NOUN:POSS	1	0	32	100.00	3.03	13.51
R:ORTH	292	76	276	79.35	51.41	71.57
R:OTHER	401	633	899	38.78	30.85	36.88
R:PART	4	1	11	80.00	26.67	57.14
R:PREP	51	11	212	82.26	19.39	49.90
R:PRON	13	9	30	59.09	30.23	49.62
R:PUNCT	19	80	127	19.19	13.01	17.53
R:SPELL	272	11	48	96.11	85.00	93.66
R:VERB	37	83	180	30.83	17.05	26.54
R:VERB:FORM	54	12	125	81.82	30.17	60.95
R:VERB:INFL	5	0	4	100.00	55.56	86.21
R:VERB:SVA	37	3	110	92.50	25.17	60.26
R:VERB:TENSE	27	36	195	42.86	12.16	28.48
R:WO	40	3	112	93.02	26.32	61.73
U:ADJ	2	9	6	18.18	25.00	19.23
U:ADV	10	32	20	23.81	33.33	25.25
U:CONJ	5	3	5	62.50	50.00	59.52
U:CONTR	0	0	10	100.00	0.00	0.00
U:DET	49	43	173	53.26	22.07	41.53
U:NOUN	9	31	17	22.50	34.62	24.19
U:NOUN:POSS	0	0	13	100.00	0.00	0.00
U:OTHER	16	29	105	35.56	13.22	26.58
U:PART	2	0	3	100.00	40.00	76.92
U:PREP	30	38	59	44.12	33.71	41.55
U:PRON	8	22	14	26.67	36.36	28.17
U:PUNCT	78	207	43	27.37	64.46	30.93
U:VERB	5	19	31	20.83	13.89	18.94
U:VERB:FORM	1	5	6	16.67	14.29	16.13
U:VERB:TENSE	4	9	17	30.77	19.05	27.40
UNK	49	0	128	100.00	27.68	65.68

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	558	1076	1594	34.15	25.93	32.11
Span-level detection	851	786	1527	51.99	35.79	47.67
Token-level detection	1123	603	1849	65.06	37.79	56.86

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	281	466	291	37.62	49.13	39.47
R	232	500	1145	31.69	16.85	26.95
U	45	110	158	29.03	22.17	27.34

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	8	9	0.00	0.00	0.00
ADJ:FORM	2	1	1	66.67	66.67	66.67
ADV	5	21	25	19.23	16.67	18.66
CONJ	3	7	4	30.00	42.86	31.91
CONTR	0	1	5	0.00	0.00	0.00
DET	71	151	169	31.98	29.58	31.47
MORPH	13	14	63	48.15	17.11	35.33
NOUN	1	72	39	1.37	2.50	1.51
NOUN:INFL	4	2	2	66.67	66.67	66.67
NOUN:NUM	33	22	88	60.00	27.27	48.39
NOUN:POSS	0	0	11	100.00	0.00	0.00
ORTH	60	39	139	60.61	30.15	50.42
OTHER	6	225	365	2.60	1.62	2.32
PART	1	0	6	100.00	14.29	45.45
PREP	30	86	132	25.86	18.52	23.96
PRON	14	42	40	25.00	25.93	25.18
PUNCT	185	224	149	45.23	55.39	46.95
SPELL	74	50	38	59.68	66.07	60.86
VERB	11	47	88	18.97	11.11	16.62
VERB:FORM	25	32	57	43.86	30.49	40.32
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	6	1	58	85.71	9.38	32.61
VERB:TENSE	10	30	89	25.00	10.10	19.31
WO	1	1	16	50.00	5.88	20.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	3	9	6	25.00	33.33	26.32
M:CONJ	1	6	1	14.29	50.00	16.67
M:DET	52	132	58	28.26	47.27	30.73
M:NOUN	0	6	3	0.00	0.00	0.00
M:NOUN:POSS	0	0	3	100.00	0.00	0.00
M:OTHER	2	13	24	13.33	7.69	11.63
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	17	68	33	20.00	34.00	21.79
M:PRON	9	22	20	29.03	31.03	29.41
M:PUNCT	172	162	111	51.50	60.78	53.12
M:VERB	6	13	13	31.58	31.58	31.58
M:VERB:FORM	15	25	0	37.50	100.00	42.86
M:VERB:TENSE	4	10	17	28.57	19.05	25.97
R:ADJ	0	4	7	0.00	0.00	0.00
R:ADJ:FORM	2	1	1	66.67	66.67	66.67
R:ADV	0	5	11	0.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	4	9	36	30.77	10.00	21.74
R:MORPH	13	14	63	48.15	17.11	35.33
R:NOUN	0	60	29	0.00	0.00	0.00
R:NOUN:INFL	4	2	2	66.67	66.67	66.67
R:NOUN:NUM	33	22	88	60.00	27.27	48.39
R:NOUN:POSS	0	0	5	100.00	0.00	0.00
R:ORTH	60	39	139	60.61	30.15	50.42
R:OTHER	4	205	332	1.91	1.19	1.71
R:PART	0	0	3	100.00	0.00	0.00
R:PREP	8	7	76	53.33	9.52	27.78
R:PRON	3	7	15	30.00	16.67	25.86
R:PUNCT	0	24	31	0.00	0.00	0.00
R:SPELL	74	50	38	59.68	66.07	60.86
R:VERB	2	26	69	7.14	2.82	5.46
R:VERB:FORM	10	6	56	62.50	15.15	38.46
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	6	1	58	85.71	9.38	32.61
R:VERB:TENSE	5	16	68	23.81	6.85	15.92
R:WO	1	1	16	50.00	5.88	20.00
U:ADJ	0	4	1	0.00	0.00	0.00
U:ADV	2	7	8	22.22	20.00	21.74
U:CONJ	2	1	3	66.67	40.00	58.82
U:CONTR	0	0	4	100.00	0.00	0.00
U:DET	15	10	75	60.00	16.67	39.47
U:NOUN	1	6	7	14.29	12.50	13.89
U:NOUN:POSS	0	0	3	100.00	0.00	0.00
U:OTHER	0	7	9	0.00	0.00	0.00
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	5	11	23	31.25	17.86	27.17
U:PRON	2	13	5	13.33	28.57	14.93
U:PUNCT	13	38	7	25.49	65.00	29.02
U:VERB	3	8	6	27.27	33.33	28.30
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	1	4	4	20.00	20.00	20.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	353	395	278	47.19	55.94	48.72
R	439	305	1028	59.01	29.93	49.40
U	49	86	173	36.30	22.07	32.15
UNK	10	0	48	100.00	17.24	51.02

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	6	16	25.00	11.11	20.00
ADJ:FORM	2	1	2	66.67	50.00	62.50
ADV	10	15	25	40.00	28.57	37.04
CONJ	4	4	7	50.00	36.36	46.51
CONTR	1	1	5	50.00	16.67	35.71
DET	86	139	169	38.22	33.73	37.23
MORPH	23	9	58	71.88	28.40	55.02
NOUN	13	50	36	20.63	26.53	21.59
NOUN:INFL	4	0	2	100.00	66.67	90.91
NOUN:NUM	38	18	84	67.86	31.15	54.91
NOUN:POSS	1	0	10	100.00	9.09	33.33
ORTH	117	18	99	86.67	54.17	77.38
OTHER	85	149	329	36.32	20.53	31.48
PART	1	0	6	100.00	14.29	45.45
PREP	54	66	118	45.00	31.40	41.41
PRON	20	26	46	43.48	30.30	40.00
PUNCT	205	193	149	51.51	57.91	52.67
SPELL	96	10	14	90.57	87.27	89.89
UNK	10	0	48	100.00	17.24	51.02
VERB	23	27	89	46.00	20.54	36.86
VERB:FORM	25	27	59	48.08	29.76	42.81
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	11	2	60	84.62	15.49	44.72
VERB:TENSE	15	24	83	38.46	15.31	29.53
WO	1	1	12	50.00	7.69	23.81

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	6	8	7	42.86	46.15	43.48
M:CONJ	2	3	3	40.00	40.00	40.00
M:DET	66	120	55	35.48	54.55	38.15
M:NOUN	1	5	2	16.67	33.33	18.52
M:NOUN:POSS	1	0	2	100.00	33.33	71.43
M:OTHER	16	6	24	72.73	40.00	62.50
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	31	57	27	35.23	53.45	37.80
M:PRON	13	18	23	41.94	36.11	40.62
M:PUNCT	184	140	106	56.79	63.45	58.01
M:VERB	13	8	11	61.90	54.17	60.19
M:VERB:FORM	14	23	0	37.84	100.00	43.21
M:VERB:TENSE	6	7	15	46.15	28.57	41.10
R:ADJ	1	3	9	25.00	10.00	19.23
R:ADJ:FORM	2	1	2	66.67	50.00	62.50
R:ADV	3	1	9	75.00	25.00	53.57
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	5	9	38	35.71	11.63	25.25
R:MORPH	23	9	58	71.88	28.40	55.02
R:NOUN	10	43	27	18.87	27.03	20.08
R:NOUN:INFL	4	0	2	100.00	66.67	90.91
R:NOUN:NUM	38	18	84	67.86	31.15	54.91
R:NOUN:POSS	0	0	4	100.00	0.00	0.00
R:ORTH	117	18	99	86.67	54.17	77.38
R:OTHER	69	138	295	33.33	18.96	28.94
R:PART	1	0	3	100.00	25.00	62.50
R:PREP	18	1	72	94.74	20.00	54.22
R:PRON	4	3	15	57.14	21.05	42.55
R:PUNCT	5	18	33	21.74	13.16	19.23
R:SPELL	96	10	14	90.57	87.27	89.89
R:VERB	7	13	71	35.00	8.97	22.15
R:VERB:FORM	11	3	58	78.57	15.94	44.00
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	11	2	60	84.62	15.49	44.72
R:VERB:TENSE	8	13	62	38.10	11.43	25.97
R:WO	1	1	12	50.00	7.69	23.81
U:ADJ	1	3	5	25.00	16.67	22.73
U:ADV	1	6	9	14.29	10.00	13.16
U:CONJ	2	1	4	66.67	33.33	55.56
U:CONTR	0	0	5	100.00	0.00	0.00
U:DET	15	10	76	60.00	16.48	39.27
U:NOUN	2	2	7	50.00	22.22	40.00
U:NOUN:POSS	0	0	4	100.00	0.00	0.00
U:OTHER	0	5	10	0.00	0.00	0.00
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	5	8	19	38.46	20.83	32.89
U:PRON	3	5	8	37.50	27.27	34.88
U:PUNCT	16	35	10	31.37	61.54	34.78
U:VERB	3	6	7	33.33	30.00	32.61
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	1	4	6	20.00	14.29	18.52
UNK	10	0	48	100.00	17.24	51.02

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	400	260	287	60.61	58.22	60.11
R	622	276	1266	69.27	32.94	56.75
U	81	67	222	54.73	26.73	45.25
UNK	20	0	74	100.00	21.28	57.47

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	3	16	50.00	15.79	34.88
ADJ:FORM	3	1	2	75.00	60.00	71.43
ADV	10	10	34	50.00	22.73	40.32
CONJ	9	3	9	75.00	50.00	68.18
CONTR	1	1	6	50.00	14.29	33.33
DET	120	93	187	56.34	39.09	51.77
MORPH	30	9	53	76.92	36.14	62.76
NOUN	21	43	52	32.81	28.77	31.91
NOUN:INFL	4	0	2	100.00	66.67	90.91
NOUN:NUM	47	17	88	73.44	34.81	60.10
NOUN:POSS	1	0	15	100.00	6.25	25.00
ORTH	130	16	104	89.04	55.56	79.46
OTHER	202	136	493	59.76	29.06	49.34
PART	2	0	10	100.00	16.67	50.00
PREP	59	42	136	58.42	30.26	49.25
PRON	23	18	44	56.10	34.33	49.78
PUNCT	225	162	160	58.14	58.44	58.20
SPELL	96	4	12	96.00	88.89	94.49
UNK	20	0	74	100.00	21.28	57.47
VERB	34	18	114	65.38	22.97	47.75
VERB:FORM	34	9	58	79.07	36.96	64.39
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	19	1	54	95.00	26.03	62.09
VERB:TENSE	18	17	105	51.43	14.63	34.22
WO	8	0	20	100.00	28.57	66.67

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	6	4	9	60.00	40.00	54.55
M:CONJ	4	2	5	66.67	44.44	60.61
M:DET	85	78	57	52.15	59.86	53.53
M:NOUN	2	3	8	40.00	20.00	33.33
M:NOUN:POSS	1	0	2	100.00	33.33	71.43
M:OTHER	19	5	28	79.17	40.43	66.43
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	31	35	28	46.97	52.54	47.99
M:PRON	15	11	20	57.69	42.86	53.96
M:PUNCT	202	109	100	64.95	66.89	65.33
M:VERB	15	5	11	75.00	57.69	70.75
M:VERB:FORM	13	5	0	72.22	100.00	76.47
M:VERB:TENSE	7	3	15	70.00	31.82	56.45
R:ADJ	2	2	11	50.00	15.38	34.48
R:ADJ:FORM	3	1	2	75.00	60.00	71.43
R:ADV	2	1	11	66.67	15.38	40.00
R:CONJ	1	0	0	100.00	100.00	100.00
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	7	8	40	46.67	14.89	32.71
R:MORPH	30	9	53	76.92	36.14	62.76
R:NOUN	15	38	34	28.30	30.61	28.74
R:NOUN:INFL	4	0	2	100.00	66.67	90.91
R:NOUN:NUM	47	17	88	73.44	34.81	60.10
R:NOUN:POSS	0	0	7	100.00	0.00	0.00
R:ORTH	130	16	104	89.04	55.56	79.46
R:OTHER	180	128	441	58.44	28.99	48.57
R:PART	1	0	7	100.00	12.50	41.67
R:PREP	18	1	85	94.74	17.48	50.28
R:PRON	4	3	17	57.14	19.05	40.82
R:PUNCT	4	23	46	14.81	8.00	12.66
R:SPELL	96	4	12	96.00	88.89	94.49
R:VERB	15	9	90	62.50	14.29	37.31
R:VERB:FORM	21	3	57	87.50	26.92	60.34
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	19	1	54	95.00	26.03	62.09
R:VERB:TENSE	10	11	84	47.62	10.64	28.09
R:WO	8	0	20	100.00	28.57	66.67
U:ADJ	1	1	3	50.00	25.00	41.67
U:ADV	2	5	14	28.57	12.50	22.73
U:CONJ	4	1	4	80.00	50.00	71.43
U:CONTR	0	0	6	100.00	0.00	0.00
U:DET	28	7	90	80.00	23.73	54.26
U:NOUN	4	2	10	66.67	28.57	52.63
U:NOUN:POSS	0	0	6	100.00	0.00	0.00
U:OTHER	3	3	24	50.00	11.11	29.41
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	10	6	23	62.50	30.30	51.55
U:PRON	4	4	7	50.00	36.36	46.51
U:PUNCT	19	30	14	38.78	57.58	41.48
U:VERB	4	4	13	50.00	23.53	40.82
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	1	3	6	25.00	14.29	21.74
UNK	20	0	74	100.00	21.28	57.47

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	470	1213	1163	27.93	28.78	28.09
Span-level detection	668	1016	1116	39.67	37.44	39.20
Token-level detection	883	873	1419	50.28	38.36	47.34

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	302	483	223	38.47	57.52	41.20
R	131	577	823	18.50	13.73	17.30
U	37	153	117	19.47	24.03	20.24

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	21	16	0.00	0.00	0.00
ADJ:FORM	1	1	2	50.00	33.33	45.45
ADV	2	32	16	5.88	11.11	6.49
CONJ	1	10	7	9.09	12.50	9.62
CONTR	0	2	2	0.00	0.00	0.00
DET	56	153	142	26.79	28.28	27.08
MORPH	4	9	36	30.77	10.00	21.74
NOUN	4	128	44	3.03	8.33	3.47
NOUN:NUM	18	35	42	33.96	30.00	33.09
NOUN:POSS	0	0	10	100.00	0.00	0.00
ORTH	25	40	65	38.46	27.78	35.71
OTHER	7	238	214	2.86	3.17	2.91
PART	0	3	5	0.00	0.00	0.00
PREP	26	92	124	22.03	17.33	20.90
PRON	7	26	27	21.21	20.59	21.08
PUNCT	246	303	122	44.81	66.85	47.97
SPELL	45	28	27	61.64	62.50	61.81
VERB	6	49	70	10.91	7.89	10.14
VERB:FORM	11	22	50	33.33	18.03	28.50
VERB:SVA	2	1	37	66.67	5.13	19.61
VERB:TENSE	8	19	77	29.63	9.41	20.73
WO	1	1	28	50.00	3.45	13.51

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	4	0.00	0.00	0.00
M:ADV	0	9	5	0.00	0.00	0.00
M:CONJ	1	10	4	9.09	20.00	10.20
M:DET	47	125	57	27.33	45.19	29.67
M:NOUN	1	8	5	11.11	16.67	11.90
M:NOUN:POSS	0	0	4	100.00	0.00	0.00
M:OTHER	1	18	12	5.26	7.69	5.62
M:PART	0	3	2	0.00	0.00	0.00
M:PREP	10	65	21	13.33	32.26	15.11
M:PRON	5	11	13	31.25	27.78	30.49
M:PUNCT	231	200	73	53.60	75.99	56.95
M:VERB	4	14	6	22.22	40.00	24.39
M:VERB:FORM	1	15	1	6.25	50.00	7.58
M:VERB:TENSE	1	3	16	25.00	5.88	15.15
R:ADJ	0	12	11	0.00	0.00	0.00
R:ADJ:FORM	1	1	2	50.00	33.33	45.45
R:ADV	0	9	7	0.00	0.00	0.00
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	0	2	1	0.00	0.00	0.00
R:DET	4	15	49	21.05	7.55	15.50
R:MORPH	4	9	36	30.77	10.00	21.74
R:NOUN	2	111	32	1.77	5.88	2.06
R:NOUN:NUM	18	35	42	33.96	30.00	33.09
R:NOUN:POSS	0	0	2	100.00	0.00	0.00
R:ORTH	25	40	65	38.46	27.78	35.71
R:OTHER	6	215	185	2.71	3.14	2.79
R:PART	0	0	2	100.00	0.00	0.00
R:PREP	5	10	82	33.33	5.75	17.01
R:PRON	0	3	9	0.00	0.00	0.00
R:PUNCT	1	36	40	2.70	2.44	2.65
R:SPELL	45	28	27	61.64	62.50	61.81
R:VERB	1	30	60	3.23	1.64	2.70
R:VERB:FORM	10	5	48	66.67	17.24	42.37
R:VERB:SVA	2	1	37	66.67	5.13	19.61
R:VERB:TENSE	6	14	55	30.00	9.84	21.28
R:WO	1	1	28	50.00	3.45	13.51
U:ADJ	0	7	1	0.00	0.00	0.00
U:ADV	2	14	4	12.50	33.33	14.29
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	5	13	36	27.78	12.20	22.12
U:NOUN	1	9	7	10.00	12.50	10.42
U:NOUN:POSS	0	0	4	100.00	0.00	0.00
U:OTHER	0	5	17	0.00	0.00	0.00
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	11	17	21	39.29	34.38	38.19
U:PRON	2	12	5	14.29	28.57	15.87
U:PUNCT	14	67	9	17.28	60.87	20.17
U:VERB	1	5	4	16.67	20.00	17.24
U:VERB:FORM	0	2	1	0.00	0.00	0.00
U:VERB:TENSE	1	2	6	33.33	14.29	26.32

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	353	434	220	44.85	61.61	47.43
R	261	446	769	36.92	25.34	33.83
U	46	136	118	25.27	28.05	25.78
UNK	8	0	9	100.00	47.06	81.63

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	18	12	21.74	29.41	22.94
ADJ:FORM	1	1	2	50.00	33.33	45.45
ADV	6	29	15	17.14	28.57	18.63
CONJ	3	9	6	25.00	33.33	26.32
CONTR	0	2	2	0.00	0.00	0.00
DET	74	132	137	35.92	35.07	35.75
MORPH	7	7	32	50.00	17.95	36.84
NOUN	17	102	35	14.29	32.69	16.10
NOUN:NUM	25	29	40	46.30	38.46	44.48
NOUN:POSS	1	0	10	100.00	9.09	33.33
ORTH	49	26	64	65.33	43.36	59.32
OTHER	49	202	198	19.52	19.84	19.58
PART	2	3	5	40.00	28.57	37.04
PREP	40	74	124	35.09	24.39	32.26
PRON	15	23	27	39.47	35.71	38.66
PUNCT	259	282	125	47.87	67.45	50.82
SPELL	60	4	11	93.75	84.51	91.74
UNK	8	0	9	100.00	47.06	81.63
VERB	15	39	70	27.78	17.65	24.92
VERB:FORM	14	19	49	42.42	22.22	35.90
VERB:SVA	6	0	36	100.00	14.29	45.45
VERB:TENSE	11	14	76	44.00	12.64	29.41
WO	1	1	31	50.00	3.12	12.50

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	2	0.00	0.00	0.00
M:ADV	1	9	5	10.00	16.67	10.87
M:CONJ	3	9	4	25.00	42.86	27.27
M:DET	62	108	53	36.47	53.91	38.99
M:NOUN	2	8	4	20.00	33.33	21.74
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:OTHER	12	14	12	46.15	50.00	46.88
M:PART	2	3	2	40.00	50.00	41.67
M:PREP	13	57	21	18.57	38.24	20.70
M:PRON	12	9	15	57.14	44.44	54.05
M:PUNCT	238	188	78	55.87	75.32	58.91
M:VERB	5	11	6	31.25	45.45	33.33
M:VERB:FORM	1	14	0	6.67	100.00	8.20
M:VERB:TENSE	2	2	13	50.00	13.33	32.26
R:ADJ	5	10	10	33.33	33.33	33.33
R:ADJ:FORM	1	1	2	50.00	33.33	45.45
R:ADV	2	7	7	22.22	22.22	22.22
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	0	2	1	0.00	0.00	0.00
R:DET	5	13	45	27.78	10.00	20.49
R:MORPH	7	7	32	50.00	17.95	36.84
R:NOUN	13	87	27	13.00	32.50	14.77
R:NOUN:NUM	25	29	40	46.30	38.46	44.48
R:NOUN:POSS	1	0	2	100.00	33.33	71.43
R:ORTH	49	26	64	65.33	43.36	59.32
R:OTHER	35	184	168	15.98	17.24	16.22
R:PART	0	0	2	100.00	0.00	0.00
R:PREP	17	4	82	80.95	17.17	46.45
R:PRON	2	3	7	40.00	22.22	34.48
R:PUNCT	4	30	37	11.76	9.76	11.30
R:SPELL	60	4	11	93.75	84.51	91.74
R:VERB	8	25	59	24.24	11.94	20.10
R:VERB:FORM	13	3	48	81.25	21.31	52.00
R:VERB:SVA	6	0	36	100.00	14.29	45.45
R:VERB:TENSE	7	10	56	41.18	11.11	26.72
R:WO	1	1	31	50.00	3.12	12.50
U:ADJ	0	6	0	0.00	100.00	0.00
U:ADV	3	13	3	18.75	50.00	21.43
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	7	11	39	38.89	15.22	29.66
U:NOUN	2	7	4	22.22	33.33	23.81
U:NOUN:POSS	0	0	3	100.00	0.00	0.00
U:OTHER	2	4	18	33.33	10.00	22.73
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	10	13	21	43.48	32.26	40.65
U:PRON	1	11	5	8.33	16.67	9.26
U:PUNCT	17	64	10	20.99	62.96	24.22
U:VERB	2	3	5	40.00	28.57	37.04
U:VERB:FORM	0	2	1	0.00	0.00	0.00
U:VERB:TENSE	2	2	7	50.00	22.22	40.00
UNK	8	0	9	100.00	47.06	81.63

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	387	335	245	53.60	61.23	54.97
R	423	412	957	50.66	30.65	44.81
U	63	126	196	33.33	24.32	31.03
UNK	10	0	21	100.00	32.26	70.42

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	7	15	20	31.82	25.93	30.43
ADJ:FORM	2	1	1	66.67	66.67	66.67
ADV	11	24	23	31.43	32.35	31.61
CONJ	7	3	8	70.00	46.67	63.64
CONTR	0	2	2	0.00	0.00	0.00
DET	88	108	143	44.90	38.10	43.35
MORPH	11	6	31	64.71	26.19	50.00
NOUN	22	94	31	18.97	41.51	21.28
NOUN:NUM	29	24	44	54.72	39.73	50.88
NOUN:POSS	1	0	13	100.00	7.14	27.78
ORTH	59	23	81	71.95	42.14	63.03
OTHER	142	187	357	43.16	28.46	39.12
PART	2	3	5	40.00	28.57	37.04
PREP	50	63	126	44.25	28.41	39.81
PRON	22	17	29	56.41	43.14	53.14
PUNCT	272	241	130	53.02	67.66	55.42
SPELL	60	4	12	93.75	83.33	91.46
UNK	10	0	21	100.00	32.26	70.42
VERB	16	35	96	31.37	14.29	25.32
VERB:FORM	23	11	51	67.65	31.08	54.76
VERB:SVA	14	0	39	100.00	26.42	64.22
VERB:TENSE	19	11	93	63.33	16.96	40.95
WO	16	1	63	94.12	20.25	54.42

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	4	0.00	0.00	0.00
M:ADV	2	6	12	25.00	14.29	21.74
M:CONJ	6	3	4	66.67	60.00	65.22
M:DET	70	83	53	45.75	56.91	47.62
M:NOUN	3	7	4	30.00	42.86	31.91
M:NOUN:POSS	1	0	4	100.00	20.00	55.56
M:OTHER	14	12	19	53.85	42.42	51.09
M:PART	1	3	2	25.00	33.33	26.32
M:PREP	15	50	21	23.08	41.67	25.34
M:PRON	14	5	15	73.68	48.28	66.67
M:PUNCT	249	146	77	63.04	76.38	65.32
M:VERB	6	8	13	42.86	31.58	40.00
M:VERB:FORM	2	9	1	18.18	66.67	21.28
M:VERB:TENSE	4	1	16	80.00	20.00	50.00
R:ADJ	7	8	15	46.67	31.82	42.68
R:ADJ:FORM	2	1	1	66.67	66.67	66.67
R:ADV	3	7	6	30.00	33.33	30.61
R:CONJ	1	0	4	100.00	20.00	55.56
R:CONTR	0	2	1	0.00	0.00	0.00
R:DET	9	12	44	42.86	16.98	32.85
R:MORPH	11	6	31	64.71	26.19	50.00
R:NOUN	16	80	23	16.67	41.03	18.91
R:NOUN:NUM	29	24	44	54.72	39.73	50.88
R:NOUN:POSS	0	0	4	100.00	0.00	0.00
R:ORTH	59	23	81	71.95	42.14	63.03
R:OTHER	121	170	270	41.58	30.95	38.91
R:PART	1	0	2	100.00	33.33	71.43
R:PREP	21	2	81	91.30	20.59	54.12
R:PRON	5	3	8	62.50	38.46	55.56
R:PUNCT	5	37	42	11.90	10.64	11.63
R:SPELL	60	4	12	93.75	83.33	91.46
R:VERB	9	24	68	27.27	11.69	21.53
R:VERB:FORM	20	0	47	100.00	29.85	68.03
R:VERB:SVA	14	0	39	100.00	26.42	64.22
R:VERB:TENSE	14	8	71	63.64	16.47	40.46
R:WO	16	1	63	94.12	20.25	54.42
U:ADJ	0	5	1	0.00	0.00	0.00
U:ADV	6	11	5	35.29	54.55	37.97
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	9	13	46	40.91	16.36	31.47
U:NOUN	3	7	4	30.00	42.86	31.91
U:NOUN:POSS	0	0	5	100.00	0.00	0.00
U:OTHER	7	5	68	58.33	9.33	28.46
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	14	11	24	56.00	36.84	50.72
U:PRON	3	9	6	25.00	33.33	26.32
U:PUNCT	18	58	11	23.68	62.07	27.03
U:VERB	1	3	15	25.00	6.25	15.62
U:VERB:FORM	1	2	3	33.33	25.00	31.25
U:VERB:TENSE	1	2	6	33.33	14.29	26.32
UNK	10	0	21	100.00	32.26	70.42

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	275	895	409	23.50	40.20	25.63
Span-level detection	376	794	413	32.14	47.66	34.38
Token-level detection	480	742	531	39.28	47.48	40.68

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	170	324	94	34.41	64.39	37.95
R	80	428	262	15.75	23.39	16.85
U	25	143	53	14.88	32.05	16.67

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	16	7	0.00	0.00	0.00
ADJ:FORM	0	2	2	0.00	0.00	0.00
ADV	0	22	3	0.00	0.00	0.00
CONJ	2	8	2	20.00	50.00	22.73
CONTR	0	2	3	0.00	0.00	0.00
DET	36	97	64	27.07	36.00	28.48
MORPH	3	12	15	20.00	16.67	19.23
NOUN	1	108	8	0.92	11.11	1.12
NOUN:INFL	0	0	1	100.00	0.00	0.00
NOUN:NUM	11	16	22	40.74	33.33	39.01
NOUN:POSS	0	0	8	100.00	0.00	0.00
ORTH	25	26	20	49.02	55.56	50.20
OTHER	2	186	59	1.06	3.28	1.23
PART	2	2	3	50.00	40.00	47.62
PREP	17	52	44	24.64	27.87	25.22
PRON	1	17	10	5.56	9.09	6.02
PUNCT	142	242	52	36.98	73.20	41.04
SPELL	26	13	9	66.67	74.29	68.06
VERB	1	36	15	2.70	6.25	3.05
VERB:FORM	2	20	12	9.09	14.29	9.80
VERB:SVA	2	1	10	66.67	16.67	41.67
VERB:TENSE	1	16	33	5.88	2.94	4.90
WO	1	1	7	50.00	12.50	31.25

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	0	6	1	0.00	0.00	0.00
M:CONJ	2	6	1	25.00	66.67	28.57
M:DET	28	73	22	27.72	56.00	30.84
M:NOUN	0	6	2	0.00	0.00	0.00
M:NOUN:POSS	0	0	1	100.00	0.00	0.00
M:OTHER	0	4	4	0.00	0.00	0.00
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	10	40	11	20.00	47.62	22.62
M:PRON	1	11	5	8.33	16.67	9.26
M:PUNCT	127	150	38	45.85	76.97	49.88
M:VERB	0	8	2	0.00	0.00	0.00
M:VERB:FORM	2	16	0	11.11	100.00	13.51
M:VERB:TENSE	0	3	5	0.00	0.00	0.00
R:ADJ	0	13	4	0.00	0.00	0.00
R:ADJ:FORM	0	2	2	0.00	0.00	0.00
R:ADV	0	6	1	0.00	0.00	0.00
R:CONJ	0	1	1	0.00	0.00	0.00
R:CONTR	0	2	1	0.00	0.00	0.00
R:DET	3	12	13	20.00	18.75	19.74
R:MORPH	3	12	15	20.00	16.67	19.23
R:NOUN	1	89	6	1.11	14.29	1.36
R:NOUN:INFL	0	0	1	100.00	0.00	0.00
R:NOUN:NUM	11	16	22	40.74	33.33	39.01
R:NOUN:POSS	0	0	5	100.00	0.00	0.00
R:ORTH	25	26	20	49.02	55.56	50.20
R:OTHER	1	177	55	0.56	1.79	0.65
R:PART	1	1	3	50.00	25.00	41.67
R:PREP	5	5	25	50.00	16.67	35.71
R:PRON	0	1	4	0.00	0.00	0.00
R:PUNCT	0	12	8	0.00	0.00	0.00
R:SPELL	26	13	9	66.67	74.29	68.06
R:VERB	1	23	12	4.17	7.69	4.59
R:VERB:FORM	0	3	12	0.00	0.00	0.00
R:VERB:SVA	2	1	10	66.67	16.67	41.67
R:VERB:TENSE	0	12	26	0.00	0.00	0.00
R:WO	1	1	7	50.00	12.50	31.25
U:ADJ	0	3	1	0.00	0.00	0.00
U:ADV	0	10	1	0.00	0.00	0.00
U:CONJ	0	1	0	0.00	100.00	0.00
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	5	12	29	29.41	14.71	24.51
U:NOUN	0	13	0	0.00	100.00	0.00
U:NOUN:POSS	0	0	2	100.00	0.00	0.00
U:OTHER	1	5	0	16.67	100.00	20.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	2	7	8	22.22	20.00	21.74
U:PRON	0	5	1	0.00	0.00	0.00
U:PUNCT	15	80	6	15.79	71.43	18.70
U:VERB	0	5	1	0.00	0.00	0.00
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	1	1	2	50.00	33.33	45.45

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	197	299	89	39.72	68.88	43.39
R	143	365	263	28.15	35.22	29.33
U	34	130	57	20.73	37.36	22.76
UNK	2	0	4	100.00	33.33	71.43

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	14	9	6.67	10.00	7.14
ADJ:FORM	0	1	2	0.00	0.00	0.00
ADV	2	20	5	9.09	28.57	10.53
CONJ	3	6	2	33.33	60.00	36.59
CONTR	0	2	3	0.00	0.00	0.00
DET	47	87	63	35.07	42.73	36.38
MORPH	7	9	15	43.75	31.82	40.70
NOUN	5	98	9	4.85	35.71	5.87
NOUN:INFL	0	0	1	100.00	0.00	0.00
NOUN:NUM	11	15	21	42.31	34.38	40.44
NOUN:POSS	0	0	7	100.00	0.00	0.00
ORTH	35	19	25	64.81	58.33	63.41
OTHER	21	166	61	11.23	25.61	12.65
PART	3	2	4	60.00	42.86	55.56
PREP	24	48	44	33.33	35.29	33.71
PRON	3	17	8	15.00	27.27	16.48
PUNCT	156	224	55	41.05	73.93	45.06
SPELL	38	2	0	95.00	100.00	95.96
UNK	2	0	4	100.00	33.33	71.43
VERB	7	29	16	19.44	30.43	20.96
VERB:FORM	6	18	13	25.00	31.58	26.09
VERB:SVA	2	1	9	66.67	18.18	43.48
VERB:TENSE	2	15	33	11.76	5.71	9.71
WO	1	1	4	50.00	20.00	38.46

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	3	100.00	0.00	0.00
M:ADV	0	6	1	0.00	0.00	0.00
M:CONJ	3	4	1	42.86	75.00	46.88
M:DET	34	66	20	34.00	62.96	37.44
M:NOUN	1	6	2	14.29	33.33	16.13
M:OTHER	5	3	4	62.50	55.56	60.98
M:PART	0	1	2	0.00	0.00	0.00
M:PREP	13	38	8	25.49	61.90	28.89
M:PRON	3	11	3	21.43	50.00	24.19
M:PUNCT	133	140	39	48.72	77.33	52.61
M:VERB	2	7	1	22.22	66.67	25.64
M:VERB:FORM	3	14	0	17.65	100.00	21.13
M:VERB:TENSE	0	3	5	0.00	0.00	0.00
R:ADJ	1	12	5	7.69	16.67	8.62
R:ADJ:FORM	0	1	2	0.00	0.00	0.00
R:ADV	2	6	3	25.00	40.00	27.03
R:CONJ	0	1	1	0.00	0.00	0.00
R:CONTR	0	2	1	0.00	0.00	0.00
R:DET	6	11	12	35.29	33.33	34.88
R:MORPH	7	9	15	43.75	31.82	40.70
R:NOUN	2	80	7	2.44	22.22	2.97
R:NOUN:INFL	0	0	1	100.00	0.00	0.00
R:NOUN:NUM	11	15	21	42.31	34.38	40.44
R:NOUN:POSS	0	0	5	100.00	0.00	0.00
R:ORTH	35	19	25	64.81	58.33	63.41
R:OTHER	15	158	54	8.67	21.74	9.86
R:PART	2	1	2	66.67	50.00	62.50
R:PREP	8	4	29	66.67	21.62	47.06
R:PRON	0	1	4	0.00	0.00	0.00
R:PUNCT	5	9	10	35.71	33.33	35.21
R:SPELL	38	2	0	95.00	100.00	95.96
R:VERB	5	18	14	21.74	26.32	22.52
R:VERB:FORM	3	3	13	50.00	18.75	37.50
R:VERB:SVA	2	1	9	66.67	18.18	43.48
R:VERB:TENSE	0	11	26	0.00	0.00	0.00
R:WO	1	1	4	50.00	20.00	38.46
U:ADJ	0	2	1	0.00	0.00	0.00
U:ADV	0	8	1	0.00	0.00	0.00
U:CONJ	0	1	0	0.00	100.00	0.00
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	7	10	31	41.18	18.42	33.02
U:NOUN	2	12	0	14.29	100.00	17.24
U:NOUN:POSS	0	0	2	100.00	0.00	0.00
U:OTHER	1	5	3	16.67	25.00	17.86
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	3	6	7	33.33	30.00	32.61
U:PRON	0	5	1	0.00	0.00	0.00
U:PUNCT	18	75	6	19.35	75.00	22.73
U:VERB	0	4	1	0.00	0.00	0.00
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	2	1	2	66.67	50.00	62.50
UNK	2	0	4	100.00	33.33	71.43

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	217	262	87	45.30	71.38	48.87
R	212	359	341	37.13	38.34	37.36
U	41	121	74	25.31	35.65	26.87
UNK	10	0	29	100.00	25.64	63.29

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	14	8	12.50	20.00	13.51
ADJ:FORM	0	1	3	0.00	0.00	0.00
ADV	2	17	7	10.53	22.22	11.76
CONJ	5	6	1	45.45	83.33	50.00
CONTR	0	2	4	0.00	0.00	0.00
DET	53	78	67	40.46	44.17	41.15
MORPH	7	9	13	43.75	35.00	41.67
NOUN	5	97	14	4.90	26.32	5.85
NOUN:INFL	0	0	1	100.00	0.00	0.00
NOUN:NUM	11	14	20	44.00	35.48	41.98
NOUN:POSS	2	0	9	100.00	18.18	52.63
ORTH	47	14	30	77.05	61.04	73.21
OTHER	57	173	115	24.78	33.14	26.10
PART	3	1	5	75.00	37.50	62.50
PREP	27	36	48	42.86	36.00	41.28
PRON	6	17	8	26.09	42.86	28.30
PUNCT	172	203	51	45.87	77.13	49.91
SPELL	36	2	0	94.74	100.00	95.74
UNK	10	0	29	100.00	25.64	63.29
VERB	8	28	17	22.22	32.00	23.67
VERB:FORM	9	15	12	37.50	42.86	38.46
VERB:SVA	2	1	10	66.67	16.67	41.67
VERB:TENSE	4	13	39	23.53	9.30	18.02
WO	12	1	20	92.31	37.50	71.43

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	0	6	2	0.00	0.00	0.00
M:CONJ	4	4	0	50.00	100.00	55.56
M:DET	37	58	23	38.95	61.67	42.05
M:NOUN	1	6	3	14.29	25.00	15.62
M:NOUN:POSS	2	0	0	100.00	100.00	100.00
M:OTHER	5	3	5	62.50	50.00	59.52
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	15	29	8	34.09	65.22	37.69
M:PRON	3	11	4	21.43	42.86	23.81
M:PUNCT	145	126	30	53.51	82.86	57.59
M:VERB	1	6	2	14.29	33.33	16.13
M:VERB:FORM	3	11	0	21.43	100.00	25.42
M:VERB:TENSE	1	2	6	33.33	14.29	26.32
R:ADJ	2	12	5	14.29	28.57	15.87
R:ADJ:FORM	0	1	3	0.00	0.00	0.00
R:ADV	2	6	4	25.00	33.33	26.32
R:CONJ	1	1	0	50.00	100.00	55.56
R:CONTR	0	2	1	0.00	0.00	0.00
R:DET	7	11	12	38.89	36.84	38.46
R:MORPH	7	9	13	43.75	35.00	41.67
R:NOUN	2	80	8	2.44	20.00	2.96
R:NOUN:INFL	0	0	1	100.00	0.00	0.00
R:NOUN:NUM	11	14	20	44.00	35.48	41.98
R:NOUN:POSS	0	0	7	100.00	0.00	0.00
R:ORTH	47	14	30	77.05	61.04	73.21
R:OTHER	48	162	103	22.86	31.79	24.22
R:PART	2	1	2	66.67	50.00	62.50
R:PREP	9	2	31	81.82	22.50	53.57
R:PRON	2	1	3	66.67	40.00	58.82
R:PUNCT	8	8	13	50.00	38.10	47.06
R:SPELL	36	2	0	94.74	100.00	95.74
R:VERB	7	18	13	28.00	35.00	29.17
R:VERB:FORM	6	3	12	66.67	33.33	55.56
R:VERB:SVA	2	1	10	66.67	16.67	41.67
R:VERB:TENSE	1	10	30	9.09	3.23	6.67
R:WO	12	1	20	92.31	37.50	71.43
U:ADJ	0	2	1	0.00	0.00	0.00
U:ADV	0	5	1	0.00	0.00	0.00
U:CONJ	0	1	1	0.00	0.00	0.00
U:CONTR	0	0	3	100.00	0.00	0.00
U:DET	9	9	32	50.00	21.95	39.82
U:NOUN	2	11	3	15.38	40.00	17.54
U:NOUN:POSS	0	0	2	100.00	0.00	0.00
U:OTHER	4	8	7	33.33	36.36	33.90
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	3	5	9	37.50	25.00	34.09
U:PRON	1	5	1	16.67	50.00	19.23
U:PUNCT	19	69	8	21.59	70.37	25.07
U:VERB	0	4	2	0.00	0.00	0.00
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	2	1	3	66.67	40.00	58.82
UNK	10	0	29	100.00	25.64	63.29

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	335	1130	320	22.87	51.15	25.71
Span-level detection	433	1032	291	29.56	59.81	32.88
Token-level detection	530	989	405	34.89	56.68	37.80

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	195	468	56	29.41	77.69	33.59
R	119	513	241	18.83	33.06	20.60
U	21	149	23	12.35	47.73	14.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	20	5	4.76	16.67	5.56
ADJ:FORM	0	1	1	0.00	0.00	0.00
ADV	0	30	2	0.00	0.00	0.00
CONJ	1	8	0	11.11	100.00	13.51
CONTR	0	1	1	0.00	0.00	0.00
DET	17	126	13	11.89	56.67	14.12
MORPH	0	11	6	0.00	0.00	0.00
NOUN	1	140	10	0.71	9.09	0.87
NOUN:INFL	1	8	10	11.11	9.09	10.64
NOUN:NUM	10	28	14	26.32	41.67	28.41
NOUN:POSS	1	0	15	100.00	6.25	25.00
ORTH	26	28	44	48.15	37.14	45.45
OTHER	6	201	46	2.90	11.54	3.41
PART	0	0	1	100.00	0.00	0.00
PREP	7	143	15	4.67	31.82	5.63
PRON	1	15	4	6.25	20.00	7.25
PUNCT	193	251	64	43.47	75.10	47.47
SPELL	65	20	35	76.47	65.00	73.86
VERB	1	54	13	1.82	7.14	2.14
VERB:FORM	3	24	5	11.11	37.50	12.93
VERB:INFL	0	0	4	100.00	0.00	0.00
VERB:SVA	1	1	6	50.00	14.29	33.33
VERB:TENSE	0	19	5	0.00	0.00	0.00
WO	0	1	1	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	8	1	0.00	0.00	0.00
M:CONJ	0	7	0	0.00	100.00	0.00
M:DET	15	96	5	13.51	75.00	16.16
M:NOUN	0	15	3	0.00	0.00	0.00
M:NOUN:POSS	1	0	4	100.00	20.00	55.56
M:OTHER	0	4	2	0.00	0.00	0.00
M:PREP	3	116	0	2.52	100.00	3.13
M:PRON	0	8	2	0.00	0.00	0.00
M:PUNCT	175	181	36	49.16	82.94	53.52
M:VERB	1	9	3	10.00	25.00	11.36
M:VERB:FORM	0	16	0	0.00	100.00	0.00
M:VERB:TENSE	0	8	0	0.00	100.00	0.00
R:ADJ	1	19	5	5.00	16.67	5.81
R:ADJ:FORM	0	1	1	0.00	0.00	0.00
R:ADV	0	7	1	0.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	1	17	3	5.56	25.00	6.58
R:MORPH	0	11	6	0.00	0.00	0.00
R:NOUN	1	112	7	0.88	12.50	1.09
R:NOUN:INFL	1	8	10	11.11	9.09	10.64
R:NOUN:NUM	10	28	14	26.32	41.67	28.41
R:NOUN:POSS	0	0	11	100.00	0.00	0.00
R:ORTH	26	28	44	48.15	37.14	45.45
R:OTHER	5	184	41	2.65	10.87	3.12
R:PREP	2	7	13	22.22	13.33	19.61
R:PRON	1	3	2	25.00	33.33	26.32
R:PUNCT	2	14	21	12.50	8.70	11.49
R:SPELL	65	20	35	76.47	65.00	73.86
R:VERB	0	37	8	0.00	0.00	0.00
R:VERB:FORM	3	6	4	33.33	42.86	34.88
R:VERB:INFL	0	0	4	100.00	0.00	0.00
R:VERB:SVA	1	1	6	50.00	14.29	33.33
R:VERB:TENSE	0	8	3	0.00	0.00	0.00
R:WO	0	1	1	0.00	0.00	0.00
U:ADJ	0	1	0	0.00	100.00	0.00
U:ADV	0	15	0	0.00	100.00	0.00
U:CONJ	1	1	0	50.00	100.00	55.56
U:DET	1	13	5	7.14	16.67	8.06
U:NOUN	0	13	0	0.00	100.00	0.00
U:OTHER	1	13	3	7.14	25.00	8.33
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	2	20	2	9.09	50.00	10.87
U:PRON	0	4	0	0.00	100.00	0.00
U:PUNCT	16	56	7	22.22	69.57	25.72
U:VERB	0	8	2	0.00	0.00	0.00
U:VERB:FORM	0	2	1	0.00	0.00	0.00
U:VERB:TENSE	0	3	2	0.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	211	451	54	31.87	79.62	36.22
R	192	437	217	30.52	46.94	32.82
U	26	144	19	15.29	57.78	17.93
UNK	4	0	1	100.00	80.00	95.24

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	18	4	14.29	42.86	16.48
ADJ:FORM	0	1	1	0.00	0.00	0.00
ADV	2	29	2	6.45	50.00	7.81
CONJ	3	5	0	37.50	100.00	42.86
CONTR	0	1	1	0.00	0.00	0.00
DET	21	120	13	14.89	61.76	17.56
MORPH	3	11	4	21.43	42.86	23.81
NOUN	3	126	12	2.33	20.00	2.82
NOUN:INFL	9	0	2	100.00	81.82	95.74
NOUN:NUM	11	26	13	29.73	45.83	31.98
NOUN:POSS	4	0	14	100.00	22.22	58.82
ORTH	42	24	42	63.64	50.00	60.34
OTHER	22	183	44	10.73	33.33	12.42
PART	0	0	1	100.00	0.00	0.00
PREP	10	135	12	6.90	45.45	8.31
PRON	3	14	3	17.65	50.00	20.27
PUNCT	200	246	63	44.84	76.05	48.85
SPELL	80	1	24	98.77	76.92	93.46
UNK	4	0	1	100.00	80.00	95.24
VERB	5	49	12	9.26	29.41	10.73
VERB:FORM	4	24	7	14.29	36.36	16.26
VERB:INFL	1	0	3	100.00	25.00	62.50
VERB:SVA	2	1	6	66.67	25.00	50.00
VERB:TENSE	1	17	6	5.56	14.29	6.33
WO	0	1	1	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	8	1	0.00	0.00	0.00
M:CONJ	2	4	0	33.33	100.00	38.46
M:DET	17	92	5	15.60	77.27	18.56
M:NOUN	0	15	3	0.00	0.00	0.00
M:NOUN:POSS	3	0	3	100.00	50.00	83.33
M:OTHER	1	4	2	20.00	33.33	21.74
M:PREP	4	111	0	3.48	100.00	4.31
M:PRON	1	8	2	11.11	33.33	12.82
M:PUNCT	180	178	36	50.28	83.33	54.61
M:VERB	2	8	2	20.00	50.00	22.73
M:VERB:FORM	0	16	0	0.00	100.00	0.00
M:VERB:TENSE	1	7	0	12.50	100.00	15.15
R:ADJ	3	17	4	15.00	42.86	17.24
R:ADJ:FORM	0	1	1	0.00	0.00	0.00
R:ADV	1	7	1	12.50	50.00	14.71
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	2	15	4	11.76	33.33	13.51
R:MORPH	3	11	4	21.43	42.86	23.81
R:NOUN	3	99	9	2.94	25.00	3.57
R:NOUN:INFL	9	0	2	100.00	81.82	95.74
R:NOUN:NUM	11	26	13	29.73	45.83	31.98
R:NOUN:POSS	1	0	11	100.00	8.33	31.25
R:ORTH	42	24	42	63.64	50.00	60.34
R:OTHER	20	167	39	10.70	33.90	12.39
R:PREP	3	6	11	33.33	21.43	30.00
R:PRON	2	2	1	50.00	66.67	52.63
R:PUNCT	2	12	21	14.29	8.70	12.66
R:SPELL	80	1	24	98.77	76.92	93.46
R:VERB	3	33	8	8.33	27.27	9.68
R:VERB:FORM	4	6	7	40.00	36.36	39.22
R:VERB:INFL	1	0	3	100.00	25.00	62.50
R:VERB:SVA	2	1	6	66.67	25.00	50.00
R:VERB:TENSE	0	7	4	0.00	0.00	0.00
R:WO	0	1	1	0.00	0.00	0.00
U:ADJ	0	1	0	0.00	100.00	0.00
U:ADV	1	14	0	6.67	100.00	8.20
U:CONJ	1	1	0	50.00	100.00	55.56
U:DET	2	13	4	13.33	33.33	15.15
U:NOUN	0	12	0	0.00	100.00	0.00
U:OTHER	1	12	3	7.69	25.00	8.93
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	3	18	1	14.29	75.00	17.05
U:PRON	0	4	0	0.00	100.00	0.00
U:PUNCT	18	56	6	24.32	75.00	28.12
U:VERB	0	8	2	0.00	0.00	0.00
U:VERB:FORM	0	2	0	0.00	100.00	0.00
U:VERB:TENSE	0	3	2	0.00	0.00	0.00
UNK	4	0	1	100.00	80.00	95.24

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	230	418	57	35.49	80.14	39.94
R	257	438	314	36.98	45.01	38.35
U	34	133	30	20.36	53.12	23.22
UNK	9	0	4	100.00	69.23	91.84

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	18	6	21.74	45.45	24.27
ADJ:FORM	0	1	2	0.00	0.00	0.00
ADV	3	26	3	10.34	50.00	12.30
CONJ	3	5	0	37.50	100.00	42.86
CONTR	0	1	4	0.00	0.00	0.00
DET	22	109	12	16.79	64.71	19.71
MORPH	4	11	3	26.67	57.14	29.85
NOUN	4	122	13	3.17	23.53	3.84
NOUN:INFL	9	0	2	100.00	81.82	95.74
NOUN:NUM	15	26	11	36.59	57.69	39.47
NOUN:POSS	4	0	17	100.00	19.05	54.05
ORTH	56	23	61	70.89	47.86	64.67
OTHER	57	190	94	23.08	37.75	25.02
PREP	14	131	18	9.66	43.75	11.44
PRON	3	12	4	20.00	42.86	22.39
PUNCT	217	230	74	48.55	74.57	52.19
SPELL	80	1	24	98.77	76.92	93.46
UNK	9	0	4	100.00	69.23	91.84
VERB	8	47	11	14.55	42.11	16.74
VERB:FORM	7	19	11	26.92	38.89	28.69
VERB:INFL	1	0	3	100.00	25.00	62.50
VERB:SVA	2	1	7	66.67	22.22	47.62
VERB:TENSE	3	15	12	16.67	20.00	17.24
WO	4	1	9	80.00	30.77	60.61

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	8	2	0.00	0.00	0.00
M:CONJ	2	4	0	33.33	100.00	38.46
M:DET	17	81	3	17.35	85.00	20.63
M:NOUN	0	14	4	0.00	0.00	0.00
M:NOUN:POSS	3	0	3	100.00	50.00	83.33
M:OTHER	3	4	3	42.86	50.00	44.12
M:PREP	8	109	0	6.84	100.00	8.40
M:PRON	1	6	2	14.29	33.33	16.13
M:PUNCT	193	168	38	53.46	83.55	57.61
M:VERB	2	7	1	22.22	66.67	25.64
M:VERB:FORM	0	12	0	0.00	100.00	0.00
M:VERB:TENSE	1	5	0	16.67	100.00	20.00
R:ADJ	4	17	4	19.05	50.00	21.74
R:ADJ:FORM	0	1	2	0.00	0.00	0.00
R:ADV	1	7	1	12.50	50.00	14.71
R:CONTR	0	1	4	0.00	0.00	0.00
R:DET	2	14	4	12.50	33.33	14.29
R:MORPH	4	11	3	26.67	57.14	29.85
R:NOUN	4	97	9	3.96	30.77	4.80
R:NOUN:INFL	9	0	2	100.00	81.82	95.74
R:NOUN:NUM	15	26	11	36.59	57.69	39.47
R:NOUN:POSS	1	0	14	100.00	6.67	26.32
R:ORTH	56	23	61	70.89	47.86	64.67
R:OTHER	52	173	85	23.11	37.96	25.07
R:PREP	3	6	15	33.33	16.67	27.78
R:PRON	2	2	2	50.00	50.00	50.00
R:PUNCT	2	12	26	14.29	7.14	11.90
R:SPELL	80	1	24	98.77	76.92	93.46
R:VERB	6	32	9	15.79	40.00	17.96
R:VERB:FORM	7	6	9	53.85	43.75	51.47
R:VERB:INFL	1	0	3	100.00	25.00	62.50
R:VERB:SVA	2	1	7	66.67	22.22	47.62
R:VERB:TENSE	2	7	10	22.22	16.67	20.83
R:WO	4	1	9	80.00	30.77	60.61
U:ADJ	1	1	1	50.00	50.00	50.00
U:ADV	2	11	0	15.38	100.00	18.52
U:CONJ	1	1	0	50.00	100.00	55.56
U:DET	3	14	5	17.65	37.50	19.74
U:NOUN	0	11	0	0.00	100.00	0.00
U:OTHER	2	13	6	13.33	25.00	14.71
U:PREP	3	16	3	15.79	50.00	18.29
U:PRON	0	4	0	0.00	100.00	0.00
U:PUNCT	22	50	10	30.56	68.75	34.38
U:VERB	0	8	1	0.00	0.00	0.00
U:VERB:FORM	0	1	2	0.00	0.00	0.00
U:VERB:TENSE	0	3	2	0.00	0.00	0.00
UNK	9	0	4	100.00	69.23	91.84

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:47:47+00:00
Competition submission:	6
Competition phase:	3 - Open phase

Detailed results

Submission information

Results