BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1833	1873	2939	49.46	38.41	46.77
Span-level detection	2300	1414	2793	61.93	45.16	57.65
Token-level detection	3043	1312	3357	69.87	47.55	63.87

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	471	360	665	56.68	41.46	52.80
R	1125	1183	1992	48.74	36.09	45.55
U	237	330	282	41.80	45.66	42.52

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	36	26	12.20	16.13	12.82
ADJ:FORM	2	2	6	50.00	25.00	41.67
ADV	23	44	40	34.33	36.51	34.74
CONJ	8	13	19	38.10	29.63	36.04
CONTR	7	3	3	70.00	70.00	70.00
DET	270	213	341	55.90	44.19	53.09
MORPH	64	61	84	51.20	43.24	49.38
NOUN	19	206	94	8.44	16.81	9.38
NOUN:INFL	10	6	11	62.50	47.62	58.82
NOUN:NUM	139	110	111	55.82	55.60	55.78
NOUN:POSS	19	8	31	70.37	38.00	60.13
ORTH	182	54	190	77.12	48.92	69.15
OTHER	76	335	595	18.49	11.33	16.41
PART	18	10	14	64.29	56.25	62.50
PREP	150	164	245	47.77	37.97	45.43
PRON	49	45	92	52.13	34.75	47.39
PUNCT	286	131	344	68.59	45.40	62.23
SPELL	115	76	193	60.21	37.34	53.64
VERB	51	95	151	34.93	25.25	32.44
VERB:FORM	126	86	69	59.43	64.62	60.40
VERB:INFL	5	1	5	83.33	50.00	73.53
VERB:SVA	109	58	48	65.27	69.43	66.06
VERB:TENSE	75	89	161	45.73	31.78	42.04
WO	25	27	66	48.08	27.47	41.81

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	4	4	0.00	0.00	0.00
M:ADV	5	12	15	29.41	25.00	28.41
M:CONJ	7	11	9	38.89	43.75	39.77
M:CONTR	1	1	0	50.00	100.00	55.56
M:DET	136	107	150	55.97	47.55	54.05
M:NOUN	2	13	11	13.33	15.38	13.70
M:NOUN:POSS	7	3	8	70.00	46.67	63.64
M:OTHER	4	25	40	13.79	9.09	12.50
M:PART	0	0	4	100.00	0.00	0.00
M:PREP	35	50	57	41.18	38.04	40.51
M:PRON	29	24	51	54.72	36.25	49.66
M:PUNCT	206	69	256	74.91	44.59	65.94
M:VERB	13	21	25	38.24	34.21	37.36
M:VERB:FORM	15	6	3	71.43	83.33	73.53
M:VERB:TENSE	11	14	32	44.00	25.58	38.46
R:ADJ	3	24	19	11.11	13.64	11.54
R:ADJ:FORM	2	2	6	50.00	25.00	41.67
R:ADV	8	14	15	36.36	34.78	36.04
R:CONJ	0	0	6	100.00	0.00	0.00
R:CONTR	3	2	1	60.00	75.00	62.50
R:DET	28	26	72	51.85	28.00	44.30
R:MORPH	64	61	84	51.20	43.24	49.38
R:NOUN	13	159	74	7.56	14.94	8.39
R:NOUN:INFL	10	6	11	62.50	47.62	58.82
R:NOUN:NUM	139	110	111	55.82	55.60	55.78
R:NOUN:POSS	7	3	16	70.00	30.43	55.56
R:ORTH	182	54	190	77.12	48.92	69.15
R:OTHER	67	248	534	21.27	11.15	18.00
R:PART	15	10	6	60.00	71.43	61.98
R:PREP	82	68	153	54.67	34.89	49.10
R:PRON	9	9	32	50.00	21.95	39.82
R:PUNCT	54	47	53	53.47	50.47	52.84
R:SPELL	115	76	193	60.21	37.34	53.64
R:VERB	28	45	112	38.36	20.00	32.41
R:VERB:FORM	106	74	65	58.89	61.99	59.48
R:VERB:INFL	5	1	5	83.33	50.00	73.53
R:VERB:SVA	109	58	48	65.27	69.43	66.06
R:VERB:TENSE	51	59	120	46.36	29.82	41.73
R:WO	25	27	66	48.08	27.47	41.81
U:ADJ	2	8	3	20.00	40.00	22.22
U:ADV	10	18	10	35.71	50.00	37.88
U:CONJ	1	2	4	33.33	20.00	29.41
U:CONTR	3	0	2	100.00	60.00	88.24
U:DET	106	80	119	56.99	47.11	54.70
U:NOUN	4	34	9	10.53	30.77	12.12
U:NOUN:POSS	5	2	7	71.43	41.67	62.50
U:OTHER	5	62	21	7.46	19.23	8.50
U:PART	3	0	4	100.00	42.86	78.95
U:PREP	33	46	35	41.77	48.53	42.97
U:PRON	11	12	9	47.83	55.00	49.11
U:PUNCT	26	15	35	63.41	42.62	57.78
U:VERB	10	29	14	25.64	41.67	27.78
U:VERB:FORM	5	6	1	45.45	83.33	50.00
U:VERB:TENSE	13	16	9	44.83	59.09	47.10

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	540	300	629	64.29	46.19	59.62
R	1482	830	1809	64.10	45.03	59.10
U	262	284	289	47.99	47.55	47.90
UNK	16	0	66	100.00	19.51	54.79

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	13	27	26	32.50	33.33	32.66
ADJ:FORM	1	1	8	50.00	11.11	29.41
ADV	24	38	41	38.71	36.92	38.34
CONJ	10	12	22	45.45	31.25	41.67
CONTR	5	2	3	71.43	62.50	69.44
DET	304	182	328	62.55	48.10	59.01
MORPH	75	35	83	68.18	47.47	62.71
NOUN	43	159	87	21.29	33.08	22.92
NOUN:INFL	9	1	11	90.00	45.00	75.00
NOUN:NUM	138	85	98	61.88	58.47	61.17
NOUN:POSS	25	7	30	78.12	45.45	68.31
ORTH	227	38	168	85.66	57.47	78.01
OTHER	221	253	552	46.62	28.59	41.40
PART	18	8	10	69.23	64.29	68.18
PREP	185	121	238	60.46	43.74	56.16
PRON	61	34	85	64.21	41.78	57.98
PUNCT	303	117	336	72.14	47.42	65.33
SPELL	155	37	152	80.73	50.49	72.09
UNK	16	0	66	100.00	19.51	54.79
VERB	87	72	148	54.72	37.02	49.94
VERB:FORM	129	68	66	65.48	66.15	65.62
VERB:INFL	7	0	4	100.00	63.64	89.74
VERB:SVA	123	38	37	76.40	76.88	76.49
VERB:TENSE	96	58	135	62.34	41.56	56.67
WO	25	21	59	54.35	29.76	46.64

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	4	4	0.00	0.00	0.00
M:ADV	4	11	11	26.67	26.67	26.67
M:CONJ	9	10	13	47.37	40.91	45.92
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	153	91	137	62.70	52.76	60.43
M:NOUN	4	11	9	26.67	30.77	27.40
M:NOUN:POSS	7	3	9	70.00	43.75	62.50
M:OTHER	14	17	48	45.16	22.58	37.63
M:PART	0	0	4	100.00	0.00	0.00
M:PREP	46	42	58	52.27	44.23	50.44
M:PRON	36	18	43	66.67	45.57	61.02
M:PUNCT	217	61	250	78.06	46.47	68.71
M:VERB	19	16	18	54.29	51.35	53.67
M:VERB:FORM	15	6	2	71.43	88.24	74.26
M:VERB:TENSE	16	9	23	64.00	41.03	57.55
R:ADJ	12	17	19	41.38	38.71	40.82
R:ADJ:FORM	1	1	8	50.00	11.11	29.41
R:ADV	11	12	18	47.83	37.93	45.45
R:CONJ	0	0	4	100.00	0.00	0.00
R:CONTR	2	1	1	66.67	66.67	66.67
R:DET	41	21	71	66.13	36.61	56.94
R:MORPH	75	35	83	68.18	47.47	62.71
R:NOUN	33	120	66	21.57	33.33	23.21
R:NOUN:INFL	9	1	11	90.00	45.00	75.00
R:NOUN:NUM	138	85	98	61.88	58.47	61.17
R:NOUN:POSS	13	3	13	81.25	50.00	72.22
R:ORTH	227	38	168	85.66	57.47	78.01
R:OTHER	198	176	481	52.94	29.16	45.52
R:PART	15	8	3	65.22	83.33	68.18
R:PREP	103	44	145	70.07	41.53	61.60
R:PRON	12	6	35	66.67	25.53	50.42
R:PUNCT	56	43	51	56.57	52.34	55.67
R:SPELL	155	37	152	80.73	50.49	72.09
R:VERB	55	32	116	63.22	32.16	52.99
R:VERB:FORM	109	56	63	66.06	63.37	65.50
R:VERB:INFL	7	0	4	100.00	63.64	89.74
R:VERB:SVA	123	38	37	76.40	76.88	76.49
R:VERB:TENSE	62	35	103	63.92	37.58	56.06
R:WO	25	21	59	54.35	29.76	46.64
U:ADJ	1	6	3	14.29	25.00	15.62
U:ADV	9	15	12	37.50	42.86	38.46
U:CONJ	1	2	5	33.33	16.67	27.78
U:CONTR	3	0	2	100.00	60.00	88.24
U:DET	110	70	120	61.11	47.83	57.89
U:NOUN	6	28	12	17.65	33.33	19.48
U:NOUN:POSS	5	1	8	83.33	38.46	67.57
U:OTHER	9	60	23	13.04	28.12	14.61
U:PART	3	0	3	100.00	50.00	83.33
U:PREP	36	35	35	50.70	50.70	50.70
U:PRON	13	10	7	56.52	65.00	58.04
U:PUNCT	30	13	35	69.77	46.15	63.29
U:VERB	13	24	14	35.14	48.15	37.14
U:VERB:FORM	5	6	1	45.45	83.33	50.00
U:VERB:TENSE	18	14	9	56.25	66.67	58.06
UNK	16	0	66	100.00	19.51	54.79

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	694	185	670	78.95	50.88	71.11
R	1984	786	2203	71.62	47.38	64.98
U	319	341	385	48.33	45.31	47.70
UNK	46	0	99	100.00	31.72	69.91

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	15	22	36	40.54	29.41	37.69
ADJ:FORM	2	2	13	50.00	13.33	32.26
ADV	35	21	52	62.50	40.23	56.27
CONJ	12	5	21	70.59	36.36	59.41
CONTR	4	1	6	80.00	40.00	66.67
DET	342	145	319	70.23	51.74	65.54
MORPH	77	26	79	74.76	49.36	67.78
NOUN	57	136	108	29.53	34.55	30.42
NOUN:INFL	9	1	11	90.00	45.00	75.00
NOUN:NUM	147	68	100	68.37	59.51	66.40
NOUN:POSS	35	4	41	89.74	46.05	75.43
ORTH	305	31	184	90.77	62.37	83.20
OTHER	479	408	838	54.00	36.37	49.23
PART	16	4	12	80.00	57.14	74.07
PREP	204	90	253	69.39	44.64	62.46
PRON	73	27	76	73.00	48.99	66.48
PUNCT	441	84	389	84.00	53.13	75.26
SPELL	166	26	147	86.46	53.04	76.78
UNK	46	0	99	100.00	31.72	69.91
VERB	101	57	190	63.92	34.71	54.71
VERB:FORM	132	49	67	72.93	66.33	71.51
VERB:INFL	7	0	3	100.00	70.00	92.11
VERB:SVA	120	28	39	81.08	75.47	79.89
VERB:TENSE	125	55	174	69.44	41.81	61.33
WO	93	22	100	80.87	48.19	71.21

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	3	6	0.00	0.00	0.00
M:ADV	10	5	14	66.67	41.67	59.52
M:CONJ	12	5	11	70.59	52.17	65.93
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	167	61	135	73.25	55.30	68.78
M:NOUN	5	8	18	38.46	21.74	33.33
M:NOUN:POSS	9	1	9	90.00	50.00	77.59
M:OTHER	19	13	46	59.38	29.23	49.22
M:PART	1	0	5	100.00	16.67	50.00
M:PREP	61	25	58	70.93	51.26	65.87
M:PRON	48	12	33	80.00	59.26	74.77
M:PUNCT	293	39	281	88.25	51.05	77.02
M:VERB	24	8	29	75.00	45.28	66.30
M:VERB:FORM	18	1	1	94.74	94.74	94.74
M:VERB:TENSE	27	3	24	90.00	52.94	78.95
R:ADJ	13	15	26	46.43	33.33	43.05
R:ADJ:FORM	2	2	13	50.00	13.33	32.26
R:ADV	12	9	21	57.14	36.36	51.28
R:CONJ	0	0	7	100.00	0.00	0.00
R:CONTR	2	0	3	100.00	40.00	76.92
R:DET	51	18	68	73.91	42.86	64.56
R:MORPH	77	26	79	74.76	49.36	67.78
R:NOUN	46	110	75	29.49	38.02	30.87
R:NOUN:INFL	9	1	11	90.00	45.00	75.00
R:NOUN:NUM	147	68	100	68.37	59.51	66.40
R:NOUN:POSS	21	3	22	87.50	48.84	75.54
R:ORTH	305	31	184	90.77	62.37	83.20
R:OTHER	420	228	704	64.81	37.37	56.51
R:PART	12	4	4	75.00	75.00	75.00
R:PREP	109	39	151	73.65	41.92	63.97
R:PRON	14	5	34	73.68	29.17	56.45
R:PUNCT	106	35	69	75.18	60.57	71.72
R:SPELL	166	26	147	86.46	53.04	76.78
R:VERB	65	34	141	65.66	31.55	53.99
R:VERB:FORM	109	43	64	71.71	63.01	69.78
R:VERB:INFL	7	0	3	100.00	70.00	92.11
R:VERB:SVA	120	28	39	81.08	75.47	79.89
R:VERB:TENSE	78	39	138	66.67	36.11	57.02
R:WO	93	22	100	80.87	48.19	71.21
U:ADJ	2	4	4	33.33	33.33	33.33
U:ADV	13	7	17	65.00	43.33	59.09
U:CONJ	0	0	3	100.00	0.00	0.00
U:CONTR	2	0	3	100.00	40.00	76.92
U:DET	124	66	116	65.26	51.67	62.00
U:NOUN	6	18	15	25.00	28.57	25.64
U:NOUN:POSS	5	0	10	100.00	33.33	71.43
U:OTHER	40	167	88	19.32	31.25	20.92
U:PART	3	0	3	100.00	50.00	83.33
U:PREP	34	26	44	56.67	43.59	53.46
U:PRON	11	10	9	52.38	55.00	52.88
U:PUNCT	42	10	39	80.77	51.85	72.66
U:VERB	12	15	20	44.44	37.50	42.86
U:VERB:FORM	5	5	2	50.00	71.43	53.19
U:VERB:TENSE	20	13	12	60.61	62.50	60.98
UNK	46	0	99	100.00	31.72	69.91

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	856	620	1333	57.99	39.10	52.89
Span-level detection	1071	409	1250	72.36	46.14	64.98
Token-level detection	1415	287	1453	83.14	49.34	73.12

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	186	136	303	57.76	38.04	52.34
R	574	393	898	59.36	38.99	53.75
U	96	91	132	51.34	42.11	49.18

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	5	10	28.57	16.67	25.00
ADJ:FORM	1	1	3	50.00	25.00	41.67
ADV	10	11	19	47.62	34.48	44.25
CONJ	3	3	8	50.00	27.27	42.86
CONTR	4	3	0	57.14	100.00	62.50
DET	115	64	158	64.25	42.12	58.14
MORPH	44	19	38	69.84	53.66	65.87
NOUN	6	58	42	9.38	12.50	9.87
NOUN:INFL	6	2	1	75.00	85.71	76.92
NOUN:NUM	76	34	51	69.09	59.84	67.02
NOUN:POSS	7	3	6	70.00	53.85	66.04
ORTH	103	22	97	82.40	51.50	73.57
OTHER	36	108	320	25.00	10.11	19.31
PART	10	2	6	83.33	62.50	78.12
PREP	62	56	105	52.54	37.13	48.51
PRON	28	20	51	58.33	35.44	51.66
PUNCT	88	44	143	66.67	38.10	57.97
SPELL	59	31	54	65.56	52.21	62.37
VERB	26	32	69	44.83	27.37	39.76
VERB:FORM	66	35	29	65.35	69.47	66.13
VERB:INFL	5	1	1	83.33	83.33	83.33
VERB:SVA	59	25	22	70.24	72.84	70.74
VERB:TENSE	33	33	78	50.00	29.73	44.00
WO	7	8	22	46.67	24.14	39.33

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	2	0.00	0.00	0.00
M:ADV	0	3	8	0.00	0.00	0.00
M:CONJ	2	3	2	40.00	50.00	41.67
M:CONTR	1	1	0	50.00	100.00	55.56
M:DET	56	38	61	59.57	47.86	56.80
M:NOUN	0	3	2	0.00	0.00	0.00
M:NOUN:POSS	1	1	2	50.00	33.33	45.45
M:OTHER	3	11	25	21.43	10.71	17.86
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	20	21	24	48.78	45.45	48.08
M:PRON	16	11	26	59.26	38.10	53.33
M:PUNCT	62	25	113	71.26	35.43	59.27
M:VERB	7	7	16	50.00	30.43	44.30
M:VERB:FORM	11	5	3	68.75	78.57	70.51
M:VERB:TENSE	7	6	17	53.85	29.17	46.05
R:ADJ	0	2	6	0.00	0.00	0.00
R:ADJ:FORM	1	1	3	50.00	25.00	41.67
R:ADV	5	2	7	71.43	41.67	62.50
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	2	2	0	50.00	100.00	55.56
R:DET	11	14	30	44.00	26.83	39.01
R:MORPH	44	19	38	69.84	53.66	65.87
R:NOUN	5	43	33	10.42	13.16	10.87
R:NOUN:INFL	6	2	1	75.00	85.71	76.92
R:NOUN:NUM	76	34	51	69.09	59.84	67.02
R:NOUN:POSS	3	2	2	60.00	60.00	60.00
R:ORTH	103	22	97	82.40	51.50	73.57
R:OTHER	32	76	286	29.63	10.06	21.33
R:PART	9	2	2	81.82	81.82	81.82
R:PREP	28	24	68	53.85	29.17	46.05
R:PRON	7	4	19	63.64	26.92	50.00
R:PUNCT	20	13	21	60.61	48.78	57.80
R:SPELL	59	31	54	65.56	52.21	62.37
R:VERB	13	13	48	50.00	21.31	39.39
R:VERB:FORM	55	29	26	65.48	67.90	65.95
R:VERB:INFL	5	1	1	83.33	83.33	83.33
R:VERB:SVA	59	25	22	70.24	72.84	70.74
R:VERB:TENSE	24	24	59	50.00	28.92	43.64
R:WO	7	8	22	46.67	24.14	39.33
U:ADJ	2	2	2	50.00	50.00	50.00
U:ADV	5	6	4	45.45	55.56	47.17
U:CONJ	1	0	4	100.00	20.00	55.56
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	48	12	67	80.00	41.74	67.61
U:NOUN	1	12	7	7.69	12.50	8.33
U:NOUN:POSS	3	0	2	100.00	60.00	88.24
U:OTHER	1	21	9	4.55	10.00	5.10
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	14	11	13	56.00	51.85	55.12
U:PRON	5	5	6	50.00	45.45	49.02
U:PUNCT	6	6	9	50.00	40.00	47.62
U:VERB	6	12	5	33.33	54.55	36.14
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	2	3	2	40.00	50.00	41.67

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	220	107	262	67.28	45.64	61.45
R	730	230	804	76.04	47.59	67.92
U	112	72	136	60.87	45.16	56.91
UNK	9	0	48	100.00	15.79	48.39

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	3	12	50.00	20.00	38.46
ADJ:FORM	0	1	4	0.00	0.00	0.00
ADV	11	7	20	61.11	35.48	53.40
CONJ	4	3	11	57.14	26.67	46.51
CONTR	2	2	0	50.00	100.00	55.56
DET	132	53	145	71.35	47.65	64.90
MORPH	50	10	39	83.33	56.18	75.99
NOUN	17	42	38	28.81	30.91	29.21
NOUN:INFL	5	1	1	83.33	83.33	83.33
NOUN:NUM	73	20	42	78.49	63.48	74.95
NOUN:POSS	7	3	6	70.00	53.85	66.04
ORTH	118	16	81	88.06	59.30	80.27
OTHER	120	71	287	62.83	29.48	51.24
PART	10	2	3	83.33	76.92	81.97
PREP	81	31	96	72.32	45.76	64.80
PRON	36	14	49	72.00	42.35	63.16
PUNCT	88	38	136	69.84	39.29	60.44
SPELL	73	12	36	85.88	66.97	81.29
UNK	9	0	48	100.00	15.79	48.39
VERB	47	17	72	73.44	39.50	62.67
VERB:FORM	64	25	29	71.91	68.82	71.27
VERB:INFL	6	0	1	100.00	85.71	96.77
VERB:SVA	64	14	17	82.05	79.01	81.42
VERB:TENSE	44	17	61	72.13	41.90	63.04
WO	7	7	16	50.00	30.43	44.30

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	2	0.00	0.00	0.00
M:ADV	1	3	5	25.00	16.67	22.73
M:CONJ	3	3	5	50.00	37.50	46.88
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	66	31	53	68.04	55.46	65.09
M:NOUN	1	3	0	25.00	100.00	29.41
M:NOUN:POSS	1	1	3	50.00	25.00	41.67
M:OTHER	7	7	28	50.00	20.00	38.46
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	26	16	20	61.90	56.52	60.75
M:PRON	20	8	22	71.43	47.62	64.94
M:PUNCT	62	21	104	74.70	37.35	62.25
M:VERB	12	3	9	80.00	57.14	74.07
M:VERB:FORM	11	5	2	68.75	84.62	71.43
M:VERB:TENSE	10	4	8	71.43	55.56	67.57
R:ADJ	2	0	8	100.00	20.00	55.56
R:ADJ:FORM	0	1	4	0.00	0.00	0.00
R:ADV	6	1	10	85.71	37.50	68.18
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	14	11	30	56.00	31.82	48.61
R:MORPH	50	10	39	83.33	56.18	75.99
R:NOUN	13	30	29	30.23	30.95	30.37
R:NOUN:INFL	5	1	1	83.33	83.33	83.33
R:NOUN:NUM	73	20	42	78.49	63.48	74.95
R:NOUN:POSS	3	2	1	60.00	75.00	62.50
R:ORTH	118	16	81	88.06	59.30	80.27
R:OTHER	109	44	250	71.24	30.36	56.13
R:PART	9	2	0	81.82	100.00	84.91
R:PREP	39	10	63	79.59	38.24	65.44
R:PRON	9	2	22	81.82	29.03	60.00
R:PUNCT	19	11	21	63.33	47.50	59.37
R:SPELL	73	12	36	85.88	66.97	81.29
R:VERB	28	5	56	84.85	33.33	64.81
R:VERB:FORM	53	19	27	73.61	66.25	72.01
R:VERB:INFL	6	0	1	100.00	85.71	96.77
R:VERB:SVA	64	14	17	82.05	79.01	81.42
R:VERB:TENSE	29	11	49	72.50	37.18	60.92
R:WO	7	7	16	50.00	30.43	44.30
U:ADJ	1	2	2	33.33	33.33	33.33
U:ADV	4	3	5	57.14	44.44	54.05
U:CONJ	1	0	5	100.00	16.67	50.00
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	52	11	62	82.54	45.61	71.04
U:NOUN	3	9	9	25.00	25.00	25.00
U:NOUN:POSS	3	0	2	100.00	60.00	88.24
U:OTHER	4	20	9	16.67	30.77	18.35
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	16	5	13	76.19	55.17	70.80
U:PRON	7	4	5	63.64	58.33	62.50
U:PUNCT	7	6	11	53.85	38.89	50.00
U:VERB	7	9	7	43.75	50.00	44.87
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	5	2	4	71.43	55.56	67.57
UNK	9	0	48	100.00	15.79	48.39

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	288	45	269	86.49	51.71	76.23
R	960	174	959	84.66	50.03	74.36
U	143	68	163	67.77	46.73	62.17
UNK	24	0	62	100.00	27.91	65.93

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	1	14	83.33	26.32	58.14
ADJ:FORM	1	2	6	33.33	14.29	26.32
ADV	16	0	21	100.00	43.24	79.21
CONJ	3	1	8	75.00	27.27	55.56
CONTR	2	1	0	66.67	100.00	71.43
DET	157	32	139	83.07	53.04	74.62
MORPH	52	6	37	89.66	58.43	81.00
NOUN	22	31	47	41.51	31.88	39.15
NOUN:INFL	5	1	1	83.33	83.33	83.33
NOUN:NUM	80	12	45	86.96	64.00	81.14
NOUN:POSS	11	2	11	84.62	50.00	74.32
ORTH	147	10	71	93.63	67.43	86.88
OTHER	246	89	406	73.43	37.73	61.75
PART	8	0	6	100.00	57.14	86.96
PREP	94	14	102	87.04	47.96	74.84
PRON	40	9	39	81.63	50.63	72.73
PUNCT	148	16	156	90.24	48.68	77.08
SPELL	77	5	35	93.90	68.75	87.50
UNK	24	0	62	100.00	27.91	65.93
VERB	53	12	92	81.54	36.55	65.43
VERB:FORM	65	15	30	81.25	68.42	78.31
VERB:INFL	6	0	0	100.00	100.00	100.00
VERB:SVA	65	10	18	86.67	78.31	84.86
VERB:TENSE	58	14	73	80.56	44.27	69.21
WO	30	4	34	88.24	46.88	75.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	4	0	6	100.00	40.00	76.92
M:CONJ	3	1	4	75.00	42.86	65.22
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	76	14	53	84.44	58.91	77.71
M:NOUN	2	3	4	40.00	33.33	38.46
M:NOUN:POSS	1	0	3	100.00	25.00	62.50
M:OTHER	8	4	23	66.67	25.81	50.63
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	35	5	20	87.50	63.64	81.40
M:PRON	23	4	16	85.19	58.97	78.23
M:PUNCT	96	10	114	90.57	45.71	75.71
M:VERB	14	0	14	100.00	50.00	83.33
M:VERB:FORM	12	1	1	92.31	92.31	92.31
M:VERB:TENSE	14	2	7	87.50	66.67	82.35
R:ADJ	3	0	11	100.00	21.43	57.69
R:ADJ:FORM	1	2	6	33.33	14.29	26.32
R:ADV	6	0	8	100.00	42.86	78.95
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	20	10	25	66.67	44.44	60.61
R:MORPH	52	6	37	89.66	58.43	81.00
R:NOUN	17	25	34	40.48	33.33	38.81
R:NOUN:INFL	5	1	1	83.33	83.33	83.33
R:NOUN:NUM	80	12	45	86.96	64.00	81.14
R:NOUN:POSS	7	2	5	77.78	58.33	72.92
R:ORTH	147	10	71	93.63	67.43	86.88
R:OTHER	220	47	352	82.40	38.46	67.07
R:PART	7	0	2	100.00	77.78	94.59
R:PREP	43	8	64	84.31	40.19	69.13
R:PRON	11	1	18	91.67	37.93	71.43
R:PUNCT	37	2	33	94.87	52.86	81.86
R:SPELL	77	5	35	93.90	68.75	87.50
R:VERB	33	6	70	84.62	32.04	63.71
R:VERB:FORM	53	13	28	80.30	65.43	76.81
R:VERB:INFL	6	0	0	100.00	100.00	100.00
R:VERB:SVA	65	10	18	86.67	78.31	84.86
R:VERB:TENSE	39	10	61	79.59	39.00	65.88
R:WO	30	4	34	88.24	46.88	75.00
U:ADJ	2	1	1	66.67	66.67	66.67
U:ADV	6	0	7	100.00	46.15	81.08
U:CONJ	0	0	3	100.00	0.00	0.00
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	61	8	61	88.41	50.00	76.63
U:NOUN	3	3	9	50.00	25.00	41.67
U:NOUN:POSS	3	0	3	100.00	50.00	83.33
U:OTHER	18	38	31	32.14	36.73	32.97
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	16	1	18	94.12	47.06	78.43
U:PRON	6	4	5	60.00	54.55	58.82
U:PUNCT	15	4	9	78.95	62.50	75.00
U:VERB	6	6	8	50.00	42.86	48.39
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	5	2	5	71.43	50.00	65.79
UNK	24	0	62	100.00	27.91	65.93

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	554	547	957	50.32	36.66	46.83
Span-level detection	686	417	930	62.19	42.45	56.90
Token-level detection	919	455	1191	66.89	43.55	60.41

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	165	109	221	60.22	42.75	55.67
R	313	340	643	47.93	32.74	43.86
U	76	98	93	43.68	44.97	43.93

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	9	8	10.00	11.11	10.20
ADJ:FORM	1	1	1	50.00	50.00	50.00
ADV	9	14	16	39.13	36.00	38.46
CONJ	4	4	6	50.00	40.00	47.62
CONTR	2	0	1	100.00	66.67	90.91
DET	93	61	128	60.39	42.08	55.56
MORPH	14	10	28	58.33	33.33	50.72
NOUN	10	54	31	15.62	24.39	16.84
NOUN:INFL	0	1	0	0.00	100.00	0.00
NOUN:NUM	37	23	33	61.67	52.86	59.68
NOUN:POSS	5	1	8	83.33	38.46	67.57
ORTH	35	15	36	70.00	49.30	64.58
OTHER	15	123	190	10.87	7.32	9.91
PART	5	5	5	50.00	50.00	50.00
PREP	48	38	91	55.81	34.53	49.69
PRON	15	14	28	51.72	34.88	47.17
PUNCT	101	50	102	66.89	49.75	62.58
SPELL	28	22	41	56.00	40.58	52.04
VERB	20	22	62	47.62	24.39	40.00
VERB:FORM	40	24	33	62.50	54.79	60.79
VERB:SVA	35	17	18	67.31	66.04	67.05
VERB:TENSE	28	28	59	50.00	32.18	45.02
WO	8	11	32	42.11	20.00	34.48

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	1	0.00	0.00	0.00
M:ADV	3	4	7	42.86	30.00	39.47
M:CONJ	4	3	4	57.14	50.00	55.56
M:DET	55	29	62	65.48	47.01	60.71
M:NOUN	1	5	2	16.67	33.33	18.52
M:NOUN:POSS	3	0	2	100.00	60.00	88.24
M:OTHER	1	8	12	11.11	7.69	10.20
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	8	11	20	42.11	28.57	38.46
M:PRON	9	8	19	52.94	32.14	46.88
M:PUNCT	72	26	75	73.47	48.98	66.79
M:VERB	5	7	4	41.67	55.56	43.86
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	3	6	11	33.33	21.43	30.00
R:ADJ	1	5	7	16.67	12.50	15.62
R:ADJ:FORM	1	1	1	50.00	50.00	50.00
R:ADV	3	7	5	30.00	37.50	31.25
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	12	6	34	66.67	26.09	50.85
R:MORPH	14	10	28	58.33	33.33	50.72
R:NOUN	6	39	28	13.33	17.65	14.02
R:NOUN:INFL	0	1	0	0.00	100.00	0.00
R:NOUN:NUM	37	23	33	61.67	52.86	59.68
R:NOUN:POSS	1	1	2	50.00	33.33	45.45
R:ORTH	35	15	36	70.00	49.30	64.58
R:OTHER	12	92	168	11.54	6.67	10.07
R:PART	5	5	2	50.00	71.43	53.19
R:PREP	26	18	56	59.09	31.71	50.39
R:PRON	1	3	7	25.00	12.50	20.83
R:PUNCT	20	19	17	51.28	54.05	51.81
R:SPELL	28	22	41	56.00	40.58	52.04
R:VERB	12	6	51	66.67	19.05	44.44
R:VERB:FORM	35	21	32	62.50	52.24	60.14
R:VERB:SVA	35	17	18	67.31	66.04	67.05
R:VERB:TENSE	20	18	43	52.63	31.75	46.51
R:WO	8	11	32	42.11	20.00	34.48
U:ADJ	0	2	0	0.00	100.00	0.00
U:ADV	3	3	4	50.00	42.86	48.39
U:CONJ	0	1	0	0.00	100.00	0.00
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	26	26	32	50.00	44.83	48.87
U:NOUN	3	10	1	23.08	75.00	26.79
U:NOUN:POSS	1	0	4	100.00	20.00	55.56
U:OTHER	2	23	10	8.00	16.67	8.93
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	14	9	15	60.87	48.28	57.85
U:PRON	5	3	2	62.50	71.43	64.10
U:PUNCT	9	5	10	64.29	47.37	60.00
U:VERB	3	9	7	25.00	30.00	25.86
U:VERB:FORM	4	3	1	57.14	80.00	60.61
U:VERB:TENSE	5	4	5	55.56	50.00	54.35

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	186	88	223	67.88	45.48	61.79
R	417	245	597	62.99	41.12	56.94
U	80	84	94	48.78	45.98	48.19
UNK	3	0	16	100.00	15.79	48.39

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	7	8	46.15	42.86	45.45
ADJ:FORM	1	0	1	100.00	50.00	83.33
ADV	9	13	15	40.91	37.50	40.18
CONJ	4	3	7	57.14	36.36	51.28
CONTR	2	0	1	100.00	66.67	90.91
DET	104	46	124	69.33	45.61	62.80
MORPH	15	5	28	75.00	34.88	60.98
NOUN	16	45	29	26.23	35.56	27.68
NOUN:NUM	38	18	32	67.86	54.29	64.63
NOUN:POSS	5	1	10	83.33	33.33	64.10
ORTH	49	8	36	85.96	57.65	78.27
OTHER	53	96	182	35.57	22.55	31.89
PART	5	4	5	55.56	50.00	54.35
PREP	56	28	95	66.67	37.09	57.49
PRON	17	12	24	58.62	41.46	54.14
PUNCT	111	45	101	71.15	52.36	66.39
SPELL	37	13	33	74.00	52.86	68.52
UNK	3	0	16	100.00	15.79	48.39
VERB	31	20	58	60.78	34.83	52.90
VERB:FORM	43	20	29	68.25	59.72	66.36
VERB:SVA	40	8	13	83.33	75.47	81.63
VERB:TENSE	33	18	51	64.71	39.29	57.29
WO	8	7	32	53.33	20.00	40.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	1	0.00	0.00	0.00
M:ADV	2	3	5	40.00	28.57	37.04
M:CONJ	4	2	5	66.67	44.44	60.61
M:DET	60	22	58	73.17	50.85	67.26
M:NOUN	1	5	2	16.67	33.33	18.52
M:NOUN:POSS	3	0	2	100.00	60.00	88.24
M:OTHER	4	6	14	40.00	22.22	34.48
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	11	9	25	55.00	30.56	47.41
M:PRON	11	6	16	64.71	40.74	57.89
M:PUNCT	79	23	78	77.45	50.32	69.91
M:VERB	5	7	5	41.67	50.00	43.10
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	5	3	10	62.50	33.33	53.19
R:ADJ	6	4	7	60.00	46.15	56.60
R:ADJ:FORM	1	0	1	100.00	50.00	83.33
R:ADV	4	7	5	36.36	44.44	37.74
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	18	4	31	81.82	36.73	65.69
R:MORPH	15	5	28	75.00	34.88	60.98
R:NOUN	12	30	25	28.57	32.43	29.27
R:NOUN:NUM	38	18	32	67.86	54.29	64.63
R:NOUN:POSS	1	1	3	50.00	25.00	41.67
R:ORTH	49	8	36	85.96	57.65	78.27
R:OTHER	46	68	157	40.35	22.66	34.90
R:PART	5	4	2	55.56	71.43	58.14
R:PREP	30	13	55	69.77	35.29	58.37
R:PRON	1	3	7	25.00	12.50	20.83
R:PUNCT	23	19	15	54.76	60.53	55.83
R:SPELL	37	13	33	74.00	52.86	68.52
R:VERB	21	5	48	80.77	30.43	60.69
R:VERB:FORM	38	17	28	69.09	57.58	66.43
R:VERB:SVA	40	8	13	83.33	75.47	81.63
R:VERB:TENSE	23	11	37	67.65	38.33	58.67
R:WO	8	7	32	53.33	20.00	40.00
U:ADJ	0	1	0	0.00	100.00	0.00
U:ADV	3	3	5	50.00	37.50	46.88
U:CONJ	0	1	0	0.00	100.00	0.00
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	26	20	35	56.52	42.62	53.06
U:NOUN	3	10	2	23.08	60.00	26.32
U:NOUN:POSS	1	0	5	100.00	16.67	50.00
U:OTHER	3	22	11	12.00	21.43	13.16
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	15	6	15	71.43	50.00	65.79
U:PRON	5	3	1	62.50	83.33	65.79
U:PUNCT	9	3	8	75.00	52.94	69.23
U:VERB	5	8	5	38.46	50.00	40.32
U:VERB:FORM	4	3	1	57.14	80.00	60.61
U:VERB:TENSE	5	4	4	55.56	55.56	55.56
UNK	3	0	16	100.00	15.79	48.39

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	228	57	238	80.00	48.93	70.98
R	576	282	774	67.13	42.67	60.23
U	99	116	150	46.05	39.76	44.63
UNK	16	0	29	100.00	35.56	73.39

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	4	13	60.00	31.58	50.85
ADJ:FORM	1	0	2	100.00	33.33	71.43
ADV	12	9	22	57.14	35.29	50.85
CONJ	6	2	9	75.00	40.00	63.83
CONTR	1	0	1	100.00	50.00	83.33
DET	113	39	123	74.34	47.88	66.94
MORPH	15	3	26	83.33	36.59	66.37
NOUN	24	36	37	40.00	39.34	39.87
NOUN:NUM	39	14	30	73.58	56.52	69.40
NOUN:POSS	7	1	13	87.50	35.00	67.31
ORTH	73	7	52	91.25	58.40	82.02
OTHER	138	199	310	40.95	30.80	38.42
PART	4	2	5	66.67	44.44	60.61
PREP	61	20	105	75.31	36.75	62.24
PRON	23	10	25	69.70	47.92	63.89
PUNCT	141	41	112	77.47	55.73	71.87
SPELL	37	11	33	77.08	52.86	70.61
UNK	16	0	29	100.00	35.56	73.39
VERB	38	9	78	80.85	32.76	62.50
VERB:FORM	44	15	28	74.58	61.11	71.43
VERB:SVA	36	7	13	83.72	73.47	81.45
VERB:TENSE	44	18	73	70.97	37.61	60.27
WO	40	8	52	83.33	43.48	70.42

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	2	0.00	0.00	0.00
M:ADV	5	3	7	62.50	41.67	56.82
M:CONJ	6	2	4	75.00	60.00	71.43
M:DET	60	16	59	78.95	50.42	70.92
M:NOUN	1	2	5	33.33	16.67	27.78
M:NOUN:POSS	4	0	2	100.00	66.67	90.91
M:OTHER	6	5	17	54.55	26.09	44.78
M:PART	1	0	2	100.00	33.33	71.43
M:PREP	15	6	25	71.43	37.50	60.48
M:PRON	18	4	12	81.82	60.00	76.27
M:PUNCT	92	15	80	85.98	53.49	76.67
M:VERB	9	2	11	81.82	45.00	70.31
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	9	0	12	100.00	42.86	78.95
R:ADJ	6	2	11	75.00	35.29	61.22
R:ADJ:FORM	1	0	2	100.00	33.33	71.43
R:ADV	4	5	9	44.44	30.77	40.82
R:CONJ	0	0	5	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	22	4	33	84.62	40.00	69.18
R:MORPH	15	3	26	83.33	36.59	66.37
R:NOUN	20	27	27	42.55	42.55	42.55
R:NOUN:NUM	39	14	30	73.58	56.52	69.40
R:NOUN:POSS	2	1	5	66.67	28.57	52.63
R:ORTH	73	7	52	91.25	58.40	82.02
R:OTHER	114	122	244	48.31	31.84	43.78
R:PART	3	2	2	60.00	60.00	60.00
R:PREP	32	11	61	74.42	34.41	60.38
R:PRON	1	3	10	25.00	9.09	18.52
R:PUNCT	39	23	21	62.90	65.00	63.31
R:SPELL	37	11	33	77.08	52.86	70.61
R:VERB	24	5	57	82.76	29.63	60.91
R:VERB:FORM	38	12	27	76.00	58.46	71.70
R:VERB:SVA	36	7	13	83.72	73.47	81.45
R:VERB:TENSE	29	15	54	65.91	34.94	55.98
R:WO	40	8	52	83.33	43.48	70.42
U:ADV	3	1	6	75.00	33.33	60.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	31	19	31	62.00	50.00	59.16
U:NOUN	3	7	5	30.00	37.50	31.25
U:NOUN:POSS	1	0	6	100.00	14.29	45.45
U:OTHER	18	72	49	20.00	26.87	21.08
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	14	3	19	82.35	42.42	69.31
U:PRON	4	3	3	57.14	57.14	57.14
U:PUNCT	10	3	11	76.92	47.62	68.49
U:VERB	5	2	10	71.43	33.33	58.14
U:VERB:FORM	4	3	1	57.14	80.00	60.61
U:VERB:TENSE	6	3	7	66.67	46.15	61.22
UNK	16	0	29	100.00	35.56	73.39

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	259	280	344	48.05	42.95	46.94
Span-level detection	309	232	330	57.12	48.36	55.12
Token-level detection	391	218	380	64.20	50.71	60.96

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	73	44	90	62.39	44.79	57.84
R	138	188	213	42.33	39.32	41.69
U	48	48	41	50.00	53.93	50.74

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	6	5	14.29	16.67	14.71
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	4	8	4	33.33	50.00	35.71
CONJ	0	4	5	0.00	0.00	0.00
CONTR	1	0	2	100.00	33.33	71.43
DET	54	29	51	65.06	51.43	61.78
MORPH	6	10	13	37.50	31.58	36.14
NOUN	2	43	12	4.44	14.29	5.15
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	16	20	17	44.44	48.48	45.20
NOUN:POSS	1	0	5	100.00	16.67	50.00
ORTH	25	8	20	75.76	55.56	70.62
OTHER	14	45	40	23.73	25.93	24.14
PART	2	1	3	66.67	40.00	58.82
PREP	32	25	39	56.14	45.07	53.51
PRON	5	6	8	45.45	38.46	43.86
PUNCT	46	14	38	76.67	54.76	70.99
SPELL	10	10	28	50.00	26.32	42.37
VERB	0	19	10	0.00	0.00	0.00
VERB:FORM	14	11	5	56.00	73.68	58.82
VERB:SVA	6	5	4	54.55	60.00	55.56
VERB:TENSE	12	13	21	48.00	36.36	45.11
WO	6	3	12	66.67	33.33	55.56

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	1	0.00	0.00	0.00
M:ADV	2	2	0	50.00	100.00	55.56
M:CONJ	0	3	3	0.00	0.00	0.00
M:DET	22	11	26	66.67	45.83	61.11
M:NOUN	1	2	5	33.33	16.67	27.78
M:OTHER	0	2	3	0.00	0.00	0.00
M:PREP	6	10	13	37.50	31.58	36.14
M:PRON	3	2	4	60.00	42.86	55.56
M:PUNCT	35	7	29	83.33	54.69	75.43
M:VERB	0	3	2	0.00	0.00	0.00
M:VERB:FORM	3	0	0	100.00	100.00	100.00
M:VERB:TENSE	1	1	4	50.00	20.00	38.46
R:ADJ	1	4	3	20.00	25.00	20.83
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	0	4	2	0.00	0.00	0.00
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	5	4	6	55.56	45.45	53.19
R:MORPH	6	10	13	37.50	31.58	36.14
R:NOUN	1	33	6	2.94	14.29	3.50
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	16	20	17	44.44	48.48	45.20
R:NOUN:POSS	0	0	5	100.00	0.00	0.00
R:ORTH	25	8	20	75.76	55.56	70.62
R:OTHER	13	37	36	26.00	26.53	26.10
R:PART	1	1	2	50.00	33.33	45.45
R:PREP	23	10	20	69.70	53.49	65.71
R:PRON	1	1	3	50.00	25.00	41.67
R:PUNCT	6	6	4	50.00	60.00	51.72
R:SPELL	10	10	28	50.00	26.32	42.37
R:VERB	0	12	7	0.00	0.00	0.00
R:VERB:FORM	10	10	5	50.00	66.67	52.63
R:VERB:SVA	6	5	4	54.55	60.00	55.56
R:VERB:TENSE	6	10	15	37.50	28.57	35.29
R:WO	6	3	12	66.67	33.33	55.56
U:ADJ	0	1	1	0.00	0.00	0.00
U:ADV	2	2	2	50.00	50.00	50.00
U:CONJ	0	1	0	0.00	100.00	0.00
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	27	14	19	65.85	58.70	64.29
U:NOUN	0	8	1	0.00	0.00	0.00
U:NOUN:POSS	1	0	0	100.00	100.00	100.00
U:OTHER	1	6	1	14.29	50.00	16.67
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	3	5	6	37.50	33.33	36.59
U:PRON	1	3	1	25.00	50.00	27.78
U:PUNCT	5	1	5	83.33	50.00	73.53
U:VERB	0	4	1	0.00	0.00	0.00
U:VERB:FORM	1	1	0	50.00	100.00	55.56
U:VERB:TENSE	5	2	2	71.43	71.43	71.43

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	80	41	91	66.12	46.78	61.07
R	178	146	196	54.94	47.59	53.29
U	49	45	42	52.13	53.85	52.46
UNK	2	0	1	100.00	66.67	90.91

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	5	4	28.57	33.33	29.41
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	4	8	5	33.33	44.44	35.09
CONJ	0	4	4	0.00	0.00	0.00
CONTR	1	0	2	100.00	33.33	71.43
DET	56	29	51	65.88	52.34	62.64
MORPH	8	5	12	61.54	40.00	55.56
NOUN	7	28	12	20.00	36.84	22.01
NOUN:INFL	3	0	0	100.00	100.00	100.00
NOUN:NUM	17	18	14	48.57	54.84	49.71
NOUN:POSS	1	0	5	100.00	16.67	50.00
ORTH	29	7	16	80.56	64.44	76.72
OTHER	28	37	41	43.08	40.58	42.55
PART	2	0	2	100.00	50.00	83.33
PREP	33	23	38	58.93	46.48	55.93
PRON	5	4	8	55.56	38.46	51.02
PUNCT	51	12	38	80.95	57.30	74.78
SPELL	14	11	24	56.00	36.84	50.72
UNK	2	0	1	100.00	66.67	90.91
VERB	1	16	10	5.88	9.09	6.33
VERB:FORM	15	8	6	65.22	71.43	66.37
VERB:SVA	9	5	3	64.29	75.00	66.18
VERB:TENSE	15	10	21	60.00	41.67	55.15
WO	6	2	11	75.00	35.29	61.22

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	1	0.00	0.00	0.00
M:ADV	1	2	1	33.33	50.00	35.71
M:CONJ	0	3	3	0.00	0.00	0.00
M:DET	23	11	24	67.65	48.94	62.84
M:NOUN	2	1	5	66.67	28.57	52.63
M:OTHER	2	2	4	50.00	33.33	45.45
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	7	9	12	43.75	36.84	42.17
M:PRON	3	2	4	60.00	42.86	55.56
M:PUNCT	38	6	29	86.36	56.72	78.19
M:VERB	0	3	2	0.00	0.00	0.00
M:VERB:FORM	3	0	0	100.00	100.00	100.00
M:VERB:TENSE	1	1	5	50.00	16.67	35.71
R:ADJ	2	3	2	40.00	50.00	41.67
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	4	2	20.00	33.33	21.74
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	7	4	6	63.64	53.85	61.40
R:MORPH	8	5	12	61.54	40.00	55.56
R:NOUN	5	21	6	19.23	45.45	21.74
R:NOUN:INFL	3	0	0	100.00	100.00	100.00
R:NOUN:NUM	17	18	14	48.57	54.84	49.71
R:NOUN:POSS	0	0	5	100.00	0.00	0.00
R:ORTH	29	7	16	80.56	64.44	76.72
R:OTHER	25	29	35	46.30	41.67	45.29
R:PART	1	0	1	100.00	50.00	83.33
R:PREP	24	9	19	72.73	55.81	68.57
R:PRON	1	0	3	100.00	25.00	62.50
R:PUNCT	6	5	5	54.55	54.55	54.55
R:SPELL	14	11	24	56.00	36.84	50.72
R:VERB	1	9	7	10.00	12.50	10.42
R:VERB:FORM	11	7	6	61.11	64.71	61.80
R:VERB:SVA	9	5	3	64.29	75.00	66.18
R:VERB:TENSE	8	7	15	53.33	34.78	48.19
R:WO	6	2	11	75.00	35.29	61.22
U:ADJ	0	1	1	0.00	0.00	0.00
U:ADV	2	2	2	50.00	50.00	50.00
U:CONJ	0	1	0	0.00	100.00	0.00
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	26	14	21	65.00	55.32	62.80
U:NOUN	0	6	1	0.00	0.00	0.00
U:NOUN:POSS	1	0	0	100.00	100.00	100.00
U:OTHER	1	6	2	14.29	33.33	16.13
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	2	5	7	28.57	22.22	27.03
U:PRON	1	2	1	33.33	50.00	35.71
U:PUNCT	7	1	4	87.50	63.64	81.40
U:VERB	0	4	1	0.00	0.00	0.00
U:VERB:FORM	1	1	0	50.00	100.00	55.56
U:VERB:TENSE	6	2	1	75.00	85.71	76.92
UNK	2	0	1	100.00	66.67	90.91

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	102	31	100	76.69	50.50	69.48
R	232	129	225	64.27	50.77	61.02
U	53	58	49	47.75	51.96	48.53
UNK	4	0	6	100.00	40.00	76.92

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	5	6	16.67	14.29	16.13
ADJ:FORM	0	0	3	100.00	0.00	0.00
ADV	5	7	7	41.67	41.67	41.67
CONJ	0	1	4	0.00	0.00	0.00
CONTR	1	0	3	100.00	25.00	62.50
DET	61	28	48	68.54	55.96	65.59
MORPH	8	4	12	66.67	40.00	58.82
NOUN	9	23	14	28.12	39.13	29.80
NOUN:INFL	3	0	0	100.00	100.00	100.00
NOUN:NUM	17	15	15	53.12	53.12	53.12
NOUN:POSS	3	0	6	100.00	33.33	71.43
ORTH	39	7	19	84.78	67.24	80.58
OTHER	50	50	63	50.00	44.25	48.73
PART	3	0	1	100.00	75.00	93.75
PREP	35	19	36	64.81	49.30	60.98
PRON	6	4	9	60.00	40.00	54.55
PUNCT	72	10	46	87.80	61.02	80.72
SPELL	15	9	23	62.50	39.47	55.97
UNK	4	0	6	100.00	40.00	76.92
VERB	2	16	13	11.11	13.33	11.49
VERB:FORM	16	7	7	69.57	69.57	69.57
VERB:SVA	9	3	3	75.00	75.00	75.00
VERB:TENSE	16	8	23	66.67	41.03	59.26
WO	16	2	13	88.89	55.17	79.21

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	2	0.00	0.00	0.00
M:ADV	1	1	1	50.00	50.00	50.00
M:CONJ	0	1	3	0.00	0.00	0.00
M:DET	27	10	21	72.97	56.25	68.88
M:NOUN	2	1	6	66.67	25.00	50.00
M:NOUN:POSS	1	0	0	100.00	100.00	100.00
M:OTHER	3	2	5	60.00	37.50	53.57
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	9	6	11	60.00	45.00	56.25
M:PRON	4	2	5	66.67	44.44	60.61
M:PUNCT	49	5	37	90.74	56.98	81.13
M:VERB	0	2	3	0.00	0.00	0.00
M:VERB:FORM	4	0	0	100.00	100.00	100.00
M:VERB:TENSE	2	0	5	100.00	28.57	66.67
R:ADJ	1	3	2	25.00	33.33	26.32
R:ADJ:FORM	0	0	3	100.00	0.00	0.00
R:ADV	1	4	2	20.00	33.33	21.74
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	7	3	6	70.00	53.85	66.04
R:MORPH	8	4	12	66.67	40.00	58.82
R:NOUN	7	17	7	29.17	50.00	31.82
R:NOUN:INFL	3	0	0	100.00	100.00	100.00
R:NOUN:NUM	17	15	15	53.12	53.12	53.12
R:NOUN:POSS	1	0	6	100.00	14.29	45.45
R:ORTH	39	7	19	84.78	67.24	80.58
R:OTHER	45	27	52	62.50	46.39	58.44
R:PART	2	0	0	100.00	100.00	100.00
R:PREP	24	9	18	72.73	57.14	68.97
R:PRON	1	0	3	100.00	25.00	62.50
R:PUNCT	15	4	5	78.95	75.00	78.12
R:SPELL	15	9	23	62.50	39.47	55.97
R:VERB	2	10	9	16.67	18.18	16.95
R:VERB:FORM	11	6	7	64.71	61.11	63.95
R:VERB:SVA	9	3	3	75.00	75.00	75.00
R:VERB:TENSE	8	6	18	57.14	30.77	48.78
R:WO	16	2	13	88.89	55.17	79.21
U:ADJ	0	1	2	0.00	0.00	0.00
U:ADV	3	2	4	60.00	42.86	55.56
U:CONTR	1	0	2	100.00	33.33	71.43
U:DET	27	15	21	64.29	56.25	62.50
U:NOUN	0	5	1	0.00	0.00	0.00
U:NOUN:POSS	1	0	0	100.00	100.00	100.00
U:OTHER	2	21	6	8.70	25.00	10.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	2	4	7	33.33	22.22	30.30
U:PRON	1	2	1	33.33	50.00	35.71
U:PUNCT	8	1	4	88.89	66.67	83.33
U:VERB	0	4	1	0.00	0.00	0.00
U:VERB:FORM	1	1	0	50.00	100.00	55.56
U:VERB:TENSE	6	2	0	75.00	100.00	78.95
UNK	4	0	6	100.00	40.00	76.92

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	164	426	305	27.80	34.97	28.99
Span-level detection	234	356	283	39.66	45.26	40.67
Token-level detection	318	352	333	47.46	48.85	47.73

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	47	71	51	39.83	47.96	41.23
R	100	262	238	27.62	29.59	28.00
U	17	93	16	15.45	51.52	17.97

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	16	3	5.88	25.00	6.94
ADV	0	11	1	0.00	0.00	0.00
CONJ	1	2	0	33.33	100.00	38.46
DET	8	59	4	11.94	66.67	14.29
MORPH	0	22	5	0.00	0.00	0.00
NOUN	1	51	9	1.92	10.00	2.29
NOUN:INFL	2	3	10	40.00	16.67	31.25
NOUN:NUM	10	33	10	23.26	50.00	26.04
NOUN:POSS	6	4	12	60.00	33.33	51.72
ORTH	19	9	37	67.86	33.93	56.55
OTHER	11	59	45	15.71	19.64	16.37
PART	1	2	0	33.33	100.00	38.46
PREP	8	45	10	15.09	44.44	17.39
PRON	1	5	5	16.67	16.67	16.67
PUNCT	51	23	61	68.92	45.54	62.50
SPELL	18	13	70	58.06	20.45	42.45
VERB	5	22	10	18.52	33.33	20.33
VERB:FORM	6	16	2	27.27	75.00	31.25
VERB:INFL	0	0	4	100.00	0.00	0.00
VERB:SVA	9	11	4	45.00	69.23	48.39
VERB:TENSE	2	15	3	11.76	40.00	13.70
WO	4	5	0	44.44	100.00	50.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	3	0	0.00	100.00	0.00
M:CONJ	1	2	0	33.33	100.00	38.46
M:DET	3	29	1	9.38	75.00	11.36
M:NOUN	0	3	2	0.00	0.00	0.00
M:NOUN:POSS	3	2	4	60.00	42.86	55.56
M:OTHER	0	4	0	0.00	100.00	0.00
M:PREP	1	8	0	11.11	100.00	13.51
M:PRON	1	3	2	25.00	33.33	26.32
M:PUNCT	37	11	39	77.08	48.68	69.03
M:VERB	1	4	3	20.00	25.00	20.83
M:VERB:FORM	0	1	0	0.00	100.00	0.00
M:VERB:TENSE	0	1	0	0.00	100.00	0.00
R:ADJ	1	13	3	7.14	25.00	8.33
R:ADV	0	1	1	0.00	0.00	0.00
R:DET	0	2	2	0.00	0.00	0.00
R:MORPH	0	22	5	0.00	0.00	0.00
R:NOUN	1	44	7	2.22	12.50	2.66
R:NOUN:INFL	2	3	10	40.00	16.67	31.25
R:NOUN:NUM	10	33	10	23.26	50.00	26.04
R:NOUN:POSS	3	0	7	100.00	30.00	68.18
R:ORTH	19	9	37	67.86	33.93	56.55
R:OTHER	10	43	44	18.87	18.52	18.80
R:PART	0	2	0	0.00	100.00	0.00
R:PREP	5	16	9	23.81	35.71	25.51
R:PRON	0	1	3	0.00	0.00	0.00
R:PUNCT	8	9	11	47.06	42.11	45.98
R:SPELL	18	13	70	58.06	20.45	42.45
R:VERB	3	14	6	17.65	33.33	19.48
R:VERB:FORM	6	14	2	30.00	75.00	34.09
R:VERB:INFL	0	0	4	100.00	0.00	0.00
R:VERB:SVA	9	11	4	45.00	69.23	48.39
R:VERB:TENSE	1	7	3	12.50	25.00	13.89
R:WO	4	5	0	44.44	100.00	50.00
U:ADJ	0	3	0	0.00	100.00	0.00
U:ADV	0	7	0	0.00	100.00	0.00
U:DET	5	28	1	15.15	83.33	18.12
U:NOUN	0	4	0	0.00	100.00	0.00
U:NOUN:POSS	0	2	1	0.00	0.00	0.00
U:OTHER	1	12	1	7.69	50.00	9.26
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	2	21	1	8.70	66.67	10.53
U:PRON	0	1	0	0.00	100.00	0.00
U:PUNCT	6	3	11	66.67	35.29	56.60
U:VERB	1	4	1	20.00	50.00	22.73
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	1	7	0	12.50	100.00	15.15

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	54	64	53	45.76	50.47	46.63
R	157	209	212	42.90	42.55	42.83
U	21	83	17	20.19	55.26	23.13
UNK	2	0	1	100.00	66.67	90.91

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	12	2	14.29	50.00	16.67
ADJ:FORM	0	0	1	100.00	0.00	0.00
ADV	0	10	1	0.00	0.00	0.00
CONJ	2	2	0	50.00	100.00	55.56
DET	12	54	8	18.18	60.00	21.13
MORPH	2	15	4	11.76	33.33	13.51
NOUN	3	44	8	6.38	27.27	7.54
NOUN:INFL	1	0	10	100.00	9.09	33.33
NOUN:NUM	10	29	10	25.64	50.00	28.41
NOUN:POSS	12	3	9	80.00	57.14	74.07
ORTH	31	7	35	81.58	46.97	71.10
OTHER	20	49	42	28.99	32.26	29.59
PART	1	2	0	33.33	100.00	38.46
PREP	15	39	9	27.78	62.50	31.25
PRON	3	4	4	42.86	42.86	42.86
PUNCT	53	22	61	70.67	46.49	64.01
SPELL	31	1	59	96.88	34.44	71.10
UNK	2	0	1	100.00	66.67	90.91
VERB	8	19	8	29.63	50.00	32.26
VERB:FORM	7	15	2	31.82	77.78	36.08
VERB:INFL	1	0	3	100.00	25.00	62.50
VERB:SVA	10	11	4	47.62	71.43	51.02
VERB:TENSE	4	13	2	23.53	66.67	27.03
WO	4	5	0	44.44	100.00	50.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	3	0	0.00	100.00	0.00
M:CONJ	2	2	0	50.00	100.00	55.56
M:DET	4	27	2	12.90	66.67	15.38
M:NOUN	0	2	2	0.00	0.00	0.00
M:NOUN:POSS	3	2	4	60.00	42.86	55.56
M:OTHER	1	2	2	33.33	33.33	33.33
M:PREP	2	8	1	20.00	66.67	23.26
M:PRON	2	2	1	50.00	66.67	52.63
M:PUNCT	38	11	39	77.55	49.35	69.60
M:VERB	2	3	2	40.00	50.00	41.67
M:VERB:FORM	0	1	0	0.00	100.00	0.00
M:VERB:TENSE	0	1	0	0.00	100.00	0.00
R:ADJ	2	10	2	16.67	50.00	19.23
R:ADJ:FORM	0	0	1	100.00	0.00	0.00
R:ADV	0	0	1	100.00	0.00	0.00
R:DET	2	2	4	50.00	33.33	45.45
R:MORPH	2	15	4	11.76	33.33	13.51
R:NOUN	3	39	6	7.14	33.33	8.47
R:NOUN:INFL	1	0	10	100.00	9.09	33.33
R:NOUN:NUM	10	29	10	25.64	50.00	28.41
R:NOUN:POSS	9	0	4	100.00	69.23	91.84
R:ORTH	31	7	35	81.58	46.97	71.10
R:OTHER	18	35	39	33.96	31.58	33.46
R:PART	0	2	0	0.00	100.00	0.00
R:PREP	10	12	8	45.45	55.56	47.17
R:PRON	1	1	3	50.00	25.00	41.67
R:PUNCT	8	8	10	50.00	44.44	48.78
R:SPELL	31	1	59	96.88	34.44	71.10
R:VERB	5	13	5	27.78	50.00	30.49
R:VERB:FORM	7	13	2	35.00	77.78	39.33
R:VERB:INFL	1	0	3	100.00	25.00	62.50
R:VERB:SVA	10	11	4	47.62	71.43	51.02
R:VERB:TENSE	2	6	2	25.00	50.00	27.78
R:WO	4	5	0	44.44	100.00	50.00
U:ADJ	0	2	0	0.00	100.00	0.00
U:ADV	0	7	0	0.00	100.00	0.00
U:DET	6	25	2	19.35	75.00	22.73
U:NOUN	0	3	0	0.00	100.00	0.00
U:NOUN:POSS	0	1	1	0.00	0.00	0.00
U:OTHER	1	12	1	7.69	50.00	9.26
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	3	19	0	13.64	100.00	16.48
U:PRON	0	1	0	0.00	100.00	0.00
U:PUNCT	7	3	12	70.00	36.84	59.32
U:VERB	1	3	1	25.00	50.00	27.78
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	2	6	0	25.00	100.00	29.41
UNK	2	0	1	100.00	66.67	90.91

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	76	52	63	59.38	54.68	58.37
R	216	201	245	51.80	46.85	50.73
U	24	99	23	19.51	51.06	22.26
UNK	2	0	2	100.00	50.00	83.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	12	3	20.00	50.00	22.73
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	2	5	2	28.57	50.00	31.25
CONJ	3	1	0	75.00	100.00	78.95
CONTR	0	0	2	100.00	0.00	0.00
DET	11	46	9	19.30	55.00	22.18
MORPH	2	13	4	13.33	33.33	15.15
NOUN	2	46	10	4.17	16.67	4.90
NOUN:INFL	1	0	10	100.00	9.09	33.33
NOUN:NUM	11	27	10	28.95	52.38	31.79
NOUN:POSS	14	1	11	93.33	56.00	82.35
ORTH	46	7	42	86.79	52.27	76.67
OTHER	45	70	59	39.13	43.27	39.89
PART	1	2	0	33.33	100.00	38.46
PREP	14	37	10	27.45	58.33	30.70
PRON	4	4	3	50.00	57.14	51.28
PUNCT	80	17	75	82.47	51.61	73.66
SPELL	37	1	56	97.37	39.78	75.51
UNK	2	0	2	100.00	50.00	83.33
VERB	8	20	7	28.57	53.33	31.50
VERB:FORM	7	12	2	36.84	77.78	41.18
VERB:INFL	1	0	3	100.00	25.00	62.50
VERB:SVA	10	8	5	55.56	66.67	57.47
VERB:TENSE	7	15	5	31.82	58.33	35.00
WO	7	8	1	46.67	87.50	51.47

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	1	0	0.00	100.00	0.00
M:CONJ	3	1	0	75.00	100.00	78.95
M:DET	4	21	2	16.00	66.67	18.87
M:NOUN	0	2	3	0.00	0.00	0.00
M:NOUN:POSS	3	1	4	75.00	42.86	65.22
M:OTHER	2	2	1	50.00	66.67	52.63
M:PREP	2	8	2	20.00	50.00	22.73
M:PRON	3	2	0	60.00	100.00	65.22
M:PUNCT	56	9	50	86.15	52.83	76.50
M:VERB	1	4	1	20.00	50.00	22.73
M:VERB:TENSE	2	1	0	66.67	100.00	71.43
R:ADJ	3	10	2	23.08	60.00	26.32
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONTR	0	0	2	100.00	0.00	0.00
R:DET	2	1	4	66.67	33.33	55.56
R:MORPH	2	13	4	13.33	33.33	15.15
R:NOUN	2	41	7	4.65	22.22	5.52
R:NOUN:INFL	1	0	10	100.00	9.09	33.33
R:NOUN:NUM	11	27	10	28.95	52.38	31.79
R:NOUN:POSS	11	0	6	100.00	64.71	90.16
R:ORTH	46	7	42	86.79	52.27	76.67
R:OTHER	41	32	56	56.16	42.27	52.70
R:PART	0	2	0	0.00	100.00	0.00
R:PREP	10	11	8	47.62	55.56	49.02
R:PRON	1	1	3	50.00	25.00	41.67
R:PUNCT	15	6	10	71.43	60.00	68.81
R:SPELL	37	1	56	97.37	39.78	75.51
R:VERB	6	13	5	31.58	54.55	34.48
R:VERB:FORM	7	12	2	36.84	77.78	41.18
R:VERB:INFL	1	0	3	100.00	25.00	62.50
R:VERB:SVA	10	8	5	55.56	66.67	57.47
R:VERB:TENSE	2	8	5	20.00	28.57	21.28
R:WO	7	8	1	46.67	87.50	51.47
U:ADJ	0	2	1	0.00	0.00	0.00
U:ADV	1	4	0	20.00	100.00	23.81
U:DET	5	24	3	17.24	62.50	20.16
U:NOUN	0	3	0	0.00	100.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	2	36	2	5.26	50.00	6.41
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	2	18	0	10.00	100.00	12.20
U:PRON	0	1	0	0.00	100.00	0.00
U:PUNCT	9	2	15	81.82	37.50	66.18
U:VERB	1	3	1	25.00	50.00	27.78
U:VERB:TENSE	3	6	0	33.33	100.00	38.46
UNK	2	0	2	100.00	50.00	83.33

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:43:59+00:00
Competition submission:	13
Competition phase:	3 - Open phase

Detailed results

Submission information

Results