BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	2002	2168	2759	48.01	42.05	46.69
Span-level detection	2572	1604	2576	61.59	49.96	58.85
Token-level detection	3334	1460	3154	69.55	51.39	64.95

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	567	453	614	55.59	48.01	53.89
R	1217	1383	1868	46.81	39.45	45.12
U	218	332	277	39.64	44.04	40.45

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	24	28	20.00	17.65	19.48
ADJ:FORM	3	3	6	50.00	33.33	45.45
ADV	20	45	40	30.77	33.33	31.25
CONJ	7	17	20	29.17	25.93	28.46
CONTR	11	1	2	91.67	84.62	90.16
DET	272	268	326	50.37	45.48	49.31
MORPH	66	51	77	56.41	46.15	54.01
NOUN	17	102	89	14.29	16.04	14.60
NOUN:INFL	12	9	6	57.14	66.67	58.82
NOUN:NUM	142	138	98	50.71	59.17	52.21
NOUN:POSS	22	7	32	75.86	40.74	64.71
ORTH	201	65	165	75.56	54.92	70.28
OTHER	88	351	603	20.05	12.74	17.98
PART	12	13	13	48.00	48.00	48.00
PREP	166	207	241	44.50	40.79	43.71
PRON	43	50	94	46.24	31.39	42.24
PUNCT	354	208	320	62.99	52.52	60.57
SPELL	212	180	108	54.08	66.25	56.14
VERB	41	112	160	26.80	20.40	25.22
VERB:FORM	110	90	62	55.00	63.95	56.58
VERB:INFL	7	0	2	100.00	77.78	94.59
VERB:SVA	101	52	48	66.01	67.79	66.36
VERB:TENSE	73	139	158	34.43	31.60	33.83
WO	16	36	61	30.77	20.78	28.07

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	4	6	0.00	0.00	0.00
M:ADV	2	14	19	12.50	9.52	11.76
M:CONJ	6	15	12	28.57	33.33	29.41
M:CONTR	1	0	0	100.00	100.00	100.00
M:DET	149	117	133	56.02	52.84	55.35
M:NOUN	0	10	9	0.00	0.00	0.00
M:NOUN:POSS	3	1	10	75.00	23.08	51.72
M:OTHER	8	38	41	17.39	16.33	17.17
M:PART	1	2	4	33.33	20.00	29.41
M:PREP	36	58	58	38.30	38.30	38.30
M:PRON	26	26	49	50.00	34.67	45.94
M:PUNCT	298	121	218	71.12	57.75	67.97
M:VERB	12	23	23	34.29	34.29	34.29
M:VERB:FORM	16	7	1	69.57	94.12	73.39
M:VERB:TENSE	9	17	31	34.62	22.50	31.25
R:ADJ	4	10	19	28.57	17.39	25.32
R:ADJ:FORM	3	3	6	50.00	33.33	45.45
R:ADV	8	7	10	53.33	44.44	51.28
R:CONJ	0	1	4	0.00	0.00	0.00
R:CONTR	3	1	1	75.00	75.00	75.00
R:DET	27	61	86	30.68	23.89	29.03
R:MORPH	66	51	77	56.41	46.15	54.01
R:NOUN	14	65	73	17.72	16.09	17.37
R:NOUN:INFL	12	9	6	57.14	66.67	58.82
R:NOUN:NUM	142	138	98	50.71	59.17	52.21
R:NOUN:POSS	9	4	19	69.23	32.14	56.25
R:ORTH	201	65	165	75.56	54.92	70.28
R:OTHER	73	246	541	22.88	11.89	19.31
R:PART	8	9	7	47.06	53.33	48.19
R:PREP	96	109	144	46.83	40.00	45.28
R:PRON	9	18	30	33.33	23.08	30.61
R:PUNCT	44	70	68	38.60	39.29	38.73
R:SPELL	212	180	108	54.08	66.25	56.14
R:VERB	23	61	121	27.38	15.97	23.96
R:VERB:FORM	90	80	58	52.94	60.81	54.35
R:VERB:INFL	7	0	2	100.00	77.78	94.59
R:VERB:SVA	101	52	48	66.01	67.79	66.36
R:VERB:TENSE	49	107	116	31.41	29.70	31.05
R:WO	16	36	61	30.77	20.78	28.07
U:ADJ	2	10	3	16.67	40.00	18.87
U:ADV	10	24	11	29.41	47.62	31.85
U:CONJ	1	1	4	50.00	20.00	38.46
U:CONTR	7	0	1	100.00	87.50	97.22
U:DET	96	90	107	51.61	47.29	50.69
U:NOUN	3	27	7	10.00	30.00	11.54
U:NOUN:POSS	10	2	3	83.33	76.92	81.97
U:OTHER	7	67	21	9.46	25.00	10.80
U:PART	3	2	2	60.00	60.00	60.00
U:PREP	34	40	39	45.95	46.58	46.07
U:PRON	8	6	15	57.14	34.78	50.63
U:PUNCT	12	17	34	41.38	26.09	37.04
U:VERB	6	28	16	17.65	27.27	18.99
U:VERB:FORM	4	3	3	57.14	57.14	57.14
U:VERB:TENSE	15	15	11	50.00	57.69	51.37

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	664	361	597	64.78	52.66	61.93
R	1638	951	1647	63.27	49.86	60.04
U	253	292	271	46.42	48.28	46.78
UNK	17	0	61	100.00	21.79	58.22

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	17	16	26	51.52	39.53	48.57
ADJ:FORM	2	3	8	40.00	20.00	33.33
ADV	26	40	38	39.39	40.62	39.63
CONJ	10	14	21	41.67	32.26	39.37
CONTR	9	1	2	90.00	81.82	88.24
DET	312	227	306	57.88	50.49	56.24
MORPH	76	34	76	69.09	50.00	64.19
NOUN	45	71	79	38.79	36.29	38.27
NOUN:INFL	17	1	1	94.44	94.44	94.44
NOUN:NUM	144	112	89	56.25	61.80	57.28
NOUN:POSS	29	5	26	85.29	52.73	75.92
ORTH	257	48	154	84.26	62.53	78.79
OTHER	231	240	534	49.04	30.20	43.60
PART	16	10	14	61.54	53.33	59.70
PREP	208	155	233	57.30	47.17	54.94
PRON	62	40	86	60.78	41.89	55.76
PUNCT	382	182	319	67.73	54.49	64.59
SPELL	280	85	45	76.71	86.15	78.43
UNK	17	0	61	100.00	21.79	58.22
VERB	87	82	148	51.48	37.02	47.75
VERB:FORM	116	65	62	64.09	65.17	64.30
VERB:INFL	8	0	2	100.00	80.00	95.24
VERB:SVA	105	37	46	73.94	69.54	73.02
VERB:TENSE	100	106	143	48.54	41.15	46.86
WO	16	30	57	34.78	21.92	31.13

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	4	6	20.00	14.29	18.52
M:ADV	2	12	18	14.29	10.00	13.16
M:CONJ	9	13	12	40.91	42.86	41.28
M:DET	175	91	121	65.79	59.12	64.34
M:NOUN	2	7	9	22.22	18.18	21.28
M:NOUN:POSS	3	1	10	75.00	23.08	51.72
M:OTHER	21	26	44	44.68	32.31	41.50
M:PART	2	1	6	66.67	25.00	50.00
M:PREP	46	47	56	49.46	45.10	48.52
M:PRON	38	21	42	64.41	47.50	60.13
M:PUNCT	317	100	222	76.02	58.81	71.82
M:VERB	20	17	18	54.05	52.63	53.76
M:VERB:FORM	16	7	1	69.57	94.12	73.39
M:VERB:TENSE	12	14	32	46.15	27.27	40.54
R:ADJ	13	5	17	72.22	43.33	63.73
R:ADJ:FORM	2	3	8	40.00	20.00	33.33
R:ADV	12	6	8	66.67	60.00	65.22
R:CONJ	0	1	5	0.00	0.00	0.00
R:CONTR	2	1	1	66.67	66.67	66.67
R:DET	33	54	81	37.93	28.95	35.71
R:MORPH	76	34	76	69.09	50.00	64.19
R:NOUN	36	38	66	48.65	35.29	45.23
R:NOUN:INFL	17	1	1	94.44	94.44	94.44
R:NOUN:NUM	144	112	89	56.25	61.80	57.28
R:NOUN:POSS	16	3	14	84.21	53.33	75.47
R:ORTH	257	48	154	84.26	62.53	78.79
R:OTHER	197	152	468	56.45	29.62	47.79
R:PART	10	7	6	58.82	62.50	59.52
R:PREP	129	77	140	62.62	47.96	59.01
R:PRON	13	13	30	50.00	30.23	44.22
R:PUNCT	48	66	63	42.11	43.24	42.33
R:SPELL	280	85	45	76.71	86.15	78.43
R:VERB	58	42	112	58.00	34.12	50.88
R:VERB:FORM	96	55	59	63.58	61.94	63.24
R:VERB:INFL	8	0	2	100.00	80.00	95.24
R:VERB:SVA	105	37	46	73.94	69.54	73.02
R:VERB:TENSE	70	81	99	46.36	41.42	45.28
R:WO	16	30	57	34.78	21.92	31.13
U:ADJ	3	7	3	30.00	50.00	32.61
U:ADV	12	22	12	35.29	50.00	37.50
U:CONJ	1	0	4	100.00	20.00	55.56
U:CONTR	7	0	1	100.00	87.50	97.22
U:DET	104	82	104	55.91	50.00	54.62
U:NOUN	7	26	4	21.21	63.64	24.48
U:NOUN:POSS	10	1	2	90.91	83.33	89.29
U:OTHER	13	62	22	17.33	37.14	19.40
U:PART	4	2	2	66.67	66.67	66.67
U:PREP	33	31	37	51.56	47.14	50.61
U:PRON	11	6	14	64.71	44.00	59.14
U:PUNCT	17	16	34	51.52	33.33	46.45
U:VERB	9	23	18	28.12	33.33	29.03
U:VERB:FORM	4	3	2	57.14	66.67	58.82
U:VERB:TENSE	18	11	12	62.07	60.00	61.64
UNK	17	0	61	100.00	21.79	58.22

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	834	236	638	77.94	56.66	72.50
R	2154	879	2031	71.02	51.47	66.00
U	308	345	401	47.17	43.44	46.37
UNK	38	0	84	100.00	31.15	69.34

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	17	12	28	58.62	37.78	52.80
ADJ:FORM	3	3	9	50.00	25.00	41.67
ADV	36	30	51	54.55	41.38	51.28
CONJ	16	6	21	72.73	43.24	64.00
CONTR	8	1	5	88.89	61.54	81.63
DET	354	165	320	68.21	52.52	64.36
MORPH	82	31	76	72.57	51.90	67.21
NOUN	59	60	92	49.58	39.07	47.05
NOUN:INFL	17	1	1	94.44	94.44	94.44
NOUN:NUM	154	88	86	63.64	64.17	63.74
NOUN:POSS	41	4	32	91.11	56.16	81.03
ORTH	343	42	171	89.09	66.73	83.50
OTHER	510	359	844	58.69	37.67	52.80
PART	11	8	14	57.89	44.00	54.46
PREP	237	120	255	66.39	48.17	61.72
PRON	78	29	83	72.90	48.45	66.21
PUNCT	505	144	354	77.81	58.79	73.08
SPELL	290	70	32	80.56	90.06	82.29
UNK	38	0	84	100.00	31.15	69.34
VERB	112	63	192	64.00	36.84	55.78
VERB:FORM	120	57	74	67.80	61.86	66.52
VERB:INFL	9	0	2	100.00	81.82	95.74
VERB:SVA	107	33	44	76.43	70.86	75.25
VERB:TENSE	123	103	182	54.42	40.33	50.87
WO	64	31	102	67.37	38.55	58.61

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	2	6	33.33	14.29	26.32
M:ADV	10	11	21	47.62	32.26	43.48
M:CONJ	14	6	12	70.00	53.85	66.04
M:DET	194	51	123	79.18	61.20	74.79
M:NOUN	4	6	13	40.00	23.53	35.09
M:NOUN:POSS	6	1	10	85.71	37.50	68.18
M:OTHER	38	15	46	71.70	45.24	64.19
M:PART	2	1	5	66.67	28.57	52.63
M:PREP	65	31	63	67.71	50.78	63.48
M:PRON	46	14	39	76.67	54.12	70.77
M:PUNCT	390	75	242	83.87	61.71	78.25
M:VERB	26	11	27	70.27	49.06	64.68
M:VERB:FORM	18	5	1	78.26	94.74	81.08
M:VERB:TENSE	20	7	30	74.07	40.00	63.29
R:ADJ	14	4	18	77.78	43.75	67.31
R:ADJ:FORM	3	3	9	50.00	25.00	41.67
R:ADV	11	5	12	68.75	47.83	63.22
R:CONJ	0	0	6	100.00	0.00	0.00
R:CONTR	2	1	3	66.67	40.00	58.82
R:DET	44	46	76	48.89	36.67	45.83
R:MORPH	82	31	76	72.57	51.90	67.21
R:NOUN	48	34	67	58.54	41.74	54.18
R:NOUN:INFL	17	1	1	94.44	94.44	94.44
R:NOUN:NUM	154	88	86	63.64	64.17	63.74
R:NOUN:POSS	24	3	18	88.89	57.14	80.00
R:ORTH	343	42	171	89.09	66.73	83.50
R:OTHER	439	179	705	71.04	38.37	60.70
R:PART	6	5	8	54.55	42.86	51.72
R:PREP	136	65	148	67.66	47.89	62.50
R:PRON	18	12	29	60.00	38.30	53.89
R:PUNCT	83	56	72	59.71	53.55	58.37
R:SPELL	290	70	32	80.56	90.06	82.29
R:VERB	76	37	138	67.26	35.51	57.06
R:VERB:FORM	98	49	71	66.67	57.99	64.73
R:VERB:INFL	9	0	2	100.00	81.82	95.74
R:VERB:SVA	107	33	44	76.43	70.86	75.25
R:VERB:TENSE	86	84	137	50.59	38.57	47.62
R:WO	64	31	102	67.37	38.55	58.61
U:ADJ	2	6	4	25.00	33.33	26.32
U:ADV	15	14	18	51.72	45.45	50.34
U:CONJ	2	0	3	100.00	40.00	76.92
U:CONTR	6	0	2	100.00	75.00	93.75
U:DET	116	68	121	63.04	48.95	59.61
U:NOUN	7	20	12	25.93	36.84	27.56
U:NOUN:POSS	11	0	4	100.00	73.33	93.22
U:OTHER	33	165	93	16.67	26.19	17.97
U:PART	3	2	1	60.00	75.00	62.50
U:PREP	36	24	44	60.00	45.00	56.25
U:PRON	14	3	15	82.35	48.28	72.16
U:PUNCT	32	13	40	71.11	44.44	63.49
U:VERB	10	15	27	40.00	27.03	36.50
U:VERB:FORM	4	3	2	57.14	66.67	58.82
U:VERB:TENSE	17	12	15	58.62	53.12	57.43
UNK	38	0	84	100.00	31.15	69.34

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	914	739	1278	55.29	41.70	51.91
Span-level detection	1171	485	1188	70.71	49.64	65.18
Token-level detection	1549	344	1403	81.83	52.47	73.59

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	232	170	281	57.71	45.22	54.69
R	587	483	861	54.86	40.54	51.24
U	95	86	136	52.49	41.13	49.74

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	4	9	33.33	18.18	28.57
ADJ:FORM	1	0	4	100.00	20.00	55.56
ADV	10	13	21	43.48	32.26	40.65
CONJ	3	8	9	27.27	25.00	26.79
CONTR	6	0	0	100.00	100.00	100.00
DET	123	81	156	60.29	44.09	56.16
MORPH	37	11	41	77.08	47.44	68.52
NOUN	8	29	42	21.62	16.00	20.20
NOUN:INFL	6	1	0	85.71	100.00	88.24
NOUN:NUM	78	52	45	60.00	63.41	60.65
NOUN:POSS	8	2	7	80.00	53.33	72.73
ORTH	113	31	80	78.47	58.55	73.47
OTHER	47	132	313	26.26	13.06	21.84
PART	8	2	6	80.00	57.14	74.07
PREP	64	59	106	52.03	37.65	48.34
PRON	23	20	56	53.49	29.11	45.82
PUNCT	119	69	131	63.30	47.60	59.38
SPELL	82	70	32	53.95	71.93	56.79
VERB	20	32	75	38.46	21.05	33.00
VERB:FORM	64	36	22	64.00	74.42	65.84
VERB:INFL	4	0	0	100.00	100.00	100.00
VERB:SVA	52	23	28	69.33	65.00	68.42
VERB:TENSE	29	50	79	36.71	26.85	34.20
WO	7	14	16	33.33	30.43	32.71

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	2	0.00	0.00	0.00
M:ADV	0	6	11	0.00	0.00	0.00
M:CONJ	2	6	4	25.00	33.33	26.32
M:CONTR	1	0	0	100.00	100.00	100.00
M:DET	62	42	57	59.62	52.10	57.94
M:NOUN	0	4	2	0.00	0.00	0.00
M:NOUN:POSS	1	0	2	100.00	33.33	71.43
M:OTHER	6	18	23	25.00	20.69	24.00
M:PART	1	0	2	100.00	33.33	71.43
M:PREP	22	21	27	51.16	44.90	49.77
M:PRON	13	10	30	56.52	30.23	48.15
M:PUNCT	102	46	95	68.92	51.78	64.64
M:VERB	6	7	11	46.15	35.29	43.48
M:VERB:FORM	13	4	0	76.47	100.00	80.25
M:VERB:TENSE	3	5	15	37.50	16.67	30.00
R:ADJ	1	2	5	33.33	16.67	27.78
R:ADJ:FORM	1	0	4	100.00	20.00	55.56
R:ADV	5	2	5	71.43	50.00	65.79
R:CONJ	0	1	1	0.00	0.00	0.00
R:CONTR	2	0	0	100.00	100.00	100.00
R:DET	11	17	39	39.29	22.00	33.95
R:MORPH	37	11	41	77.08	47.44	68.52
R:NOUN	6	18	35	25.00	14.63	21.90
R:NOUN:INFL	6	1	0	85.71	100.00	88.24
R:NOUN:NUM	78	52	45	60.00	63.41	60.65
R:NOUN:POSS	1	1	5	50.00	16.67	35.71
R:ORTH	113	31	80	78.47	58.55	73.47
R:OTHER	40	95	281	29.63	12.46	23.23
R:PART	6	2	3	75.00	66.67	73.17
R:PREP	30	29	59	50.85	33.71	46.15
R:PRON	6	7	16	46.15	27.27	40.54
R:PUNCT	15	20	26	42.86	36.59	41.44
R:SPELL	82	70	32	53.95	71.93	56.79
R:VERB	11	16	58	40.74	15.94	31.07
R:VERB:FORM	50	31	22	61.73	69.44	63.13
R:VERB:INFL	4	0	0	100.00	100.00	100.00
R:VERB:SVA	52	23	28	69.33	65.00	68.42
R:VERB:TENSE	23	40	60	36.51	27.71	34.33
R:WO	7	14	16	33.33	30.43	32.71
U:ADJ	1	1	2	50.00	33.33	45.45
U:ADV	5	5	5	50.00	50.00	50.00
U:CONJ	1	1	4	50.00	20.00	38.46
U:CONTR	3	0	0	100.00	100.00	100.00
U:DET	50	22	60	69.44	45.45	62.81
U:NOUN	2	7	5	22.22	28.57	23.26
U:NOUN:POSS	6	1	0	85.71	100.00	88.24
U:OTHER	1	19	9	5.00	10.00	5.56
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	12	9	20	57.14	37.50	51.72
U:PRON	4	3	10	57.14	28.57	47.62
U:PUNCT	2	3	10	40.00	16.67	31.25
U:VERB	3	9	6	25.00	33.33	26.32
U:VERB:FORM	1	1	0	50.00	100.00	55.56
U:VERB:TENSE	3	5	4	37.50	42.86	38.46

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	271	132	258	67.25	51.23	63.29
R	774	282	761	73.30	50.42	67.20
U	117	71	128	62.23	47.76	58.68
UNK	9	0	41	100.00	18.00	52.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	8	1	9	88.89	47.06	75.47
ADJ:FORM	0	0	6	100.00	0.00	0.00
ADV	13	8	19	61.90	40.62	56.03
CONJ	6	6	7	50.00	46.15	49.18
CONTR	4	0	0	100.00	100.00	100.00
DET	143	67	139	68.10	50.71	63.73
MORPH	47	4	41	92.16	53.41	80.48
NOUN	20	19	38	51.28	34.48	46.73
NOUN:INFL	6	0	0	100.00	100.00	100.00
NOUN:NUM	76	35	41	68.47	64.96	67.74
NOUN:POSS	10	2	6	83.33	62.50	78.12
ORTH	138	21	65	86.79	67.98	82.24
OTHER	127	82	266	60.77	32.32	51.67
PART	10	0	5	100.00	66.67	90.91
PREP	81	37	103	68.64	44.02	61.74
PRON	33	14	48	70.21	40.74	61.34
PUNCT	126	56	126	69.23	50.00	64.29
SPELL	99	34	16	74.44	86.09	76.51
UNK	9	0	41	100.00	18.00	52.33
VERB	42	22	73	65.62	36.52	56.60
VERB:FORM	66	24	22	73.33	75.00	73.66
VERB:INFL	5	0	0	100.00	100.00	100.00
VERB:SVA	53	11	27	82.81	66.25	78.87
VERB:TENSE	43	31	72	58.11	37.39	52.31
WO	6	11	18	35.29	25.00	32.61

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	1	50.00	50.00	50.00
M:ADV	1	4	9	20.00	10.00	16.67
M:CONJ	5	5	2	50.00	71.43	53.19
M:DET	76	32	49	70.37	60.80	68.22
M:NOUN	0	3	3	0.00	0.00	0.00
M:NOUN:POSS	1	0	2	100.00	33.33	71.43
M:OTHER	12	11	24	52.17	33.33	46.88
M:PART	1	0	2	100.00	33.33	71.43
M:PREP	24	18	25	57.14	48.98	55.30
M:PRON	17	7	24	70.83	41.46	62.04
M:PUNCT	106	36	92	74.65	53.54	69.19
M:VERB	11	6	10	64.71	52.38	61.80
M:VERB:FORM	13	4	0	76.47	100.00	80.25
M:VERB:TENSE	3	5	15	37.50	16.67	30.00
R:ADJ	5	0	6	100.00	45.45	80.65
R:ADJ:FORM	0	0	6	100.00	0.00	0.00
R:ADV	7	1	5	87.50	58.33	79.55
R:CONJ	0	1	1	0.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	13	15	35	46.43	27.08	40.63
R:MORPH	47	4	41	92.16	53.41	80.48
R:NOUN	15	9	32	62.50	31.91	52.45
R:NOUN:INFL	6	0	0	100.00	100.00	100.00
R:NOUN:NUM	76	35	41	68.47	64.96	67.74
R:NOUN:POSS	3	1	4	75.00	42.86	65.22
R:ORTH	138	21	65	86.79	67.98	82.24
R:OTHER	110	52	234	67.90	31.98	55.44
R:PART	7	0	2	100.00	77.78	94.59
R:PREP	45	15	60	75.00	42.86	65.22
R:PRON	9	4	16	69.23	36.00	58.44
R:PUNCT	17	17	24	50.00	41.46	48.02
R:SPELL	99	34	16	74.44	86.09	76.51
R:VERB	25	9	55	73.53	31.25	57.87
R:VERB:FORM	52	19	22	73.24	70.27	72.63
R:VERB:INFL	5	0	0	100.00	100.00	100.00
R:VERB:SVA	53	11	27	82.81	66.25	78.87
R:VERB:TENSE	35	23	51	60.34	40.70	55.03
R:WO	6	11	18	35.29	25.00	32.61
U:ADJ	2	0	2	100.00	50.00	83.33
U:ADV	5	3	5	62.50	50.00	59.52
U:CONJ	1	0	4	100.00	20.00	55.56
U:CONTR	3	0	0	100.00	100.00	100.00
U:DET	54	20	55	72.97	49.54	66.67
U:NOUN	5	7	3	41.67	62.50	44.64
U:NOUN:POSS	6	1	0	85.71	100.00	88.24
U:OTHER	5	19	8	20.83	38.46	22.94
U:PART	2	0	1	100.00	66.67	90.91
U:PREP	12	4	18	75.00	40.00	63.83
U:PRON	7	3	8	70.00	46.67	63.64
U:PUNCT	3	3	10	50.00	23.08	40.54
U:VERB	6	7	8	46.15	42.86	45.45
U:VERB:FORM	1	1	0	50.00	100.00	55.56
U:VERB:TENSE	5	3	6	62.50	45.45	58.14
UNK	9	0	41	100.00	18.00	52.33

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	357	64	265	84.80	57.40	77.41
R	1020	218	905	82.39	52.99	74.16
U	149	62	168	70.62	47.00	64.17
UNK	23	0	65	100.00	26.14	63.89

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	9	0	10	100.00	47.37	81.82
ADJ:FORM	0	0	5	100.00	0.00	0.00
ADV	22	9	26	70.97	45.83	63.95
CONJ	7	1	8	87.50	46.67	74.47
CONTR	4	0	0	100.00	100.00	100.00
DET	167	35	143	82.67	53.87	74.69
MORPH	49	2	41	96.08	54.44	83.33
NOUN	33	13	43	71.74	43.42	63.46
NOUN:INFL	6	0	0	100.00	100.00	100.00
NOUN:NUM	81	24	38	77.14	68.07	75.14
NOUN:POSS	14	1	10	93.33	58.33	83.33
ORTH	169	17	63	90.86	72.84	86.58
OTHER	284	93	380	75.33	42.77	65.38
PART	6	0	6	100.00	50.00	83.33
PREP	93	18	114	83.78	44.93	71.43
PRON	40	8	44	83.33	47.62	72.46
PUNCT	185	30	140	86.05	56.92	78.06
SPELL	99	22	11	81.82	90.00	83.33
UNK	23	0	65	100.00	26.14	63.89
VERB	54	11	88	83.08	38.03	67.16
VERB:FORM	63	19	30	76.83	67.74	74.82
VERB:INFL	6	0	0	100.00	100.00	100.00
VERB:SVA	57	9	25	86.36	69.51	82.37
VERB:TENSE	58	25	89	69.88	39.46	60.54
WO	20	7	24	74.07	45.45	65.79

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	1	100.00	50.00	83.33
M:ADV	6	5	12	54.55	33.33	48.39
M:CONJ	6	1	5	85.71	54.55	76.92
M:DET	87	11	46	88.78	65.41	82.86
M:NOUN	1	2	4	33.33	20.00	29.41
M:NOUN:POSS	2	0	2	100.00	50.00	83.33
M:OTHER	23	7	25	76.67	47.92	68.45
M:PART	1	0	2	100.00	33.33	71.43
M:PREP	35	6	25	85.37	58.33	78.13
M:PRON	21	4	22	84.00	48.84	73.43
M:PUNCT	142	22	95	86.59	59.92	79.51
M:VERB	13	3	14	81.25	48.15	71.43
M:VERB:FORM	13	2	0	86.67	100.00	89.04
M:VERB:TENSE	6	1	12	85.71	33.33	65.22
R:ADJ	6	0	8	100.00	42.86	78.95
R:ADJ:FORM	0	0	5	100.00	0.00	0.00
R:ADV	7	1	6	87.50	53.85	77.78
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	17	11	32	60.71	34.69	52.80
R:MORPH	49	2	41	96.08	54.44	83.33
R:NOUN	26	7	31	78.79	45.61	68.78
R:NOUN:INFL	6	0	0	100.00	100.00	100.00
R:NOUN:NUM	81	24	38	77.14	68.07	75.14
R:NOUN:POSS	6	1	7	85.71	46.15	73.17
R:ORTH	169	17	63	90.86	72.84	86.58
R:OTHER	247	57	328	81.25	42.96	68.96
R:PART	3	0	4	100.00	42.86	78.95
R:PREP	45	10	69	81.82	39.47	67.37
R:PRON	11	3	14	78.57	44.00	67.90
R:PUNCT	33	6	32	84.62	50.77	74.66
R:SPELL	99	22	11	81.82	90.00	83.33
R:VERB	35	4	65	89.74	35.00	68.36
R:VERB:FORM	49	16	30	75.38	62.03	72.27
R:VERB:INFL	6	0	0	100.00	100.00	100.00
R:VERB:SVA	57	9	25	86.36	69.51	82.37
R:VERB:TENSE	47	21	72	69.12	39.50	60.10
R:WO	20	7	24	74.07	45.45	65.79
U:ADJ	2	0	1	100.00	66.67	90.91
U:ADV	9	3	8	75.00	52.94	69.23
U:CONJ	1	0	3	100.00	25.00	62.50
U:CONTR	3	0	0	100.00	100.00	100.00
U:DET	63	13	65	82.89	49.22	72.92
U:NOUN	6	4	8	60.00	42.86	55.56
U:NOUN:POSS	6	0	1	100.00	85.71	96.77
U:OTHER	14	29	27	32.56	34.15	32.86
U:PART	2	0	0	100.00	100.00	100.00
U:PREP	13	2	20	86.67	39.39	69.89
U:PRON	8	1	8	88.89	50.00	76.92
U:PUNCT	10	2	13	83.33	43.48	70.42
U:VERB	6	4	9	60.00	40.00	54.55
U:VERB:FORM	1	1	0	50.00	100.00	55.56
U:VERB:TENSE	5	3	5	62.50	50.00	59.52
UNK	23	0	65	100.00	26.14	63.89

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	594	637	920	48.25	39.23	46.13
Span-level detection	768	465	862	62.29	47.12	58.52
Token-level detection	1002	455	1116	68.77	47.31	63.05

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	192	138	203	58.18	48.61	55.98
R	332	394	627	45.73	34.62	42.97
U	70	105	90	40.00	43.75	40.70

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	6	11	33.33	21.43	30.00
ADJ:FORM	2	2	0	50.00	100.00	55.56
ADV	7	12	15	36.84	31.82	35.71
CONJ	4	3	6	57.14	40.00	52.63
CONTR	3	0	1	100.00	75.00	93.75
DET	85	83	121	50.60	41.26	48.41
MORPH	13	17	23	43.33	36.11	41.67
NOUN	5	33	32	13.16	13.51	13.23
NOUN:INFL	0	2	0	0.00	100.00	0.00
NOUN:NUM	38	39	28	49.35	57.58	50.80
NOUN:POSS	6	2	8	75.00	42.86	65.22
ORTH	40	18	38	68.97	51.28	64.52
OTHER	17	106	199	13.82	7.87	12.01
PART	2	5	5	28.57	28.57	28.57
PREP	66	61	87	51.97	43.14	49.92
PRON	15	16	26	48.39	36.59	45.45
PUNCT	120	61	101	66.30	54.30	63.49
SPELL	49	51	22	49.00	69.01	52.02
VERB	15	40	66	27.27	18.52	24.92
VERB:FORM	34	25	32	57.63	51.52	56.29
VERB:SVA	35	8	14	81.40	71.43	79.19
VERB:TENSE	30	39	52	43.48	36.59	41.90
WO	5	8	33	38.46	13.16	27.78

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	3	100.00	0.00	0.00
M:ADV	1	2	7	33.33	12.50	25.00
M:CONJ	4	3	5	57.14	44.44	54.05
M:DET	56	38	53	59.57	51.38	57.73
M:NOUN	0	3	3	0.00	0.00	0.00
M:NOUN:POSS	2	1	3	66.67	40.00	58.82
M:OTHER	2	9	11	18.18	15.38	17.54
M:PART	0	1	2	0.00	0.00	0.00
M:PREP	8	18	18	30.77	30.77	30.77
M:PRON	10	9	13	52.63	43.48	50.51
M:PUNCT	100	35	64	74.07	60.98	71.02
M:VERB	4	9	8	30.77	33.33	31.25
M:VERB:FORM	0	2	1	0.00	0.00	0.00
M:VERB:TENSE	5	8	12	38.46	29.41	36.23
R:ADJ	2	2	8	50.00	20.00	38.46
R:ADJ:FORM	2	2	0	50.00	100.00	55.56
R:ADV	3	3	4	50.00	42.86	48.39
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	7	18	40	28.00	14.89	23.81
R:MORPH	13	17	23	43.33	36.11	41.67
R:NOUN	4	20	27	16.67	12.90	15.75
R:NOUN:INFL	0	2	0	0.00	100.00	0.00
R:NOUN:NUM	38	39	28	49.35	57.58	50.80
R:NOUN:POSS	2	0	2	100.00	50.00	83.33
R:ORTH	40	18	38	68.97	51.28	64.52
R:OTHER	10	71	178	12.35	5.32	9.77
R:PART	2	4	2	33.33	50.00	35.71
R:PREP	40	36	57	52.63	41.24	49.88
R:PRON	2	4	9	33.33	18.18	28.57
R:PUNCT	18	21	26	46.15	40.91	45.00
R:SPELL	49	51	22	49.00	69.01	52.02
R:VERB	9	20	50	31.03	15.25	25.71
R:VERB:FORM	31	23	29	57.41	51.67	56.16
R:VERB:SVA	35	8	14	81.40	71.43	79.19
R:VERB:TENSE	19	27	36	41.30	34.55	39.75
R:WO	5	8	33	38.46	13.16	27.78
U:ADJ	1	4	0	20.00	100.00	23.81
U:ADV	3	7	4	30.00	42.86	31.91
U:CONTR	2	0	1	100.00	66.67	90.91
U:DET	22	27	28	44.90	44.00	44.72
U:NOUN	1	10	2	9.09	33.33	10.64
U:NOUN:POSS	2	1	3	66.67	40.00	58.82
U:OTHER	5	26	10	16.13	33.33	17.99
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	18	7	12	72.00	60.00	69.23
U:PRON	3	3	4	50.00	42.86	48.39
U:PUNCT	2	5	11	28.57	15.38	24.39
U:VERB	2	11	8	15.38	20.00	16.13
U:VERB:FORM	3	0	2	100.00	60.00	88.24
U:VERB:TENSE	6	4	4	60.00	60.00	60.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	230	103	200	69.07	53.49	65.27
R	455	273	561	62.50	44.78	57.92
U	77	89	91	46.39	45.83	46.27
UNK	6	0	10	100.00	37.50	75.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	7	5	10	58.33	41.18	53.85
ADJ:FORM	2	2	0	50.00	100.00	55.56
ADV	11	12	15	47.83	42.31	46.61
CONJ	4	3	8	57.14	33.33	50.00
CONTR	3	0	1	100.00	75.00	93.75
DET	97	66	116	59.51	45.54	56.07
MORPH	13	10	21	56.52	38.24	51.59
NOUN	17	21	26	44.74	39.53	43.59
NOUN:NUM	39	30	26	56.52	60.00	57.18
NOUN:POSS	7	1	6	87.50	53.85	77.78
ORTH	58	13	43	81.69	57.43	75.32
OTHER	59	67	178	46.83	24.89	39.81
PART	4	4	7	50.00	36.36	46.51
PREP	78	47	88	62.40	46.99	58.56
PRON	22	13	27	62.86	44.90	58.20
PUNCT	130	52	96	71.43	57.52	68.13
SPELL	62	32	9	65.96	87.32	69.35
UNK	6	0	10	100.00	37.50	75.00
VERB	35	26	55	57.38	38.89	52.40
VERB:FORM	37	17	31	68.52	54.41	65.14
VERB:SVA	36	8	13	81.82	73.47	80.00
VERB:TENSE	36	30	47	54.55	43.37	51.87
WO	5	6	29	45.45	14.71	32.05

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	4	100.00	0.00	0.00
M:ADV	1	2	8	33.33	11.11	23.81
M:CONJ	4	3	6	57.14	40.00	52.63
M:DET	65	27	48	70.65	57.52	67.57
M:NOUN	1	1	2	50.00	33.33	45.45
M:NOUN:POSS	2	1	3	66.67	40.00	58.82
M:OTHER	5	8	13	38.46	27.78	35.71
M:PART	1	0	3	100.00	25.00	62.50
M:PREP	14	14	18	50.00	43.75	48.61
M:PRON	16	8	13	66.67	55.17	64.00
M:PUNCT	107	25	65	81.06	62.21	76.43
M:VERB	7	7	4	50.00	63.64	52.24
M:VERB:FORM	0	2	1	0.00	0.00	0.00
M:VERB:TENSE	7	5	12	58.33	36.84	52.24
R:ADJ	6	2	6	75.00	50.00	68.18
R:ADJ:FORM	2	2	0	50.00	100.00	55.56
R:ADV	5	3	2	62.50	71.43	64.10
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	10	17	39	37.04	20.41	31.85
R:MORPH	13	10	21	56.52	38.24	51.59
R:NOUN	14	10	23	58.33	37.84	52.63
R:NOUN:NUM	39	30	26	56.52	60.00	57.18
R:NOUN:POSS	3	0	1	100.00	75.00	93.75
R:ORTH	58	13	43	81.69	57.43	75.32
R:OTHER	48	38	154	55.81	23.76	43.96
R:PART	3	4	3	42.86	50.00	44.12
R:PREP	46	26	58	63.89	44.23	58.67
R:PRON	3	2	9	60.00	25.00	46.88
R:PUNCT	19	22	21	46.34	47.50	46.57
R:SPELL	62	32	9	65.96	87.32	69.35
R:VERB	25	11	43	69.44	36.76	58.96
R:VERB:FORM	34	15	28	69.39	54.84	65.89
R:VERB:SVA	36	8	13	81.82	73.47	80.00
R:VERB:TENSE	23	22	31	51.11	42.59	49.15
R:WO	5	6	29	45.45	14.71	32.05
U:ADJ	1	3	0	25.00	100.00	29.41
U:ADV	5	7	5	41.67	50.00	43.10
U:CONTR	2	0	1	100.00	66.67	90.91
U:DET	22	22	29	50.00	43.14	48.46
U:NOUN	2	10	1	16.67	66.67	19.61
U:NOUN:POSS	2	0	2	100.00	50.00	83.33
U:OTHER	6	21	11	22.22	35.29	24.00
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	18	7	12	72.00	60.00	69.23
U:PRON	3	3	5	50.00	37.50	46.88
U:PUNCT	4	5	10	44.44	28.57	40.00
U:VERB	3	8	8	27.27	27.27	27.27
U:VERB:FORM	3	0	2	100.00	60.00	88.24
U:VERB:TENSE	6	3	4	66.67	60.00	65.22
UNK	6	0	10	100.00	37.50	75.00

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	281	66	220	80.98	56.09	74.38
R	621	247	721	71.54	46.27	64.50
U	90	142	164	38.79	35.43	38.07
UNK	10	0	11	100.00	47.62	81.97

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	7	3	9	70.00	43.75	62.50
ADJ:FORM	2	2	1	50.00	66.67	52.63
ADV	11	6	16	64.71	40.74	57.89
CONJ	7	1	9	87.50	43.75	72.92
CONTR	2	0	1	100.00	66.67	90.91
DET	113	50	123	69.33	47.88	63.63
MORPH	16	9	20	64.00	44.44	58.82
NOUN	19	19	29	50.00	39.58	47.50
NOUN:NUM	43	19	24	69.35	64.18	68.25
NOUN:POSS	10	1	6	90.91	62.50	83.33
ORTH	87	11	51	88.78	63.04	82.08
OTHER	136	140	316	49.28	30.09	43.70
PART	3	3	7	50.00	30.00	44.12
PREP	88	37	98	70.40	47.31	64.14
PRON	27	8	30	77.14	47.37	68.53
PUNCT	161	42	102	79.31	61.22	74.88
SPELL	65	30	7	68.42	90.28	71.90
UNK	10	0	11	100.00	47.62	81.97
VERB	45	17	83	72.58	35.16	59.84
VERB:FORM	42	16	30	72.41	58.33	69.08
VERB:SVA	35	7	13	83.33	72.92	81.02
VERB:TENSE	40	26	69	60.61	36.70	53.62
WO	33	8	61	80.49	35.11	63.95

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	3	100.00	0.00	0.00
M:ADV	4	1	7	80.00	36.36	64.52
M:CONJ	6	1	5	85.71	54.55	76.92
M:DET	70	14	54	83.33	56.45	76.09
M:NOUN	2	1	4	66.67	33.33	55.56
M:NOUN:POSS	3	1	3	75.00	50.00	68.18
M:OTHER	10	6	12	62.50	45.45	58.14
M:PART	1	0	2	100.00	33.33	71.43
M:PREP	17	12	24	58.62	41.46	54.14
M:PRON	18	4	13	81.82	58.06	75.63
M:PUNCT	128	18	68	87.67	65.31	82.05
M:VERB	11	4	9	73.33	55.00	68.75
M:VERB:FORM	2	2	1	50.00	66.67	52.63
M:VERB:TENSE	9	2	15	81.82	37.50	66.18
R:ADJ	7	1	6	87.50	53.85	77.78
R:ADJ:FORM	2	2	1	50.00	66.67	52.63
R:ADV	4	2	4	66.67	50.00	62.50
R:CONJ	0	0	4	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	18	14	36	56.25	33.33	49.45
R:MORPH	16	9	20	64.00	44.44	58.82
R:NOUN	16	10	22	61.54	42.11	56.34
R:NOUN:NUM	43	19	24	69.35	64.18	68.25
R:NOUN:POSS	4	0	0	100.00	100.00	100.00
R:ORTH	87	11	51	88.78	63.04	82.08
R:OTHER	111	45	248	71.15	30.92	56.46
R:PART	2	3	4	40.00	33.33	38.46
R:PREP	51	20	58	71.83	46.79	64.89
R:PRON	4	2	11	66.67	26.67	51.28
R:PUNCT	28	19	21	59.57	57.14	59.07
R:SPELL	65	30	7	68.42	90.28	71.90
R:VERB	31	10	58	75.61	34.83	61.26
R:VERB:FORM	37	14	27	72.55	57.81	69.03
R:VERB:SVA	35	7	13	83.33	72.92	81.02
R:VERB:TENSE	26	21	45	55.32	36.62	50.19
R:WO	33	8	61	80.49	35.11	63.95
U:ADJ	0	2	0	0.00	100.00	0.00
U:ADV	3	3	5	50.00	37.50	46.88
U:CONJ	1	0	0	100.00	100.00	100.00
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	25	22	33	53.19	43.10	50.81
U:NOUN	1	8	3	11.11	25.00	12.50
U:NOUN:POSS	3	0	3	100.00	50.00	83.33
U:OTHER	15	89	56	14.42	21.13	15.40
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	20	5	16	80.00	55.56	73.53
U:PRON	5	2	6	71.43	45.45	64.10
U:PUNCT	5	5	13	50.00	27.78	43.10
U:VERB	3	3	16	50.00	15.79	34.88
U:VERB:FORM	3	0	2	100.00	60.00	88.24
U:VERB:TENSE	5	3	9	62.50	35.71	54.35
UNK	10	0	11	100.00	47.62	81.97

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	274	323	299	45.90	47.82	46.27
Span-level detection	331	267	293	55.35	53.04	54.87
Token-level detection	415	262	363	61.30	53.34	59.52

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	78	61	77	56.12	50.32	54.85
R	155	216	188	41.78	45.19	42.42
U	41	46	34	47.13	54.67	48.46

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	6	4	14.29	20.00	15.15
ADJ:FORM	0	1	2	0.00	0.00	0.00
ADV	3	6	3	33.33	50.00	35.71
CONJ	0	5	4	0.00	0.00	0.00
CONTR	2	1	1	66.67	66.67	66.67
DET	53	37	46	58.89	53.54	57.73
MORPH	13	6	9	68.42	59.09	66.33
NOUN	2	13	6	13.33	25.00	14.71
NOUN:INFL	1	1	0	50.00	100.00	55.56
NOUN:NUM	19	17	15	52.78	55.88	53.37
NOUN:POSS	3	1	4	75.00	42.86	65.22
ORTH	23	6	18	79.31	56.10	73.25
OTHER	14	61	49	18.67	22.22	19.28
PART	1	2	2	33.33	33.33	33.33
PREP	30	28	35	51.72	46.15	50.51
PRON	4	7	7	36.36	36.36	36.36
PUNCT	50	42	28	54.35	64.10	56.05
SPELL	22	24	16	47.83	57.89	49.55
VERB	2	17	10	10.53	16.67	11.36
VERB:FORM	9	15	5	37.50	64.29	40.91
VERB:SVA	8	6	2	57.14	80.00	60.61
VERB:TENSE	12	14	21	46.15	36.36	43.80
WO	2	7	12	22.22	14.29	20.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	1	0.00	0.00	0.00
M:ADV	1	2	0	33.33	100.00	38.46
M:CONJ	0	5	2	0.00	0.00	0.00
M:DET	25	12	22	67.57	53.19	64.10
M:NOUN	0	0	2	100.00	0.00	0.00
M:OTHER	0	8	7	0.00	0.00	0.00
M:PREP	5	7	12	41.67	29.41	38.46
M:PRON	2	3	4	40.00	33.33	38.46
M:PUNCT	40	21	22	65.57	64.52	65.36
M:VERB	1	2	1	33.33	50.00	35.71
M:VERB:FORM	3	0	0	100.00	100.00	100.00
M:VERB:TENSE	1	0	4	100.00	20.00	55.56
R:ADJ	1	2	2	33.33	33.33	33.33
R:ADJ:FORM	0	1	2	0.00	0.00	0.00
R:ADV	0	0	1	100.00	0.00	0.00
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	8	12	6	40.00	57.14	42.55
R:MORPH	13	6	9	68.42	59.09	66.33
R:NOUN	2	11	4	15.38	33.33	17.24
R:NOUN:INFL	1	1	0	50.00	100.00	55.56
R:NOUN:NUM	19	17	15	52.78	55.88	53.37
R:NOUN:POSS	1	1	4	50.00	20.00	38.46
R:ORTH	23	6	18	79.31	56.10	73.25
R:OTHER	13	43	41	23.21	24.07	23.38
R:PART	0	2	2	0.00	0.00	0.00
R:PREP	21	15	18	58.33	53.85	57.38
R:PRON	1	4	2	20.00	33.33	21.74
R:PUNCT	7	17	3	29.17	70.00	33.02
R:SPELL	22	24	16	47.83	57.89	49.55
R:VERB	1	12	8	7.69	11.11	8.20
R:VERB:FORM	6	14	5	30.00	54.55	32.97
R:VERB:SVA	8	6	2	57.14	80.00	60.61
R:VERB:TENSE	6	14	15	30.00	28.57	29.70
R:WO	2	7	12	22.22	14.29	20.00
U:ADJ	0	3	1	0.00	0.00	0.00
U:ADV	2	4	2	33.33	50.00	35.71
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	20	13	18	60.61	52.63	58.82
U:NOUN	0	2	0	0.00	100.00	0.00
U:NOUN:POSS	2	0	0	100.00	100.00	100.00
U:OTHER	1	10	1	9.09	50.00	10.87
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	4	6	5	40.00	44.44	40.82
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	3	4	3	42.86	50.00	44.12
U:VERB	0	3	1	0.00	0.00	0.00
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	5	0	2	100.00	71.43	92.59

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	91	49	81	65.00	52.91	62.16
R	196	175	170	52.83	53.55	52.97
U	44	43	37	50.57	54.32	51.28
UNK	0	0	5	100.00	0.00	0.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	3	3	40.00	40.00	40.00
ADJ:FORM	0	1	2	0.00	0.00	0.00
ADV	2	6	3	25.00	40.00	27.03
CONJ	0	4	5	0.00	0.00	0.00
CONTR	2	1	1	66.67	66.67	66.67
DET	57	31	47	64.77	54.81	62.50
MORPH	13	4	10	76.47	56.52	71.43
NOUN	5	10	7	33.33	41.67	34.72
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	21	17	12	55.26	63.64	56.76
NOUN:POSS	4	1	3	80.00	57.14	74.07
ORTH	29	4	15	87.88	65.91	82.39
OTHER	25	47	49	34.72	33.78	34.53
PART	1	2	2	33.33	33.33	33.33
PREP	35	23	33	60.34	51.47	58.33
PRON	6	6	6	50.00	50.00	50.00
PUNCT	55	40	32	57.89	63.22	58.89
SPELL	32	17	7	65.31	82.05	68.09
UNK	0	0	5	100.00	0.00	0.00
VERB	5	14	11	26.32	31.25	27.17
VERB:FORM	9	13	6	40.91	60.00	43.69
VERB:SVA	10	5	2	66.67	83.33	69.44
VERB:TENSE	14	12	22	53.85	38.89	50.00
WO	3	6	10	33.33	23.08	30.61

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	1	0.00	0.00	0.00
M:ADV	0	2	0	0.00	100.00	0.00
M:CONJ	0	4	3	0.00	0.00	0.00
M:DET	26	9	22	74.29	54.17	69.15
M:NOUN	1	0	2	100.00	33.33	71.43
M:OTHER	4	4	7	50.00	36.36	46.51
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	7	6	12	53.85	36.84	49.30
M:PRON	4	2	3	66.67	57.14	64.52
M:PUNCT	43	21	24	67.19	64.18	66.56
M:VERB	1	0	1	100.00	50.00	83.33
M:VERB:FORM	3	0	0	100.00	100.00	100.00
M:VERB:TENSE	2	0	5	100.00	28.57	66.67
R:ADJ	2	0	1	100.00	66.67	90.91
R:ADJ:FORM	0	1	2	0.00	0.00	0.00
R:ADV	0	0	1	100.00	0.00	0.00
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	9	10	6	47.37	60.00	49.45
R:MORPH	13	4	10	76.47	56.52	71.43
R:NOUN	4	8	5	33.33	44.44	35.09
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	21	17	12	55.26	63.64	56.76
R:NOUN:POSS	2	1	3	66.67	40.00	58.82
R:ORTH	29	4	15	87.88	65.91	82.39
R:OTHER	19	33	41	36.54	31.67	35.45
R:PART	0	2	1	0.00	0.00	0.00
R:PREP	25	11	15	69.44	62.50	67.93
R:PRON	1	4	2	20.00	33.33	21.74
R:PUNCT	8	16	4	33.33	66.67	37.04
R:SPELL	32	17	7	65.31	82.05	68.09
R:VERB	4	11	9	26.67	30.77	27.40
R:VERB:FORM	6	12	6	33.33	50.00	35.71
R:VERB:SVA	10	5	2	66.67	83.33	69.44
R:VERB:TENSE	7	12	15	36.84	31.82	35.71
R:WO	3	6	10	33.33	23.08	30.61
U:ADJ	0	2	1	0.00	0.00	0.00
U:ADV	2	4	2	33.33	50.00	35.71
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	22	12	19	64.71	53.66	62.15
U:NOUN	0	2	0	0.00	100.00	0.00
U:NOUN:POSS	2	0	0	100.00	100.00	100.00
U:OTHER	2	10	1	16.67	66.67	19.61
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	3	6	6	33.33	33.33	33.33
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	4	3	4	57.14	50.00	55.56
U:VERB	0	3	1	0.00	0.00	0.00
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	5	0	2	100.00	71.43	92.59
UNK	0	0	5	100.00	0.00	0.00

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	109	39	85	73.65	56.19	69.34
R	257	175	224	59.49	53.43	58.17
U	47	48	48	49.47	49.47	49.47
UNK	2	0	6	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	3	5	25.00	16.67	22.73
ADJ:FORM	0	1	3	0.00	0.00	0.00
ADV	2	3	6	40.00	25.00	35.71
CONJ	1	3	3	25.00	25.00	25.00
CONTR	2	1	2	66.67	50.00	62.50
DET	59	29	49	67.05	54.63	64.13
MORPH	14	4	11	77.78	56.00	72.16
NOUN	4	7	10	36.36	28.57	34.48
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	20	16	14	55.56	58.82	56.18
NOUN:POSS	6	1	4	85.71	60.00	78.95
ORTH	42	4	15	91.30	73.68	87.14
OTHER	54	55	90	49.54	37.50	46.55
PART	2	2	1	50.00	66.67	52.63
PREP	39	19	33	67.24	54.17	64.14
PRON	8	6	5	57.14	61.54	57.97
PUNCT	71	43	37	62.28	65.74	62.94
SPELL	35	16	5	68.63	87.50	71.72
UNK	2	0	6	100.00	25.00	62.50
VERB	8	14	13	36.36	38.10	36.70
VERB:FORM	11	10	11	52.38	50.00	51.89
VERB:SVA	9	5	2	64.29	81.82	67.16
VERB:TENSE	16	14	22	53.33	42.11	50.63
WO	8	6	16	57.14	33.33	50.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	2	0.00	0.00	0.00
M:ADV	0	1	0	0.00	100.00	0.00
M:CONJ	1	3	1	25.00	50.00	27.78
M:DET	30	9	21	76.92	58.82	72.46
M:NOUN	1	0	2	100.00	33.33	71.43
M:NOUN:POSS	1	0	0	100.00	100.00	100.00
M:OTHER	5	1	8	83.33	38.46	67.57
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	10	4	13	71.43	43.48	63.29
M:PRON	5	2	3	71.43	62.50	69.44
M:PUNCT	48	18	29	72.73	62.34	70.38
M:VERB	1	0	2	100.00	33.33	71.43
M:VERB:FORM	3	0	0	100.00	100.00	100.00
M:VERB:TENSE	4	0	3	100.00	57.14	86.96
R:ADJ	1	0	1	100.00	50.00	83.33
R:ADJ:FORM	0	1	3	0.00	0.00	0.00
R:ADV	0	0	2	100.00	0.00	0.00
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	8	10	7	44.44	53.33	45.98
R:MORPH	14	4	11	77.78	56.00	72.16
R:NOUN	3	6	7	33.33	30.00	32.61
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	20	16	14	55.56	58.82	56.18
R:NOUN:POSS	3	1	4	75.00	42.86	65.22
R:ORTH	42	4	15	91.30	73.68	87.14
R:OTHER	46	35	75	56.79	38.02	51.69
R:PART	1	2	0	33.33	100.00	38.46
R:PREP	26	10	14	72.22	65.00	70.65
R:PRON	2	4	1	33.33	66.67	37.04
R:PUNCT	16	22	5	42.11	76.19	46.24
R:SPELL	35	16	5	68.63	87.50	71.72
R:VERB	6	10	10	37.50	37.50	37.50
R:VERB:FORM	8	9	11	47.06	42.11	45.98
R:VERB:SVA	9	5	2	64.29	81.82	67.16
R:VERB:TENSE	8	13	18	38.10	30.77	36.36
R:WO	8	6	16	57.14	33.33	50.00
U:ADJ	0	2	2	0.00	0.00	0.00
U:ADV	2	2	4	50.00	33.33	45.45
U:CONTR	2	0	1	100.00	66.67	90.91
U:DET	21	10	21	67.74	50.00	63.25
U:NOUN	0	1	1	0.00	0.00	0.00
U:NOUN:POSS	2	0	0	100.00	100.00	100.00
U:OTHER	3	19	7	13.64	30.00	15.31
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	3	5	6	37.50	33.33	36.59
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	7	3	3	70.00	70.00	70.00
U:VERB	1	4	1	20.00	50.00	22.73
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	4	1	1	80.00	80.00	80.00
UNK	2	0	6	100.00	25.00	62.50

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	220	469	262	31.93	45.64	33.97
Span-level detection	302	387	233	43.83	56.45	45.88
Token-level detection	368	399	272	47.98	57.50	49.62

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	65	84	53	43.62	55.08	45.52
R	143	290	192	33.03	42.69	34.59
U	12	95	17	11.21	41.38	13.13

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	8	4	0.00	0.00	0.00
ADV	0	14	1	0.00	0.00	0.00
CONJ	0	1	1	0.00	0.00	0.00
DET	11	67	3	14.10	78.57	16.87
MORPH	3	17	4	15.00	42.86	17.24
NOUN	2	27	9	6.90	18.18	7.87
NOUN:INFL	5	5	6	50.00	45.45	49.02
NOUN:NUM	7	30	10	18.92	41.18	21.21
NOUN:POSS	5	2	13	71.43	27.78	54.35
ORTH	25	10	29	71.43	46.30	64.43
OTHER	10	52	42	16.13	19.23	16.67
PART	1	4	0	20.00	100.00	23.81
PREP	6	59	13	9.23	31.58	10.75
PRON	1	7	5	12.50	16.67	13.16
PUNCT	65	36	60	64.36	52.00	61.44
SPELL	59	35	38	62.77	60.82	62.37
VERB	4	23	9	14.81	30.77	16.53
VERB:FORM	3	14	3	17.65	50.00	20.27
VERB:INFL	3	0	2	100.00	60.00	88.24
VERB:SVA	6	15	4	28.57	60.00	31.91
VERB:TENSE	2	36	6	5.26	25.00	6.25
WO	2	7	0	22.22	100.00	26.32

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	0	0.00	100.00	0.00
M:ADV	0	4	1	0.00	0.00	0.00
M:CONJ	0	1	1	0.00	0.00	0.00
M:DET	6	25	1	19.35	85.71	22.90
M:NOUN	0	3	2	0.00	0.00	0.00
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:OTHER	0	3	0	0.00	100.00	0.00
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	1	12	1	7.69	50.00	9.26
M:PRON	1	4	2	20.00	33.33	21.74
M:PUNCT	56	19	37	74.67	60.22	71.25
M:VERB	1	5	3	16.67	25.00	17.86
M:VERB:FORM	0	1	0	0.00	100.00	0.00
M:VERB:TENSE	0	4	0	0.00	100.00	0.00
R:ADJ	0	4	4	0.00	0.00	0.00
R:ADV	0	2	0	0.00	100.00	0.00
R:DET	1	14	1	6.67	50.00	8.06
R:MORPH	3	17	4	15.00	42.86	17.24
R:NOUN	2	16	7	11.11	22.22	12.35
R:NOUN:INFL	5	5	6	50.00	45.45	49.02
R:NOUN:NUM	7	30	10	18.92	41.18	21.21
R:NOUN:POSS	5	2	8	71.43	38.46	60.98
R:ORTH	25	10	29	71.43	46.30	64.43
R:OTHER	10	37	41	21.28	19.61	20.92
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	5	29	10	14.71	33.33	16.56
R:PRON	0	3	3	0.00	0.00	0.00
R:PUNCT	4	12	13	25.00	23.53	24.69
R:SPELL	59	35	38	62.77	60.82	62.37
R:VERB	2	13	5	13.33	28.57	14.93
R:VERB:FORM	3	12	2	20.00	60.00	23.08
R:VERB:INFL	3	0	2	100.00	60.00	88.24
R:VERB:SVA	6	15	4	28.57	60.00	31.91
R:VERB:TENSE	1	26	5	3.70	16.67	4.39
R:WO	2	7	0	22.22	100.00	26.32
U:ADJ	0	2	0	0.00	100.00	0.00
U:ADV	0	8	0	0.00	100.00	0.00
U:DET	4	28	1	12.50	80.00	15.04
U:NOUN	0	8	0	0.00	100.00	0.00
U:OTHER	0	12	1	0.00	0.00	0.00
U:PART	1	2	0	33.33	100.00	38.46
U:PREP	0	18	2	0.00	0.00	0.00
U:PUNCT	5	5	10	50.00	33.33	45.45
U:VERB	1	5	1	16.67	50.00	19.23
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	1	6	1	14.29	50.00	16.67

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	72	77	58	48.32	55.38	49.59
R	213	221	155	49.08	57.88	50.62
U	15	89	15	14.42	50.00	16.82
UNK	2	0	5	100.00	28.57	66.67

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	7	4	0.00	0.00	0.00
ADV	0	14	1	0.00	0.00	0.00
CONJ	0	1	1	0.00	0.00	0.00
DET	15	63	4	19.23	78.95	22.66
MORPH	3	16	4	15.79	42.86	18.07
NOUN	3	21	8	12.50	27.27	14.02
NOUN:INFL	10	1	1	90.91	90.91	90.91
NOUN:NUM	8	30	10	21.05	44.44	23.53
NOUN:POSS	8	1	11	88.89	42.11	72.73
ORTH	32	10	31	76.19	50.79	69.26
OTHER	20	44	41	31.25	32.79	31.55
PART	1	4	0	20.00	100.00	23.81
PREP	14	48	9	22.58	60.87	25.83
PRON	1	7	5	12.50	16.67	13.16
PUNCT	71	34	65	67.62	52.21	63.85
SPELL	87	2	13	97.75	87.00	95.39
UNK	2	0	5	100.00	28.57	66.67
VERB	5	20	9	20.00	35.71	21.93
VERB:FORM	4	11	3	26.67	57.14	29.85
VERB:INFL	3	0	2	100.00	60.00	88.24
VERB:SVA	6	13	4	31.58	60.00	34.88
VERB:TENSE	7	33	2	17.50	77.78	20.71
WO	2	7	0	22.22	100.00	26.32

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	0	0.00	100.00	0.00
M:ADV	0	4	1	0.00	0.00	0.00
M:CONJ	0	1	1	0.00	0.00	0.00
M:DET	8	23	2	25.81	80.00	29.85
M:NOUN	0	3	2	0.00	0.00	0.00
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:OTHER	0	3	0	0.00	100.00	0.00
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	1	9	1	10.00	50.00	11.90
M:PRON	1	4	2	20.00	33.33	21.74
M:PUNCT	61	18	41	77.22	59.80	72.97
M:VERB	1	4	3	20.00	25.00	20.83
M:VERB:FORM	0	1	0	0.00	100.00	0.00
M:VERB:TENSE	0	4	0	0.00	100.00	0.00
R:ADJ	0	3	4	0.00	0.00	0.00
R:ADV	0	2	0	0.00	100.00	0.00
R:DET	1	12	1	7.69	50.00	9.26
R:MORPH	3	16	4	15.79	42.86	18.07
R:NOUN	3	11	6	21.43	33.33	23.08
R:NOUN:INFL	10	1	1	90.91	90.91	90.91
R:NOUN:NUM	8	30	10	21.05	44.44	23.53
R:NOUN:POSS	8	1	6	88.89	57.14	80.00
R:ORTH	32	10	31	76.19	50.79	69.26
R:OTHER	20	29	39	40.82	33.90	39.22
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	13	25	7	34.21	65.00	37.79
R:PRON	0	3	3	0.00	0.00	0.00
R:PUNCT	4	11	14	26.67	22.22	25.64
R:SPELL	87	2	13	97.75	87.00	95.39
R:VERB	4	11	5	26.67	44.44	28.99
R:VERB:FORM	4	9	3	30.77	57.14	33.90
R:VERB:INFL	3	0	2	100.00	60.00	88.24
R:VERB:SVA	6	13	4	31.58	60.00	34.88
R:VERB:TENSE	5	24	2	17.24	71.43	20.33
R:WO	2	7	0	22.22	100.00	26.32
U:ADJ	0	2	0	0.00	100.00	0.00
U:ADV	0	8	0	0.00	100.00	0.00
U:DET	6	28	1	17.65	85.71	20.98
U:NOUN	0	7	0	0.00	100.00	0.00
U:OTHER	0	12	2	0.00	0.00	0.00
U:PART	1	2	0	33.33	100.00	38.46
U:PREP	0	14	1	0.00	0.00	0.00
U:PUNCT	6	5	10	54.55	37.50	50.00
U:VERB	0	5	1	0.00	0.00	0.00
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	2	5	0	28.57	100.00	33.33
UNK	2	0	5	100.00	28.57	66.67

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	87	67	68	56.49	56.13	56.42
R	256	239	181	51.72	58.58	52.96
U	22	93	21	19.13	51.16	21.87
UNK	3	0	2	100.00	60.00	88.24

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	6	4	0.00	0.00	0.00
ADJ:FORM	1	0	0	100.00	100.00	100.00
ADV	1	12	3	7.69	25.00	8.93
CONJ	1	1	1	50.00	50.00	50.00
CONTR	0	0	2	100.00	0.00	0.00
DET	15	51	5	22.73	75.00	26.41
MORPH	3	16	4	15.79	42.86	18.07
NOUN	3	21	10	12.50	23.08	13.76
NOUN:INFL	10	1	1	90.91	90.91	90.91
NOUN:NUM	10	29	10	25.64	50.00	28.41
NOUN:POSS	11	1	12	91.67	47.83	77.46
ORTH	45	10	42	81.82	51.72	73.29
OTHER	36	71	58	33.64	38.30	34.48
PART	0	3	0	0.00	100.00	0.00
PREP	17	46	10	26.98	62.96	30.47
PRON	3	7	4	30.00	42.86	31.91
PUNCT	88	29	75	75.21	53.99	69.73
SPELL	91	2	9	97.85	91.00	96.40
UNK	3	0	2	100.00	60.00	88.24
VERB	5	21	8	19.23	38.46	21.37
VERB:FORM	4	12	3	25.00	57.14	28.17
VERB:INFL	3	0	2	100.00	60.00	88.24
VERB:SVA	6	12	4	33.33	60.00	36.59
VERB:TENSE	9	38	2	19.15	81.82	22.61
WO	3	10	1	23.08	75.00	26.79

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	0	0.00	100.00	0.00
M:ADV	0	4	2	0.00	0.00	0.00
M:CONJ	1	1	1	50.00	50.00	50.00
M:DET	7	17	2	29.17	77.78	33.33
M:NOUN	0	3	3	0.00	0.00	0.00
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:OTHER	0	1	1	0.00	0.00	0.00
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	3	9	1	25.00	75.00	28.85
M:PRON	2	4	1	33.33	66.67	37.04
M:PUNCT	72	17	50	80.90	59.02	75.31
M:VERB	1	4	2	20.00	33.33	21.74
M:VERB:FORM	0	1	0	0.00	100.00	0.00
M:VERB:TENSE	1	4	0	20.00	100.00	23.81
R:ADJ	0	3	3	0.00	0.00	0.00
R:ADJ:FORM	1	0	0	100.00	100.00	100.00
R:ADV	0	2	0	0.00	100.00	0.00
R:CONTR	0	0	2	100.00	0.00	0.00
R:DET	1	11	1	8.33	50.00	10.00
R:MORPH	3	16	4	15.79	42.86	18.07
R:NOUN	3	11	7	21.43	30.00	22.73
R:NOUN:INFL	10	1	1	90.91	90.91	90.91
R:NOUN:NUM	10	29	10	25.64	50.00	28.41
R:NOUN:POSS	11	1	7	91.67	61.11	83.33
R:ORTH	45	10	42	81.82	51.72	73.29
R:OTHER	35	42	54	45.45	39.33	44.08
R:PREP	14	25	7	35.90	66.67	39.55
R:PRON	1	3	3	25.00	25.00	25.00
R:PUNCT	6	9	14	40.00	30.00	37.50
R:SPELL	91	2	9	97.85	91.00	96.40
R:VERB	4	13	5	23.53	44.44	25.97
R:VERB:FORM	4	10	3	28.57	57.14	31.75
R:VERB:INFL	3	0	2	100.00	60.00	88.24
R:VERB:SVA	6	12	4	33.33	60.00	36.59
R:VERB:TENSE	5	29	2	14.71	71.43	17.48
R:WO	3	10	1	23.08	75.00	26.79
U:ADJ	0	2	1	0.00	0.00	0.00
U:ADV	1	6	1	14.29	50.00	16.67
U:DET	7	23	2	23.33	77.78	27.13
U:NOUN	0	7	0	0.00	100.00	0.00
U:OTHER	1	28	3	3.45	25.00	4.17
U:PART	0	2	0	0.00	100.00	0.00
U:PREP	0	12	2	0.00	0.00	0.00
U:PUNCT	10	3	11	76.92	47.62	68.49
U:VERB	0	4	1	0.00	0.00	0.00
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	3	5	0	37.50	100.00	42.86
UNK	3	0	2	100.00	60.00	88.24

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:43:14+00:00
Competition submission:	4
Competition phase:	3 - Open phase

Detailed results

Submission information

Results