BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	3127	1199	2074	72.28	60.12	69.47
Span-level detection	3508	827	1863	80.92	65.31	77.23
Token-level detection	4246	550	2136	88.53	66.53	83.04

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	855	363	473	70.20	64.38	68.95
R	1954	719	1391	73.10	58.42	69.60
U	318	117	210	73.10	60.23	70.11

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	12	12	30	50.00	28.57	43.48
ADJ:FORM	7	1	3	87.50	70.00	83.33
ADV	25	23	36	52.08	40.98	49.41
CONJ	11	11	14	50.00	44.00	48.67
CONTR	10	2	1	83.33	90.91	84.75
DET	418	116	208	78.28	66.77	75.67
MORPH	105	21	53	83.33	66.46	79.31
NOUN	48	64	87	42.86	35.56	41.17
NOUN:INFL	16	1	3	94.12	84.21	91.95
NOUN:NUM	191	43	68	81.62	73.75	79.92
NOUN:POSS	40	5	19	88.89	67.80	83.68
ORTH	210	15	169	93.33	55.41	82.10
OTHER	217	208	463	51.06	31.91	45.59
PART	19	9	11	67.86	63.33	66.90
PREP	325	120	158	73.03	67.29	71.81
PRON	76	27	67	73.79	53.15	68.47
PUNCT	534	246	280	68.46	65.60	67.87
SPELL	289	65	42	81.64	87.31	82.71
VERB	101	53	135	65.58	42.80	59.27
VERB:FORM	153	39	41	79.69	78.87	79.52
VERB:INFL	7	0	1	100.00	87.50	97.22
VERB:SVA	123	18	22	87.23	84.83	86.74
VERB:TENSE	143	62	117	69.76	55.00	66.20
WO	47	38	46	55.29	50.54	54.27

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	4	7	42.86	30.00	39.47
M:ADV	7	11	12	38.89	36.84	38.46
M:CONJ	7	10	6	41.18	53.85	43.21
M:DET	217	64	85	77.22	71.85	76.09
M:NOUN	4	15	8	21.05	33.33	22.73
M:NOUN:POSS	8	2	8	80.00	50.00	71.43
M:OTHER	27	35	29	43.55	48.21	44.41
M:PART	2	1	3	66.67	40.00	58.82
M:PREP	70	45	39	60.87	64.22	61.51
M:PRON	41	20	32	67.21	56.16	64.67
M:PUNCT	403	116	211	77.65	65.64	74.91
M:VERB	22	18	17	55.00	56.41	55.28
M:VERB:FORM	16	7	1	69.57	94.12	73.39
M:VERB:TENSE	28	15	15	65.12	65.12	65.12
R:ADJ	6	4	19	60.00	24.00	46.15
R:ADJ:FORM	7	1	3	87.50	70.00	83.33
R:ADV	8	6	14	57.14	36.36	51.28
R:CONJ	0	0	5	100.00	0.00	0.00
R:CONTR	3	1	1	75.00	75.00	75.00
R:DET	56	25	60	69.14	48.28	63.64
R:MORPH	105	21	53	83.33	66.46	79.31
R:NOUN	38	34	70	52.78	35.19	47.98
R:NOUN:INFL	16	1	3	94.12	84.21	91.95
R:NOUN:NUM	191	43	68	81.62	73.75	79.92
R:NOUN:POSS	23	2	6	92.00	79.31	89.15
R:ORTH	210	15	169	93.33	55.41	82.10
R:OTHER	181	159	413	53.24	30.47	46.32
R:PART	15	8	5	65.22	75.00	66.96
R:PREP	207	58	89	78.11	69.93	76.33
R:PRON	24	6	21	80.00	53.33	72.73
R:PUNCT	93	116	47	44.50	66.43	47.64
R:SPELL	289	65	42	81.64	87.31	82.71
R:VERB	71	26	103	73.20	40.80	63.17
R:VERB:FORM	134	31	36	81.21	78.82	80.72
R:VERB:INFL	7	0	1	100.00	87.50	97.22
R:VERB:SVA	123	18	22	87.23	84.83	86.74
R:VERB:TENSE	100	41	95	70.92	51.28	65.88
R:WO	47	38	46	55.29	50.54	54.27
U:ADJ	3	4	4	42.86	42.86	42.86
U:ADV	10	6	10	62.50	50.00	59.52
U:CONJ	4	1	3	80.00	57.14	74.07
U:CONTR	7	1	0	87.50	100.00	89.74
U:DET	145	27	63	84.30	69.71	80.92
U:NOUN	6	15	9	28.57	40.00	30.30
U:NOUN:POSS	9	1	5	90.00	64.29	83.33
U:OTHER	9	14	21	39.13	30.00	36.89
U:PART	2	0	3	100.00	40.00	76.92
U:PREP	48	17	30	73.85	61.54	71.01
U:PRON	11	1	14	91.67	44.00	75.34
U:PUNCT	38	14	22	73.08	63.33	70.90
U:VERB	8	9	15	47.06	34.78	43.96
U:VERB:FORM	3	1	4	75.00	42.86	65.22
U:VERB:TENSE	15	6	7	71.43	68.18	70.75

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	940	276	419	77.30	69.17	75.53
R	2196	454	1193	82.87	64.80	78.49
U	351	97	193	78.35	64.52	75.13
UNK	21	0	58	100.00	26.58	64.42

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	22	11	26	66.67	45.83	61.11
ADJ:FORM	6	1	3	85.71	66.67	81.08
ADV	30	15	35	66.67	46.15	61.22
CONJ	14	5	15	73.68	48.28	66.67
CONTR	9	2	1	81.82	90.00	83.33
DET	452	96	179	82.48	71.63	80.06
MORPH	106	7	44	93.81	70.67	88.04
NOUN	63	44	75	58.88	45.65	55.65
NOUN:INFL	17	0	3	100.00	85.00	96.59
NOUN:NUM	190	26	55	87.96	77.55	85.66
NOUN:POSS	40	4	17	90.91	70.18	85.84
ORTH	224	10	142	95.73	61.20	86.02
OTHER	378	111	384	77.30	49.61	69.54
PART	21	8	12	72.41	63.64	70.47
PREP	350	80	143	81.40	70.99	79.08
PRON	94	17	47	84.68	66.67	80.34
PUNCT	566	223	274	71.74	67.38	70.82
SPELL	290	30	31	90.62	90.34	90.57
UNK	21	0	58	100.00	26.58	64.42
VERB	132	38	120	77.65	52.38	70.82
VERB:FORM	149	29	35	83.71	80.98	83.15
VERB:INFL	7	0	1	100.00	87.50	97.22
VERB:SVA	125	7	18	94.70	87.41	93.14
VERB:TENSE	156	33	105	82.54	59.77	76.70
WO	46	30	40	60.53	53.49	58.97

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	5	4	7	55.56	41.67	52.08
M:ADV	7	8	10	46.67	41.18	45.45
M:CONJ	8	5	9	61.54	47.06	57.97
M:DET	231	53	70	81.34	76.74	80.38
M:NOUN	8	10	5	44.44	61.54	47.06
M:NOUN:POSS	8	2	8	80.00	50.00	71.43
M:OTHER	37	19	28	66.07	56.92	64.01
M:PART	2	1	3	66.67	40.00	58.82
M:PREP	81	31	34	72.32	70.43	71.94
M:PRON	53	14	20	79.10	72.60	77.71
M:PUNCT	425	98	204	81.26	67.57	78.10
M:VERB	26	16	9	61.90	74.29	64.04
M:VERB:FORM	14	8	1	63.64	93.33	67.96
M:VERB:TENSE	35	7	11	83.33	76.09	81.78
R:ADJ	13	3	16	81.25	44.83	69.89
R:ADJ:FORM	6	1	3	85.71	66.67	81.08
R:ADV	12	3	16	80.00	42.86	68.18
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	2	1	1	66.67	66.67	66.67
R:DET	67	18	53	78.82	55.83	72.83
R:MORPH	106	7	44	93.81	70.67	88.04
R:NOUN	49	19	59	72.06	45.37	64.47
R:NOUN:INFL	17	0	3	100.00	85.00	96.59
R:NOUN:NUM	190	26	55	87.96	77.55	85.66
R:NOUN:POSS	24	1	5	96.00	82.76	93.02
R:ORTH	224	10	142	95.73	61.20	86.02
R:OTHER	329	79	336	80.64	49.47	71.62
R:PART	17	7	6	70.83	73.91	71.43
R:PREP	218	37	86	85.49	71.71	82.33
R:PRON	27	2	18	93.10	60.00	83.85
R:PUNCT	96	114	45	45.71	68.09	48.93
R:SPELL	290	30	31	90.62	90.34	90.57
R:VERB	96	17	96	84.96	50.00	74.53
R:VERB:FORM	131	20	31	86.75	80.86	85.51
R:VERB:INFL	7	0	1	100.00	87.50	97.22
R:VERB:SVA	125	7	18	94.70	87.41	93.14
R:VERB:TENSE	104	22	85	82.54	55.03	75.04
R:WO	46	30	40	60.53	53.49	58.97
U:ADJ	4	4	3	50.00	57.14	51.28
U:ADV	11	4	9	73.33	55.00	68.75
U:CONJ	6	0	3	100.00	66.67	90.91
U:CONTR	7	1	0	87.50	100.00	89.74
U:DET	154	25	56	86.03	73.33	83.15
U:NOUN	6	15	11	28.57	35.29	29.70
U:NOUN:POSS	8	1	4	88.89	66.67	83.33
U:OTHER	12	13	20	48.00	37.50	45.45
U:PART	2	0	3	100.00	40.00	76.92
U:PREP	51	12	23	80.95	68.92	78.22
U:PRON	14	1	9	93.33	60.87	84.34
U:PUNCT	45	11	25	80.36	64.29	76.53
U:VERB	10	5	15	66.67	40.00	58.82
U:VERB:FORM	4	1	3	80.00	57.14	74.07
U:VERB:TENSE	17	4	9	80.95	65.38	77.27
UNK	21	0	58	100.00	26.58	64.42

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	1050	159	423	86.85	71.28	83.21
R	2714	306	1374	89.87	66.39	83.93
U	426	85	254	83.37	62.65	78.19
UNK	56	0	85	100.00	39.72	76.71

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	21	9	30	70.00	41.18	61.40
ADJ:FORM	7	1	4	87.50	63.64	81.40
ADV	40	8	41	83.33	49.38	73.26
CONJ	21	2	14	91.30	60.00	82.68
CONTR	9	2	3	81.82	75.00	80.36
DET	473	51	180	90.27	72.43	86.03
MORPH	107	2	47	98.17	69.48	90.68
NOUN	81	24	81	77.14	50.00	69.59
NOUN:INFL	17	0	2	100.00	89.47	97.70
NOUN:NUM	197	15	51	92.92	79.44	89.87
NOUN:POSS	52	1	19	98.11	73.24	91.87
ORTH	289	6	145	97.97	66.59	89.53
OTHER	679	91	536	88.18	55.88	79.05
PART	13	3	11	81.25	54.17	73.86
PREP	360	57	150	86.33	70.59	82.64
PRON	102	10	46	91.07	68.92	85.57
PUNCT	702	172	261	80.32	72.90	78.72
SPELL	287	21	30	93.18	90.54	92.64
UNK	56	0	85	100.00	39.72	76.71
VERB	153	22	147	87.43	51.00	76.50
VERB:FORM	156	11	37	93.41	80.83	90.59
VERB:INFL	6	0	0	100.00	100.00	100.00
VERB:SVA	127	4	20	96.95	86.39	94.63
VERB:TENSE	171	20	135	89.53	55.88	79.91
WO	120	18	61	86.96	66.30	81.86

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	4	7	42.86	30.00	39.47
M:ADV	12	4	10	75.00	54.55	69.77
M:CONJ	16	2	5	88.89	76.19	86.02
M:DET	242	19	70	92.72	77.56	89.23
M:NOUN	11	8	9	57.89	55.00	57.29
M:NOUN:POSS	9	1	7	90.00	56.25	80.36
M:OTHER	40	11	31	78.43	56.34	72.73
M:PART	1	0	3	100.00	25.00	62.50
M:PREP	89	18	36	83.18	71.20	80.47
M:PRON	59	8	18	88.06	76.62	85.51
M:PUNCT	490	70	196	87.50	71.43	83.73
M:VERB	30	9	17	76.92	63.83	73.89
M:VERB:FORM	13	1	1	92.86	92.86	92.86
M:VERB:TENSE	35	4	13	89.74	72.92	85.78
R:ADJ	14	3	20	82.35	41.18	68.63
R:ADJ:FORM	7	1	4	87.50	63.64	81.40
R:ADV	14	3	19	82.35	42.42	69.31
R:CONJ	0	0	6	100.00	0.00	0.00
R:CONTR	2	1	2	66.67	50.00	62.50
R:DET	63	13	49	82.89	56.25	75.72
R:MORPH	107	2	47	98.17	69.48	90.68
R:NOUN	61	9	56	87.14	52.14	76.83
R:NOUN:INFL	17	0	2	100.00	89.47	97.70
R:NOUN:NUM	197	15	51	92.92	79.44	89.87
R:NOUN:POSS	34	0	6	100.00	85.00	96.59
R:ORTH	289	6	145	97.97	66.59	89.53
R:OTHER	601	45	437	93.03	57.90	82.97
R:PART	10	3	5	76.92	66.67	74.63
R:PREP	215	33	92	86.69	70.03	82.76
R:PRON	28	2	18	93.33	60.87	84.34
R:PUNCT	149	90	50	62.34	74.87	64.50
R:SPELL	287	21	30	93.18	90.54	92.64
R:VERB	108	13	111	89.26	49.32	76.81
R:VERB:FORM	140	10	33	93.33	80.92	90.56
R:VERB:INFL	6	0	0	100.00	100.00	100.00
R:VERB:SVA	127	4	20	96.95	86.39	94.63
R:VERB:TENSE	118	14	110	89.39	51.75	78.04
R:WO	120	18	61	86.96	66.30	81.86
U:ADJ	4	2	3	66.67	57.14	64.52
U:ADV	14	1	12	93.33	53.85	81.40
U:CONJ	5	0	3	100.00	62.50	89.29
U:CONTR	7	1	1	87.50	87.50	87.50
U:DET	168	19	61	89.84	73.36	85.98
U:NOUN	9	7	16	56.25	36.00	50.56
U:NOUN:POSS	9	0	6	100.00	60.00	88.24
U:OTHER	38	35	68	52.05	35.85	47.74
U:PART	2	0	3	100.00	40.00	76.92
U:PREP	56	6	22	90.32	71.79	85.89
U:PRON	15	0	10	100.00	60.00	88.24
U:PUNCT	63	12	15	84.00	80.77	83.33
U:VERB	15	0	19	100.00	44.12	79.79
U:VERB:FORM	3	0	3	100.00	50.00	83.33
U:VERB:TENSE	18	2	12	90.00	60.00	81.82
UNK	56	0	85	100.00	39.72	76.71

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1378	578	973	70.45	58.61	67.71
Span-level detection	1593	366	859	81.32	64.97	77.42
Token-level detection	1968	181	946	91.58	67.54	85.49

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	327	196	230	62.52	58.71	61.72
R	911	331	640	73.35	58.74	69.87
U	140	51	103	73.30	57.61	69.51

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	4	6	10	40.00	28.57	37.04
ADJ:FORM	4	0	1	100.00	80.00	95.24
ADV	10	8	17	55.56	37.04	50.51
CONJ	4	5	5	44.44	44.44	44.44
CONTR	5	0	0	100.00	100.00	100.00
DET	182	62	102	74.59	64.08	72.22
MORPH	59	12	27	83.10	68.60	79.73
NOUN	20	30	41	40.00	32.79	38.31
NOUN:INFL	5	1	1	83.33	83.33	83.33
NOUN:NUM	97	27	33	78.23	74.62	77.48
NOUN:POSS	10	1	6	90.91	62.50	83.33
ORTH	116	8	83	93.55	58.29	83.45
OTHER	103	98	245	51.24	29.60	44.70
PART	10	5	5	66.67	66.67	66.67
PREP	141	55	61	71.94	69.80	71.50
PRON	46	16	36	74.19	56.10	69.70
PUNCT	174	102	129	63.04	57.43	61.83
SPELL	107	28	13	79.26	89.17	81.06
VERB	54	28	61	65.85	46.96	60.95
VERB:FORM	79	25	21	75.96	79.00	76.55
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	67	8	10	89.33	87.01	88.86
VERB:TENSE	65	38	49	63.11	57.02	61.79
WO	13	15	16	46.43	44.83	46.10

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	2	1	50.00	66.67	52.63
M:ADV	2	3	6	40.00	25.00	35.71
M:CONJ	2	4	2	33.33	50.00	35.71
M:DET	88	38	40	69.84	68.75	69.62
M:NOUN	2	10	2	16.67	50.00	19.23
M:NOUN:POSS	1	1	3	50.00	25.00	41.67
M:OTHER	14	22	20	38.89	41.18	39.33
M:PART	0	1	2	0.00	0.00	0.00
M:PREP	30	19	20	61.22	60.00	60.98
M:PRON	25	11	13	69.44	65.79	68.68
M:PUNCT	125	60	104	67.57	54.59	64.50
M:VERB	12	9	10	57.14	54.55	56.60
M:VERB:FORM	13	7	1	65.00	92.86	69.15
M:VERB:TENSE	11	9	6	55.00	64.71	56.70
R:ADJ	0	2	7	0.00	0.00	0.00
R:ADJ:FORM	4	0	1	100.00	80.00	95.24
R:ADV	3	2	7	60.00	30.00	50.00
R:CONTR	2	0	0	100.00	100.00	100.00
R:DET	21	13	25	61.76	45.65	57.69
R:MORPH	59	12	27	83.10	68.60	79.73
R:NOUN	15	13	32	53.57	31.91	47.17
R:NOUN:INFL	5	1	1	83.33	83.33	83.33
R:NOUN:NUM	97	27	33	78.23	74.62	77.48
R:NOUN:POSS	4	0	2	100.00	66.67	90.91
R:ORTH	116	8	83	93.55	58.29	83.45
R:OTHER	86	71	216	54.78	28.48	46.24
R:PART	9	4	1	69.23	90.00	72.58
R:PREP	90	28	28	76.27	76.27	76.27
R:PRON	17	4	12	80.95	58.62	75.22
R:PUNCT	41	39	18	51.25	69.49	54.09
R:SPELL	107	28	13	79.26	89.17	81.06
R:VERB	36	13	45	73.47	44.44	64.98
R:VERB:FORM	66	18	19	78.57	77.65	78.38
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	67	8	10	89.33	87.01	88.86
R:VERB:TENSE	50	25	43	66.67	53.76	63.61
R:WO	13	15	16	46.43	44.83	46.10
U:ADJ	2	2	2	50.00	50.00	50.00
U:ADV	5	3	4	62.50	55.56	60.98
U:CONJ	2	1	3	66.67	40.00	58.82
U:CONTR	3	0	0	100.00	100.00	100.00
U:DET	73	11	37	86.90	66.36	81.84
U:NOUN	3	7	7	30.00	30.00	30.00
U:NOUN:POSS	5	0	1	100.00	83.33	96.15
U:OTHER	3	5	9	37.50	25.00	34.09
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	21	8	13	72.41	61.76	70.00
U:PRON	4	1	11	80.00	26.67	57.14
U:PUNCT	8	3	7	72.73	53.33	67.80
U:VERB	6	6	6	50.00	50.00	50.00
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	4	4	0	50.00	100.00	55.56

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	374	144	188	72.20	66.55	70.99
R	1043	183	540	85.07	65.89	80.39
U	164	39	89	80.79	64.82	77.00
UNK	12	0	42	100.00	22.22	58.82

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	8	5	9	61.54	47.06	57.97
ADJ:FORM	3	0	1	100.00	75.00	93.75
ADV	13	4	19	76.47	40.62	65.00
CONJ	7	1	7	87.50	50.00	76.09
CONTR	4	0	0	100.00	100.00	100.00
DET	206	52	77	79.84	72.79	78.33
MORPH	58	3	26	95.08	69.05	88.41
NOUN	24	20	34	54.55	41.38	51.28
NOUN:INFL	5	0	1	100.00	83.33	96.15
NOUN:NUM	98	15	24	86.73	80.33	85.37
NOUN:POSS	10	2	6	83.33	62.50	78.12
ORTH	123	6	68	95.35	64.40	86.99
OTHER	202	40	195	83.47	50.88	73.99
PART	12	4	4	75.00	75.00	75.00
PREP	158	28	50	84.95	75.96	82.98
PRON	57	10	25	85.07	69.51	81.43
PUNCT	183	91	115	66.79	61.41	65.64
SPELL	106	14	10	88.33	91.38	88.93
UNK	12	0	42	100.00	22.22	58.82
VERB	72	17	57	80.90	55.81	74.23
VERB:FORM	73	20	19	78.49	79.35	78.66
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	67	2	11	97.10	85.90	94.63
VERB:TENSE	76	19	45	80.00	62.81	75.85
WO	13	13	13	50.00	50.00	50.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	2	1	60.00	75.00	62.50
M:ADV	3	3	6	50.00	33.33	45.45
M:CONJ	3	1	4	75.00	42.86	65.22
M:DET	98	32	28	75.38	77.78	75.85
M:NOUN	2	8	1	20.00	66.67	23.26
M:NOUN:POSS	1	1	3	50.00	25.00	41.67
M:OTHER	21	10	17	67.74	55.26	64.81
M:PART	0	1	1	0.00	0.00	0.00
M:PREP	38	9	16	80.85	70.37	78.51
M:PRON	30	8	9	78.95	76.92	78.53
M:PUNCT	132	50	90	72.53	59.46	69.47
M:VERB	16	6	6	72.73	72.73	72.73
M:VERB:FORM	11	8	1	57.89	91.67	62.50
M:VERB:TENSE	16	5	5	76.19	76.19	76.19
R:ADJ	3	1	6	75.00	33.33	60.00
R:ADJ:FORM	3	0	1	100.00	75.00	93.75
R:ADV	5	0	8	100.00	38.46	75.76
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	27	10	18	72.97	60.00	69.95
R:MORPH	58	3	26	95.08	69.05	88.41
R:NOUN	19	5	26	79.17	42.22	67.38
R:NOUN:INFL	5	0	1	100.00	83.33	96.15
R:NOUN:NUM	98	15	24	86.73	80.33	85.37
R:NOUN:POSS	5	0	3	100.00	62.50	89.29
R:ORTH	123	6	68	95.35	64.40	86.99
R:OTHER	176	26	170	87.13	50.87	76.26
R:PART	11	3	1	78.57	91.67	80.88
R:PREP	95	14	27	87.16	77.87	85.13
R:PRON	20	1	9	95.24	68.97	88.50
R:PUNCT	39	38	18	50.65	68.42	53.42
R:SPELL	106	14	10	88.33	91.38	88.93
R:VERB	50	8	43	86.21	53.76	76.92
R:VERB:FORM	62	12	17	83.78	78.48	82.67
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	67	2	11	97.10	85.90	94.63
R:VERB:TENSE	54	12	39	81.82	58.06	75.63
R:WO	13	13	13	50.00	50.00	50.00
U:ADJ	2	2	2	50.00	50.00	50.00
U:ADV	5	1	5	83.33	50.00	73.53
U:CONJ	4	0	3	100.00	57.14	86.96
U:CONTR	3	0	0	100.00	100.00	100.00
U:DET	81	10	31	89.01	72.32	85.08
U:NOUN	3	7	7	30.00	30.00	30.00
U:NOUN:POSS	4	1	0	80.00	100.00	83.33
U:OTHER	5	4	8	55.56	38.46	51.02
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	25	5	7	83.33	78.12	82.24
U:PRON	7	1	7	87.50	50.00	76.09
U:PUNCT	12	3	7	80.00	63.16	75.95
U:VERB	6	3	8	66.67	42.86	60.00
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	6	2	1	75.00	85.71	76.92
UNK	12	0	42	100.00	22.22	58.82

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	431	72	173	85.69	71.36	82.38
R	1303	94	624	93.27	67.62	86.69
U	207	15	102	93.24	66.99	86.47
UNK	27	0	47	100.00	36.49	74.18

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	8	3	8	72.73	50.00	66.67
ADJ:FORM	4	0	1	100.00	80.00	95.24
ADV	21	1	20	95.45	51.22	81.40
CONJ	10	1	8	90.91	55.56	80.65
CONTR	5	0	0	100.00	100.00	100.00
DET	221	24	78	90.20	73.91	86.40
MORPH	56	0	26	100.00	68.29	91.50
NOUN	34	9	37	79.07	47.89	69.96
NOUN:INFL	5	0	0	100.00	100.00	100.00
NOUN:NUM	103	7	21	93.64	83.06	91.31
NOUN:POSS	15	0	7	100.00	68.18	91.46
ORTH	145	3	57	97.97	71.78	91.31
OTHER	380	14	275	96.45	58.02	85.16
PART	7	1	5	87.50	58.33	79.55
PREP	163	16	57	91.06	74.09	87.07
PRON	61	6	21	91.04	74.39	87.14
PUNCT	246	61	100	80.13	71.10	78.14
SPELL	101	7	10	93.52	90.99	93.00
UNK	27	0	47	100.00	36.49	74.18
VERB	83	8	64	91.21	56.46	81.21
VERB:FORM	80	8	21	90.91	79.21	88.30
VERB:INFL	2	0	0	100.00	100.00	100.00
VERB:SVA	69	0	9	100.00	88.46	97.46
VERB:TENSE	86	9	59	90.53	59.31	81.90
WO	36	3	15	92.31	70.59	86.96

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	2	1	50.00	66.67	52.63
M:ADV	7	1	7	87.50	50.00	76.09
M:CONJ	7	1	3	87.50	70.00	83.33
M:DET	104	10	28	91.23	78.79	88.44
M:NOUN	3	6	3	33.33	50.00	35.71
M:NOUN:POSS	2	0	2	100.00	50.00	83.33
M:OTHER	23	6	16	79.31	58.97	74.19
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	44	3	17	93.62	72.13	88.35
M:PRON	33	5	8	86.84	80.49	85.49
M:PUNCT	164	33	74	83.25	68.91	79.92
M:VERB	16	2	9	88.89	64.00	82.47
M:VERB:FORM	10	1	1	90.91	90.91	90.91
M:VERB:TENSE	16	2	3	88.89	84.21	87.91
R:ADJ	4	1	6	80.00	40.00	66.67
R:ADJ:FORM	4	0	1	100.00	80.00	95.24
R:ADV	8	0	7	100.00	53.33	85.11
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	26	7	19	78.79	57.78	73.45
R:MORPH	56	0	26	100.00	68.29	91.50
R:NOUN	26	1	26	96.30	50.00	81.25
R:NOUN:INFL	5	0	0	100.00	100.00	100.00
R:NOUN:NUM	103	7	21	93.64	83.06	91.31
R:NOUN:POSS	8	0	3	100.00	72.73	93.02
R:ORTH	145	3	57	97.97	71.78	91.31
R:OTHER	339	7	234	97.98	59.16	86.61
R:PART	6	1	2	85.71	75.00	83.33
R:PREP	89	12	34	88.12	72.36	84.44
R:PRON	20	1	7	95.24	74.07	90.09
R:PUNCT	61	25	25	70.93	70.93	70.93
R:SPELL	101	7	10	93.52	90.99	93.00
R:VERB	61	6	49	91.04	55.45	80.69
R:VERB:FORM	70	7	19	90.91	78.65	88.16
R:VERB:INFL	2	0	0	100.00	100.00	100.00
R:VERB:SVA	69	0	9	100.00	88.46	97.46
R:VERB:TENSE	63	6	52	91.30	54.78	80.56
R:WO	36	3	15	92.31	70.59	86.96
U:ADJ	2	0	1	100.00	66.67	90.91
U:ADV	6	0	6	100.00	50.00	83.33
U:CONJ	3	0	3	100.00	50.00	83.33
U:CONTR	4	0	0	100.00	100.00	100.00
U:DET	91	7	31	92.86	74.59	88.52
U:NOUN	5	2	8	71.43	38.46	60.98
U:NOUN:POSS	5	0	2	100.00	71.43	92.59
U:OTHER	18	1	25	94.74	41.86	75.63
U:PART	1	0	2	100.00	33.33	71.43
U:PREP	30	1	6	96.77	83.33	93.75
U:PRON	8	0	6	100.00	57.14	86.96
U:PUNCT	21	3	1	87.50	95.45	88.98
U:VERB	6	0	6	100.00	50.00	83.33
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	7	1	4	87.50	63.64	81.40
UNK	27	0	47	100.00	36.49	74.18

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	962	350	725	73.32	57.02	69.36
Span-level detection	1072	245	637	81.40	62.73	76.82
Token-level detection	1306	179	751	87.95	63.49	81.66

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	306	106	157	74.27	66.09	72.48
R	553	211	496	72.38	52.72	67.36
U	103	33	72	75.74	58.86	71.63

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	3	12	66.67	33.33	55.56
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	12	8	17	60.00	41.38	55.05
CONJ	5	3	6	62.50	45.45	58.14
CONTR	2	1	1	66.67	66.67	66.67
DET	142	27	79	84.02	64.25	79.15
MORPH	30	6	16	83.33	65.22	78.95
NOUN	17	18	31	48.57	35.42	45.21
NOUN:NUM	54	8	18	87.10	75.00	84.37
NOUN:POSS	10	1	7	90.91	58.82	81.97
ORTH	43	4	35	91.49	55.13	80.83
OTHER	57	66	161	46.34	26.15	40.14
PART	6	4	5	60.00	54.55	58.82
PREP	120	38	57	75.95	67.80	74.17
PRON	18	6	26	75.00	40.91	64.29
PUNCT	182	78	85	70.00	68.16	69.63
SPELL	63	18	11	77.78	85.14	79.15
VERB	31	20	59	60.78	34.44	52.72
VERB:FORM	51	10	17	83.61	75.00	81.73
VERB:SVA	39	6	12	86.67	76.47	84.42
VERB:TENSE	51	13	50	79.69	50.50	71.43
WO	20	11	20	64.52	50.00	60.98

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	4	50.00	20.00	38.46
M:ADV	4	5	6	44.44	40.00	43.48
M:CONJ	4	3	3	57.14	57.14	57.14
M:DET	84	14	32	85.71	72.41	82.68
M:NOUN	2	3	2	40.00	50.00	41.67
M:NOUN:POSS	3	0	2	100.00	60.00	88.24
M:OTHER	10	10	6	50.00	62.50	52.08
M:PART	2	0	1	100.00	66.67	90.91
M:PREP	24	18	10	57.14	70.59	59.41
M:PRON	12	5	16	70.59	42.86	62.50
M:PUNCT	139	36	62	79.43	69.15	77.14
M:VERB	7	7	5	50.00	58.33	51.47
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	13	4	8	76.47	61.90	73.03
R:ADJ	4	1	7	80.00	36.36	64.52
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	4	1	5	80.00	44.44	68.97
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	23	6	31	79.31	42.59	67.65
R:MORPH	30	6	16	83.33	65.22	78.95
R:NOUN	13	10	27	56.52	32.50	49.24
R:NOUN:NUM	54	8	18	87.10	75.00	84.37
R:NOUN:POSS	5	1	1	83.33	83.33	83.33
R:ORTH	43	4	35	91.49	55.13	80.83
R:OTHER	42	52	146	44.68	22.34	37.23
R:PART	4	4	3	50.00	57.14	51.28
R:PREP	75	15	37	83.33	66.96	79.45
R:PRON	1	1	7	50.00	12.50	31.25
R:PUNCT	28	37	16	43.08	63.64	46.05
R:SPELL	63	18	11	77.78	85.14	79.15
R:VERB	23	10	47	69.70	32.86	56.93
R:VERB:FORM	47	10	15	82.46	75.81	81.03
R:VERB:SVA	39	6	12	86.67	76.47	84.42
R:VERB:TENSE	32	8	38	80.00	45.71	69.57
R:WO	20	11	20	64.52	50.00	60.98
U:ADJ	1	1	1	50.00	50.00	50.00
U:ADV	4	2	6	66.67	40.00	58.82
U:CONJ	1	0	0	100.00	100.00	100.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	35	7	16	83.33	68.63	79.91
U:NOUN	2	5	2	28.57	50.00	31.25
U:NOUN:POSS	2	0	4	100.00	33.33	71.43
U:OTHER	5	4	9	55.56	35.71	50.00
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	21	5	10	80.77	67.74	77.78
U:PRON	5	0	3	100.00	62.50	89.29
U:PUNCT	15	5	7	75.00	68.18	73.53
U:VERB	1	3	7	25.00	12.50	20.83
U:VERB:FORM	3	0	2	100.00	60.00	88.24
U:VERB:TENSE	6	1	4	85.71	60.00	78.95

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	332	83	141	80.00	70.19	77.82
R	624	134	416	82.32	60.00	76.62
U	110	28	70	79.71	61.11	75.14
UNK	6	0	10	100.00	37.50	75.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	10	3	10	76.92	50.00	69.44
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	15	5	14	75.00	51.72	68.81
CONJ	5	2	6	71.43	45.45	64.10
CONTR	2	1	1	66.67	66.67	66.67
DET	150	20	74	88.24	66.96	82.96
MORPH	30	2	9	93.75	76.92	89.82
NOUN	22	15	27	59.46	44.90	55.84
NOUN:NUM	54	3	18	94.74	75.00	90.00
NOUN:POSS	9	0	6	100.00	60.00	88.24
ORTH	46	2	27	95.83	63.01	86.79
OTHER	100	41	138	70.92	42.02	62.34
PART	6	4	6	60.00	50.00	57.69
PREP	127	27	56	82.47	69.40	79.47
PRON	23	3	18	88.46	56.10	79.31
PUNCT	196	71	80	73.41	71.01	72.92
SPELL	60	8	9	88.24	86.96	87.98
UNK	6	0	10	100.00	37.50	75.00
VERB	42	16	45	72.41	48.28	65.83
VERB:FORM	52	6	15	89.66	77.61	86.96
VERB:SVA	41	2	7	95.35	85.42	93.18
VERB:TENSE	52	6	42	89.66	55.32	79.75
WO	21	7	19	75.00	52.50	69.08

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	1	4	66.67	33.33	55.56
M:ADV	4	3	4	57.14	50.00	55.56
M:CONJ	4	2	4	66.67	50.00	62.50
M:DET	88	10	31	89.80	73.95	86.11
M:NOUN	3	2	2	60.00	60.00	60.00
M:NOUN:POSS	3	0	2	100.00	60.00	88.24
M:OTHER	13	7	7	65.00	65.00	65.00
M:PART	2	0	1	100.00	66.67	90.91
M:PREP	26	15	10	63.41	72.22	65.00
M:PRON	17	3	9	85.00	65.38	80.19
M:PUNCT	148	31	61	82.68	70.81	80.00
M:VERB	7	8	1	46.67	87.50	51.47
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	14	1	5	93.33	73.68	88.61
R:ADJ	7	1	5	87.50	58.33	79.55
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	6	0	6	100.00	50.00	83.33
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	27	4	29	87.10	48.21	75.00
R:MORPH	30	2	9	93.75	76.92	89.82
R:NOUN	17	8	21	68.00	44.74	61.59
R:NOUN:NUM	54	3	18	94.74	75.00	90.00
R:NOUN:POSS	4	0	0	100.00	100.00	100.00
R:ORTH	46	2	27	95.83	63.01	86.79
R:OTHER	81	30	122	72.97	39.90	62.60
R:PART	4	4	4	50.00	50.00	50.00
R:PREP	80	9	36	89.89	68.97	84.75
R:PRON	1	0	7	100.00	12.50	41.67
R:PUNCT	31	36	10	46.27	75.61	50.16
R:SPELL	60	8	9	88.24	86.96	87.98
R:VERB	32	6	39	84.21	45.07	71.75
R:VERB:FORM	47	6	13	88.68	78.33	86.40
R:VERB:SVA	41	2	7	95.35	85.42	93.18
R:VERB:TENSE	32	4	32	88.89	50.00	76.92
R:WO	21	7	19	75.00	52.50	69.08
U:ADJ	1	1	1	50.00	50.00	50.00
U:ADV	5	2	4	71.43	55.56	67.57
U:CONJ	1	0	0	100.00	100.00	100.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	35	6	14	85.37	71.43	82.16
U:NOUN	2	5	4	28.57	33.33	29.41
U:NOUN:POSS	2	0	4	100.00	33.33	71.43
U:OTHER	6	4	9	60.00	40.00	54.55
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	21	3	10	87.50	67.74	82.68
U:PRON	5	0	2	100.00	71.43	92.59
U:PUNCT	17	4	9	80.95	65.38	77.27
U:VERB	3	2	5	60.00	37.50	53.57
U:VERB:FORM	4	0	2	100.00	66.67	90.91
U:VERB:TENSE	6	1	5	85.71	54.55	76.92
UNK	6	0	10	100.00	37.50	75.00

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	354	46	139	88.50	71.81	84.57
R	796	95	478	89.34	62.48	82.27
U	132	38	105	77.65	55.70	71.97
UNK	24	0	29	100.00	45.28	80.54

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	9	3	12	75.00	42.86	65.22
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	16	2	17	88.89	48.48	76.19
CONJ	8	0	5	100.00	61.54	88.89
CONTR	1	1	1	50.00	50.00	50.00
DET	155	9	71	94.51	68.58	87.87
MORPH	33	1	11	97.06	75.00	91.67
NOUN	28	7	29	80.00	49.12	71.07
NOUN:NUM	56	3	14	94.92	80.00	91.50
NOUN:POSS	13	0	6	100.00	68.42	91.55
ORTH	67	1	31	98.53	68.37	90.54
OTHER	186	47	189	79.83	49.60	71.16
PART	3	2	4	60.00	42.86	55.56
PREP	131	17	55	88.51	70.43	84.19
PRON	25	0	22	100.00	53.19	85.03
PUNCT	229	55	65	80.63	77.89	80.07
SPELL	62	7	8	89.86	88.57	89.60
UNK	24	0	29	100.00	45.28	80.54
VERB	50	8	66	86.21	43.10	71.84
VERB:FORM	50	2	15	96.15	76.92	91.58
VERB:SVA	42	1	9	97.67	82.35	94.17
VERB:TENSE	58	4	54	93.55	51.79	80.56
WO	57	8	38	87.69	60.00	80.28

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	3	50.00	25.00	41.67
M:ADV	5	2	3	71.43	62.50	69.44
M:CONJ	7	0	2	100.00	77.78	94.59
M:DET	91	2	29	97.85	75.83	92.48
M:NOUN	4	2	3	66.67	57.14	64.52
M:NOUN:POSS	3	0	2	100.00	60.00	88.24
M:OTHER	12	3	10	80.00	54.55	73.17
M:PART	1	0	1	100.00	50.00	83.33
M:PREP	26	8	11	76.47	70.27	75.14
M:PRON	19	0	8	100.00	70.37	92.23
M:PUNCT	159	23	52	87.36	75.36	84.66
M:VERB	11	4	6	73.33	64.71	71.43
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	14	1	9	93.33	60.87	84.34
R:ADJ	7	1	9	87.50	43.75	72.92
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	5	0	10	100.00	33.33	71.43
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	26	3	25	89.66	50.98	77.84
R:MORPH	33	1	11	97.06	75.00	91.67
R:NOUN	22	3	19	88.00	53.66	78.01
R:NOUN:NUM	56	3	14	94.92	80.00	91.50
R:NOUN:POSS	8	0	0	100.00	100.00	100.00
R:ORTH	67	1	31	98.53	68.37	90.54
R:OTHER	155	19	144	89.08	51.84	77.89
R:PART	2	2	2	50.00	50.00	50.00
R:PREP	83	7	34	92.22	70.94	87.00
R:PRON	1	0	10	100.00	9.09	33.33
R:PUNCT	51	28	8	64.56	86.44	68.00
R:SPELL	62	7	8	89.86	88.57	89.60
R:VERB	32	4	49	88.89	39.51	71.11
R:VERB:FORM	46	2	13	95.83	77.97	91.63
R:VERB:SVA	42	1	9	97.67	82.35	94.17
R:VERB:TENSE	38	3	40	92.68	48.72	78.51
R:WO	57	8	38	87.69	60.00	80.28
U:ADJ	1	1	0	50.00	100.00	55.56
U:ADV	6	0	4	100.00	60.00	88.24
U:CONJ	1	0	0	100.00	100.00	100.00
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	38	4	17	90.48	69.09	85.20
U:NOUN	2	2	7	50.00	22.22	40.00
U:NOUN:POSS	2	0	4	100.00	33.33	71.43
U:OTHER	19	25	35	43.18	35.19	41.30
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	22	2	10	91.67	68.75	85.94
U:PRON	5	0	4	100.00	55.56	86.21
U:PUNCT	19	4	5	82.61	79.17	81.90
U:VERB	7	0	11	100.00	38.89	76.09
U:VERB:FORM	3	0	2	100.00	60.00	88.24
U:VERB:TENSE	6	0	5	100.00	54.55	85.71
UNK	24	0	29	100.00	45.28	80.54

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	440	131	222	77.06	66.47	74.68
Span-level detection	463	109	223	80.94	67.49	77.84
Token-level detection	540	92	266	85.44	67.00	80.98

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	139	26	54	84.24	72.02	81.48
R	246	94	146	72.35	62.76	70.21
U	55	11	22	83.33	71.43	80.65

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	5	100.00	16.67	50.00
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	2	2	2	50.00	50.00	50.00
CONJ	1	1	3	50.00	25.00	41.67
CONTR	3	1	0	75.00	100.00	78.95
DET	82	9	23	90.11	78.10	87.42
MORPH	14	1	8	93.33	63.64	85.37
NOUN	3	5	11	37.50	21.43	32.61
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	23	2	12	92.00	65.71	85.19
NOUN:POSS	7	0	1	100.00	87.50	97.22
ORTH	29	2	18	93.55	61.70	84.80
OTHER	29	26	33	52.73	46.77	51.42
PART	2	0	1	100.00	66.67	90.91
PREP	49	12	29	80.33	62.82	76.09
PRON	6	3	4	66.67	60.00	65.22
PUNCT	90	35	30	72.00	75.00	72.58
SPELL	34	12	4	73.91	89.47	76.58
VERB	6	2	11	75.00	35.29	61.22
VERB:FORM	14	2	1	87.50	93.33	88.61
VERB:SVA	9	2	0	81.82	100.00	84.91
VERB:TENSE	22	7	14	75.86	61.11	72.37
WO	12	7	10	63.16	54.55	61.22

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	1	2	0	33.33	100.00	38.46
M:CONJ	1	1	1	50.00	50.00	50.00
M:DET	39	3	12	92.86	76.47	89.04
M:NOUN	0	0	2	100.00	0.00	0.00
M:NOUN:POSS	1	0	0	100.00	100.00	100.00
M:OTHER	3	3	3	50.00	50.00	50.00
M:PREP	14	4	8	77.78	63.64	74.47
M:PRON	2	2	2	50.00	50.00	50.00
M:PUNCT	71	9	22	88.75	76.34	85.96
M:VERB	1	1	1	50.00	50.00	50.00
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	4	1	1	80.00	80.00	80.00
R:ADJ	1	0	2	100.00	33.33	71.43
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	11	4	3	73.33	78.57	74.32
R:MORPH	14	1	8	93.33	63.64	85.37
R:NOUN	2	4	9	33.33	18.18	28.57
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	23	2	12	92.00	65.71	85.19
R:NOUN:POSS	4	0	1	100.00	80.00	95.24
R:ORTH	29	2	18	93.55	61.70	84.80
R:OTHER	25	21	28	54.35	47.17	52.74
R:PART	2	0	1	100.00	66.67	90.91
R:PREP	31	8	16	79.49	65.96	76.35
R:PRON	2	1	2	66.67	50.00	62.50
R:PUNCT	12	22	5	35.29	70.59	39.22
R:SPELL	34	12	4	73.91	89.47	76.58
R:VERB	5	1	9	83.33	35.71	65.79
R:VERB:FORM	12	2	1	85.71	92.31	86.96
R:VERB:SVA	9	2	0	81.82	100.00	84.91
R:VERB:TENSE	14	5	11	73.68	56.00	69.31
R:WO	12	7	10	63.16	54.55	61.22
U:ADJ	0	0	1	100.00	0.00	0.00
U:CONTR	2	1	0	66.67	100.00	71.43
U:DET	32	2	8	94.12	80.00	90.91
U:NOUN	1	1	0	50.00	100.00	55.56
U:NOUN:POSS	2	0	0	100.00	100.00	100.00
U:OTHER	1	2	2	33.33	33.33	33.33
U:PREP	4	0	5	100.00	44.44	80.00
U:PRON	2	0	0	100.00	100.00	100.00
U:PUNCT	7	4	3	63.64	70.00	64.81
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	4	1	2	80.00	66.67	76.92

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	142	23	54	86.06	72.45	82.94
R	263	76	143	77.58	64.78	74.63
U	56	10	23	84.85	70.89	81.63
UNK	2	0	3	100.00	40.00	76.92

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	0	5	100.00	28.57	66.67
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	1	2	2	33.33	33.33	33.33
CONJ	1	0	2	100.00	33.33	71.43
CONTR	3	1	0	75.00	100.00	78.95
DET	83	7	23	92.22	78.30	89.06
MORPH	15	0	7	100.00	68.18	91.46
NOUN	6	3	12	66.67	33.33	55.56
NOUN:INFL	3	0	0	100.00	100.00	100.00
NOUN:NUM	23	1	8	95.83	74.19	90.55
NOUN:POSS	7	0	1	100.00	87.50	97.22
ORTH	31	1	15	96.88	67.39	89.08
OTHER	38	21	33	64.41	53.52	61.89
PART	2	0	2	100.00	50.00	83.33
PREP	49	12	28	80.33	63.64	76.32
PRON	7	3	4	70.00	63.64	68.63
PUNCT	93	33	35	73.81	72.66	73.58
SPELL	35	8	3	81.40	92.11	83.33
UNK	2	0	3	100.00	40.00	76.92
VERB	8	2	14	80.00	36.36	64.52
VERB:FORM	14	1	1	93.33	93.33	93.33
VERB:SVA	9	1	0	90.00	100.00	91.84
VERB:TENSE	21	6	15	77.78	58.33	72.92
WO	10	7	8	58.82	55.56	58.14

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	0	2	0	0.00	100.00	0.00
M:CONJ	1	0	1	100.00	50.00	83.33
M:DET	39	3	10	92.86	79.59	89.86
M:NOUN	1	0	2	100.00	33.33	71.43
M:NOUN:POSS	1	0	0	100.00	100.00	100.00
M:OTHER	2	2	4	50.00	33.33	45.45
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	15	4	7	78.95	68.18	76.53
M:PRON	3	2	2	60.00	60.00	60.00
M:PUNCT	73	8	23	90.12	76.04	86.90
M:VERB	1	1	1	50.00	50.00	50.00
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	4	1	1	80.00	80.00	80.00
R:ADJ	1	0	3	100.00	25.00	62.50
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	12	2	4	85.71	75.00	83.33
R:MORPH	15	0	7	100.00	68.18	91.46
R:NOUN	4	2	10	66.67	28.57	52.63
R:NOUN:INFL	3	0	0	100.00	100.00	100.00
R:NOUN:NUM	23	1	8	95.83	74.19	90.55
R:NOUN:POSS	4	0	1	100.00	80.00	95.24
R:ORTH	31	1	15	96.88	67.39	89.08
R:OTHER	35	17	27	67.31	56.45	64.81
R:PART	2	0	1	100.00	66.67	90.91
R:PREP	31	8	16	79.49	65.96	76.35
R:PRON	2	1	2	66.67	50.00	62.50
R:PUNCT	12	22	8	35.29	60.00	38.46
R:SPELL	35	8	3	81.40	92.11	83.33
R:VERB	7	1	12	87.50	36.84	68.63
R:VERB:FORM	12	1	1	92.31	92.31	92.31
R:VERB:SVA	9	1	0	90.00	100.00	91.84
R:VERB:TENSE	13	4	12	76.47	52.00	69.89
R:WO	10	7	8	58.82	55.56	58.14
U:ADJ	1	0	0	100.00	100.00	100.00
U:CONTR	2	1	0	66.67	100.00	71.43
U:DET	32	2	9	94.12	78.05	90.40
U:NOUN	1	1	0	50.00	100.00	55.56
U:NOUN:POSS	2	0	0	100.00	100.00	100.00
U:OTHER	1	2	2	33.33	33.33	33.33
U:PREP	3	0	5	100.00	37.50	75.00
U:PRON	2	0	0	100.00	100.00	100.00
U:PUNCT	8	3	4	72.73	66.67	71.43
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	4	1	2	80.00	66.67	76.92
UNK	2	0	3	100.00	40.00	76.92

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	162	21	65	88.52	71.37	84.46
R	310	58	161	84.24	65.82	79.77
U	65	13	32	83.33	67.01	79.46
UNK	3	0	8	100.00	27.27	65.22

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	7	100.00	12.50	41.67
ADJ:FORM	0	0	3	100.00	0.00	0.00
ADV	2	1	4	66.67	33.33	55.56
CONJ	2	0	1	100.00	66.67	90.91
CONTR	3	1	1	75.00	75.00	75.00
DET	84	5	25	94.38	77.06	90.32
MORPH	15	0	7	100.00	68.18	91.46
NOUN	6	2	11	75.00	35.29	61.22
NOUN:INFL	3	0	0	100.00	100.00	100.00
NOUN:NUM	23	0	10	100.00	69.70	92.00
NOUN:POSS	9	0	1	100.00	90.00	97.83
ORTH	36	1	17	97.30	67.92	89.55
OTHER	60	19	49	75.95	55.05	70.59
PART	2	0	2	100.00	50.00	83.33
PREP	51	12	29	80.95	63.75	76.81
PRON	9	3	3	75.00	75.00	75.00
PUNCT	120	31	44	79.47	73.17	78.12
SPELL	34	7	3	82.93	91.89	84.58
UNK	3	0	8	100.00	27.27	65.22
VERB	10	2	14	83.33	41.67	69.44
VERB:FORM	16	0	1	100.00	94.12	98.77
VERB:SVA	8	1	1	88.89	88.89	88.89
VERB:TENSE	20	5	17	80.00	54.05	72.99
WO	23	2	8	92.00	74.19	87.79

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	3	100.00	0.00	0.00
M:ADV	0	1	0	0.00	100.00	0.00
M:CONJ	2	0	0	100.00	100.00	100.00
M:DET	41	2	11	95.35	78.85	91.52
M:NOUN	1	0	2	100.00	33.33	71.43
M:NOUN:POSS	1	0	0	100.00	100.00	100.00
M:OTHER	4	2	5	66.67	44.44	60.61
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	16	4	7	80.00	69.57	77.67
M:PRON	4	2	2	66.67	66.67	66.67
M:PUNCT	86	8	31	91.49	73.50	87.22
M:VERB	1	1	2	50.00	33.33	45.45
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	4	1	1	80.00	80.00	80.00
R:ADJ	0	0	3	100.00	0.00	0.00
R:ADJ:FORM	0	0	3	100.00	0.00	0.00
R:ADV	1	0	2	100.00	33.33	71.43
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	10	1	4	90.91	71.43	86.21
R:MORPH	15	0	7	100.00	68.18	91.46
R:NOUN	4	1	9	80.00	30.77	60.61
R:NOUN:INFL	3	0	0	100.00	100.00	100.00
R:NOUN:NUM	23	0	10	100.00	69.70	92.00
R:NOUN:POSS	6	0	1	100.00	85.71	96.77
R:ORTH	36	1	17	97.30	67.92	89.55
R:OTHER	55	13	38	80.88	59.14	75.34
R:PART	2	0	1	100.00	66.67	90.91
R:PREP	32	8	17	80.00	65.31	76.56
R:PRON	3	1	1	75.00	75.00	75.00
R:PUNCT	20	19	9	51.28	68.97	54.05
R:SPELL	34	7	3	82.93	91.89	84.58
R:VERB	8	1	11	88.89	42.11	72.73
R:VERB:FORM	14	0	1	100.00	93.33	98.59
R:VERB:SVA	8	1	1	88.89	88.89	88.89
R:VERB:TENSE	12	3	14	80.00	46.15	69.77
R:WO	23	2	8	92.00	74.19	87.79
U:ADJ	1	0	1	100.00	50.00	83.33
U:ADV	1	0	2	100.00	33.33	71.43
U:CONTR	2	1	1	66.67	66.67	66.67
U:DET	33	2	10	94.29	76.74	90.16
U:NOUN	1	1	0	50.00	100.00	55.56
U:NOUN:POSS	2	0	0	100.00	100.00	100.00
U:OTHER	1	4	6	20.00	14.29	18.52
U:PREP	3	0	5	100.00	37.50	75.00
U:PRON	2	0	0	100.00	100.00	100.00
U:PUNCT	14	4	4	77.78	77.78	77.78
U:VERB	1	0	1	100.00	50.00	83.33
U:VERB:TENSE	4	1	2	80.00	66.67	76.92
UNK	3	0	8	100.00	27.27	65.22

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	347	140	154	71.25	69.26	70.85
Span-level detection	380	107	144	78.03	72.52	76.86
Token-level detection	432	98	173	81.51	71.40	79.27

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	83	35	32	70.34	72.17	70.70
R	244	83	109	74.62	69.12	73.45
U	20	22	13	47.62	60.61	49.75

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	3	3	25.00	25.00	25.00
ADV	1	5	0	16.67	100.00	20.00
CONJ	1	2	0	33.33	100.00	38.46
DET	12	18	4	40.00	75.00	44.12
MORPH	2	2	2	50.00	50.00	50.00
NOUN	8	11	4	42.11	66.67	45.45
NOUN:INFL	9	0	2	100.00	81.82	95.74
NOUN:NUM	17	6	5	73.91	77.27	74.56
NOUN:POSS	13	3	5	81.25	72.22	79.27
ORTH	22	1	33	95.65	40.00	74.83
OTHER	28	18	24	60.87	53.85	59.32
PART	1	0	0	100.00	100.00	100.00
PREP	15	15	11	50.00	57.69	51.37
PRON	6	2	1	75.00	85.71	76.92
PUNCT	88	31	36	73.95	70.97	73.33
SPELL	85	7	14	92.39	85.86	91.01
VERB	10	3	4	76.92	71.43	75.76
VERB:FORM	9	2	2	81.82	81.82	81.82
VERB:INFL	4	0	0	100.00	100.00	100.00
VERB:SVA	8	2	0	80.00	100.00	83.33
VERB:TENSE	5	4	4	55.56	55.56	55.56
WO	2	5	0	28.57	100.00	33.33

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	0	0.00	100.00	0.00
M:ADV	0	1	0	0.00	100.00	0.00
M:CONJ	0	2	0	0.00	100.00	0.00
M:DET	6	9	1	40.00	85.71	44.78
M:NOUN	0	2	2	0.00	0.00	0.00
M:NOUN:POSS	3	1	3	75.00	50.00	68.18
M:PREP	2	4	1	33.33	66.67	37.04
M:PRON	2	2	1	50.00	66.67	52.63
M:PUNCT	68	11	23	86.08	74.73	83.54
M:VERB	2	1	1	66.67	66.67	66.67
M:VERB:TENSE	0	1	0	0.00	100.00	0.00
R:ADJ	1	1	3	50.00	25.00	41.67
R:ADV	0	3	0	0.00	100.00	0.00
R:DET	1	2	1	33.33	50.00	35.71
R:MORPH	2	2	2	50.00	50.00	50.00
R:NOUN	8	7	2	53.33	80.00	57.14
R:NOUN:INFL	9	0	2	100.00	81.82	95.74
R:NOUN:NUM	17	6	5	73.91	77.27	74.56
R:NOUN:POSS	10	1	2	90.91	83.33	89.29
R:ORTH	22	1	33	95.65	40.00	74.83
R:OTHER	28	15	23	65.12	54.90	62.78
R:PREP	11	7	8	61.11	57.89	60.44
R:PRON	4	0	0	100.00	100.00	100.00
R:PUNCT	12	18	8	40.00	60.00	42.86
R:SPELL	85	7	14	92.39	85.86	91.01
R:VERB	7	2	2	77.78	77.78	77.78
R:VERB:FORM	9	1	1	90.00	90.00	90.00
R:VERB:INFL	4	0	0	100.00	100.00	100.00
R:VERB:SVA	8	2	0	80.00	100.00	83.33
R:VERB:TENSE	4	3	3	57.14	57.14	57.14
R:WO	2	5	0	28.57	100.00	33.33
U:ADJ	0	1	0	0.00	100.00	0.00
U:ADV	1	1	0	50.00	100.00	55.56
U:CONJ	1	0	0	100.00	100.00	100.00
U:DET	5	7	2	41.67	71.43	45.45
U:NOUN	0	2	0	0.00	100.00	0.00
U:NOUN:POSS	0	1	0	0.00	100.00	0.00
U:OTHER	0	3	1	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	2	4	2	33.33	50.00	35.71
U:PUNCT	8	2	5	80.00	61.54	75.47
U:VERB	1	0	1	100.00	50.00	83.33
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	1	0	1	100.00	50.00	83.33

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	92	26	36	77.97	71.88	76.67
R	266	61	94	81.35	73.89	79.74
U	21	20	11	51.22	65.62	53.57
UNK	1	0	3	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	3	2	40.00	50.00	41.67
ADV	1	4	0	20.00	100.00	23.81
CONJ	1	2	0	33.33	100.00	38.46
DET	13	17	5	43.33	72.22	47.10
MORPH	3	2	2	60.00	60.00	60.00
NOUN	11	6	2	64.71	84.62	67.90
NOUN:INFL	9	0	2	100.00	81.82	95.74
NOUN:NUM	15	7	5	68.18	75.00	69.44
NOUN:POSS	14	2	4	87.50	77.78	85.37
ORTH	24	1	32	96.00	42.86	76.92
OTHER	38	9	18	80.85	67.86	77.87
PART	1	0	0	100.00	100.00	100.00
PREP	16	13	9	55.17	64.00	56.74
PRON	7	1	0	87.50	100.00	89.74
PUNCT	94	28	44	77.05	68.12	75.08
SPELL	89	0	9	100.00	90.82	98.02
UNK	1	0	3	100.00	25.00	62.50
VERB	10	3	4	76.92	71.43	75.76
VERB:FORM	10	2	0	83.33	100.00	86.21
VERB:INFL	4	0	0	100.00	100.00	100.00
VERB:SVA	8	2	0	80.00	100.00	83.33
VERB:TENSE	7	2	3	77.78	70.00	76.09
WO	2	3	0	40.00	100.00	45.45

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	0	0.00	100.00	0.00
M:CONJ	0	2	0	0.00	100.00	0.00
M:DET	6	8	1	42.86	85.71	47.62
M:NOUN	2	0	0	100.00	100.00	100.00
M:NOUN:POSS	3	1	3	75.00	50.00	68.18
M:OTHER	1	0	0	100.00	100.00	100.00
M:PREP	2	3	1	40.00	66.67	43.48
M:PRON	3	1	0	75.00	100.00	78.95
M:PUNCT	72	9	30	88.89	70.59	84.51
M:VERB	2	1	1	66.67	66.67	66.67
M:VERB:TENSE	1	0	0	100.00	100.00	100.00
R:ADJ	2	1	2	66.67	50.00	62.50
R:ADV	0	3	0	0.00	100.00	0.00
R:DET	1	2	2	33.33	33.33	33.33
R:MORPH	3	2	2	60.00	60.00	60.00
R:NOUN	9	4	2	69.23	81.82	71.43
R:NOUN:INFL	9	0	2	100.00	81.82	95.74
R:NOUN:NUM	15	7	5	68.18	75.00	69.44
R:NOUN:POSS	11	1	1	91.67	91.67	91.67
R:ORTH	24	1	32	96.00	42.86	76.92
R:OTHER	37	6	17	86.05	68.52	81.86
R:PREP	12	6	7	66.67	63.16	65.93
R:PRON	4	0	0	100.00	100.00	100.00
R:PUNCT	14	18	9	43.75	60.87	46.36
R:SPELL	89	0	9	100.00	90.82	98.02
R:VERB	7	2	2	77.78	77.78	77.78
R:VERB:FORM	10	1	0	90.91	100.00	92.59
R:VERB:INFL	4	0	0	100.00	100.00	100.00
R:VERB:SVA	8	2	0	80.00	100.00	83.33
R:VERB:TENSE	5	2	2	71.43	71.43	71.43
R:WO	2	3	0	40.00	100.00	45.45
U:ADJ	0	1	0	0.00	100.00	0.00
U:ADV	1	1	0	50.00	100.00	55.56
U:CONJ	1	0	0	100.00	100.00	100.00
U:DET	6	7	2	46.15	75.00	50.00
U:NOUN	0	2	0	0.00	100.00	0.00
U:OTHER	0	3	1	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	2	4	1	33.33	66.67	37.04
U:PUNCT	8	1	5	88.89	61.54	81.63
U:VERB	1	0	1	100.00	50.00	83.33
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	1	0	1	100.00	50.00	83.33
UNK	1	0	3	100.00	25.00	62.50

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	103	20	46	83.74	69.13	80.34
R	305	59	111	83.79	73.32	81.46
U	22	19	15	53.66	59.46	54.73
UNK	2	0	1	100.00	66.67	90.91

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	3	3	50.00	50.00	50.00
ADV	1	4	0	20.00	100.00	23.81
CONJ	1	1	0	50.00	100.00	55.56
CONTR	0	0	1	100.00	0.00	0.00
DET	13	13	6	50.00	68.42	52.85
MORPH	3	1	3	75.00	50.00	68.18
NOUN	13	6	4	68.42	76.47	69.89
NOUN:INFL	9	0	2	100.00	81.82	95.74
NOUN:NUM	15	5	6	75.00	71.43	74.26
NOUN:POSS	15	1	5	93.75	75.00	89.29
ORTH	41	1	40	97.62	50.62	82.33
OTHER	53	11	23	82.81	69.74	79.82
PART	1	0	0	100.00	100.00	100.00
PREP	15	12	9	55.56	62.50	56.82
PRON	7	1	0	87.50	100.00	89.74
PUNCT	107	25	52	81.06	67.30	77.87
SPELL	90	0	9	100.00	90.91	98.04
UNK	2	0	1	100.00	66.67	90.91
VERB	10	4	3	71.43	76.92	72.46
VERB:FORM	10	1	0	90.91	100.00	92.59
VERB:INFL	4	0	0	100.00	100.00	100.00
VERB:SVA	8	2	1	80.00	88.89	81.63
VERB:TENSE	7	2	5	77.78	58.33	72.92
WO	4	5	0	44.44	100.00	50.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	0	0.00	100.00	0.00
M:CONJ	0	1	0	0.00	100.00	0.00
M:DET	6	5	2	54.55	75.00	57.69
M:NOUN	3	0	1	100.00	75.00	93.75
M:NOUN:POSS	3	1	3	75.00	50.00	68.18
M:OTHER	1	0	0	100.00	100.00	100.00
M:PREP	3	3	1	50.00	75.00	53.57
M:PRON	3	1	0	75.00	100.00	78.95
M:PUNCT	81	6	39	93.10	67.50	86.54
M:VERB	2	2	0	50.00	100.00	55.56
M:VERB:TENSE	1	0	0	100.00	100.00	100.00
R:ADJ	3	1	2	75.00	60.00	71.43
R:ADV	0	3	0	0.00	100.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	1	2	1	33.33	50.00	35.71
R:MORPH	3	1	3	75.00	50.00	68.18
R:NOUN	9	4	2	69.23	81.82	71.43
R:NOUN:INFL	9	0	2	100.00	81.82	95.74
R:NOUN:NUM	15	5	6	75.00	71.43	74.26
R:NOUN:POSS	12	0	2	100.00	85.71	96.77
R:ORTH	41	1	40	97.62	50.62	82.33
R:OTHER	52	6	21	89.66	71.23	85.25
R:PREP	11	6	7	64.71	61.11	63.95
R:PRON	4	0	0	100.00	100.00	100.00
R:PUNCT	17	18	8	48.57	68.00	51.52
R:SPELL	90	0	9	100.00	90.91	98.04
R:VERB	7	2	2	77.78	77.78	77.78
R:VERB:FORM	10	1	0	90.91	100.00	92.59
R:VERB:INFL	4	0	0	100.00	100.00	100.00
R:VERB:SVA	8	2	1	80.00	88.89	81.63
R:VERB:TENSE	5	2	4	71.43	55.56	67.57
R:WO	4	5	0	44.44	100.00	50.00
U:ADJ	0	1	1	0.00	0.00	0.00
U:ADV	1	1	0	50.00	100.00	55.56
U:CONJ	1	0	0	100.00	100.00	100.00
U:DET	6	6	3	50.00	66.67	52.63
U:NOUN	1	2	1	33.33	50.00	35.71
U:OTHER	0	5	2	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	1	3	1	25.00	50.00	27.78
U:PUNCT	9	1	5	90.00	64.29	83.33
U:VERB	1	0	1	100.00	50.00	83.33
U:VERB:TENSE	1	0	1	100.00	50.00	83.33
UNK	2	0	1	100.00	66.67	90.91

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:44:38+00:00
Competition submission:	21
Competition phase:	3 - Open phase

Detailed results

Submission information

Results