BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	2554	1646	2432	60.81	51.22	58.62
Span-level detection	3021	1186	2244	71.81	57.38	68.37
Token-level detection	3748	940	2664	79.95	58.45	74.47

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	585	331	580	63.86	50.21	60.57
R	1550	904	1655	63.16	48.36	59.52
U	419	411	197	50.48	68.02	53.23

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	15	12	27	55.56	35.71	50.00
ADJ:FORM	6	0	6	100.00	50.00	83.33
ADV	39	51	43	43.33	47.56	44.12
CONJ	6	12	23	33.33	20.69	29.70
CONTR	9	6	4	60.00	69.23	61.64
DET	425	238	228	64.10	65.08	64.30
MORPH	73	29	76	71.57	48.99	65.53
NOUN	23	75	101	23.47	18.55	22.29
NOUN:INFL	13	6	6	68.42	68.42	68.42
NOUN:NUM	183	95	77	65.83	70.38	66.69
NOUN:POSS	20	9	36	68.97	35.71	58.14
ORTH	221	48	164	82.16	57.40	75.63
OTHER	145	278	551	34.28	20.83	30.36
PART	18	14	9	56.25	66.67	58.06
PREP	258	177	182	59.31	58.64	59.17
PRON	61	63	77	49.19	44.20	48.11
PUNCT	275	85	346	76.39	44.28	66.72
SPELL	252	141	74	64.12	77.30	66.39
VERB	74	76	138	49.33	34.91	45.57
VERB:FORM	147	61	52	70.67	73.87	71.29
VERB:INFL	6	0	1	100.00	85.71	96.77
VERB:SVA	129	44	27	74.57	82.69	76.06
VERB:TENSE	116	107	137	52.02	45.85	50.66
WO	40	19	47	67.80	45.98	61.92

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	5	6	3	45.45	62.50	48.08
M:ADV	9	21	19	30.00	32.14	30.41
M:CONJ	5	5	10	50.00	33.33	45.45
M:CONTR	1	3	0	25.00	100.00	29.41
M:DET	178	53	112	77.06	61.38	73.31
M:NOUN	2	24	9	7.69	18.18	8.70
M:NOUN:POSS	4	2	12	66.67	25.00	50.00
M:OTHER	18	33	41	35.29	30.51	34.22
M:PART	1	3	1	25.00	50.00	27.78
M:PREP	66	55	36	54.55	64.71	56.31
M:PRON	39	38	36	50.65	52.00	50.91
M:PUNCT	196	41	259	82.70	43.08	69.85
M:VERB	18	27	17	40.00	51.43	41.86
M:VERB:FORM	17	7	3	70.83	85.00	73.28
M:VERB:TENSE	26	13	22	66.67	54.17	63.73
R:ADJ	6	2	20	75.00	23.08	51.72
R:ADJ:FORM	6	0	6	100.00	50.00	83.33
R:ADV	8	8	14	50.00	36.36	46.51
R:CONJ	0	0	6	100.00	0.00	0.00
R:CONTR	2	2	2	50.00	50.00	50.00
R:DET	43	28	64	60.56	40.19	54.99
R:MORPH	73	29	76	71.57	48.99	65.53
R:NOUN	14	34	84	29.17	14.29	24.14
R:NOUN:INFL	13	6	6	68.42	68.42	68.42
R:NOUN:NUM	183	95	77	65.83	70.38	66.69
R:NOUN:POSS	7	3	21	70.00	25.00	51.47
R:ORTH	221	48	164	82.16	57.40	75.63
R:OTHER	108	171	493	38.71	17.97	31.45
R:PART	14	11	6	56.00	70.00	58.33
R:PREP	135	77	120	63.68	52.94	61.20
R:PRON	12	15	29	44.44	29.27	40.27
R:PUNCT	46	23	56	66.67	45.10	60.85
R:SPELL	252	141	74	64.12	77.30	66.39
R:VERB	46	26	107	63.89	30.07	52.15
R:VERB:FORM	115	48	48	70.55	70.55	70.55
R:VERB:INFL	6	0	1	100.00	85.71	96.77
R:VERB:SVA	129	44	27	74.57	82.69	76.06
R:VERB:TENSE	71	74	107	48.97	39.89	46.83
R:WO	40	19	47	67.80	45.98	61.92
U:ADJ	4	4	4	50.00	50.00	50.00
U:ADV	22	22	10	50.00	68.75	52.88
U:CONJ	1	7	7	12.50	12.50	12.50
U:CONTR	6	1	2	85.71	75.00	83.33
U:DET	204	157	52	56.51	79.69	60.00
U:NOUN	7	17	8	29.17	46.67	31.53
U:NOUN:POSS	9	4	3	69.23	75.00	70.31
U:OTHER	19	74	17	20.43	52.78	23.28
U:PART	3	0	2	100.00	60.00	88.24
U:PREP	57	45	26	55.88	68.67	58.04
U:PRON	10	10	12	50.00	45.45	49.02
U:PUNCT	33	21	31	61.11	51.56	58.93
U:VERB	10	23	14	30.30	41.67	32.05
U:VERB:FORM	15	6	1	71.43	93.75	75.00
U:VERB:TENSE	19	20	8	48.72	70.37	51.91

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	666	251	540	72.63	55.22	68.32
R	1892	584	1452	76.41	56.58	71.41
U	445	351	196	55.90	69.42	58.17
UNK	18	0	56	100.00	24.32	61.64

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	22	9	31	70.97	41.51	62.15
ADJ:FORM	4	1	7	80.00	36.36	64.52
ADV	44	40	41	52.38	51.76	52.26
CONJ	9	11	24	45.00	27.27	39.82
CONTR	9	4	2	69.23	81.82	71.43
DET	472	206	222	69.62	68.01	69.29
MORPH	84	18	72	82.35	53.85	74.47
NOUN	44	60	89	42.31	33.08	40.07
NOUN:INFL	18	1	2	94.74	90.00	93.75
NOUN:NUM	177	75	74	70.24	70.52	70.29
NOUN:POSS	27	6	30	81.82	47.37	71.43
ORTH	246	38	141	86.62	63.57	80.76
OTHER	288	183	460	61.15	38.50	54.71
PART	23	13	7	63.89	76.67	66.09
PREP	294	127	173	69.83	62.96	68.34
PRON	79	42	70	65.29	53.02	62.40
PUNCT	301	68	319	81.57	48.55	71.80
SPELL	275	78	50	77.90	84.62	79.16
UNK	18	0	56	100.00	24.32	61.64
VERB	115	52	130	68.86	46.94	62.98
VERB:FORM	144	43	51	77.01	73.85	76.35
VERB:INFL	7	0	2	100.00	77.78	94.59
VERB:SVA	140	26	20	84.34	87.50	84.95
VERB:TENSE	144	69	124	67.61	53.73	64.29
WO	37	16	47	69.81	44.05	62.50

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	5	5	4	50.00	55.56	51.02
M:ADV	10	16	18	38.46	35.71	37.88
M:CONJ	7	4	12	63.64	36.84	55.56
M:CONTR	0	3	0	0.00	100.00	0.00
M:DET	200	40	112	83.33	64.10	78.62
M:NOUN	7	20	9	25.93	43.75	28.23
M:NOUN:POSS	4	2	11	66.67	26.67	51.28
M:OTHER	28	24	37	53.85	43.08	51.28
M:PART	3	3	2	50.00	60.00	51.72
M:PREP	69	45	36	60.53	65.71	61.50
M:PRON	47	26	31	64.38	60.26	63.51
M:PUNCT	213	29	240	88.02	47.02	74.95
M:VERB	27	18	10	60.00	72.97	62.21
M:VERB:FORM	17	7	1	70.83	94.44	74.56
M:VERB:TENSE	29	9	17	76.32	63.04	73.23
R:ADJ	13	1	23	92.86	36.11	70.65
R:ADJ:FORM	4	1	7	80.00	36.36	64.52
R:ADV	12	5	15	70.59	44.44	63.16
R:CONJ	0	0	6	100.00	0.00	0.00
R:CONTR	3	1	0	75.00	100.00	78.95
R:DET	63	25	54	71.59	53.85	67.16
R:MORPH	84	18	72	82.35	53.85	74.47
R:NOUN	28	27	71	50.91	28.28	43.89
R:NOUN:INFL	18	1	2	94.74	90.00	93.75
R:NOUN:NUM	177	75	74	70.24	70.52	70.29
R:NOUN:POSS	14	1	15	93.33	48.28	78.65
R:ORTH	246	38	141	86.62	63.57	80.76
R:OTHER	239	91	406	72.42	37.05	60.81
R:PART	17	10	3	62.96	85.00	66.41
R:PREP	165	52	112	76.04	59.57	72.05
R:PRON	17	10	29	62.96	36.96	55.19
R:PUNCT	48	18	50	72.73	48.98	66.30
R:SPELL	275	78	50	77.90	84.62	79.16
R:VERB	78	15	104	83.87	42.86	70.40
R:VERB:FORM	112	30	49	78.87	69.57	76.82
R:VERB:INFL	7	0	2	100.00	77.78	94.59
R:VERB:SVA	140	26	20	84.34	87.50	84.95
R:VERB:TENSE	95	45	100	67.86	48.72	62.91
R:WO	37	16	47	69.81	44.05	62.50
U:ADJ	4	3	4	57.14	50.00	55.56
U:ADV	22	19	8	53.66	73.33	56.70
U:CONJ	2	7	6	22.22	25.00	22.73
U:CONTR	6	0	2	100.00	75.00	93.75
U:DET	209	141	56	59.71	78.87	62.76
U:NOUN	9	13	9	40.91	50.00	42.45
U:NOUN:POSS	9	3	4	75.00	69.23	73.77
U:OTHER	21	68	17	23.60	55.26	26.65
U:PART	3	0	2	100.00	60.00	88.24
U:PREP	60	30	25	66.67	70.59	67.42
U:PRON	15	6	10	71.43	60.00	68.81
U:PUNCT	40	21	29	65.57	57.97	63.90
U:VERB	10	19	16	34.48	38.46	35.21
U:VERB:FORM	15	6	1	71.43	93.75	75.00
U:VERB:TENSE	20	15	7	57.14	74.07	59.88
UNK	18	0	56	100.00	24.32	61.64

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	797	157	551	83.54	59.12	77.17
R	2395	464	1752	83.77	57.75	76.85
U	511	319	277	61.57	64.85	62.20
UNK	45	0	84	100.00	34.88	72.82

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	18	7	36	72.00	33.33	58.44
ADJ:FORM	6	0	9	100.00	40.00	76.92
ADV	53	30	44	63.86	54.64	61.77
CONJ	18	8	25	69.23	41.86	61.22
CONTR	9	3	3	75.00	75.00	75.00
DET	493	170	220	74.36	69.14	73.25
MORPH	89	13	68	87.25	56.69	78.76
NOUN	60	43	104	58.25	36.59	52.08
NOUN:INFL	17	0	2	100.00	89.47	97.70
NOUN:NUM	177	51	77	77.63	69.69	75.90
NOUN:POSS	40	4	30	90.91	57.14	81.30
ORTH	301	31	157	90.66	65.72	84.27
OTHER	616	174	707	77.97	46.56	68.70
PART	16	6	6	72.73	72.73	72.73
PREP	306	96	179	76.12	63.09	73.10
PRON	93	29	58	76.23	61.59	72.77
PUNCT	393	46	337	89.52	53.84	79.04
SPELL	274	65	49	80.83	84.83	81.60
UNK	45	0	84	100.00	34.88	72.82
VERB	143	32	152	81.71	48.47	71.86
VERB:FORM	147	31	55	82.58	72.77	80.42
VERB:INFL	7	0	1	100.00	87.50	97.22
VERB:SVA	139	20	17	87.42	89.10	87.75
VERB:TENSE	165	64	154	72.05	51.72	66.80
WO	123	17	90	87.86	57.75	79.56

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	2	3	7	40.00	22.22	34.48
M:ADV	16	10	15	61.54	51.61	59.26
M:CONJ	16	2	14	88.89	53.33	78.43
M:CONTR	0	3	0	0.00	100.00	0.00
M:DET	216	20	101	91.53	68.14	85.65
M:NOUN	11	18	11	37.93	50.00	39.86
M:NOUN:POSS	7	2	9	77.78	43.75	67.31
M:OTHER	36	14	46	72.00	43.90	63.83
M:PART	3	3	1	50.00	75.00	53.57
M:PREP	77	29	39	72.64	66.38	71.30
M:PRON	56	17	28	76.71	66.67	74.47
M:PUNCT	279	17	239	94.26	53.86	81.96
M:VERB	30	14	19	68.18	61.22	66.67
M:VERB:FORM	16	2	2	88.89	88.89	88.89
M:VERB:TENSE	32	3	20	91.43	61.54	83.33
R:ADJ	13	1	24	92.86	35.14	69.89
R:ADJ:FORM	6	0	9	100.00	40.00	76.92
R:ADV	13	4	16	76.47	44.83	67.01
R:CONJ	0	0	6	100.00	0.00	0.00
R:CONTR	3	0	0	100.00	100.00	100.00
R:DET	66	20	60	76.74	52.38	70.21
R:MORPH	89	13	68	87.25	56.69	78.76
R:NOUN	38	18	81	67.86	31.93	55.39
R:NOUN:INFL	17	0	2	100.00	89.47	97.70
R:NOUN:NUM	177	51	77	77.63	69.69	75.90
R:NOUN:POSS	22	0	15	100.00	59.46	88.00
R:ORTH	301	31	157	90.66	65.72	84.27
R:OTHER	525	79	590	86.92	47.09	74.34
R:PART	11	3	3	78.57	78.57	78.57
R:PREP	168	44	113	79.25	59.79	74.40
R:PRON	19	8	23	70.37	45.24	63.33
R:PUNCT	61	9	65	87.14	48.41	75.12
R:SPELL	274	65	49	80.83	84.83	81.60
R:VERB	96	9	111	91.43	46.38	76.56
R:VERB:FORM	118	23	51	83.69	69.82	80.49
R:VERB:INFL	7	0	1	100.00	87.50	97.22
R:VERB:SVA	139	20	17	87.42	89.10	87.75
R:VERB:TENSE	109	49	124	68.99	46.78	63.01
R:WO	123	17	90	87.86	57.75	79.56
U:ADJ	3	3	5	50.00	37.50	46.88
U:ADV	24	16	13	60.00	64.86	60.91
U:CONJ	2	6	5	25.00	28.57	25.64
U:CONTR	6	0	3	100.00	66.67	90.91
U:DET	211	130	59	61.88	78.15	64.57
U:NOUN	11	7	12	61.11	47.83	57.89
U:NOUN:POSS	11	2	6	84.62	64.71	79.71
U:OTHER	55	81	71	40.44	43.65	41.04
U:PART	2	0	2	100.00	50.00	83.33
U:PREP	61	23	27	72.62	69.32	71.93
U:PRON	18	4	7	81.82	72.00	79.65
U:PUNCT	53	20	33	72.60	61.63	70.11
U:VERB	17	9	22	65.38	43.59	59.44
U:VERB:FORM	13	6	2	68.42	86.67	71.43
U:VERB:TENSE	24	12	10	66.67	70.59	67.42
UNK	45	0	84	100.00	34.88	72.82

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1106	615	1111	64.26	49.89	60.76
Span-level detection	1341	382	1018	77.83	56.85	72.48
Token-level detection	1686	240	1170	87.54	59.03	79.83

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	242	146	252	62.37	48.99	59.14
R	700	349	767	66.73	47.72	61.80
U	164	120	92	57.75	64.06	58.91

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	9	5	6	64.29	60.00	63.38
ADJ:FORM	2	0	4	100.00	33.33	71.43
ADV	16	17	20	48.48	44.44	47.62
CONJ	4	4	8	50.00	33.33	45.45
CONTR	6	2	1	75.00	85.71	76.92
DET	176	68	112	72.13	61.11	69.62
MORPH	36	7	42	83.72	46.15	72.00
NOUN	7	34	44	17.07	13.73	16.28
NOUN:INFL	5	1	1	83.33	83.33	83.33
NOUN:NUM	87	36	40	70.73	68.50	70.27
NOUN:POSS	6	1	10	85.71	37.50	68.18
ORTH	119	20	80	85.61	59.80	78.81
OTHER	73	116	283	38.62	20.51	32.82
PART	10	5	3	66.67	76.92	68.49
PREP	100	53	75	65.36	57.14	63.53
PRON	29	29	45	50.00	39.19	47.39
PUNCT	83	38	146	68.60	36.24	58.20
SPELL	94	53	23	63.95	80.34	66.67
VERB	36	30	60	54.55	37.50	50.00
VERB:FORM	70	25	23	73.68	75.27	74.00
VERB:INFL	2	0	0	100.00	100.00	100.00
VERB:SVA	67	18	15	78.82	81.71	79.38
VERB:TENSE	55	45	58	55.00	48.67	53.61
WO	14	8	12	63.64	53.85	61.40

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	4	1	42.86	75.00	46.88
M:ADV	1	9	10	10.00	9.09	9.80
M:CONJ	3	2	2	60.00	60.00	60.00
M:CONTR	1	1	0	50.00	100.00	55.56
M:DET	76	21	43	78.35	63.87	74.95
M:NOUN	1	12	3	7.69	25.00	8.93
M:NOUN:POSS	1	0	3	100.00	25.00	62.50
M:OTHER	15	12	23	55.56	39.47	51.37
M:PART	1	1	0	50.00	100.00	55.56
M:PREP	29	20	17	59.18	63.04	59.92
M:PRON	18	16	18	52.94	50.00	52.33
M:PUNCT	58	24	111	70.73	34.32	58.35
M:VERB	8	11	10	42.11	44.44	42.55
M:VERB:FORM	13	6	1	68.42	92.86	72.22
M:VERB:TENSE	14	7	10	66.67	58.33	64.81
R:ADJ	3	0	4	100.00	42.86	78.95
R:ADJ:FORM	2	0	4	100.00	33.33	71.43
R:ADV	4	0	7	100.00	36.36	74.07
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	1	1	50.00	50.00	50.00
R:DET	13	13	31	50.00	29.55	43.92
R:MORPH	36	7	42	83.72	46.15	72.00
R:NOUN	3	11	35	21.43	7.89	15.96
R:NOUN:INFL	5	1	1	83.33	83.33	83.33
R:NOUN:NUM	87	36	40	70.73	68.50	70.27
R:NOUN:POSS	3	0	6	100.00	33.33	71.43
R:ORTH	119	20	80	85.61	59.80	78.81
R:OTHER	51	80	255	38.93	16.67	30.72
R:PART	8	4	2	66.67	80.00	68.97
R:PREP	48	22	48	68.57	50.00	63.83
R:PRON	7	7	19	50.00	26.92	42.68
R:PUNCT	19	9	23	67.86	45.24	61.69
R:SPELL	94	53	23	63.95	80.34	66.67
R:VERB	22	9	47	70.97	31.88	56.99
R:VERB:FORM	56	17	22	76.71	71.79	75.68
R:VERB:INFL	2	0	0	100.00	100.00	100.00
R:VERB:SVA	67	18	15	78.82	81.71	79.38
R:VERB:TENSE	36	33	48	52.17	42.86	50.00
R:WO	14	8	12	63.64	53.85	61.40
U:ADJ	3	1	1	75.00	75.00	75.00
U:ADV	11	8	3	57.89	78.57	61.11
U:CONJ	1	2	4	33.33	20.00	29.41
U:CONTR	4	0	0	100.00	100.00	100.00
U:DET	87	34	38	71.90	69.60	71.43
U:NOUN	3	11	6	21.43	33.33	23.08
U:NOUN:POSS	2	1	1	66.67	66.67	66.67
U:OTHER	7	24	5	22.58	58.33	25.74
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	23	11	10	67.65	69.70	68.05
U:PRON	4	6	8	40.00	33.33	38.46
U:PUNCT	6	5	12	54.55	33.33	48.39
U:VERB	6	10	3	37.50	66.67	41.10
U:VERB:FORM	1	2	0	33.33	100.00	38.46
U:VERB:TENSE	5	5	0	50.00	100.00	55.56

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	277	105	219	72.51	55.85	68.43
R	874	184	671	82.61	56.57	75.64
U	181	93	87	66.06	67.54	66.35
UNK	9	0	41	100.00	18.00	52.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	10	3	9	76.92	52.63	70.42
ADJ:FORM	1	0	5	100.00	16.67	50.00
ADV	19	12	18	61.29	51.35	59.01
CONJ	5	4	9	55.56	35.71	50.00
CONTR	5	2	0	71.43	100.00	75.76
DET	190	63	106	75.10	64.19	72.63
MORPH	45	3	39	93.75	53.57	81.52
NOUN	20	24	38	45.45	34.48	42.74
NOUN:INFL	5	0	1	100.00	83.33	96.15
NOUN:NUM	82	23	37	78.10	68.91	76.07
NOUN:POSS	8	0	8	100.00	50.00	83.33
ORTH	135	12	59	91.84	69.59	86.32
OTHER	154	68	235	69.37	39.59	60.30
PART	11	4	2	73.33	84.62	75.34
PREP	122	29	70	80.79	63.54	76.63
PRON	44	16	42	73.33	51.16	67.48
PUNCT	91	24	124	79.13	42.33	67.41
SPELL	103	25	12	80.47	89.57	82.14
UNK	9	0	41	100.00	18.00	52.33
VERB	53	16	64	76.81	45.30	67.43
VERB:FORM	66	17	24	79.52	73.33	78.20
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	71	8	12	89.87	85.54	88.97
VERB:TENSE	75	24	49	75.76	60.48	72.12
WO	14	5	13	73.68	51.85	67.96

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	3	3	1	50.00	75.00	53.57
M:ADV	3	6	10	33.33	23.08	30.61
M:CONJ	3	2	3	60.00	50.00	57.69
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	80	21	43	79.21	65.04	75.90
M:NOUN	2	10	3	16.67	40.00	18.87
M:NOUN:POSS	1	0	3	100.00	25.00	62.50
M:OTHER	20	8	17	71.43	54.05	67.11
M:PART	1	1	0	50.00	100.00	55.56
M:PREP	33	14	16	70.21	67.35	69.62
M:PRON	25	9	16	73.53	60.98	70.62
M:PUNCT	63	13	95	82.89	39.87	68.18
M:VERB	14	5	6	73.68	70.00	72.92
M:VERB:FORM	13	6	0	68.42	100.00	73.03
M:VERB:TENSE	16	6	6	72.73	72.73	72.73
R:ADJ	4	0	7	100.00	36.36	74.07
R:ADJ:FORM	1	0	5	100.00	16.67	50.00
R:ADV	6	0	6	100.00	50.00	83.33
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	20	13	26	60.61	43.48	56.18
R:MORPH	45	3	39	93.75	53.57	81.52
R:NOUN	13	7	30	65.00	30.23	52.85
R:NOUN:INFL	5	0	1	100.00	83.33	96.15
R:NOUN:NUM	82	23	37	78.10	68.91	76.07
R:NOUN:POSS	5	0	3	100.00	62.50	89.29
R:ORTH	135	12	59	91.84	69.59	86.32
R:OTHER	126	36	213	77.78	37.17	63.83
R:PART	9	3	1	75.00	90.00	77.59
R:PREP	62	10	47	86.11	56.88	78.09
R:PRON	11	4	20	73.33	35.48	60.44
R:PUNCT	19	6	20	76.00	48.72	68.35
R:SPELL	103	25	12	80.47	89.57	82.14
R:VERB	34	4	51	89.47	40.00	71.73
R:VERB:FORM	52	9	24	85.25	68.42	81.25
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	71	8	12	89.87	85.54	88.97
R:VERB:TENSE	53	15	42	77.94	55.79	72.21
R:WO	14	5	13	73.68	51.85	67.96
U:ADJ	3	0	1	100.00	75.00	93.75
U:ADV	10	6	2	62.50	83.33	65.79
U:CONJ	2	2	4	50.00	33.33	45.45
U:CONTR	4	0	0	100.00	100.00	100.00
U:DET	90	29	37	75.63	70.87	74.63
U:NOUN	5	7	5	41.67	50.00	43.10
U:NOUN:POSS	2	0	2	100.00	50.00	83.33
U:OTHER	8	24	5	25.00	61.54	28.37
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	27	5	7	84.38	79.41	83.33
U:PRON	8	3	6	72.73	57.14	68.97
U:PUNCT	9	5	9	64.29	50.00	60.81
U:VERB	5	7	7	41.67	41.67	41.67
U:VERB:FORM	1	2	0	33.33	100.00	38.46
U:VERB:TENSE	6	3	1	66.67	85.71	69.77
UNK	9	0	41	100.00	18.00	52.33

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	339	49	211	87.37	61.64	80.64
R	1097	116	803	90.44	57.74	81.24
U	220	75	102	74.58	68.32	73.24
UNK	30	0	54	100.00	35.71	73.53

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	9	1	8	90.00	52.94	78.95
ADJ:FORM	1	0	6	100.00	14.29	45.45
ADV	25	8	17	75.76	59.52	71.84
CONJ	8	2	10	80.00	44.44	68.97
CONTR	5	1	1	83.33	83.33	83.33
DET	208	41	106	83.53	66.24	79.39
MORPH	49	3	34	94.23	59.04	84.19
NOUN	29	16	49	64.44	37.18	56.20
NOUN:INFL	5	0	1	100.00	83.33	96.15
NOUN:NUM	82	9	40	90.11	67.21	84.36
NOUN:POSS	14	0	6	100.00	70.00	92.11
ORTH	151	9	59	94.37	71.90	88.82
OTHER	306	51	332	85.71	47.96	74.06
PART	7	1	3	87.50	70.00	83.33
PREP	128	20	75	86.49	63.05	80.50
PRON	52	8	30	86.67	63.41	80.75
PUNCT	134	12	135	91.78	49.81	78.55
SPELL	101	19	11	84.17	90.18	85.30
UNK	30	0	54	100.00	35.71	73.53
VERB	70	6	73	92.11	48.95	78.30
VERB:FORM	68	8	26	89.47	72.34	85.43
VERB:INFL	3	0	0	100.00	100.00	100.00
VERB:SVA	75	4	10	94.94	88.24	93.52
VERB:TENSE	85	18	62	82.52	57.82	76.03
WO	41	3	22	93.18	65.08	85.77

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	1	50.00	50.00	50.00
M:ADV	6	4	8	60.00	42.86	55.56
M:CONJ	6	0	5	100.00	54.55	85.71
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	89	9	36	90.82	71.20	86.07
M:NOUN	3	9	4	25.00	42.86	27.27
M:NOUN:POSS	2	0	2	100.00	50.00	83.33
M:OTHER	24	3	20	88.89	54.55	78.95
M:PART	1	1	0	50.00	100.00	55.56
M:PREP	37	7	17	84.09	68.52	80.43
M:PRON	31	4	13	88.57	70.45	84.24
M:PUNCT	95	5	90	95.00	51.35	81.20
M:VERB	16	3	8	84.21	66.67	80.00
M:VERB:FORM	11	1	1	91.67	91.67	91.67
M:VERB:TENSE	17	1	6	94.44	73.91	89.47
R:ADJ	5	0	7	100.00	41.67	78.12
R:ADJ:FORM	1	0	6	100.00	14.29	45.45
R:ADV	7	0	7	100.00	50.00	83.33
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	23	9	32	71.88	41.82	62.84
R:MORPH	49	3	34	94.23	59.04	84.19
R:NOUN	19	4	38	82.61	33.33	63.76
R:NOUN:INFL	5	0	1	100.00	83.33	96.15
R:NOUN:NUM	82	9	40	90.11	67.21	84.36
R:NOUN:POSS	8	0	0	100.00	100.00	100.00
R:ORTH	151	9	59	94.37	71.90	88.82
R:OTHER	263	24	299	91.64	46.80	76.90
R:PART	5	0	2	100.00	71.43	92.59
R:PREP	63	9	52	87.50	54.78	78.16
R:PRON	13	2	13	86.67	50.00	75.58
R:PUNCT	21	1	35	95.45	37.50	72.92
R:SPELL	101	19	11	84.17	90.18	85.30
R:VERB	45	0	56	100.00	44.55	80.07
R:VERB:FORM	56	5	24	91.80	70.00	86.42
R:VERB:INFL	3	0	0	100.00	100.00	100.00
R:VERB:SVA	75	4	10	94.94	88.24	93.52
R:VERB:TENSE	60	15	54	80.00	52.63	72.46
R:WO	41	3	22	93.18	65.08	85.77
U:ADJ	3	0	0	100.00	100.00	100.00
U:ADV	12	4	2	75.00	85.71	76.92
U:CONJ	2	2	4	50.00	33.33	45.45
U:CONTR	4	0	1	100.00	80.00	95.24
U:DET	96	23	38	80.67	71.64	78.69
U:NOUN	7	3	7	70.00	50.00	64.81
U:NOUN:POSS	4	0	4	100.00	50.00	83.33
U:OTHER	19	24	13	44.19	59.38	46.57
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	28	4	6	87.50	82.35	86.42
U:PRON	8	2	4	80.00	66.67	76.92
U:PUNCT	18	6	10	75.00	64.29	72.58
U:VERB	9	3	9	75.00	50.00	68.18
U:VERB:FORM	1	2	1	33.33	50.00	35.71
U:VERB:TENSE	8	2	2	80.00	80.00	80.00
UNK	30	0	54	100.00	35.71	73.53

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	776	479	817	61.83	48.71	58.67
Span-level detection	916	342	741	72.81	55.28	68.47
Token-level detection	1136	252	907	81.84	55.60	74.79

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	186	104	198	64.14	48.44	60.23
R	441	271	556	61.94	44.23	57.35
U	149	104	63	58.89	70.28	60.87

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	4	4	12	50.00	25.00	41.67
ADJ:FORM	3	0	0	100.00	100.00	100.00
ADV	17	17	18	50.00	48.57	49.71
CONJ	1	3	10	25.00	9.09	18.52
CONTR	3	0	0	100.00	100.00	100.00
DET	142	63	80	69.27	63.96	68.14
MORPH	18	10	21	64.29	46.15	59.60
NOUN	10	23	34	30.30	22.73	28.41
NOUN:INFL	0	2	0	0.00	100.00	0.00
NOUN:NUM	59	24	21	71.08	73.75	71.60
NOUN:POSS	6	2	8	75.00	42.86	65.22
ORTH	39	15	38	72.22	50.65	66.55
OTHER	27	72	187	27.27	12.62	22.13
PART	6	5	4	54.55	60.00	55.56
PREP	101	60	64	62.73	61.21	62.42
PRON	21	18	24	53.85	46.67	52.24
PUNCT	86	23	111	78.90	43.65	67.93
SPELL	57	47	15	54.81	79.17	58.40
VERB	30	26	59	53.57	33.71	47.92
VERB:FORM	49	20	22	71.01	69.01	70.61
VERB:SVA	42	11	11	79.25	79.25	79.25
VERB:TENSE	43	29	54	59.72	44.33	55.84
WO	12	5	24	70.59	33.33	57.69

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	2	2	33.33	33.33	33.33
M:ADV	7	6	8	53.85	46.67	52.24
M:CONJ	1	1	6	50.00	14.29	33.33
M:DET	62	18	44	77.50	58.49	72.77
M:NOUN	1	6	0	14.29	100.00	17.24
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:OTHER	2	13	9	13.33	18.18	14.08
M:PART	0	1	1	0.00	0.00	0.00
M:PREP	18	23	12	43.90	60.00	46.39
M:PRON	16	13	13	55.17	55.17	55.17
M:PUNCT	61	8	83	88.41	42.36	72.62
M:VERB	7	8	4	46.67	63.64	49.30
M:VERB:FORM	1	0	1	100.00	50.00	83.33
M:VERB:TENSE	9	5	10	64.29	47.37	60.00
R:ADJ	2	1	8	66.67	20.00	45.45
R:ADJ:FORM	3	0	0	100.00	100.00	100.00
R:ADV	3	5	4	37.50	42.86	38.46
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	20	8	28	71.43	41.67	62.50
R:MORPH	18	10	21	64.29	46.15	59.60
R:NOUN	6	12	33	33.33	15.38	27.03
R:NOUN:INFL	0	2	0	0.00	100.00	0.00
R:NOUN:NUM	59	24	21	71.08	73.75	71.60
R:NOUN:POSS	2	0	1	100.00	66.67	90.91
R:ORTH	39	15	38	72.22	50.65	66.55
R:OTHER	17	42	170	28.81	9.09	20.09
R:PART	5	4	2	55.56	71.43	58.14
R:PREP	55	25	44	68.75	55.56	65.63
R:PRON	1	4	7	20.00	12.50	17.86
R:PUNCT	13	9	21	59.09	38.24	53.28
R:SPELL	57	47	15	54.81	79.17	58.40
R:VERB	19	10	47	65.52	28.79	52.20
R:VERB:FORM	42	18	20	70.00	67.74	69.54
R:VERB:SVA	42	11	11	79.25	79.25	79.25
R:VERB:TENSE	25	19	39	56.82	39.06	52.08
R:WO	12	5	24	70.59	33.33	57.69
U:ADJ	1	1	2	50.00	33.33	45.45
U:ADV	7	6	6	53.85	53.85	53.85
U:CONJ	0	2	2	0.00	0.00	0.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	60	37	8	61.86	88.24	65.79
U:NOUN	3	5	1	37.50	75.00	41.67
U:NOUN:POSS	4	2	2	66.67	66.67	66.67
U:OTHER	8	17	8	32.00	50.00	34.48
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	28	12	8	70.00	77.78	71.43
U:PRON	4	1	4	80.00	50.00	71.43
U:PUNCT	12	6	7	66.67	63.16	65.93
U:VERB	4	8	8	33.33	33.33	33.33
U:VERB:FORM	6	2	1	75.00	85.71	76.92
U:VERB:TENSE	9	5	5	64.29	64.29	64.29

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	220	74	189	74.83	53.79	69.40
R	537	178	479	75.10	52.85	69.27
U	153	90	63	62.96	70.83	64.39
UNK	6	0	10	100.00	37.50	75.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	9	4	12	69.23	42.86	61.64
ADJ:FORM	2	1	0	66.67	100.00	71.43
ADV	19	11	18	63.33	51.35	60.51
CONJ	2	3	10	40.00	16.67	31.25
CONTR	3	0	0	100.00	100.00	100.00
DET	162	47	78	77.51	67.50	75.28
MORPH	19	4	20	82.61	48.72	72.52
NOUN	16	20	28	44.44	36.36	42.55
NOUN:INFL	0	1	0	0.00	100.00	0.00
NOUN:NUM	58	18	21	76.32	73.42	75.72
NOUN:POSS	7	2	8	77.78	46.67	68.63
ORTH	44	14	39	75.86	53.01	69.84
OTHER	64	46	155	58.18	29.22	48.56
PART	9	5	4	64.29	69.23	65.22
PREP	109	45	61	70.78	64.12	69.34
PRON	23	13	22	63.89	51.11	60.85
PUNCT	98	21	106	82.35	48.04	72.06
SPELL	61	29	9	67.78	87.14	70.93
UNK	6	0	10	100.00	37.50	75.00
VERB	49	17	46	74.24	51.58	68.25
VERB:FORM	49	12	19	80.33	72.06	78.53
VERB:SVA	47	6	7	88.68	87.04	88.35
VERB:TENSE	48	18	45	72.73	51.61	67.23
WO	12	5	23	70.59	34.29	58.25

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	2	2	33.33	33.33	33.33
M:ADV	6	4	7	60.00	46.15	56.60
M:CONJ	2	1	7	66.67	22.22	47.62
M:DET	76	8	43	90.48	63.87	83.52
M:NOUN	4	4	0	50.00	100.00	55.56
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:OTHER	5	10	10	33.33	33.33	33.33
M:PART	2	1	1	66.67	66.67	66.67
M:PREP	18	19	13	48.65	58.06	50.28
M:PRON	17	10	11	62.96	60.71	62.50
M:PUNCT	68	7	81	90.67	45.64	75.72
M:VERB	10	6	1	62.50	90.91	66.67
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	10	2	8	83.33	55.56	75.76
R:ADJ	7	1	8	87.50	46.67	74.47
R:ADJ:FORM	2	1	0	66.67	100.00	71.43
R:ADV	5	2	6	71.43	45.45	64.10
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	28	7	24	80.00	53.85	72.92
R:MORPH	19	4	20	82.61	48.72	72.52
R:NOUN	9	11	26	45.00	25.71	39.13
R:NOUN:INFL	0	1	0	0.00	100.00	0.00
R:NOUN:NUM	58	18	21	76.32	73.42	75.72
R:NOUN:POSS	3	0	1	100.00	75.00	93.75
R:ORTH	44	14	39	75.86	53.01	69.84
R:OTHER	51	22	138	69.86	26.98	53.01
R:PART	6	4	2	60.00	75.00	62.50
R:PREP	63	17	39	78.75	61.76	74.64
R:PRON	1	2	7	33.33	12.50	25.00
R:PUNCT	14	8	17	63.64	45.16	58.82
R:SPELL	61	29	9	67.78	87.14	70.93
R:VERB	34	4	39	89.47	46.58	75.56
R:VERB:FORM	42	10	18	80.77	70.00	78.36
R:VERB:SVA	47	6	7	88.68	87.04	88.35
R:VERB:TENSE	30	12	33	71.43	47.62	64.94
R:WO	12	5	23	70.59	34.29	58.25
U:ADJ	1	1	2	50.00	33.33	45.45
U:ADV	8	5	5	61.54	61.54	61.54
U:CONJ	0	2	1	0.00	0.00	0.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	58	32	11	64.44	84.06	67.60
U:NOUN	3	5	2	37.50	60.00	40.54
U:NOUN:POSS	4	2	2	66.67	66.67	66.67
U:OTHER	8	14	7	36.36	53.33	38.83
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	28	9	9	75.68	75.68	75.68
U:PRON	5	1	4	83.33	55.56	75.76
U:PUNCT	16	6	8	72.73	66.67	71.43
U:VERB	5	7	6	41.67	45.45	42.37
U:VERB:FORM	6	2	1	75.00	85.71	76.92
U:VERB:TENSE	8	4	4	66.67	66.67	66.67
UNK	6	0	10	100.00	37.50	75.00

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	257	46	198	84.82	56.48	77.08
R	704	136	581	83.81	54.79	75.78
U	167	70	110	70.46	60.29	68.16
UNK	8	0	18	100.00	30.77	68.97

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	4	15	60.00	28.57	49.18
ADJ:FORM	3	0	0	100.00	100.00	100.00
ADV	20	6	20	76.92	50.00	69.44
CONJ	7	2	11	77.78	38.89	64.81
CONTR	2	0	0	100.00	100.00	100.00
DET	163	41	80	79.90	67.08	76.96
MORPH	21	1	19	95.45	52.50	82.03
NOUN	22	13	30	62.86	42.31	57.29
NOUN:NUM	57	12	20	82.61	74.03	80.74
NOUN:POSS	11	1	9	91.67	55.00	80.88
ORTH	63	12	43	84.00	59.43	77.59
OTHER	177	36	254	83.10	41.07	68.98
PART	7	2	2	77.78	77.78	77.78
PREP	112	28	60	80.00	65.12	76.50
PRON	27	9	23	75.00	54.00	69.59
PUNCT	114	16	102	87.69	52.78	77.45
SPELL	62	24	9	72.09	87.32	74.70
UNK	8	0	18	100.00	30.77	68.97
VERB	56	8	57	87.50	49.56	75.88
VERB:FORM	49	9	21	84.48	70.00	81.13
VERB:SVA	43	5	6	89.58	87.76	89.21
VERB:TENSE	56	15	60	78.87	48.28	70.00
WO	50	8	48	86.21	51.02	75.76

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	3	0.00	0.00	0.00
M:ADV	8	2	6	80.00	57.14	74.07
M:CONJ	7	1	7	87.50	50.00	76.09
M:DET	79	4	42	95.18	65.29	87.20
M:NOUN	5	4	2	55.56	71.43	58.14
M:NOUN:POSS	1	0	5	100.00	16.67	50.00
M:OTHER	9	7	13	56.25	40.91	52.33
M:PART	2	1	0	66.67	100.00	71.43
M:PREP	22	10	14	68.75	61.11	67.07
M:PRON	18	6	12	75.00	60.00	71.43
M:PUNCT	80	5	76	94.12	51.28	80.65
M:VERB	12	3	8	80.00	60.00	75.00
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	12	1	10	92.31	54.55	81.08
R:ADJ	6	1	10	85.71	37.50	68.18
R:ADJ:FORM	3	0	0	100.00	100.00	100.00
R:ADV	5	1	6	83.33	45.45	71.43
R:CONJ	0	0	4	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	28	7	24	80.00	53.85	72.92
R:MORPH	21	1	19	95.45	52.50	82.03
R:NOUN	14	6	25	70.00	35.90	58.82
R:NOUN:NUM	57	12	20	82.61	74.03	80.74
R:NOUN:POSS	6	0	2	100.00	75.00	93.75
R:ORTH	63	12	43	84.00	59.43	77.59
R:OTHER	146	18	201	89.02	42.07	72.78
R:PART	4	1	1	80.00	80.00	80.00
R:PREP	62	12	36	83.78	63.27	78.68
R:PRON	1	2	8	33.33	11.11	23.81
R:PUNCT	18	6	17	75.00	51.43	68.70
R:SPELL	62	24	9	72.09	87.32	74.70
R:VERB	36	3	39	92.31	48.00	77.92
R:VERB:FORM	43	6	20	87.76	68.25	83.01
R:VERB:SVA	43	5	6	89.58	87.76	89.21
R:VERB:TENSE	35	11	43	76.09	44.87	66.79
R:WO	50	8	48	86.21	51.02	75.76
U:ADJ	0	1	2	0.00	0.00	0.00
U:ADV	7	3	8	70.00	46.67	63.64
U:CONJ	0	1	0	0.00	100.00	0.00
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	56	30	14	65.12	80.00	67.63
U:NOUN	3	3	3	50.00	50.00	50.00
U:NOUN:POSS	4	1	2	80.00	66.67	76.92
U:OTHER	22	11	40	66.67	35.48	56.70
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	28	6	10	82.35	73.68	80.46
U:PRON	8	1	3	88.89	72.73	85.11
U:PUNCT	16	5	9	76.19	64.00	73.39
U:VERB	8	2	10	80.00	44.44	68.97
U:VERB:FORM	4	3	1	57.14	80.00	60.61
U:VERB:TENSE	9	3	7	75.00	56.25	70.31
UNK	8	0	18	100.00	30.77	68.97

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	373	241	295	60.75	55.84	59.70
Span-level detection	418	198	286	67.86	59.38	65.97
Token-level detection	508	182	343	73.62	59.69	70.34

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	96	35	87	73.28	52.46	67.89
R	201	134	181	60.00	52.62	58.36
U	76	72	27	51.35	73.79	54.68

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	5	100.00	16.67	50.00
ADJ:FORM	1	0	2	100.00	33.33	71.43
ADV	5	6	4	45.45	55.56	47.17
CONJ	1	2	4	33.33	20.00	29.41
CONTR	0	2	3	0.00	0.00	0.00
DET	82	36	34	69.49	70.69	69.73
MORPH	15	5	11	75.00	57.69	70.75
NOUN	3	6	14	33.33	17.65	28.30
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	22	17	10	56.41	68.75	58.51
NOUN:POSS	3	2	5	60.00	37.50	53.57
ORTH	28	5	18	84.85	60.87	78.65
OTHER	23	43	50	34.85	31.51	34.12
PART	1	1	2	50.00	33.33	45.45
PREP	46	29	29	61.33	61.33	61.33
PRON	8	8	5	50.00	61.54	51.95
PUNCT	46	10	41	82.14	52.87	73.95
SPELL	28	27	11	50.91	71.79	54.05
VERB	4	11	11	26.67	26.67	26.67
VERB:FORM	17	4	5	80.95	77.27	80.19
VERB:SVA	10	5	1	66.67	90.91	70.42
VERB:TENSE	15	18	20	45.45	42.86	44.91
WO	12	4	10	75.00	54.55	69.77

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	0	100.00	100.00	100.00
M:ADV	1	2	1	33.33	50.00	35.71
M:CONJ	1	2	1	33.33	50.00	35.71
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	32	7	23	82.05	58.18	75.83
M:NOUN	0	3	4	0.00	0.00	0.00
M:NOUN:POSS	0	1	0	0.00	100.00	0.00
M:OTHER	1	4	9	20.00	10.00	16.67
M:PREP	15	7	7	68.18	68.18	68.18
M:PRON	4	2	3	66.67	57.14	64.52
M:PUNCT	34	3	35	91.89	49.28	78.34
M:VERB	2	3	1	40.00	66.67	43.48
M:VERB:FORM	2	0	1	100.00	66.67	90.91
M:VERB:TENSE	3	0	2	100.00	60.00	88.24
R:ADJ	0	0	4	100.00	0.00	0.00
R:ADJ:FORM	1	0	2	100.00	33.33	71.43
R:ADV	1	1	2	50.00	33.33	45.45
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	8	4	5	66.67	61.54	65.57
R:MORPH	15	5	11	75.00	57.69	70.75
R:NOUN	2	3	9	40.00	18.18	32.26
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	22	17	10	56.41	68.75	58.51
R:NOUN:POSS	0	0	5	100.00	0.00	0.00
R:ORTH	28	5	18	84.85	60.87	78.65
R:OTHER	20	23	38	46.51	34.48	43.48
R:PART	1	1	2	50.00	33.33	45.45
R:PREP	25	11	17	69.44	59.52	67.20
R:PRON	2	3	2	40.00	50.00	41.67
R:PUNCT	6	2	2	75.00	75.00	75.00
R:SPELL	28	27	11	50.91	71.79	54.05
R:VERB	2	4	9	33.33	18.18	28.57
R:VERB:FORM	8	3	4	72.73	66.67	71.43
R:VERB:SVA	10	5	1	66.67	90.91	70.42
R:VERB:TENSE	8	15	16	34.78	33.33	34.48
R:WO	12	4	10	75.00	54.55	69.77
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	3	3	1	50.00	75.00	53.57
U:CONJ	0	0	1	100.00	0.00	0.00
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	42	25	6	62.69	87.50	66.46
U:NOUN	1	0	1	100.00	50.00	83.33
U:NOUN:POSS	3	1	0	75.00	100.00	78.95
U:OTHER	2	16	3	11.11	40.00	12.99
U:PREP	6	11	5	35.29	54.55	37.97
U:PRON	2	3	0	40.00	100.00	45.45
U:PUNCT	6	5	4	54.55	60.00	55.56
U:VERB	0	4	1	0.00	0.00	0.00
U:VERB:FORM	7	1	0	87.50	100.00	89.74
U:VERB:TENSE	4	3	2	57.14	66.67	58.82

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	105	29	89	78.36	54.12	71.92
R	233	107	166	68.53	58.40	66.23
U	79	62	29	56.03	73.15	58.78
UNK	1	0	2	100.00	33.33	71.43

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	6	100.00	14.29	45.45
ADJ:FORM	1	0	2	100.00	33.33	71.43
ADV	5	6	4	45.45	55.56	47.17
CONJ	2	1	4	66.67	33.33	55.56
CONTR	1	1	2	50.00	33.33	45.45
DET	91	29	33	75.83	73.39	75.33
MORPH	16	4	11	80.00	59.26	74.77
NOUN	5	5	14	50.00	26.32	42.37
NOUN:INFL	3	0	0	100.00	100.00	100.00
NOUN:NUM	22	16	10	57.89	68.75	59.78
NOUN:POSS	3	2	5	60.00	37.50	53.57
ORTH	31	4	15	88.57	67.39	83.33
OTHER	39	29	40	57.35	49.37	55.56
PART	2	1	1	66.67	66.67	66.67
PREP	46	25	30	64.79	60.53	63.89
PRON	8	7	4	53.33	66.67	55.56
PUNCT	50	10	42	83.33	54.35	75.30
SPELL	31	22	8	58.49	79.49	61.75
UNK	1	0	2	100.00	33.33	71.43
VERB	7	11	12	38.89	36.84	38.46
VERB:FORM	17	4	6	80.95	73.91	79.44
VERB:SVA	11	4	1	73.33	91.67	76.39
VERB:TENSE	16	13	24	55.17	40.00	51.28
WO	9	4	10	69.23	47.37	63.38

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	1	100.00	50.00	83.33
M:ADV	1	2	1	33.33	50.00	35.71
M:CONJ	2	1	1	66.67	66.67	66.67
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	36	4	23	90.00	61.02	82.19
M:NOUN	1	3	4	25.00	20.00	23.81
M:NOUN:POSS	0	1	0	0.00	100.00	0.00
M:OTHER	2	2	9	50.00	18.18	37.04
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	14	7	7	66.67	66.67	66.67
M:PRON	3	2	3	60.00	50.00	57.69
M:PUNCT	38	3	34	92.68	52.78	80.51
M:VERB	2	3	1	40.00	66.67	43.48
M:VERB:FORM	2	0	1	100.00	66.67	90.91
M:VERB:TENSE	3	0	3	100.00	50.00	83.33
R:ADJ	0	0	4	100.00	0.00	0.00
R:ADJ:FORM	1	0	2	100.00	33.33	71.43
R:ADV	1	1	2	50.00	33.33	45.45
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	11	2	3	84.62	78.57	83.33
R:MORPH	16	4	11	80.00	59.26	74.77
R:NOUN	3	2	8	60.00	27.27	48.39
R:NOUN:INFL	3	0	0	100.00	100.00	100.00
R:NOUN:NUM	22	16	10	57.89	68.75	59.78
R:NOUN:POSS	0	0	5	100.00	0.00	0.00
R:ORTH	31	4	15	88.57	67.39	83.33
R:OTHER	34	13	28	72.34	54.84	68.00
R:PART	2	1	0	66.67	100.00	71.43
R:PREP	27	11	17	71.05	61.36	68.88
R:PRON	3	3	1	50.00	75.00	53.57
R:PUNCT	6	2	4	75.00	60.00	71.43
R:SPELL	31	22	8	58.49	79.49	61.75
R:VERB	5	4	10	55.56	33.33	49.02
R:VERB:FORM	8	3	5	72.73	61.54	70.18
R:VERB:SVA	11	4	1	73.33	91.67	76.39
R:VERB:TENSE	8	11	20	42.11	28.57	38.46
R:WO	9	4	10	69.23	47.37	63.38
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	3	3	1	50.00	75.00	53.57
U:CONJ	0	0	1	100.00	0.00	0.00
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	44	23	7	65.67	86.27	68.97
U:NOUN	1	0	2	100.00	33.33	71.43
U:NOUN:POSS	3	1	0	75.00	100.00	78.95
U:OTHER	3	14	3	17.65	50.00	20.27
U:PREP	5	7	6	41.67	45.45	42.37
U:PRON	2	2	0	50.00	100.00	55.56
U:PUNCT	6	5	4	54.55	60.00	55.56
U:VERB	0	4	1	0.00	0.00	0.00
U:VERB:FORM	7	1	0	87.50	100.00	89.74
U:VERB:TENSE	5	2	1	71.43	83.33	73.53
UNK	1	0	2	100.00	33.33	71.43

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	120	24	96	83.33	55.56	75.76
R	297	93	198	76.15	60.00	72.26
U	87	65	41	57.24	67.97	59.10
UNK	4	0	8	100.00	33.33	71.43

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	8	100.00	11.11	38.46
ADJ:FORM	2	0	3	100.00	40.00	76.92
ADV	7	4	6	63.64	53.85	61.40
CONJ	2	1	3	66.67	40.00	58.82
CONTR	2	1	2	66.67	50.00	62.50
DET	94	26	29	78.33	76.42	77.94
MORPH	15	4	11	78.95	57.69	73.53
NOUN	5	4	13	55.56	27.78	46.30
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	21	14	12	60.00	63.64	60.69
NOUN:POSS	4	2	7	66.67	36.36	57.14
ORTH	39	3	15	92.86	72.22	87.84
OTHER	71	34	79	67.62	47.33	62.28
PART	2	1	1	66.67	66.67	66.67
PREP	48	22	31	68.57	60.76	66.85
PRON	9	6	4	60.00	69.23	61.64
PUNCT	66	7	45	90.41	59.46	81.89
SPELL	32	20	8	61.54	80.00	64.52
UNK	4	0	8	100.00	33.33	71.43
VERB	11	10	14	52.38	44.00	50.46
VERB:FORM	18	4	7	81.82	72.00	79.65
VERB:SVA	10	4	1	71.43	90.91	74.63
VERB:TENSE	19	13	25	59.38	43.18	55.23
WO	24	2	11	92.31	68.57	86.33

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	3	100.00	25.00	62.50
M:ADV	2	0	1	100.00	66.67	90.91
M:CONJ	2	1	1	66.67	66.67	66.67
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	40	3	20	93.02	66.67	86.21
M:NOUN	2	3	2	40.00	50.00	41.67
M:NOUN:POSS	1	1	0	50.00	100.00	55.56
M:OTHER	2	1	12	66.67	14.29	38.46
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	14	7	8	66.67	63.64	66.04
M:PRON	4	2	3	66.67	57.14	64.52
M:PUNCT	46	2	39	95.83	54.12	83.03
M:VERB	1	3	2	25.00	33.33	26.32
M:VERB:FORM	2	0	1	100.00	66.67	90.91
M:VERB:TENSE	3	0	3	100.00	50.00	83.33
R:ADJ	0	0	3	100.00	0.00	0.00
R:ADJ:FORM	2	0	3	100.00	40.00	76.92
R:ADV	1	1	2	50.00	33.33	45.45
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	11	1	3	91.67	78.57	88.71
R:MORPH	15	4	11	78.95	57.69	73.53
R:NOUN	2	1	9	66.67	18.18	43.48
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	21	14	12	60.00	63.64	60.69
R:NOUN:POSS	0	0	7	100.00	0.00	0.00
R:ORTH	39	3	15	92.86	72.22	87.84
R:OTHER	61	10	53	85.92	53.51	76.63
R:PART	2	1	0	66.67	100.00	71.43
R:PREP	29	10	16	74.36	64.44	72.14
R:PRON	3	3	1	50.00	75.00	53.57
R:PUNCT	12	1	3	92.31	80.00	89.55
R:SPELL	32	20	8	61.54	80.00	64.52
R:VERB	10	4	11	71.43	47.62	64.94
R:VERB:FORM	9	3	6	75.00	60.00	71.43
R:VERB:SVA	10	4	1	71.43	90.91	74.63
R:VERB:TENSE	11	11	22	50.00	33.33	45.45
R:WO	24	2	11	92.31	68.57	86.33
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	4	3	3	57.14	57.14	57.14
U:CONJ	0	0	1	100.00	0.00	0.00
U:CONTR	1	0	2	100.00	33.33	71.43
U:DET	43	22	6	66.15	87.76	69.58
U:NOUN	1	0	2	100.00	33.33	71.43
U:NOUN:POSS	3	1	0	75.00	100.00	78.95
U:OTHER	8	23	14	25.81	36.36	27.40
U:PREP	5	5	7	50.00	41.67	48.08
U:PRON	2	1	0	66.67	100.00	71.43
U:PUNCT	8	4	3	66.67	72.73	67.80
U:VERB	0	3	1	0.00	0.00	0.00
U:VERB:FORM	7	1	0	87.50	100.00	89.74
U:VERB:TENSE	5	2	0	71.43	100.00	75.76
UNK	4	0	8	100.00	33.33	71.43

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	299	311	209	49.02	58.86	50.71
Span-level detection	346	264	199	56.72	63.49	57.96
Token-level detection	418	266	244	61.11	63.14	61.51

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	61	46	43	57.01	58.65	57.33
R	208	150	151	58.10	57.94	58.07
U	30	115	15	20.69	66.67	24.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	3	4	25.00	20.00	23.81
ADV	1	11	1	8.33	50.00	10.00
CONJ	0	3	1	0.00	0.00	0.00
CONTR	0	2	0	0.00	100.00	0.00
DET	25	71	2	26.04	92.59	30.41
MORPH	4	7	2	36.36	66.67	40.00
NOUN	3	12	9	20.00	25.00	20.83
NOUN:INFL	6	3	5	66.67	54.55	63.83
NOUN:NUM	15	18	6	45.45	71.43	49.02
NOUN:POSS	5	4	13	55.56	27.78	46.30
ORTH	35	8	28	81.40	55.56	74.47
OTHER	22	47	31	31.88	41.51	33.43
PART	1	3	0	25.00	100.00	29.41
PREP	11	35	14	23.91	44.00	26.32
PRON	3	8	3	27.27	50.00	30.00
PUNCT	60	14	48	81.08	55.56	74.26
SPELL	73	14	25	83.91	74.49	81.84
VERB	4	9	8	30.77	33.33	31.25
VERB:FORM	11	12	2	47.83	84.62	52.38
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	10	10	0	50.00	100.00	55.56
VERB:TENSE	3	15	5	16.67	37.50	18.75
WO	2	2	1	50.00	66.67	52.63

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	4	0	0.00	100.00	0.00
M:CONJ	0	0	1	100.00	0.00	0.00
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	8	7	2	53.33	80.00	57.14
M:NOUN	0	3	2	0.00	0.00	0.00
M:NOUN:POSS	3	1	4	75.00	42.86	65.22
M:OTHER	0	4	0	0.00	100.00	0.00
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	4	5	0	44.44	100.00	50.00
M:PRON	1	7	2	12.50	33.33	14.29
M:PUNCT	43	6	30	87.76	58.90	79.93
M:VERB	1	5	2	16.67	33.33	18.52
M:VERB:FORM	1	1	0	50.00	100.00	55.56
M:VERB:TENSE	0	1	0	0.00	100.00	0.00
R:ADJ	1	1	4	50.00	20.00	38.46
R:ADV	0	2	1	0.00	0.00	0.00
R:DET	2	3	0	40.00	100.00	45.45
R:MORPH	4	7	2	36.36	66.67	40.00
R:NOUN	3	8	7	27.27	30.00	27.78
R:NOUN:INFL	6	3	5	66.67	54.55	63.83
R:NOUN:NUM	15	18	6	45.45	71.43	49.02
R:NOUN:POSS	2	3	9	40.00	18.18	32.26
R:ORTH	35	8	28	81.40	55.56	74.47
R:OTHER	20	26	30	43.48	40.00	42.74
R:PART	0	2	0	0.00	100.00	0.00
R:PREP	7	19	11	26.92	38.89	28.69
R:PRON	2	1	1	66.67	66.67	66.67
R:PUNCT	8	3	10	72.73	44.44	64.52
R:SPELL	73	14	25	83.91	74.49	81.84
R:VERB	3	3	4	50.00	42.86	48.39
R:VERB:FORM	9	10	2	47.37	81.82	51.72
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	10	10	0	50.00	100.00	55.56
R:VERB:TENSE	2	7	4	22.22	33.33	23.81
R:WO	2	2	1	50.00	66.67	52.63
U:ADJ	0	2	0	0.00	100.00	0.00
U:ADV	1	5	0	16.67	100.00	20.00
U:CONJ	0	3	0	0.00	100.00	0.00
U:CONTR	0	1	0	0.00	100.00	0.00
U:DET	15	61	0	19.74	100.00	23.51
U:NOUN	0	1	0	0.00	100.00	0.00
U:OTHER	2	17	1	10.53	66.67	12.66
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	0	11	3	0.00	0.00	0.00
U:PUNCT	9	5	8	64.29	52.94	61.64
U:VERB	0	1	2	0.00	0.00	0.00
U:VERB:FORM	1	1	0	50.00	100.00	55.56
U:VERB:TENSE	1	7	1	12.50	50.00	14.71

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	64	43	43	59.81	59.81	59.81
R	248	115	136	68.32	64.58	67.54
U	32	106	17	23.19	65.31	26.62
UNK	2	0	3	100.00	40.00	76.92

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	2	4	50.00	33.33	45.45
ADV	1	11	1	8.33	50.00	10.00
CONJ	0	3	1	0.00	0.00	0.00
CONTR	0	1	0	0.00	100.00	0.00
DET	29	67	5	30.21	85.29	34.69
MORPH	4	7	2	36.36	66.67	40.00
NOUN	3	11	9	21.43	25.00	22.06
NOUN:INFL	10	0	1	100.00	90.91	98.04
NOUN:NUM	15	18	6	45.45	71.43	49.02
NOUN:POSS	9	2	9	81.82	50.00	72.58
ORTH	36	8	28	81.82	56.25	75.00
OTHER	31	40	30	43.66	50.82	44.93
PART	1	3	0	25.00	100.00	29.41
PREP	17	28	12	37.78	58.62	40.67
PRON	4	6	2	40.00	66.67	43.48
PUNCT	62	13	47	82.67	56.88	75.79
SPELL	80	2	21	97.56	79.21	93.24
UNK	2	0	3	100.00	40.00	76.92
VERB	6	8	8	42.86	42.86	42.86
VERB:FORM	12	10	2	54.55	85.71	58.82
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	11	8	0	57.89	100.00	63.22
VERB:TENSE	5	14	6	26.32	45.45	28.74
WO	2	2	1	50.00	66.67	52.63

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	4	0	0.00	100.00	0.00
M:CONJ	0	0	1	100.00	0.00	0.00
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	8	7	3	53.33	72.73	56.34
M:NOUN	0	3	2	0.00	0.00	0.00
M:NOUN:POSS	3	1	3	75.00	50.00	68.18
M:OTHER	1	4	1	20.00	50.00	22.73
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	4	5	0	44.44	100.00	50.00
M:PRON	2	5	1	28.57	66.67	32.26
M:PUNCT	44	6	30	88.00	59.46	80.29
M:VERB	1	4	2	20.00	33.33	21.74
M:VERB:FORM	1	1	0	50.00	100.00	55.56
M:VERB:TENSE	0	1	0	0.00	100.00	0.00
R:ADJ	2	0	4	100.00	33.33	71.43
R:ADV	0	2	1	0.00	0.00	0.00
R:DET	4	3	1	57.14	80.00	60.61
R:MORPH	4	7	2	36.36	66.67	40.00
R:NOUN	3	7	7	30.00	30.00	30.00
R:NOUN:INFL	10	0	1	100.00	90.91	98.04
R:NOUN:NUM	15	18	6	45.45	71.43	49.02
R:NOUN:POSS	6	1	6	85.71	50.00	75.00
R:ORTH	36	8	28	81.82	56.25	75.00
R:OTHER	28	20	27	58.33	50.91	56.68
R:PART	0	2	0	0.00	100.00	0.00
R:PREP	13	14	9	48.15	59.09	50.00
R:PRON	2	1	1	66.67	66.67	66.67
R:PUNCT	9	2	9	81.82	50.00	72.58
R:SPELL	80	2	21	97.56	79.21	93.24
R:VERB	5	3	4	62.50	55.56	60.98
R:VERB:FORM	10	8	2	55.56	83.33	59.52
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	11	8	0	57.89	100.00	63.22
R:VERB:TENSE	4	7	5	36.36	44.44	37.74
R:WO	2	2	1	50.00	66.67	52.63
U:ADJ	0	2	0	0.00	100.00	0.00
U:ADV	1	5	0	16.67	100.00	20.00
U:CONJ	0	3	0	0.00	100.00	0.00
U:DET	17	57	1	22.97	94.44	27.07
U:NOUN	0	1	0	0.00	100.00	0.00
U:OTHER	2	16	2	11.11	50.00	13.16
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	0	9	3	0.00	0.00	0.00
U:PUNCT	9	5	8	64.29	52.94	61.64
U:VERB	0	1	2	0.00	0.00	0.00
U:VERB:FORM	1	1	0	50.00	100.00	55.56
U:VERB:TENSE	1	6	1	14.29	50.00	16.67
UNK	2	0	3	100.00	40.00	76.92

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	81	38	46	68.07	63.78	67.16
R	297	119	170	71.39	63.60	69.69
U	37	109	24	25.34	60.66	28.68
UNK	3	0	4	100.00	42.86	78.95

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	2	5	50.00	28.57	43.48
ADV	1	12	1	7.69	50.00	9.26
CONJ	1	3	1	25.00	50.00	27.78
CONTR	0	1	0	0.00	100.00	0.00
DET	28	62	5	31.11	84.85	35.62
MORPH	4	5	4	44.44	50.00	45.45
NOUN	4	10	12	28.57	25.00	27.78
NOUN:INFL	10	0	1	100.00	90.91	98.04
NOUN:NUM	17	16	5	51.52	77.27	55.19
NOUN:POSS	11	1	8	91.67	57.89	82.09
ORTH	48	7	40	87.27	54.55	77.92
OTHER	62	53	42	53.91	59.62	54.96
PART	0	2	0	0.00	100.00	0.00
PREP	18	26	13	40.91	58.06	43.48
PRON	5	6	1	45.45	83.33	50.00
PUNCT	79	11	55	87.78	58.96	79.96
SPELL	79	2	21	97.53	79.00	93.16
UNK	3	0	4	100.00	42.86	78.95
VERB	6	8	8	42.86	42.86	42.86
VERB:FORM	12	10	1	54.55	92.31	59.41
VERB:INFL	4	0	1	100.00	80.00	95.24
VERB:SVA	11	7	0	61.11	100.00	66.27
VERB:TENSE	5	18	7	21.74	41.67	24.04
WO	8	4	9	66.67	47.06	61.54

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	4	0	0.00	100.00	0.00
M:CONJ	1	0	1	100.00	50.00	83.33
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	8	4	3	66.67	72.73	67.80
M:NOUN	1	2	3	33.33	25.00	31.25
M:NOUN:POSS	3	1	2	75.00	60.00	71.43
M:OTHER	1	3	1	25.00	50.00	27.78
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	4	5	0	44.44	100.00	50.00
M:PRON	3	5	0	37.50	100.00	42.86
M:PUNCT	58	5	34	92.06	63.04	84.30
M:VERB	1	5	1	16.67	50.00	19.23
M:VERB:FORM	1	1	0	50.00	100.00	55.56
M:VERB:TENSE	0	1	1	0.00	0.00	0.00
R:ADJ	2	0	4	100.00	33.33	71.43
R:ADV	0	2	1	0.00	0.00	0.00
R:DET	4	3	1	57.14	80.00	60.61
R:MORPH	4	5	4	44.44	50.00	45.45
R:NOUN	3	7	9	30.00	25.00	28.85
R:NOUN:INFL	10	0	1	100.00	90.91	98.04
R:NOUN:NUM	17	16	5	51.52	77.27	55.19
R:NOUN:POSS	8	0	6	100.00	57.14	86.96
R:ORTH	48	7	40	87.27	54.55	77.92
R:OTHER	55	27	37	67.07	59.78	65.48
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	14	13	9	51.85	60.87	53.44
R:PRON	2	1	1	66.67	66.67	66.67
R:PUNCT	10	1	10	90.91	50.00	78.12
R:SPELL	79	2	21	97.53	79.00	93.16
R:VERB	5	2	5	71.43	50.00	65.79
R:VERB:FORM	10	9	1	52.63	90.91	57.47
R:VERB:INFL	4	0	1	100.00	80.00	95.24
R:VERB:SVA	11	7	0	61.11	100.00	66.27
R:VERB:TENSE	3	12	5	20.00	37.50	22.06
R:WO	8	4	9	66.67	47.06	61.54
U:ADJ	0	2	1	0.00	0.00	0.00
U:ADV	1	6	0	14.29	100.00	17.24
U:CONJ	0	3	0	0.00	100.00	0.00
U:DET	16	55	1	22.54	94.12	26.58
U:NOUN	0	1	0	0.00	100.00	0.00
U:OTHER	6	23	4	20.69	60.00	23.81
U:PREP	0	8	4	0.00	0.00	0.00
U:PUNCT	11	5	11	68.75	50.00	63.95
U:VERB	0	1	2	0.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	2	5	1	28.57	66.67	32.26
UNK	3	0	4	100.00	42.86	78.95

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:42:58+00:00
Competition submission:	2
Competition phase:	3 - Open phase

Detailed results

Submission information

Results