BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1428	854	2968	62.58	32.48	52.80
Span-level detection	1698	586	2892	74.34	36.99	61.85
Token-level detection	2093	470	3360	81.66	38.38	66.63

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	244	170	695	58.94	25.99	47.01
R	1031	564	1971	64.64	34.34	54.95
U	153	120	302	56.04	33.63	49.45

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	9	12	25	42.86	26.47	38.14
ADJ:FORM	3	1	5	75.00	37.50	62.50
ADV	17	19	36	47.22	32.08	43.15
CONJ	1	2	18	33.33	5.26	16.13
CONTR	4	3	5	57.14	44.44	54.05
DET	185	110	355	62.71	34.26	53.78
MORPH	54	29	85	65.06	38.85	57.32
NOUN	18	51	92	26.09	16.36	23.32
NOUN:INFL	16	2	4	88.89	80.00	86.96
NOUN:NUM	113	45	130	71.52	46.50	64.57
NOUN:POSS	9	4	39	69.23	18.75	45.00
ORTH	169	40	199	80.86	45.92	70.18
OTHER	62	119	613	34.25	9.19	22.16
PART	10	5	15	66.67	40.00	58.82
PREP	79	69	288	53.38	21.53	41.19
PRON	36	19	86	65.45	29.51	52.63
PUNCT	143	102	338	58.37	29.73	48.94
SPELL	225	72	100	75.76	69.23	74.36
VERB	25	32	151	43.86	14.20	30.94
VERB:FORM	92	38	83	70.77	52.57	66.19
VERB:INFL	5	0	4	100.00	55.56	86.21
VERB:SVA	80	24	62	76.92	56.34	71.68
VERB:TENSE	54	42	173	56.25	23.79	44.19
WO	19	14	62	57.58	23.46	44.60

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	4	0.00	0.00	0.00
M:ADV	2	5	16	28.57	11.11	21.74
M:CONJ	1	2	10	33.33	9.09	21.74
M:CONTR	1	1	0	50.00	100.00	55.56
M:DET	99	67	160	59.64	38.22	53.63
M:NOUN	0	6	9	0.00	0.00	0.00
M:NOUN:POSS	2	2	12	50.00	14.29	33.33
M:OTHER	4	11	52	26.67	7.14	17.24
M:PART	0	1	4	0.00	0.00	0.00
M:PREP	15	17	69	46.88	17.86	35.38
M:PRON	21	9	46	70.00	31.34	56.15
M:PUNCT	80	27	251	74.77	24.17	52.70
M:VERB	6	11	24	35.29	20.00	30.61
M:VERB:FORM	10	5	5	66.67	66.67	66.67
M:VERB:TENSE	3	4	33	42.86	8.33	23.44
R:ADJ	7	6	16	53.85	30.43	46.67
R:ADJ:FORM	3	1	5	75.00	37.50	62.50
R:ADV	4	3	10	57.14	28.57	47.62
R:CONJ	0	0	5	100.00	0.00	0.00
R:CONTR	1	2	2	33.33	33.33	33.33
R:DET	18	14	84	56.25	17.65	39.13
R:MORPH	54	29	85	65.06	38.85	57.32
R:NOUN	17	38	74	30.91	18.68	27.33
R:NOUN:INFL	16	2	4	88.89	80.00	86.96
R:NOUN:NUM	113	45	130	71.52	46.50	64.57
R:NOUN:POSS	4	1	19	80.00	17.39	46.51
R:ORTH	169	40	199	80.86	45.92	70.18
R:OTHER	53	89	542	37.32	8.91	22.79
R:PART	8	3	7	72.73	53.33	67.80
R:PREP	48	37	169	56.47	22.12	43.09
R:PRON	8	7	25	53.33	24.24	43.01
R:PUNCT	45	65	55	40.91	45.00	41.67
R:SPELL	225	72	100	75.76	69.23	74.36
R:VERB	16	14	113	53.33	12.40	32.13
R:VERB:FORM	78	32	73	70.91	51.66	65.99
R:VERB:INFL	5	0	4	100.00	55.56	86.21
R:VERB:SVA	80	24	62	76.92	56.34	71.68
R:VERB:TENSE	40	26	126	60.61	24.10	46.51
R:WO	19	14	62	57.58	23.46	44.60
U:ADJ	2	4	5	33.33	28.57	32.26
U:ADV	11	11	10	50.00	52.38	50.46
U:CONJ	0	0	3	100.00	0.00	0.00
U:CONTR	2	0	3	100.00	40.00	76.92
U:DET	68	29	111	70.10	37.99	59.96
U:NOUN	1	7	9	12.50	10.00	11.90
U:NOUN:POSS	3	1	8	75.00	27.27	55.56
U:OTHER	5	19	19	20.83	20.83	20.83
U:PART	2	1	4	66.67	33.33	55.56
U:PREP	16	15	50	51.61	24.24	42.11
U:PRON	7	3	15	70.00	31.82	56.45
U:PUNCT	18	10	32	64.29	36.00	55.56
U:VERB	3	7	14	30.00	17.65	26.32
U:VERB:FORM	4	1	5	80.00	44.44	68.97
U:VERB:TENSE	11	12	14	47.83	44.00	47.01

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	281	131	678	68.20	29.30	53.89
R	1241	353	1833	77.85	40.37	65.66
U	169	102	311	62.36	35.21	54.03
UNK	7	0	70	100.00	9.09	33.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	13	8	27	61.90	32.50	52.42
ADJ:FORM	2	1	7	66.67	22.22	47.62
ADV	15	18	34	45.45	30.61	41.44
CONJ	1	0	22	100.00	4.35	18.52
CONTR	6	1	3	85.71	66.67	81.08
DET	203	90	341	69.28	37.32	59.15
MORPH	58	23	82	71.60	41.43	62.50
NOUN	30	34	93	46.88	24.39	39.58
NOUN:INFL	16	0	3	100.00	84.21	96.39
NOUN:NUM	103	36	122	74.10	45.78	65.94
NOUN:POSS	12	3	36	80.00	25.00	55.56
ORTH	206	29	171	87.66	54.64	78.21
OTHER	168	81	572	67.47	22.70	48.39
PART	11	4	13	73.33	45.83	65.48
PREP	94	49	285	65.73	24.80	49.42
PRON	45	10	86	81.82	34.35	64.10
PUNCT	158	84	333	65.29	32.18	54.15
SPELL	248	11	68	95.75	78.48	91.72
UNK	7	0	70	100.00	9.09	33.33
VERB	49	24	156	67.12	23.90	49.30
VERB:FORM	92	21	75	81.42	55.09	74.31
VERB:INFL	5	0	3	100.00	62.50	89.29
VERB:SVA	82	14	61	85.42	57.34	77.80
VERB:TENSE	58	32	171	64.44	25.33	49.24
WO	16	13	58	55.17	21.62	42.11

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	5	0.00	0.00	0.00
M:ADV	1	5	13	16.67	7.14	13.16
M:CONJ	1	0	13	100.00	7.14	27.78
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	112	51	149	68.71	42.91	61.34
M:NOUN	4	4	9	50.00	30.77	44.44
M:NOUN:POSS	2	2	12	50.00	14.29	33.33
M:OTHER	11	8	52	57.89	17.46	39.57
M:PART	0	1	4	0.00	0.00	0.00
M:PREP	17	15	71	53.12	19.32	39.35
M:PRON	25	6	43	80.65	36.76	65.10
M:PUNCT	85	20	246	80.95	25.68	56.59
M:VERB	11	8	24	57.89	31.43	49.55
M:VERB:FORM	10	4	3	71.43	76.92	72.46
M:VERB:TENSE	2	4	34	33.33	5.56	16.67
R:ADJ	12	4	16	75.00	42.86	65.22
R:ADJ:FORM	2	1	7	66.67	22.22	47.62
R:ADV	5	3	11	62.50	31.25	52.08
R:CONJ	0	0	6	100.00	0.00	0.00
R:CONTR	3	0	0	100.00	100.00	100.00
R:DET	26	12	78	68.42	25.00	50.78
R:MORPH	58	23	82	71.60	41.43	62.50
R:NOUN	22	23	72	48.89	23.40	40.15
R:NOUN:INFL	16	0	3	100.00	84.21	96.39
R:NOUN:NUM	103	36	122	74.10	45.78	65.94
R:NOUN:POSS	7	1	16	87.50	30.43	63.64
R:ORTH	206	29	171	87.66	54.64	78.21
R:OTHER	150	56	500	72.82	23.08	50.88
R:PART	9	2	6	81.82	60.00	76.27
R:PREP	58	26	166	69.05	25.89	51.79
R:PRON	10	2	28	83.33	26.32	58.14
R:PUNCT	50	54	51	48.08	49.50	48.36
R:SPELL	248	11	68	95.75	78.48	91.72
R:VERB	33	11	116	75.00	22.15	50.77
R:VERB:FORM	78	16	69	82.98	53.06	74.57
R:VERB:INFL	5	0	3	100.00	62.50	89.29
R:VERB:SVA	82	14	61	85.42	57.34	77.80
R:VERB:TENSE	42	16	123	72.41	25.45	52.90
R:WO	16	13	58	55.17	21.62	42.11
U:ADJ	1	2	6	33.33	14.29	26.32
U:ADV	9	10	10	47.37	47.37	47.37
U:CONJ	0	0	3	100.00	0.00	0.00
U:CONTR	3	0	3	100.00	50.00	83.33
U:DET	65	27	114	70.65	36.31	59.41
U:NOUN	4	7	12	36.36	25.00	33.33
U:NOUN:POSS	3	0	8	100.00	27.27	65.22
U:OTHER	7	17	20	29.17	25.93	28.46
U:PART	2	1	3	66.67	40.00	58.82
U:PREP	19	8	48	70.37	28.36	54.29
U:PRON	10	2	15	83.33	40.00	68.49
U:PUNCT	23	10	36	69.70	38.98	60.21
U:VERB	5	5	16	50.00	23.81	40.98
U:VERB:FORM	4	1	3	80.00	57.14	74.07
U:VERB:TENSE	14	12	14	53.85	50.00	53.03
UNK	7	0	70	100.00	9.09	33.33

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	356	81	769	81.46	31.64	61.96
R	1515	297	2100	83.61	41.91	69.73
U	202	92	406	68.71	33.22	56.61
UNK	20	0	85	100.00	19.05	54.05

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	12	5	37	70.59	24.49	51.28
ADJ:FORM	3	1	8	75.00	27.27	55.56
ADV	25	14	53	64.10	32.05	53.42
CONJ	5	0	23	100.00	17.86	52.08
CONTR	4	1	8	80.00	33.33	62.50
DET	206	67	373	75.46	35.58	61.64
MORPH	64	16	86	80.00	42.67	68.09
NOUN	40	26	107	60.61	27.21	48.66
NOUN:INFL	15	0	3	100.00	83.33	96.15
NOUN:NUM	109	31	125	77.86	46.58	68.64
NOUN:POSS	18	4	46	81.82	28.12	59.21
ORTH	253	29	190	89.72	57.11	80.52
OTHER	301	88	717	77.38	29.57	58.47
PART	9	2	12	81.82	42.86	69.23
PREP	106	34	304	75.71	25.85	54.64
PRON	53	7	88	88.33	37.59	69.55
PUNCT	240	55	371	81.36	39.28	67.00
SPELL	247	6	74	97.63	76.95	92.65
UNK	20	0	85	100.00	19.05	54.05
VERB	63	17	206	78.75	23.42	53.48
VERB:FORM	93	14	78	86.92	54.39	77.63
VERB:INFL	5	0	3	100.00	62.50	89.29
VERB:SVA	80	12	62	86.96	56.34	78.43
VERB:TENSE	69	24	220	74.19	23.88	52.19
WO	53	17	81	75.71	39.55	64.01

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	5	0.00	0.00	0.00
M:ADV	7	4	14	63.64	33.33	53.85
M:CONJ	5	0	15	100.00	25.00	62.50
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	111	33	160	77.08	40.96	65.53
M:NOUN	7	4	15	63.64	31.82	53.03
M:NOUN:POSS	3	2	12	60.00	20.00	42.86
M:OTHER	17	5	61	77.27	21.79	51.20
M:PART	0	1	5	0.00	0.00	0.00
M:PREP	23	9	79	71.88	22.55	50.00
M:PRON	30	4	43	88.24	41.10	71.77
M:PUNCT	123	11	277	91.79	30.75	65.71
M:VERB	14	5	39	73.68	26.42	54.26
M:VERB:FORM	9	1	6	90.00	60.00	81.82
M:VERB:TENSE	7	0	38	100.00	15.56	47.95
R:ADJ	11	4	22	73.33	33.33	59.14
R:ADJ:FORM	3	1	8	75.00	27.27	55.56
R:ADV	5	3	18	62.50	21.74	45.45
R:CONJ	0	0	6	100.00	0.00	0.00
R:CONTR	3	0	3	100.00	50.00	83.33
R:DET	25	11	80	69.44	23.81	50.20
R:MORPH	64	16	86	80.00	42.67	68.09
R:NOUN	28	17	76	62.22	26.92	49.30
R:NOUN:INFL	15	0	3	100.00	83.33	96.15
R:NOUN:NUM	109	31	125	77.86	46.58	68.64
R:NOUN:POSS	11	2	21	84.62	34.38	65.48
R:ORTH	253	29	190	89.72	57.11	80.52
R:OTHER	263	58	601	81.93	30.44	61.22
R:PART	7	0	4	100.00	63.64	89.74
R:PREP	62	19	170	76.54	26.72	55.76
R:PRON	13	1	30	92.86	30.23	65.66
R:PUNCT	85	36	62	70.25	57.82	67.35
R:SPELL	247	6	74	97.63	76.95	92.65
R:VERB	44	8	141	84.62	23.78	55.98
R:VERB:FORM	80	12	70	86.96	53.33	77.22
R:VERB:INFL	5	0	3	100.00	62.50	89.29
R:VERB:SVA	80	12	62	86.96	56.34	78.43
R:VERB:TENSE	49	14	164	77.78	23.00	52.69
R:WO	53	17	81	75.71	39.55	64.01
U:ADJ	1	0	10	100.00	9.09	33.33
U:ADV	13	7	21	65.00	38.24	57.02
U:CONJ	0	0	2	100.00	0.00	0.00
U:CONTR	1	0	5	100.00	16.67	50.00
U:DET	70	23	133	75.27	34.48	60.87
U:NOUN	5	5	16	50.00	23.81	40.98
U:NOUN:POSS	4	0	13	100.00	23.53	60.61
U:OTHER	21	25	55	45.65	27.63	40.38
U:PART	2	1	3	66.67	40.00	58.82
U:PREP	21	6	55	77.78	27.63	57.07
U:PRON	10	2	15	83.33	40.00	68.49
U:PUNCT	32	8	32	80.00	50.00	71.43
U:VERB	5	4	26	55.56	16.13	37.31
U:VERB:FORM	4	1	2	80.00	66.67	76.92
U:VERB:TENSE	13	10	18	56.52	41.94	52.85
UNK	20	0	85	100.00	19.05	54.05

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	662	328	1375	66.87	32.50	55.19
Span-level detection	797	194	1331	80.42	37.45	65.41
Token-level detection	1003	115	1539	89.71	39.46	71.50

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	103	78	314	56.91	24.70	45.14
R	498	204	922	70.94	35.07	58.89
U	61	46	139	57.01	30.50	48.57

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	4	10	33.33	16.67	27.78
ADJ:FORM	1	0	2	100.00	33.33	71.43
ADV	9	6	19	60.00	32.14	51.14
CONJ	0	1	6	0.00	0.00	0.00
CONTR	2	2	1	50.00	66.67	52.63
DET	80	42	167	65.57	32.39	54.42
MORPH	28	4	51	87.50	35.44	67.63
NOUN	5	13	45	27.78	10.00	20.49
NOUN:INFL	7	0	0	100.00	100.00	100.00
NOUN:NUM	63	11	61	85.14	50.81	75.00
NOUN:POSS	5	1	6	83.33	45.45	71.43
ORTH	94	16	97	85.45	49.21	74.48
OTHER	31	47	326	39.74	8.68	23.17
PART	5	2	7	71.43	41.67	62.50
PREP	29	27	123	51.79	19.08	38.56
PRON	19	8	51	70.37	27.14	53.37
PUNCT	51	41	139	55.43	26.84	45.70
SPELL	85	38	31	69.11	73.28	69.90
VERB	16	14	70	53.33	18.60	38.83
VERB:FORM	49	18	36	73.13	57.65	69.41
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	47	11	26	81.03	64.38	77.05
VERB:TENSE	22	17	81	56.41	21.36	42.47
WO	9	5	19	64.29	32.14	53.57

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	1	0.00	0.00	0.00
M:ADV	0	3	9	0.00	0.00	0.00
M:CONJ	0	1	2	0.00	0.00	0.00
M:CONTR	1	1	0	50.00	100.00	55.56
M:DET	39	25	66	60.94	37.14	54.02
M:NOUN	0	3	3	0.00	0.00	0.00
M:NOUN:POSS	1	0	2	100.00	33.33	71.43
M:OTHER	4	5	28	44.44	12.50	29.41
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	9	9	31	50.00	22.50	40.18
M:PRON	10	3	27	76.92	27.03	56.18
M:PUNCT	29	17	110	63.04	20.86	44.89
M:VERB	1	4	14	20.00	6.67	14.29
M:VERB:FORM	7	3	5	70.00	58.33	67.31
M:VERB:TENSE	2	3	14	40.00	12.50	27.78
R:ADJ	1	0	7	100.00	12.50	41.67
R:ADJ:FORM	1	0	2	100.00	33.33	71.43
R:ADV	3	0	6	100.00	33.33	71.43
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	8	6	37	57.14	17.78	39.60
R:MORPH	28	4	51	87.50	35.44	67.63
R:NOUN	5	7	34	41.67	12.82	28.74
R:NOUN:INFL	7	0	0	100.00	100.00	100.00
R:NOUN:NUM	63	11	61	85.14	50.81	75.00
R:NOUN:POSS	3	0	3	100.00	50.00	83.33
R:ORTH	94	16	97	85.45	49.21	74.48
R:OTHER	26	32	292	44.83	8.18	23.64
R:PART	5	2	3	71.43	62.50	69.44
R:PREP	14	13	72	51.85	16.28	36.08
R:PRON	4	4	16	50.00	20.00	38.46
R:PUNCT	20	22	18	47.62	52.63	48.54
R:SPELL	85	38	31	69.11	73.28	69.90
R:VERB	13	5	49	72.22	20.97	48.51
R:VERB:FORM	42	15	30	73.68	58.33	70.00
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	47	11	26	81.03	64.38	77.05
R:VERB:TENSE	17	12	65	58.62	20.73	42.93
R:WO	9	5	19	64.29	32.14	53.57
U:ADJ	1	3	2	25.00	33.33	26.32
U:ADV	6	3	4	66.67	60.00	65.22
U:CONJ	0	0	3	100.00	0.00	0.00
U:CONTR	1	0	0	100.00	100.00	100.00
U:DET	33	11	64	75.00	34.02	60.44
U:NOUN	0	3	8	0.00	0.00	0.00
U:NOUN:POSS	1	1	1	50.00	50.00	50.00
U:OTHER	1	10	6	9.09	14.29	9.80
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	6	5	20	54.55	23.08	42.86
U:PRON	5	1	8	83.33	38.46	67.57
U:PUNCT	2	2	11	50.00	15.38	34.48
U:VERB	2	5	7	28.57	22.22	27.03
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	3	2	2	60.00	60.00	60.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	117	62	288	65.36	28.89	52.19
R	604	96	850	86.29	41.54	70.99
U	72	36	143	66.67	33.49	55.64
UNK	4	0	50	100.00	7.41	28.57

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	2	12	60.00	20.00	42.86
ADJ:FORM	0	0	4	100.00	0.00	0.00
ADV	7	5	17	58.33	29.17	48.61
CONJ	0	0	9	100.00	0.00	0.00
CONTR	3	1	0	75.00	100.00	78.95
DET	86	38	156	69.35	35.54	58.27
MORPH	32	3	50	91.43	39.02	72.07
NOUN	9	9	45	50.00	16.67	35.71
NOUN:INFL	6	0	0	100.00	100.00	100.00
NOUN:NUM	54	6	55	90.00	49.54	77.36
NOUN:POSS	5	0	5	100.00	50.00	83.33
ORTH	115	11	75	91.27	60.53	82.85
OTHER	94	25	296	78.99	24.10	54.27
PART	5	1	5	83.33	50.00	73.53
PREP	40	15	122	72.73	24.69	52.36
PRON	25	3	51	89.29	32.89	66.49
PUNCT	58	29	127	66.67	31.35	54.41
SPELL	92	7	20	92.93	82.14	90.55
UNK	4	0	50	100.00	7.41	28.57
VERB	28	9	73	75.68	27.72	56.22
VERB:FORM	48	10	34	82.76	58.54	76.43
VERB:INFL	3	0	0	100.00	100.00	100.00
VERB:SVA	46	4	26	92.00	63.89	84.56
VERB:TENSE	27	12	81	69.23	25.00	51.14
WO	7	4	18	63.64	28.00	50.72

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	1	0.00	0.00	0.00
M:ADV	0	3	8	0.00	0.00	0.00
M:CONJ	0	0	4	100.00	0.00	0.00
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	43	21	61	67.19	41.35	59.72
M:NOUN	0	3	3	0.00	0.00	0.00
M:NOUN:POSS	1	0	2	100.00	33.33	71.43
M:OTHER	7	3	24	70.00	22.58	49.30
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	10	7	32	58.82	23.81	45.45
M:PRON	12	2	24	85.71	33.33	65.22
M:PUNCT	31	12	98	72.09	24.03	51.50
M:VERB	4	3	13	57.14	23.53	44.44
M:VERB:FORM	7	3	3	70.00	70.00	70.00
M:VERB:TENSE	2	3	14	40.00	12.50	27.78
R:ADJ	2	0	8	100.00	20.00	55.56
R:ADJ:FORM	0	0	4	100.00	0.00	0.00
R:ADV	3	0	6	100.00	33.33	71.43
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	11	5	33	68.75	25.00	50.93
R:MORPH	32	3	50	91.43	39.02	72.07
R:NOUN	7	3	33	70.00	17.50	43.75
R:NOUN:INFL	6	0	0	100.00	100.00	100.00
R:NOUN:NUM	54	6	55	90.00	49.54	77.36
R:NOUN:POSS	3	0	2	100.00	60.00	88.24
R:ORTH	115	11	75	91.27	60.53	82.85
R:OTHER	84	12	266	87.50	24.00	57.22
R:PART	5	1	2	83.33	71.43	80.65
R:PREP	22	7	70	75.86	23.91	52.88
R:PRON	6	1	17	85.71	26.09	58.82
R:PUNCT	23	15	17	60.53	57.50	59.90
R:SPELL	92	7	20	92.93	82.14	90.55
R:VERB	21	3	52	87.50	28.77	62.13
R:VERB:FORM	41	7	30	85.42	57.75	77.95
R:VERB:INFL	3	0	0	100.00	100.00	100.00
R:VERB:SVA	46	4	26	92.00	63.89	84.56
R:VERB:TENSE	20	7	64	74.07	23.81	52.08
R:WO	7	4	18	63.64	28.00	50.72
U:ADJ	1	1	3	50.00	25.00	41.67
U:ADV	4	2	3	66.67	57.14	64.52
U:CONJ	0	0	3	100.00	0.00	0.00
U:CONTR	2	0	0	100.00	100.00	100.00
U:DET	32	12	62	72.73	34.04	59.26
U:NOUN	2	3	9	40.00	18.18	32.26
U:NOUN:POSS	1	0	1	100.00	50.00	83.33
U:OTHER	3	10	6	23.08	33.33	24.59
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	8	1	20	88.89	28.57	62.50
U:PRON	7	0	10	100.00	41.18	77.78
U:PUNCT	4	2	12	66.67	25.00	50.00
U:VERB	3	3	8	50.00	27.27	42.86
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	5	2	3	71.43	62.50	69.44
UNK	4	0	50	100.00	7.41	28.57

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	158	29	327	84.49	32.58	64.07
R	740	60	972	92.50	43.22	75.33
U	93	26	175	78.15	34.70	62.50
UNK	12	0	65	100.00	15.58	48.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	0	15	100.00	16.67	50.00
ADJ:FORM	0	0	4	100.00	0.00	0.00
ADV	15	2	26	88.24	36.59	68.81
CONJ	1	0	10	100.00	9.09	33.33
CONTR	2	1	1	66.67	66.67	66.67
DET	94	21	176	81.74	34.81	64.38
MORPH	35	2	51	94.59	40.70	74.79
NOUN	13	6	53	68.42	19.70	45.77
NOUN:INFL	6	0	0	100.00	100.00	100.00
NOUN:NUM	58	4	56	93.55	50.88	80.11
NOUN:POSS	10	0	8	100.00	55.56	86.21
ORTH	129	9	74	93.48	63.55	85.43
OTHER	163	21	358	88.59	31.29	64.84
PART	5	0	5	100.00	50.00	83.33
PREP	44	8	133	84.62	24.86	57.14
PRON	32	1	49	96.97	39.51	75.12
PUNCT	96	14	145	87.27	39.83	70.48
SPELL	92	2	22	97.87	80.70	93.88
UNK	12	0	65	100.00	15.58	48.00
VERB	33	6	103	84.62	24.26	56.51
VERB:FORM	49	4	32	92.45	60.49	83.62
VERB:INFL	3	0	0	100.00	100.00	100.00
VERB:SVA	47	3	28	94.00	62.67	85.45
VERB:TENSE	34	8	103	80.95	24.82	55.74
WO	27	3	22	90.00	55.10	79.88

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	5	2	7	71.43	41.67	62.50
M:CONJ	1	0	6	100.00	14.29	45.45
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	43	9	69	82.69	38.39	67.19
M:NOUN	0	3	5	0.00	0.00	0.00
M:NOUN:POSS	1	0	2	100.00	33.33	71.43
M:OTHER	10	2	31	83.33	24.39	56.18
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	14	3	36	82.35	28.00	59.32
M:PRON	15	1	23	93.75	39.47	73.53
M:PUNCT	53	6	108	89.83	32.92	66.75
M:VERB	6	2	18	75.00	25.00	53.57
M:VERB:FORM	5	0	5	100.00	50.00	83.33
M:VERB:TENSE	5	0	14	100.00	26.32	64.10
R:ADJ	2	0	10	100.00	16.67	50.00
R:ADJ:FORM	0	0	4	100.00	0.00	0.00
R:ADV	3	0	11	100.00	21.43	57.69
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	12	4	33	75.00	26.67	55.05
R:MORPH	35	2	51	94.59	40.70	74.79
R:NOUN	10	2	39	83.33	20.41	51.55
R:NOUN:INFL	6	0	0	100.00	100.00	100.00
R:NOUN:NUM	58	4	56	93.55	50.88	80.11
R:NOUN:POSS	7	0	1	100.00	87.50	97.22
R:ORTH	129	9	74	93.48	63.55	85.43
R:OTHER	146	6	314	96.05	31.74	68.35
R:PART	5	0	1	100.00	83.33	96.15
R:PREP	20	5	76	80.00	20.83	51.02
R:PRON	9	0	18	100.00	33.33	71.43
R:PUNCT	36	7	28	83.72	56.25	76.27
R:SPELL	92	2	22	97.87	80.70	93.88
R:VERB	25	2	72	92.59	25.77	60.98
R:VERB:FORM	44	4	26	91.67	62.86	83.97
R:VERB:INFL	3	0	0	100.00	100.00	100.00
R:VERB:SVA	47	3	28	94.00	62.67	85.45
R:VERB:TENSE	23	7	84	76.67	21.50	50.66
R:WO	27	3	22	90.00	55.10	79.88
U:ADJ	1	0	4	100.00	20.00	55.56
U:ADV	7	0	8	100.00	46.67	81.40
U:CONJ	0	0	2	100.00	0.00	0.00
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	39	8	74	82.98	34.51	64.78
U:NOUN	3	1	9	75.00	25.00	53.57
U:NOUN:POSS	2	0	5	100.00	28.57	66.67
U:OTHER	7	13	13	35.00	35.00	35.00
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	10	0	21	100.00	32.26	70.42
U:PRON	8	0	8	100.00	50.00	83.33
U:PUNCT	7	1	9	87.50	43.75	72.92
U:VERB	2	2	13	50.00	13.33	32.26
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	6	1	5	85.71	54.55	76.92
UNK	12	0	65	100.00	15.58	48.00

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	401	245	975	62.07	29.14	50.63
Span-level detection	469	177	964	72.60	32.73	58.38
Token-level detection	566	163	1138	77.64	33.22	61.26

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	87	48	238	64.44	26.77	50.29
R	257	161	640	61.48	28.65	50.02
U	57	36	97	61.29	37.01	54.18

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	3	7	50.00	30.00	44.12
ADJ:FORM	2	0	1	100.00	66.67	90.91
ADV	5	4	13	55.56	27.78	46.30
CONJ	1	0	7	100.00	12.50	41.67
CONTR	2	0	1	100.00	66.67	90.91
DET	69	32	123	68.32	35.94	57.89
MORPH	17	9	20	65.38	45.95	60.28
NOUN	8	17	27	32.00	22.86	29.63
NOUN:NUM	24	8	42	75.00	36.36	61.86
NOUN:POSS	1	1	12	50.00	7.69	23.81
ORTH	23	14	45	62.16	33.82	53.24
OTHER	10	46	198	17.86	4.81	11.57
PART	3	1	5	75.00	37.50	62.50
PREP	34	19	104	64.15	24.64	48.57
PRON	11	10	25	52.38	30.56	45.83
PUNCT	50	28	103	64.10	32.68	53.76
SPELL	48	16	26	75.00	64.86	72.73
VERB	6	9	65	40.00	8.45	22.90
VERB:FORM	30	10	37	75.00	44.78	66.08
VERB:SVA	28	5	23	84.85	54.90	76.50
VERB:TENSE	22	9	60	70.97	26.83	53.40
WO	4	4	31	50.00	11.43	29.85

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	2	0.00	0.00	0.00
M:ADV	1	1	6	50.00	14.29	33.33
M:CONJ	1	0	5	100.00	16.67	50.00
M:DET	38	18	65	67.86	36.89	58.10
M:NOUN	0	2	2	0.00	0.00	0.00
M:NOUN:POSS	0	1	5	0.00	0.00	0.00
M:OTHER	0	4	17	0.00	0.00	0.00
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	4	4	23	50.00	14.81	33.90
M:PRON	9	6	13	60.00	40.91	54.88
M:PUNCT	27	6	77	81.82	25.96	57.20
M:VERB	4	3	6	57.14	40.00	52.63
M:VERB:FORM	2	1	0	66.67	100.00	71.43
M:VERB:TENSE	1	1	15	50.00	6.25	20.83
R:ADJ	2	1	3	66.67	40.00	58.82
R:ADJ:FORM	2	0	1	100.00	66.67	90.91
R:ADV	1	1	3	50.00	25.00	41.67
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	8	4	36	66.67	18.18	43.48
R:MORPH	17	9	20	65.38	45.95	60.28
R:NOUN	7	14	24	33.33	22.58	30.43
R:NOUN:NUM	24	8	42	75.00	36.36	61.86
R:NOUN:POSS	0	0	2	100.00	0.00	0.00
R:ORTH	23	14	45	62.16	33.82	53.24
R:OTHER	8	35	170	18.60	4.49	11.43
R:PART	2	1	2	66.67	50.00	62.50
R:PREP	22	12	61	64.71	26.51	50.23
R:PRON	1	2	6	33.33	14.29	26.32
R:PUNCT	16	17	18	48.48	47.06	48.19
R:SPELL	48	16	26	75.00	64.86	72.73
R:VERB	1	4	53	20.00	1.85	6.76
R:VERB:FORM	26	9	34	74.29	43.33	65.00
R:VERB:SVA	28	5	23	84.85	54.90	76.50
R:VERB:TENSE	16	5	38	76.19	29.63	57.97
R:WO	4	4	31	50.00	11.43	29.85
U:ADJ	1	1	2	50.00	33.33	45.45
U:ADV	3	2	4	60.00	42.86	55.56
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	23	10	22	69.70	51.11	64.97
U:NOUN	1	1	1	50.00	50.00	50.00
U:NOUN:POSS	1	0	5	100.00	16.67	50.00
U:OTHER	2	7	11	22.22	15.38	20.41
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	8	3	20	72.73	28.57	55.56
U:PRON	1	2	6	33.33	14.29	26.32
U:PUNCT	7	5	8	58.33	46.67	55.56
U:VERB	1	2	6	33.33	14.29	26.32
U:VERB:FORM	2	0	3	100.00	40.00	76.92
U:VERB:TENSE	5	3	7	62.50	41.67	56.82

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	103	31	248	76.87	29.34	58.06
R	305	114	601	72.79	33.66	59.06
U	58	32	103	64.44	36.02	55.66
UNK	3	0	12	100.00	20.00	55.56

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	3	8	62.50	38.46	55.56
ADJ:FORM	2	0	1	100.00	66.67	90.91
ADV	7	4	13	63.64	35.00	54.69
CONJ	1	0	8	100.00	11.11	38.46
CONTR	2	0	1	100.00	66.67	90.91
DET	76	22	121	77.55	38.58	64.52
MORPH	15	7	19	68.18	44.12	61.48
NOUN	11	10	24	52.38	31.43	46.22
NOUN:NUM	23	7	40	76.67	36.51	62.84
NOUN:POSS	1	1	12	50.00	7.69	23.81
ORTH	29	13	46	69.05	38.67	59.67
OTHER	35	35	192	50.00	15.42	34.52
PART	3	1	6	75.00	33.33	60.00
PREP	36	14	104	72.00	25.71	52.94
PRON	14	7	24	66.67	36.84	57.38
PUNCT	53	27	109	66.25	32.72	54.98
SPELL	53	2	18	96.36	74.65	91.07
UNK	3	0	12	100.00	20.00	55.56
VERB	14	6	67	70.00	17.28	43.48
VERB:FORM	31	4	31	88.57	50.00	76.73
VERB:SVA	30	3	22	90.91	57.69	81.52
VERB:TENSE	21	7	57	75.00	26.92	55.26
WO	4	4	29	50.00	12.12	30.77

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	3	0.00	0.00	0.00
M:ADV	1	1	5	50.00	16.67	35.71
M:CONJ	1	0	6	100.00	14.29	45.45
M:DET	44	10	62	81.48	41.51	68.32
M:NOUN	3	0	1	100.00	75.00	93.75
M:NOUN:POSS	0	1	5	0.00	0.00	0.00
M:OTHER	3	3	20	50.00	13.04	31.91
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	4	4	25	50.00	13.79	32.79
M:PRON	11	4	13	73.33	45.83	65.48
M:PUNCT	28	5	85	84.85	24.78	57.14
M:VERB	6	1	7	85.71	46.15	73.17
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	0	1	14	0.00	0.00	0.00
R:ADJ	5	1	3	83.33	62.50	78.12
R:ADJ:FORM	2	0	1	100.00	66.67	90.91
R:ADV	2	1	3	66.67	40.00	58.82
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	11	4	34	73.33	24.44	52.38
R:MORPH	15	7	19	68.18	44.12	61.48
R:NOUN	7	9	21	43.75	25.00	38.04
R:NOUN:NUM	23	7	40	76.67	36.51	62.84
R:NOUN:POSS	0	0	2	100.00	0.00	0.00
R:ORTH	29	13	46	69.05	38.67	59.67
R:OTHER	30	27	160	52.63	15.79	35.89
R:PART	2	1	3	66.67	40.00	58.82
R:PREP	24	7	59	77.42	28.92	57.97
R:PRON	1	1	7	50.00	12.50	31.25
R:PUNCT	17	17	14	50.00	54.84	50.90
R:SPELL	53	2	18	96.36	74.65	91.07
R:VERB	6	3	53	66.67	10.17	31.58
R:VERB:FORM	27	4	29	87.10	48.21	75.00
R:VERB:SVA	30	3	22	90.91	57.69	81.52
R:VERB:TENSE	16	3	36	84.21	30.77	62.50
R:WO	4	4	29	50.00	12.12	30.77
U:ADJ	0	1	2	0.00	0.00	0.00
U:ADV	4	2	5	66.67	44.44	60.61
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	21	8	25	72.41	45.65	64.81
U:NOUN	1	1	2	50.00	33.33	45.45
U:NOUN:POSS	1	0	5	100.00	16.67	50.00
U:OTHER	2	5	12	28.57	14.29	23.81
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	8	3	20	72.73	28.57	55.56
U:PRON	2	2	4	50.00	33.33	45.45
U:PUNCT	8	5	10	61.54	44.44	57.14
U:VERB	2	2	7	50.00	22.22	40.00
U:VERB:FORM	2	0	2	100.00	50.00	83.33
U:VERB:TENSE	5	3	7	62.50	41.67	56.82
UNK	3	0	12	100.00	20.00	55.56

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	118	19	272	86.13	30.26	62.90
R	381	112	699	77.28	35.28	62.42
U	63	32	154	66.32	29.03	52.76
UNK	4	0	13	100.00	23.53	60.61

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	2	10	71.43	33.33	58.14
ADJ:FORM	2	0	1	100.00	66.67	90.91
ADV	8	4	19	66.67	29.63	53.33
CONJ	2	0	9	100.00	18.18	52.63
CONTR	1	0	1	100.00	50.00	83.33
DET	73	18	127	80.22	36.50	64.72
MORPH	16	2	21	88.89	43.24	73.39
NOUN	14	9	27	60.87	34.15	52.63
NOUN:NUM	24	5	42	82.76	36.36	65.93
NOUN:POSS	2	1	15	66.67	11.76	34.48
ORTH	46	14	54	76.67	46.00	67.65
OTHER	74	46	259	61.67	22.22	45.51
PART	2	0	5	100.00	28.57	66.67
PREP	41	10	107	80.39	27.70	58.24
PRON	13	6	30	68.42	30.23	54.62
PUNCT	70	21	114	76.92	38.04	63.87
SPELL	53	2	19	96.36	73.61	90.75
UNK	4	0	13	100.00	23.53	60.61
VERB	21	3	83	87.50	20.19	52.50
VERB:FORM	32	6	33	84.21	49.23	73.73
VERB:SVA	27	3	22	90.00	55.10	79.88
VERB:TENSE	23	4	79	85.19	22.55	54.76
WO	13	7	48	65.00	21.31	46.10

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	2	0.00	0.00	0.00
M:ADV	2	1	7	66.67	22.22	47.62
M:CONJ	2	0	6	100.00	25.00	62.50
M:DET	44	6	63	88.00	41.12	71.66
M:NOUN	3	0	3	100.00	50.00	83.33
M:NOUN:POSS	1	1	5	50.00	16.67	35.71
M:OTHER	4	2	22	66.67	15.38	40.00
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	6	3	26	66.67	18.75	44.12
M:PRON	11	3	15	78.57	42.31	67.07
M:PUNCT	35	2	88	94.59	28.46	64.58
M:VERB	7	0	15	100.00	31.82	70.00
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	1	0	18	100.00	5.26	21.74
R:ADJ	5	1	7	83.33	41.67	69.44
R:ADJ:FORM	2	0	1	100.00	66.67	90.91
R:ADV	2	1	3	66.67	40.00	58.82
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	10	4	35	71.43	22.22	49.50
R:MORPH	16	2	21	88.89	43.24	73.39
R:NOUN	10	8	19	55.56	34.48	49.50
R:NOUN:NUM	24	5	42	82.76	36.36	65.93
R:NOUN:POSS	0	0	4	100.00	0.00	0.00
R:ORTH	46	14	54	76.67	46.00	67.65
R:OTHER	60	36	198	62.50	23.26	46.73
R:PART	1	0	2	100.00	33.33	71.43
R:PREP	27	5	56	84.38	32.53	63.98
R:PRON	1	1	9	50.00	10.00	27.78
R:PUNCT	25	15	16	62.50	60.98	62.19
R:SPELL	53	2	19	96.36	73.61	90.75
R:VERB	11	1	57	91.67	16.18	47.41
R:VERB:FORM	28	6	32	82.35	46.67	71.43
R:VERB:SVA	27	3	22	90.00	55.10	79.88
R:VERB:TENSE	19	1	51	95.00	27.14	63.33
R:WO	13	7	48	65.00	21.31	46.10
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	4	2	9	66.67	30.77	54.05
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	19	8	29	70.37	39.58	60.90
U:NOUN	1	1	5	50.00	16.67	35.71
U:NOUN:POSS	1	0	6	100.00	14.29	45.45
U:OTHER	10	8	39	55.56	20.41	41.32
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	8	2	25	80.00	24.24	54.79
U:PRON	1	2	6	33.33	14.29	26.32
U:PUNCT	10	4	10	71.43	50.00	65.79
U:VERB	3	2	11	60.00	21.43	44.12
U:VERB:FORM	2	0	1	100.00	66.67	90.91
U:VERB:TENSE	3	3	10	50.00	23.08	40.54
UNK	4	0	13	100.00	23.53	60.61

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	187	139	361	57.36	34.12	50.49
Span-level detection	227	100	354	69.42	39.07	60.08
Token-level detection	283	89	409	76.08	40.90	64.91

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	38	18	95	67.86	28.57	53.22
R	123	104	222	54.19	35.65	49.08
U	26	17	44	60.47	37.14	53.72

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	1	6	50.00	14.29	33.33
ADJ:FORM	0	1	2	0.00	0.00	0.00
ADV	2	3	3	40.00	40.00	40.00
CONJ	0	1	5	0.00	0.00	0.00
CONTR	0	1	3	0.00	0.00	0.00
DET	29	17	58	63.04	33.33	53.51
MORPH	7	7	10	50.00	41.18	47.95
NOUN	1	13	13	7.14	7.14	7.14
NOUN:INFL	1	2	1	33.33	50.00	35.71
NOUN:NUM	14	13	17	51.85	45.16	50.36
NOUN:POSS	1	1	6	50.00	14.29	33.33
ORTH	23	3	22	88.46	51.11	77.18
OTHER	11	10	53	52.38	17.19	37.16
PART	1	1	3	50.00	25.00	41.67
PREP	11	7	45	61.11	19.64	42.97
PRON	4	1	6	80.00	40.00	66.67
PUNCT	29	25	39	53.70	42.65	51.06
SPELL	25	7	13	78.12	65.79	75.30
VERB	0	5	6	0.00	0.00	0.00
VERB:FORM	10	5	6	66.67	62.50	65.79
VERB:SVA	2	3	7	40.00	22.22	34.48
VERB:TENSE	10	8	26	55.56	27.78	46.30
WO	5	4	11	55.56	31.25	48.08

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	1	1	0	50.00	100.00	55.56
M:CONJ	0	1	3	0.00	0.00	0.00
M:DET	17	9	28	65.38	37.78	57.05
M:NOUN	0	0	2	100.00	0.00	0.00
M:OTHER	0	1	7	0.00	0.00	0.00
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	1	0	14	100.00	6.67	26.32
M:PRON	1	0	4	100.00	20.00	55.56
M:PUNCT	17	3	30	85.00	36.17	66.93
M:VERB	0	2	2	0.00	0.00	0.00
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	0	0	4	100.00	0.00	0.00
R:ADJ	1	1	4	50.00	20.00	38.46
R:ADJ:FORM	0	1	2	0.00	0.00	0.00
R:ADV	0	1	1	0.00	0.00	0.00
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	0	1	1	0.00	0.00	0.00
R:DET	2	4	9	33.33	18.18	28.57
R:MORPH	7	7	10	50.00	41.18	47.95
R:NOUN	1	11	11	8.33	8.33	8.33
R:NOUN:INFL	1	2	1	33.33	50.00	35.71
R:NOUN:NUM	14	13	17	51.85	45.16	50.36
R:NOUN:POSS	0	1	5	0.00	0.00	0.00
R:ORTH	23	3	22	88.46	51.11	77.18
R:OTHER	9	7	45	56.25	16.67	38.14
R:PART	1	0	2	100.00	33.33	71.43
R:PREP	9	4	24	69.23	27.27	52.94
R:PRON	2	1	1	66.67	66.67	66.67
R:PUNCT	7	19	5	26.92	58.33	30.17
R:SPELL	25	7	13	78.12	65.79	75.30
R:VERB	0	3	4	0.00	0.00	0.00
R:VERB:FORM	7	4	6	63.64	53.85	61.40
R:VERB:SVA	2	3	7	40.00	22.22	34.48
R:VERB:TENSE	7	7	19	50.00	26.92	42.68
R:WO	5	4	11	55.56	31.25	48.08
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	1	1	2	50.00	33.33	45.45
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	10	4	21	71.43	32.26	57.47
U:NOUN	0	2	0	0.00	100.00	0.00
U:NOUN:POSS	1	0	1	100.00	50.00	83.33
U:OTHER	2	2	1	50.00	66.67	52.63
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	1	3	7	25.00	12.50	20.83
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	5	3	4	62.50	55.56	60.98
U:VERB:FORM	2	1	0	66.67	100.00	71.43
U:VERB:TENSE	3	1	3	75.00	50.00	68.18

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	43	14	96	75.44	30.94	58.58
R	155	72	209	68.28	42.58	60.93
U	29	14	44	67.44	39.73	59.18
UNK	0	0	5	100.00	0.00	0.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	0	5	100.00	28.57	66.67
ADJ:FORM	0	1	2	0.00	0.00	0.00
ADV	1	3	3	25.00	25.00	25.00
CONJ	0	0	5	100.00	0.00	0.00
CONTR	1	0	2	100.00	33.33	71.43
DET	33	13	56	71.74	37.08	60.44
MORPH	8	5	9	61.54	47.06	57.97
NOUN	5	10	17	33.33	22.73	30.49
NOUN:INFL	2	0	0	100.00	100.00	100.00
NOUN:NUM	15	10	18	60.00	45.45	56.39
NOUN:POSS	3	1	4	75.00	42.86	65.22
ORTH	27	0	19	100.00	58.70	87.66
OTHER	23	8	48	74.19	32.39	58.97
PART	2	1	2	66.67	50.00	62.50
PREP	11	5	46	68.75	19.30	45.45
PRON	4	0	7	100.00	36.36	74.07
PUNCT	31	22	39	58.49	44.29	54.96
SPELL	29	1	9	96.67	76.32	91.77
UNK	0	0	5	100.00	0.00	0.00
VERB	3	5	7	37.50	30.00	35.71
VERB:FORM	10	3	7	76.92	58.82	72.46
VERB:SVA	3	3	7	50.00	30.00	44.12
VERB:TENSE	10	5	27	66.67	27.03	51.55
WO	4	4	10	50.00	28.57	43.48

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	1	0	0.00	100.00	0.00
M:CONJ	0	0	3	100.00	0.00	0.00
M:DET	19	7	25	73.08	43.18	64.19
M:NOUN	1	0	3	100.00	25.00	62.50
M:OTHER	1	1	8	50.00	11.11	29.41
M:PART	0	1	1	0.00	0.00	0.00
M:PREP	2	0	14	100.00	12.50	41.67
M:PRON	1	0	4	100.00	20.00	55.56
M:PUNCT	18	2	29	90.00	38.30	70.87
M:VERB	0	2	2	0.00	0.00	0.00
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	0	0	6	100.00	0.00	0.00
R:ADJ	2	0	3	100.00	40.00	76.92
R:ADJ:FORM	0	1	2	0.00	0.00	0.00
R:ADV	0	1	1	0.00	0.00	0.00
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	4	3	9	57.14	30.77	48.78
R:MORPH	8	5	9	61.54	47.06	57.97
R:NOUN	3	8	13	27.27	18.75	25.00
R:NOUN:INFL	2	0	0	100.00	100.00	100.00
R:NOUN:NUM	15	10	18	60.00	45.45	56.39
R:NOUN:POSS	2	1	3	66.67	40.00	58.82
R:ORTH	27	0	19	100.00	58.70	87.66
R:OTHER	20	5	39	80.00	33.90	62.89
R:PART	2	0	1	100.00	66.67	90.91
R:PREP	8	4	25	66.67	24.24	49.38
R:PRON	2	0	2	100.00	50.00	83.33
R:PUNCT	7	17	6	29.17	53.85	32.11
R:SPELL	29	1	9	96.67	76.32	91.77
R:VERB	3	3	5	50.00	37.50	46.88
R:VERB:FORM	7	2	7	77.78	50.00	70.00
R:VERB:SVA	3	3	7	50.00	30.00	44.12
R:VERB:TENSE	6	4	19	60.00	24.00	46.15
R:WO	4	4	10	50.00	28.57	43.48
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	1	1	2	50.00	33.33	45.45
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	10	3	22	76.92	31.25	59.52
U:NOUN	1	2	1	33.33	50.00	35.71
U:NOUN:POSS	1	0	1	100.00	50.00	83.33
U:OTHER	2	2	1	50.00	66.67	52.63
U:PREP	1	1	7	50.00	12.50	31.25
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	6	3	4	66.67	60.00	65.22
U:VERB:FORM	2	1	0	66.67	100.00	71.43
U:VERB:TENSE	4	1	2	80.00	66.67	76.92
UNK	0	0	5	100.00	0.00	0.00

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	56	12	114	82.35	32.94	63.35
R	191	61	239	75.79	44.42	66.41
U	34	16	50	68.00	40.48	59.86
UNK	2	0	6	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	0	7	100.00	12.50	41.67
ADJ:FORM	0	1	3	0.00	0.00	0.00
ADV	2	3	7	40.00	22.22	34.48
CONJ	1	0	4	100.00	20.00	55.56
CONTR	1	0	3	100.00	25.00	62.50
DET	32	13	60	71.11	34.78	58.82
MORPH	10	4	10	71.43	50.00	65.79
NOUN	6	6	18	50.00	25.00	41.67
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	14	10	19	58.33	42.42	54.26
NOUN:POSS	3	2	6	60.00	33.33	51.72
ORTH	34	0	21	100.00	61.82	89.01
OTHER	36	9	62	80.00	36.73	64.75
PART	1	1	2	50.00	33.33	45.45
PREP	14	4	50	77.78	21.88	51.47
PRON	6	0	5	100.00	54.55	85.71
PUNCT	50	18	48	73.53	51.02	67.57
SPELL	29	1	10	96.67	74.36	91.19
UNK	2	0	6	100.00	25.00	62.50
VERB	5	4	10	55.56	33.33	49.02
VERB:FORM	9	1	10	90.00	47.37	76.27
VERB:SVA	3	2	6	60.00	33.33	51.72
VERB:TENSE	12	5	31	70.59	27.91	54.05
WO	11	5	11	68.75	50.00	63.95

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	0	1	0	0.00	100.00	0.00
M:CONJ	1	0	3	100.00	25.00	62.50
M:DET	19	7	27	73.08	41.30	63.33
M:NOUN	2	0	3	100.00	40.00	76.92
M:OTHER	3	0	8	100.00	27.27	65.22
M:PART	0	1	1	0.00	0.00	0.00
M:PREP	2	0	16	100.00	11.11	38.46
M:PRON	3	0	3	100.00	50.00	83.33
M:PUNCT	23	2	41	92.00	35.94	70.12
M:VERB	0	1	3	0.00	0.00	0.00
M:VERB:FORM	2	0	1	100.00	66.67	90.91
M:VERB:TENSE	1	0	6	100.00	14.29	45.45
R:ADJ	1	0	3	100.00	25.00	62.50
R:ADJ:FORM	0	1	3	0.00	0.00	0.00
R:ADV	0	1	3	0.00	0.00	0.00
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	3	3	9	50.00	25.00	41.67
R:MORPH	10	4	10	71.43	50.00	65.79
R:NOUN	3	4	13	42.86	18.75	34.09
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	14	10	19	58.33	42.42	54.26
R:NOUN:POSS	2	2	5	50.00	28.57	43.48
R:ORTH	34	0	21	100.00	61.82	89.01
R:OTHER	30	5	52	85.71	36.59	67.57
R:PART	1	0	1	100.00	50.00	83.33
R:PREP	11	3	27	78.57	28.95	58.51
R:PRON	2	0	1	100.00	66.67	90.91
R:PUNCT	18	13	4	58.06	81.82	61.64
R:SPELL	29	1	10	96.67	74.36	91.19
R:VERB	5	3	7	62.50	41.67	56.82
R:VERB:FORM	5	0	9	100.00	35.71	73.53
R:VERB:SVA	3	2	6	60.00	33.33	51.72
R:VERB:TENSE	7	4	24	63.64	22.58	46.67
R:WO	11	5	11	68.75	50.00	63.95
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	2	1	4	66.67	33.33	55.56
U:CONTR	0	0	3	100.00	0.00	0.00
U:DET	10	3	24	76.92	29.41	58.14
U:NOUN	1	2	2	33.33	33.33	33.33
U:NOUN:POSS	1	0	1	100.00	50.00	83.33
U:OTHER	3	4	2	42.86	60.00	45.45
U:PREP	1	1	7	50.00	12.50	31.25
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	9	3	3	75.00	75.00	75.00
U:VERB:FORM	2	1	0	66.67	100.00	71.43
U:VERB:TENSE	4	1	1	80.00	80.00	80.00
UNK	2	0	6	100.00	25.00	62.50

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	178	142	257	55.63	40.92	51.90
Span-level detection	205	115	243	64.06	45.76	59.32
Token-level detection	241	103	274	70.06	46.80	63.72

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	16	26	48	38.10	25.00	34.48
R	153	95	187	61.69	45.00	57.43
U	9	21	22	30.00	29.03	29.80

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	4	2	42.86	60.00	45.45
ADV	1	6	1	14.29	50.00	16.67
DET	7	19	7	26.92	50.00	29.66
MORPH	2	9	4	18.18	33.33	20.00
NOUN	4	8	7	33.33	36.36	33.90
NOUN:INFL	8	0	3	100.00	72.73	93.02
NOUN:NUM	12	13	10	48.00	54.55	49.18
NOUN:POSS	2	1	15	66.67	11.76	34.48
ORTH	29	7	35	80.56	45.31	69.71
OTHER	10	16	36	38.46	21.74	33.33
PART	1	1	0	50.00	100.00	55.56
PREP	5	16	16	23.81	23.81	23.81
PRON	2	0	4	100.00	33.33	71.43
PUNCT	13	8	57	61.90	18.57	42.21
SPELL	67	11	30	85.90	69.07	81.91
VERB	3	4	10	42.86	23.08	36.59
VERB:FORM	3	5	4	37.50	42.86	38.46
VERB:INFL	2	0	3	100.00	40.00	76.92
VERB:SVA	3	5	6	37.50	33.33	36.59
VERB:TENSE	0	8	6	0.00	0.00	0.00
WO	1	1	1	50.00	50.00	50.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	0	1	100.00	0.00	0.00
M:DET	5	15	1	25.00	83.33	29.07
M:NOUN	0	1	2	0.00	0.00	0.00
M:NOUN:POSS	1	1	5	50.00	16.67	35.71
M:OTHER	0	1	0	0.00	100.00	0.00
M:PREP	1	4	1	20.00	50.00	22.73
M:PRON	1	0	2	100.00	33.33	71.43
M:PUNCT	7	1	34	87.50	17.07	47.95
M:VERB	1	2	2	33.33	33.33	33.33
M:VERB:FORM	0	1	0	0.00	100.00	0.00
R:ADJ	3	4	2	42.86	60.00	45.45
R:ADV	0	1	0	0.00	100.00	0.00
R:DET	0	0	2	100.00	0.00	0.00
R:MORPH	2	9	4	18.18	33.33	20.00
R:NOUN	4	6	5	40.00	44.44	40.82
R:NOUN:INFL	8	0	3	100.00	72.73	93.02
R:NOUN:NUM	12	13	10	48.00	54.55	49.18
R:NOUN:POSS	1	0	9	100.00	10.00	35.71
R:ORTH	29	7	35	80.56	45.31	69.71
R:OTHER	10	15	35	40.00	22.22	34.48
R:PREP	3	8	12	27.27	20.00	25.42
R:PRON	1	0	2	100.00	33.33	71.43
R:PUNCT	2	7	14	22.22	12.50	19.23
R:SPELL	67	11	30	85.90	69.07	81.91
R:VERB	2	2	7	50.00	22.22	40.00
R:VERB:FORM	3	4	3	42.86	50.00	44.12
R:VERB:INFL	2	0	3	100.00	40.00	76.92
R:VERB:SVA	3	5	6	37.50	33.33	36.59
R:VERB:TENSE	0	2	4	0.00	0.00	0.00
R:WO	1	1	1	50.00	50.00	50.00
U:ADV	1	5	0	16.67	100.00	20.00
U:DET	2	4	4	33.33	33.33	33.33
U:NOUN	0	1	0	0.00	100.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	0	0	1	100.00	0.00	0.00
U:PART	1	1	0	50.00	100.00	55.56
U:PREP	1	4	3	20.00	25.00	20.83
U:PUNCT	4	0	9	100.00	30.77	68.97
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	0	6	2	0.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	18	24	46	42.86	28.12	38.79
R	177	71	173	71.37	50.57	65.95
U	10	20	21	33.33	32.26	33.11
UNK	0	0	3	100.00	0.00	0.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	3	2	50.00	60.00	51.72
ADV	0	6	1	0.00	0.00	0.00
DET	8	17	8	32.00	50.00	34.48
MORPH	3	8	4	27.27	42.86	29.41
NOUN	5	5	7	50.00	41.67	48.08
NOUN:INFL	8	0	3	100.00	72.73	93.02
NOUN:NUM	11	13	9	45.83	55.00	47.41
NOUN:POSS	3	1	15	75.00	16.67	44.12
ORTH	35	5	31	87.50	53.03	77.43
OTHER	16	13	36	55.17	30.77	47.62
PART	1	1	0	50.00	100.00	55.56
PREP	7	15	13	31.82	35.00	32.41
PRON	2	0	4	100.00	33.33	71.43
PUNCT	16	6	58	72.73	21.62	49.38
SPELL	74	1	21	98.67	77.89	93.67
UNK	0	0	3	100.00	0.00	0.00
VERB	4	4	9	50.00	30.77	44.44
VERB:FORM	3	4	3	42.86	50.00	44.12
VERB:INFL	2	0	3	100.00	40.00	76.92
VERB:SVA	3	4	6	42.86	33.33	40.54
VERB:TENSE	0	8	6	0.00	0.00	0.00
WO	1	1	1	50.00	50.00	50.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:DET	6	13	1	31.58	85.71	36.14
M:NOUN	0	1	2	0.00	0.00	0.00
M:NOUN:POSS	1	1	5	50.00	16.67	35.71
M:OTHER	0	1	0	0.00	100.00	0.00
M:PREP	1	4	0	20.00	100.00	23.81
M:PRON	1	0	2	100.00	33.33	71.43
M:PUNCT	8	1	34	88.89	19.05	51.28
M:VERB	1	2	2	33.33	33.33	33.33
M:VERB:FORM	0	1	0	0.00	100.00	0.00
R:ADJ	3	3	2	50.00	60.00	51.72
R:ADV	0	1	1	0.00	0.00	0.00
R:DET	0	0	2	100.00	0.00	0.00
R:MORPH	3	8	4	27.27	42.86	29.41
R:NOUN	5	3	5	62.50	50.00	59.52
R:NOUN:INFL	8	0	3	100.00	72.73	93.02
R:NOUN:NUM	11	13	9	45.83	55.00	47.41
R:NOUN:POSS	2	0	9	100.00	18.18	52.63
R:ORTH	35	5	31	87.50	53.03	77.43
R:OTHER	16	12	35	57.14	31.37	49.08
R:PREP	4	8	12	33.33	25.00	31.25
R:PRON	1	0	2	100.00	33.33	71.43
R:PUNCT	3	5	14	37.50	17.65	30.61
R:SPELL	74	1	21	98.67	77.89	93.67
R:VERB	3	2	6	60.00	33.33	51.72
R:VERB:FORM	3	3	3	50.00	50.00	50.00
R:VERB:INFL	2	0	3	100.00	40.00	76.92
R:VERB:SVA	3	4	6	42.86	33.33	40.54
R:VERB:TENSE	0	2	4	0.00	0.00	0.00
R:WO	1	1	1	50.00	50.00	50.00
U:ADV	0	5	0	0.00	100.00	0.00
U:DET	2	4	5	33.33	28.57	32.26
U:NOUN	0	1	0	0.00	100.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	0	0	1	100.00	0.00	0.00
U:PART	1	1	0	50.00	100.00	55.56
U:PREP	2	3	1	40.00	66.67	43.48
U:PUNCT	5	0	10	100.00	33.33	71.43
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	0	6	2	0.00	0.00	0.00
UNK	0	0	3	100.00	0.00	0.00

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	24	21	56	53.33	30.00	46.15
R	203	64	190	76.03	51.65	69.47
U	12	18	27	40.00	30.77	37.74
UNK	2	0	1	100.00	66.67	90.91

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	3	5	50.00	37.50	46.88
ADJ:FORM	1	0	0	100.00	100.00	100.00
ADV	0	5	1	0.00	0.00	0.00
CONJ	1	0	0	100.00	100.00	100.00
CONTR	0	0	3	100.00	0.00	0.00
DET	7	15	10	31.82	41.18	33.33
MORPH	3	8	4	27.27	42.86	29.41
NOUN	7	5	9	58.33	43.75	54.69
NOUN:INFL	8	0	3	100.00	72.73	93.02
NOUN:NUM	13	12	8	52.00	61.90	53.72
NOUN:POSS	3	1	17	75.00	15.00	41.67
ORTH	44	6	41	88.00	51.76	77.19
OTHER	28	12	38	70.00	42.42	61.95
PART	1	1	0	50.00	100.00	55.56
PREP	7	12	14	36.84	33.33	36.08
PRON	2	0	4	100.00	33.33	71.43
PUNCT	24	2	64	92.31	27.27	62.50
SPELL	73	1	23	98.65	76.04	93.11
UNK	2	0	1	100.00	66.67	90.91
VERB	4	4	10	50.00	28.57	43.48
VERB:FORM	3	3	3	50.00	50.00	50.00
VERB:INFL	2	0	3	100.00	40.00	76.92
VERB:SVA	3	4	6	42.86	33.33	40.54
VERB:TENSE	0	7	7	0.00	0.00	0.00
WO	2	2	0	50.00	100.00	55.56

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	1	0	0	100.00	100.00	100.00
M:DET	5	11	1	31.25	83.33	35.71
M:NOUN	2	1	4	66.67	33.33	55.56
M:NOUN:POSS	1	1	5	50.00	16.67	35.71
M:OTHER	0	1	0	0.00	100.00	0.00
M:PREP	1	3	1	25.00	50.00	27.78
M:PRON	1	0	2	100.00	33.33	71.43
M:PUNCT	12	1	40	92.31	23.08	57.69
M:VERB	1	2	3	33.33	25.00	31.25
M:VERB:FORM	0	1	0	0.00	100.00	0.00
R:ADJ	3	3	2	50.00	60.00	51.72
R:ADJ:FORM	1	0	0	100.00	100.00	100.00
R:ADV	0	1	1	0.00	0.00	0.00
R:CONTR	0	0	3	100.00	0.00	0.00
R:DET	0	0	3	100.00	0.00	0.00
R:MORPH	3	8	4	27.27	42.86	29.41
R:NOUN	5	3	5	62.50	50.00	59.52
R:NOUN:INFL	8	0	3	100.00	72.73	93.02
R:NOUN:NUM	13	12	8	52.00	61.90	53.72
R:NOUN:POSS	2	0	11	100.00	15.38	47.62
R:ORTH	44	6	41	88.00	51.76	77.19
R:OTHER	27	11	37	71.05	42.19	62.50
R:PREP	4	6	11	40.00	26.67	36.36
R:PRON	1	0	2	100.00	33.33	71.43
R:PUNCT	6	1	14	85.71	30.00	62.50
R:SPELL	73	1	23	98.65	76.04	93.11
R:VERB	3	2	5	60.00	37.50	53.57
R:VERB:FORM	3	2	3	60.00	50.00	57.69
R:VERB:INFL	2	0	3	100.00	40.00	76.92
R:VERB:SVA	3	4	6	42.86	33.33	40.54
R:VERB:TENSE	0	2	5	0.00	0.00	0.00
R:WO	2	2	0	50.00	100.00	55.56
U:ADJ	0	0	3	100.00	0.00	0.00
U:ADV	0	4	0	0.00	100.00	0.00
U:DET	2	4	6	33.33	25.00	31.25
U:NOUN	0	1	0	0.00	100.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	1	0	1	100.00	50.00	83.33
U:PART	1	1	0	50.00	100.00	55.56
U:PREP	2	3	2	40.00	50.00	41.67
U:PUNCT	6	0	10	100.00	37.50	75.00
U:VERB	0	0	2	100.00	0.00	0.00
U:VERB:TENSE	0	5	2	0.00	0.00	0.00
UNK	2	0	1	100.00	66.67	90.91

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:44:13+00:00
Competition submission:	16
Competition phase:	3 - Open phase

Detailed results

Submission information

Results