BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1401	1265	2955	52.55	32.16	46.64
Span-level detection	1799	871	2843	67.38	38.75	58.71
Token-level detection	2338	690	3326	77.21	41.28	65.76

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	343	172	625	66.60	35.43	56.64
R	889	911	2059	49.39	30.16	43.80
U	169	182	271	48.15	38.41	45.82

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	10	16	25	38.46	28.57	35.97
ADJ:FORM	3	1	5	75.00	37.50	62.50
ADV	16	30	34	34.78	32.00	34.19
CONJ	4	10	19	28.57	17.39	25.32
CONTR	7	1	4	87.50	63.64	81.40
DET	210	97	318	68.40	39.77	59.79
MORPH	47	19	91	71.21	34.06	58.46
NOUN	19	136	92	12.26	17.12	13.00
NOUN:INFL	6	2	12	75.00	33.33	60.00
NOUN:NUM	96	35	134	73.28	41.74	63.66
NOUN:POSS	9	7	38	56.25	19.15	40.54
ORTH	134	18	216	88.16	38.29	69.94
OTHER	85	466	597	15.43	12.46	14.73
PART	13	7	9	65.00	59.09	63.73
PREP	124	92	253	57.41	32.89	49.96
PRON	39	24	80	61.90	32.77	52.56
PUNCT	178	61	314	74.48	36.18	61.46
SPELL	105	37	202	73.94	34.20	60.00
VERB	36	85	141	29.75	20.34	27.23
VERB:FORM	98	33	79	74.81	55.37	69.90
VERB:INFL	4	0	5	100.00	44.44	80.00
VERB:SVA	81	26	58	75.70	58.27	71.43
VERB:TENSE	60	52	168	53.57	26.32	44.38
WO	17	10	61	62.96	21.79	45.70

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	3	4	25.00	20.00	23.81
M:ADV	5	4	9	55.56	35.71	50.00
M:CONJ	3	7	12	30.00	20.00	27.27
M:CONTR	1	1	0	50.00	100.00	55.56
M:DET	114	51	142	69.09	44.53	62.23
M:NOUN	1	7	7	12.50	12.50	12.50
M:NOUN:POSS	2	0	10	100.00	16.67	50.00
M:OTHER	1	9	44	10.00	2.22	5.88
M:PART	1	2	1	33.33	50.00	35.71
M:PREP	26	17	62	60.47	29.55	50.00
M:PRON	19	8	44	70.37	30.16	55.56
M:PUNCT	140	39	234	78.21	37.43	64.22
M:VERB	9	16	24	36.00	27.27	33.83
M:VERB:FORM	10	2	4	83.33	71.43	80.65
M:VERB:TENSE	10	6	28	62.50	26.32	49.02
R:ADJ	5	7	18	41.67	21.74	35.21
R:ADJ:FORM	3	1	5	75.00	37.50	62.50
R:ADV	6	9	14	40.00	30.00	37.50
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	3	0	1	100.00	75.00	93.75
R:DET	25	18	75	58.14	25.00	45.96
R:MORPH	47	19	91	71.21	34.06	58.46
R:NOUN	15	98	74	13.27	16.85	13.86
R:NOUN:INFL	6	2	12	75.00	33.33	60.00
R:NOUN:NUM	96	35	134	73.28	41.74	63.66
R:NOUN:POSS	1	5	23	16.67	4.17	10.42
R:ORTH	134	18	216	88.16	38.29	69.94
R:OTHER	78	430	536	15.35	12.70	14.74
R:PART	8	5	5	61.54	61.54	61.54
R:PREP	69	54	148	56.10	31.80	48.66
R:PRON	12	11	25	52.17	32.43	46.51
R:PUNCT	28	18	48	60.87	36.84	53.85
R:SPELL	105	37	202	73.94	34.20	60.00
R:VERB	22	42	103	34.38	17.60	28.87
R:VERB:FORM	83	28	73	74.77	53.21	69.17
R:VERB:INFL	4	0	5	100.00	44.44	80.00
R:VERB:SVA	81	26	58	75.70	58.27	71.43
R:VERB:TENSE	41	38	129	51.90	24.12	42.18
R:WO	17	10	61	62.96	21.79	45.70
U:ADJ	4	6	3	40.00	57.14	42.55
U:ADV	5	17	11	22.73	31.25	24.04
U:CONJ	1	3	4	25.00	20.00	23.81
U:CONTR	3	0	3	100.00	50.00	83.33
U:DET	71	28	101	71.72	41.28	62.50
U:NOUN	3	31	11	8.82	21.43	10.00
U:NOUN:POSS	6	2	5	75.00	54.55	69.77
U:OTHER	6	27	17	18.18	26.09	19.35
U:PART	4	0	3	100.00	57.14	86.96
U:PREP	29	21	43	58.00	40.28	53.31
U:PRON	8	5	11	61.54	42.11	56.34
U:PUNCT	10	4	32	71.43	23.81	51.02
U:VERB	5	27	14	15.62	26.32	17.01
U:VERB:FORM	5	3	2	62.50	71.43	64.10
U:VERB:TENSE	9	8	11	52.94	45.00	51.14

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	373	146	624	71.87	37.41	60.69
R	1197	576	1896	67.51	38.70	58.76
U	210	149	261	58.50	44.59	55.06
UNK	19	0	62	100.00	23.46	60.51

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	15	13	29	53.57	34.09	48.08
ADJ:FORM	2	0	6	100.00	25.00	62.50
ADV	24	25	31	48.98	43.64	47.81
CONJ	8	10	20	44.44	28.57	40.00
CONTR	5	1	5	83.33	50.00	73.53
DET	229	85	315	72.93	42.10	63.61
MORPH	64	11	80	85.33	44.44	72.07
NOUN	35	95	91	26.92	27.78	27.09
NOUN:INFL	6	1	13	85.71	31.58	63.83
NOUN:NUM	91	29	128	75.83	41.55	65.09
NOUN:POSS	15	4	34	78.95	30.61	60.00
ORTH	192	14	184	93.20	51.06	80.00
OTHER	215	291	549	42.49	28.14	38.56
PART	16	5	7	76.19	69.57	74.77
PREP	148	69	258	68.20	36.45	58.08
PRON	48	12	73	80.00	39.67	66.48
PUNCT	195	51	314	79.27	38.31	65.30
SPELL	128	14	174	90.14	42.38	73.56
UNK	19	0	62	100.00	23.46	60.51
VERB	71	51	137	58.20	34.13	51.01
VERB:FORM	102	17	69	85.71	59.65	78.83
VERB:INFL	5	0	4	100.00	55.56	86.21
VERB:SVA	85	22	54	79.44	61.15	74.96
VERB:TENSE	66	39	151	62.86	30.41	51.81
WO	15	12	55	55.56	21.43	42.13

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	3	6	25.00	14.29	21.74
M:ADV	5	3	8	62.50	38.46	55.56
M:CONJ	4	7	13	36.36	23.53	32.79
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	120	43	133	73.62	47.43	66.30
M:NOUN	3	6	7	33.33	30.00	32.61
M:NOUN:POSS	2	0	11	100.00	15.38	47.62
M:OTHER	10	7	42	58.82	19.23	41.67
M:PART	1	2	2	33.33	33.33	33.33
M:PREP	28	16	68	63.64	29.17	51.47
M:PRON	20	4	41	83.33	32.79	63.69
M:PUNCT	147	33	238	81.67	38.18	66.52
M:VERB	12	14	22	46.15	35.29	43.48
M:VERB:FORM	11	1	3	91.67	78.57	88.71
M:VERB:TENSE	9	6	30	60.00	23.08	45.45
R:ADJ	11	5	19	68.75	36.67	58.51
R:ADJ:FORM	2	0	6	100.00	25.00	62.50
R:ADV	10	7	14	58.82	41.67	54.35
R:CONJ	1	0	2	100.00	33.33	71.43
R:CONTR	2	0	1	100.00	66.67	90.91
R:DET	31	15	78	67.39	28.44	52.90
R:MORPH	64	11	80	85.33	44.44	72.07
R:NOUN	26	69	73	27.37	26.26	27.14
R:NOUN:INFL	6	1	13	85.71	31.58	63.83
R:NOUN:NUM	91	29	128	75.83	41.55	65.09
R:NOUN:POSS	6	2	18	75.00	25.00	53.57
R:ORTH	192	14	184	93.20	51.06	80.00
R:OTHER	197	258	489	43.30	28.72	39.31
R:PART	11	3	3	78.57	78.57	78.57
R:PREP	86	36	155	70.49	35.68	58.98
R:PRON	16	3	23	84.21	41.03	69.57
R:PUNCT	30	15	48	66.67	38.46	58.14
R:SPELL	128	14	174	90.14	42.38	73.56
R:VERB	49	19	100	72.06	32.89	58.19
R:VERB:FORM	86	13	64	86.87	57.33	78.75
R:VERB:INFL	5	0	4	100.00	55.56	86.21
R:VERB:SVA	85	22	54	79.44	61.15	74.96
R:VERB:TENSE	47	28	111	62.67	29.75	51.31
R:WO	15	12	55	55.56	21.43	42.13
U:ADJ	3	5	4	37.50	42.86	38.46
U:ADV	9	15	9	37.50	50.00	39.47
U:CONJ	3	3	5	50.00	37.50	46.88
U:CONTR	3	0	4	100.00	42.86	78.95
U:DET	78	27	104	74.29	42.86	64.78
U:NOUN	6	20	11	23.08	35.29	24.79
U:NOUN:POSS	7	2	5	77.78	58.33	72.92
U:OTHER	8	26	18	23.53	30.77	24.69
U:PART	4	0	2	100.00	66.67	90.91
U:PREP	34	17	35	66.67	49.28	62.27
U:PRON	12	5	9	70.59	57.14	67.42
U:PUNCT	18	3	28	85.71	39.13	69.23
U:VERB	10	18	15	35.71	40.00	36.50
U:VERB:FORM	5	3	2	62.50	71.43	64.10
U:VERB:TENSE	10	5	10	66.67	50.00	62.50
UNK	19	0	62	100.00	23.46	60.51

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	530	82	652	86.60	44.84	73.00
R	1517	439	2219	77.56	40.60	65.61
U	257	169	376	60.33	40.60	54.99
UNK	34	0	79	100.00	30.09	68.27

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	15	9	35	62.50	30.00	51.37
ADJ:FORM	4	0	9	100.00	30.77	68.97
ADV	31	15	51	67.39	37.80	58.27
CONJ	10	5	18	66.67	35.71	56.82
CONTR	5	1	9	83.33	35.71	65.79
DET	258	57	340	81.90	43.14	69.43
MORPH	66	6	83	91.67	44.30	75.51
NOUN	47	70	102	40.17	31.54	38.09
NOUN:INFL	6	1	12	85.71	33.33	65.22
NOUN:NUM	102	22	132	82.26	43.59	69.86
NOUN:POSS	17	2	43	89.47	28.33	62.50
ORTH	229	8	201	96.62	53.26	83.09
OTHER	418	284	742	59.54	36.03	52.67
PART	13	2	7	86.67	65.00	81.25
PREP	167	57	276	74.55	37.70	62.36
PRON	63	8	72	88.73	46.67	75.18
PUNCT	288	30	323	90.57	47.14	76.47
SPELL	131	9	173	93.57	43.09	75.81
UNK	34	0	79	100.00	30.09	68.27
VERB	87	36	198	70.73	30.53	55.98
VERB:FORM	100	10	76	90.91	56.82	81.17
VERB:INFL	6	0	3	100.00	66.67	90.91
VERB:SVA	89	14	52	86.41	63.12	80.47
VERB:TENSE	85	36	193	70.25	30.58	55.77
WO	67	8	97	89.33	40.85	72.20

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	2	4	33.33	20.00	29.41
M:ADV	9	1	14	90.00	39.13	71.43
M:CONJ	8	3	13	72.73	38.10	61.54
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	137	21	139	86.71	49.64	75.44
M:NOUN	9	4	13	69.23	40.91	60.81
M:NOUN:POSS	3	0	12	100.00	20.00	55.56
M:OTHER	16	5	50	76.19	24.24	53.33
M:PART	1	1	2	50.00	33.33	45.45
M:PREP	46	9	67	83.64	40.71	69.07
M:PRON	33	0	39	100.00	45.83	80.88
M:PUNCT	226	23	236	90.76	48.92	77.50
M:VERB	15	8	31	65.22	32.61	54.35
M:VERB:FORM	9	0	4	100.00	69.23	91.84
M:VERB:TENSE	17	4	28	80.95	37.78	65.89
R:ADJ	10	5	22	66.67	31.25	54.35
R:ADJ:FORM	4	0	9	100.00	30.77	68.97
R:ADV	10	6	20	62.50	33.33	53.19
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	2	0	5	100.00	28.57	66.67
R:DET	34	13	77	72.34	30.63	56.86
R:MORPH	66	6	83	91.67	44.30	75.51
R:NOUN	33	53	77	38.37	30.00	36.34
R:NOUN:INFL	6	1	12	85.71	33.33	65.22
R:NOUN:NUM	102	22	132	82.26	43.59	69.86
R:NOUN:POSS	7	1	23	87.50	23.33	56.45
R:ORTH	229	8	201	96.62	53.26	83.09
R:OTHER	366	198	619	64.89	37.16	56.46
R:PART	8	1	3	88.89	72.73	85.11
R:PREP	84	33	170	71.79	33.07	58.17
R:PRON	18	3	23	85.71	43.90	72.00
R:PUNCT	39	6	56	86.67	41.05	70.91
R:SPELL	131	9	173	93.57	43.09	75.81
R:VERB	61	17	139	78.21	30.50	59.57
R:VERB:FORM	86	8	70	91.49	55.13	80.83
R:VERB:INFL	6	0	3	100.00	66.67	90.91
R:VERB:SVA	89	14	52	86.41	63.12	80.47
R:VERB:TENSE	59	27	150	68.60	28.23	53.35
R:WO	67	8	97	89.33	40.85	72.20
U:ADJ	4	2	9	66.67	30.77	54.05
U:ADV	12	8	17	60.00	41.38	55.05
U:CONJ	2	2	2	50.00	50.00	50.00
U:CONTR	3	0	4	100.00	42.86	78.95
U:DET	87	23	124	79.09	41.23	66.82
U:NOUN	5	13	12	27.78	29.41	28.09
U:NOUN:POSS	7	1	8	87.50	46.67	74.47
U:OTHER	36	81	73	30.77	33.03	31.20
U:PART	4	0	2	100.00	66.67	90.91
U:PREP	37	15	39	71.15	48.68	65.14
U:PRON	12	5	10	70.59	54.55	66.67
U:PUNCT	23	1	31	95.83	42.59	76.67
U:VERB	11	11	28	50.00	28.21	43.31
U:VERB:FORM	5	2	2	71.43	71.43	71.43
U:VERB:TENSE	9	5	15	64.29	37.50	56.25
UNK	34	0	79	100.00	30.09	68.27

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	688	443	1340	60.83	33.93	52.50
Span-level detection	883	249	1263	78.00	41.15	66.15
Token-level detection	1157	146	1426	88.80	44.79	74.21

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	141	68	282	67.46	33.33	56.00
R	465	317	937	59.46	33.17	51.32
U	82	58	121	58.57	40.39	53.74

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	4	4	7	50.00	36.36	46.51
ADJ:FORM	2	0	2	100.00	50.00	83.33
ADV	6	7	18	46.15	25.00	39.47
CONJ	1	2	9	33.33	10.00	22.73
CONTR	4	1	1	80.00	80.00	80.00
DET	101	31	136	76.52	42.62	66.01
MORPH	25	3	52	89.29	32.47	66.14
NOUN	8	38	42	17.39	16.00	17.09
NOUN:INFL	5	0	1	100.00	83.33	96.15
NOUN:NUM	50	11	68	81.97	42.37	69.06
NOUN:POSS	4	1	9	80.00	30.77	60.61
ORTH	84	11	108	88.42	43.75	73.43
OTHER	40	178	315	18.35	11.27	16.30
PART	9	3	1	75.00	90.00	77.59
PREP	55	26	107	67.90	33.95	56.58
PRON	21	11	46	65.62	31.34	53.85
PUNCT	65	23	131	73.86	33.16	59.31
SPELL	49	16	60	75.38	44.95	66.40
VERB	22	24	62	47.83	26.19	41.04
VERB:FORM	54	14	34	79.41	61.36	75.00
VERB:INFL	2	0	2	100.00	50.00	83.33
VERB:SVA	43	11	30	79.63	58.90	74.39
VERB:TENSE	28	25	81	52.83	25.69	43.61
WO	6	3	18	66.67	25.00	50.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	1	50.00	50.00	50.00
M:ADV	1	2	5	33.33	16.67	27.78
M:CONJ	0	2	5	0.00	0.00	0.00
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	49	16	57	75.38	46.23	66.94
M:NOUN	0	4	1	0.00	0.00	0.00
M:NOUN:POSS	0	0	3	100.00	0.00	0.00
M:OTHER	1	5	24	16.67	4.00	10.20
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	14	7	28	66.67	33.33	55.56
M:PRON	8	5	26	61.54	23.53	46.51
M:PUNCT	50	17	100	74.63	33.33	59.81
M:VERB	5	3	13	62.50	27.78	50.00
M:VERB:FORM	7	2	4	77.78	63.64	74.47
M:VERB:TENSE	5	2	15	71.43	25.00	52.08
R:ADJ	1	1	4	50.00	20.00	38.46
R:ADJ:FORM	2	0	2	100.00	50.00	83.33
R:ADV	3	1	7	75.00	30.00	57.69
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	2	0	0	100.00	100.00	100.00
R:DET	14	8	29	63.64	32.56	53.44
R:MORPH	25	3	52	89.29	32.47	66.14
R:NOUN	7	21	34	25.00	17.07	22.88
R:NOUN:INFL	5	0	1	100.00	83.33	96.15
R:NOUN:NUM	50	11	68	81.97	42.37	69.06
R:NOUN:POSS	0	1	6	0.00	0.00	0.00
R:ORTH	84	11	108	88.42	43.75	73.43
R:OTHER	37	162	284	18.59	11.53	16.56
R:PART	7	2	0	77.78	100.00	81.40
R:PREP	27	13	62	67.50	30.34	54.22
R:PRON	8	5	14	61.54	36.36	54.05
R:PUNCT	12	6	18	66.67	40.00	58.82
R:SPELL	49	16	60	75.38	44.95	66.40
R:VERB	14	11	44	56.00	24.14	44.30
R:VERB:FORM	46	12	30	79.31	60.53	74.68
R:VERB:INFL	2	0	2	100.00	50.00	83.33
R:VERB:SVA	43	11	30	79.63	58.90	74.39
R:VERB:TENSE	21	19	63	52.50	25.00	43.03
R:WO	6	3	18	66.67	25.00	50.00
U:ADJ	2	2	2	50.00	50.00	50.00
U:ADV	2	4	6	33.33	25.00	31.25
U:CONJ	1	0	3	100.00	25.00	62.50
U:CONTR	2	0	1	100.00	66.67	90.91
U:DET	38	7	50	84.44	43.18	70.90
U:NOUN	1	13	7	7.14	12.50	7.81
U:NOUN:POSS	4	0	0	100.00	100.00	100.00
U:OTHER	2	11	7	15.38	22.22	16.39
U:PART	2	0	1	100.00	66.67	90.91
U:PREP	14	6	17	70.00	45.16	63.06
U:PRON	5	1	6	83.33	45.45	71.43
U:PUNCT	3	0	13	100.00	18.75	53.57
U:VERB	3	10	5	23.08	37.50	25.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	2	4	3	33.33	40.00	34.48

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	154	57	265	72.99	36.75	60.97
R	617	150	839	80.44	42.38	68.19
U	100	42	114	70.42	46.73	63.94
UNK	12	0	45	100.00	21.05	57.14

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	2	10	71.43	33.33	58.14
ADJ:FORM	1	0	3	100.00	25.00	62.50
ADV	9	4	15	69.23	37.50	59.21
CONJ	5	2	7	71.43	41.67	62.50
CONTR	3	1	2	75.00	60.00	71.43
DET	108	31	126	77.70	46.15	68.35
MORPH	36	2	47	94.74	43.37	76.60
NOUN	8	23	43	25.81	15.69	22.86
NOUN:INFL	5	0	1	100.00	83.33	96.15
NOUN:NUM	44	8	65	84.62	40.37	69.40
NOUN:POSS	8	0	6	100.00	57.14	86.96
ORTH	119	9	76	92.97	61.03	84.16
OTHER	113	85	285	57.07	28.39	47.48
PART	10	2	2	83.33	83.33	83.33
PREP	69	11	107	86.25	39.20	69.56
PRON	24	5	42	82.76	36.36	65.93
PUNCT	73	18	126	80.22	36.68	64.83
SPELL	57	7	49	89.06	53.77	78.73
UNK	12	0	45	100.00	21.05	57.14
VERB	38	8	60	82.61	38.78	67.38
VERB:FORM	54	5	29	91.53	65.06	84.64
VERB:INFL	2	0	2	100.00	50.00	83.33
VERB:SVA	43	7	27	86.00	61.43	79.63
VERB:TENSE	32	15	72	68.09	30.77	54.79
WO	5	4	16	55.56	23.81	43.86

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	1	1	50.00	50.00	50.00
M:ADV	2	1	3	66.67	40.00	58.82
M:CONJ	2	2	4	50.00	33.33	45.45
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	50	16	49	75.76	50.51	68.87
M:NOUN	0	4	0	0.00	100.00	0.00
M:NOUN:POSS	0	0	3	100.00	0.00	0.00
M:OTHER	4	4	25	50.00	13.79	32.79
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	14	6	29	70.00	32.56	56.91
M:PRON	8	2	24	80.00	25.00	55.56
M:PUNCT	54	14	96	79.41	36.00	63.98
M:VERB	7	1	11	87.50	38.89	70.00
M:VERB:FORM	8	1	3	88.89	72.73	85.11
M:VERB:TENSE	4	3	17	57.14	19.05	40.82
R:ADJ	3	0	6	100.00	33.33	71.43
R:ADJ:FORM	1	0	3	100.00	25.00	62.50
R:ADV	5	0	8	100.00	38.46	75.76
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	17	7	28	70.83	37.78	60.28
R:MORPH	36	2	47	94.74	43.37	76.60
R:NOUN	6	10	36	37.50	14.29	28.30
R:NOUN:INFL	5	0	1	100.00	83.33	96.15
R:NOUN:NUM	44	8	65	84.62	40.37	69.40
R:NOUN:POSS	3	0	3	100.00	50.00	83.33
R:ORTH	119	9	76	92.97	61.03	84.16
R:OTHER	106	70	252	60.23	29.61	49.91
R:PART	8	1	1	88.89	88.89	88.89
R:PREP	38	3	66	92.68	36.54	70.90
R:PRON	9	2	13	81.82	40.91	68.18
R:PUNCT	13	4	18	76.47	41.94	65.66
R:SPELL	57	7	49	89.06	53.77	78.73
R:VERB	26	2	43	92.86	37.68	71.82
R:VERB:FORM	45	4	26	91.84	63.38	84.27
R:VERB:INFL	2	0	2	100.00	50.00	83.33
R:VERB:SVA	43	7	27	86.00	61.43	79.63
R:VERB:TENSE	25	10	53	71.43	32.05	57.34
R:WO	5	4	16	55.56	23.81	43.86
U:ADJ	1	1	3	50.00	25.00	41.67
U:ADV	2	3	4	40.00	33.33	38.46
U:CONJ	3	0	3	100.00	50.00	83.33
U:CONTR	2	0	2	100.00	50.00	83.33
U:DET	41	8	49	83.67	45.56	71.68
U:NOUN	2	9	7	18.18	22.22	18.87
U:NOUN:POSS	5	0	0	100.00	100.00	100.00
U:OTHER	3	11	8	21.43	27.27	22.39
U:PART	2	0	1	100.00	66.67	90.91
U:PREP	17	2	12	89.47	58.62	80.95
U:PRON	7	1	5	87.50	58.33	79.55
U:PUNCT	6	0	12	100.00	33.33	71.43
U:VERB	5	5	6	50.00	45.45	49.02
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	3	2	2	60.00	60.00	60.00
UNK	12	0	45	100.00	21.05	57.14

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	226	21	273	91.50	45.29	75.99
R	773	85	942	90.09	45.07	75.09
U	134	40	149	77.01	47.35	68.44
UNK	24	0	62	100.00	27.91	65.93

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	8	0	11	100.00	42.11	78.43
ADJ:FORM	2	0	4	100.00	33.33	71.43
ADV	13	2	26	86.67	33.33	65.66
CONJ	5	0	6	100.00	45.45	80.65
CONTR	3	1	1	75.00	75.00	75.00
DET	123	14	143	89.78	46.24	75.55
MORPH	35	0	48	100.00	42.17	78.48
NOUN	15	10	48	60.00	23.81	46.01
NOUN:INFL	5	0	1	100.00	83.33	96.15
NOUN:NUM	55	4	64	93.22	46.22	77.46
NOUN:POSS	8	0	11	100.00	42.11	78.43
ORTH	130	5	75	96.30	63.41	87.25
OTHER	221	70	354	75.95	38.43	63.54
PART	8	0	2	100.00	80.00	95.24
PREP	84	6	109	93.33	43.52	75.95
PRON	34	3	36	91.89	48.57	77.98
PUNCT	111	7	128	94.07	46.44	78.06
SPELL	57	3	50	95.00	53.27	82.13
UNK	24	0	62	100.00	27.91	65.93
VERB	49	4	86	92.45	36.30	70.61
VERB:FORM	53	2	31	96.36	63.10	87.17
VERB:INFL	3	0	1	100.00	75.00	93.75
VERB:SVA	45	3	25	93.75	64.29	85.88
VERB:TENSE	45	11	86	80.36	34.35	63.38
WO	21	1	18	95.45	53.85	82.68

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	1	100.00	50.00	83.33
M:ADV	4	0	7	100.00	36.36	74.07
M:CONJ	3	0	5	100.00	37.50	75.00
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	58	4	55	93.55	51.33	80.33
M:NOUN	1	2	2	33.33	33.33	33.33
M:NOUN:POSS	0	0	4	100.00	0.00	0.00
M:OTHER	9	3	27	75.00	25.00	53.57
M:PREP	26	2	27	92.86	49.06	78.79
M:PRON	15	0	22	100.00	40.54	77.32
M:PUNCT	86	7	92	92.47	48.31	78.18
M:VERB	8	1	14	88.89	36.36	68.97
M:VERB:FORM	6	0	4	100.00	60.00	88.24
M:VERB:TENSE	9	1	13	90.00	40.91	72.58
R:ADJ	4	0	8	100.00	33.33	71.43
R:ADJ:FORM	2	0	4	100.00	33.33	71.43
R:ADV	4	0	11	100.00	26.67	64.52
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	17	5	26	77.27	39.53	64.89
R:MORPH	35	0	48	100.00	42.17	78.48
R:NOUN	12	5	39	70.59	23.53	50.42
R:NOUN:INFL	5	0	1	100.00	83.33	96.15
R:NOUN:NUM	55	4	64	93.22	46.22	77.46
R:NOUN:POSS	3	0	6	100.00	33.33	71.43
R:ORTH	130	5	75	96.30	63.41	87.25
R:OTHER	195	42	306	82.28	38.92	67.29
R:PART	6	0	1	100.00	85.71	96.77
R:PREP	37	3	69	92.50	34.91	69.55
R:PRON	11	2	10	84.62	52.38	75.34
R:PUNCT	17	0	23	100.00	42.50	78.70
R:SPELL	57	3	50	95.00	53.27	82.13
R:VERB	34	2	61	94.44	35.79	71.13
R:VERB:FORM	46	2	27	95.83	63.01	86.79
R:VERB:INFL	3	0	1	100.00	75.00	93.75
R:VERB:SVA	45	3	25	93.75	64.29	85.88
R:VERB:TENSE	33	8	69	80.49	32.35	62.03
R:WO	21	1	18	95.45	53.85	82.68
U:ADJ	3	0	2	100.00	60.00	88.24
U:ADV	5	2	8	71.43	38.46	60.98
U:CONJ	2	0	1	100.00	66.67	90.91
U:CONTR	2	0	1	100.00	66.67	90.91
U:DET	48	5	62	90.57	43.64	74.53
U:NOUN	2	3	7	40.00	22.22	34.48
U:NOUN:POSS	5	0	1	100.00	83.33	96.15
U:OTHER	17	25	21	40.48	44.74	41.26
U:PART	2	0	1	100.00	66.67	90.91
U:PREP	21	1	13	95.45	61.76	86.07
U:PRON	8	1	4	88.89	66.67	83.33
U:PUNCT	8	0	13	100.00	38.10	75.47
U:VERB	7	1	11	87.50	38.89	70.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	3	2	4	60.00	42.86	55.56
UNK	24	0	62	100.00	27.91	65.93

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	418	345	962	54.78	30.29	47.16
Span-level detection	527	238	938	68.89	35.97	58.23
Token-level detection	696	209	1158	76.91	37.54	63.57

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	124	58	210	68.13	37.13	58.38
R	243	224	657	52.03	27.00	43.89
U	51	63	95	44.74	34.93	42.36

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	7	10	30.00	23.08	28.30
ADJ:FORM	1	1	1	50.00	50.00	50.00
ADV	5	13	12	27.78	29.41	28.09
CONJ	3	4	7	42.86	30.00	39.47
CONTR	2	0	1	100.00	66.67	90.91
DET	66	35	122	65.35	35.11	55.74
MORPH	13	8	22	61.90	37.14	54.62
NOUN	8	42	30	16.00	21.05	16.81
NOUN:NUM	28	10	39	73.68	41.79	63.93
NOUN:POSS	4	4	9	50.00	30.77	44.44
ORTH	24	4	45	85.71	34.78	66.30
OTHER	19	100	197	15.97	8.80	13.73
PART	3	2	5	60.00	37.50	53.57
PREP	41	25	96	62.12	29.93	51.12
PRON	11	7	24	61.11	31.43	51.40
PUNCT	58	17	100	77.33	36.71	63.32
SPELL	31	9	41	77.50	43.06	66.81
VERB	10	29	59	25.64	14.49	22.22
VERB:FORM	30	7	35	81.08	46.15	70.42
VERB:SVA	31	4	17	88.57	64.58	82.45
VERB:TENSE	20	14	60	58.82	25.00	46.30
WO	7	3	30	70.00	18.92	45.45

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	2	0.00	0.00	0.00
M:ADV	3	1	3	75.00	50.00	68.18
M:CONJ	3	2	5	60.00	37.50	53.57
M:CONTR	1	0	0	100.00	100.00	100.00
M:DET	44	20	57	68.75	43.56	61.62
M:NOUN	1	2	3	33.33	25.00	31.25
M:NOUN:POSS	2	0	2	100.00	50.00	83.33
M:OTHER	0	3	14	0.00	0.00	0.00
M:PART	1	1	1	50.00	50.00	50.00
M:PREP	7	5	19	58.33	26.92	47.30
M:PRON	8	3	13	72.73	38.10	61.54
M:PUNCT	45	8	73	84.91	38.14	68.18
M:VERB	3	8	7	27.27	30.00	27.78
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	5	3	11	62.50	31.25	52.08
R:ADJ	1	2	8	33.33	11.11	23.81
R:ADJ:FORM	1	1	1	50.00	50.00	50.00
R:ADV	2	6	6	25.00	25.00	25.00
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	5	4	36	55.56	12.20	32.47
R:MORPH	13	8	22	61.90	37.14	54.62
R:NOUN	5	31	23	13.89	17.86	14.53
R:NOUN:NUM	28	10	39	73.68	41.79	63.93
R:NOUN:POSS	1	3	2	25.00	33.33	26.32
R:ORTH	24	4	45	85.71	34.78	66.30
R:OTHER	15	86	175	14.85	7.89	12.63
R:PART	1	1	3	50.00	25.00	41.67
R:PREP	24	15	57	61.54	29.63	50.63
R:PRON	1	4	7	20.00	12.50	17.86
R:PUNCT	10	6	18	62.50	35.71	54.35
R:SPELL	31	9	41	77.50	43.06	66.81
R:VERB	5	12	47	29.41	9.62	20.83
R:VERB:FORM	26	6	33	81.25	44.07	69.52
R:VERB:SVA	31	4	17	88.57	64.58	82.45
R:VERB:TENSE	11	9	45	55.00	19.64	40.44
R:WO	7	3	30	70.00	18.92	45.45
U:ADJ	2	3	0	40.00	100.00	45.45
U:ADV	0	6	3	0.00	0.00	0.00
U:CONJ	0	2	0	0.00	100.00	0.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	17	11	29	60.71	36.96	53.80
U:NOUN	2	9	4	18.18	33.33	20.00
U:NOUN:POSS	1	1	5	50.00	16.67	35.71
U:OTHER	4	11	8	26.67	33.33	27.78
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	10	5	20	66.67	33.33	55.56
U:PRON	2	0	4	100.00	33.33	71.43
U:PUNCT	3	3	9	50.00	25.00	41.67
U:VERB	2	9	5	18.18	28.57	19.61
U:VERB:FORM	3	1	2	75.00	60.00	71.43
U:VERB:TENSE	4	2	4	66.67	50.00	62.50

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	137	46	212	74.86	39.26	63.37
R	323	137	620	70.22	34.25	58.03
U	63	55	94	53.39	40.13	50.08
UNK	4	0	12	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	7	11	46.15	35.29	43.48
ADJ:FORM	1	0	1	100.00	50.00	83.33
ADV	9	12	12	42.86	42.86	42.86
CONJ	2	4	9	33.33	18.18	28.57
CONTR	1	0	1	100.00	50.00	83.33
DET	72	28	126	72.00	36.36	60.20
MORPH	16	2	18	88.89	47.06	75.47
NOUN	21	24	24	46.67	46.67	46.67
NOUN:NUM	29	7	37	80.56	43.94	69.05
NOUN:POSS	4	2	10	66.67	28.57	52.63
ORTH	40	3	46	93.02	46.51	77.52
OTHER	51	68	188	42.86	21.34	35.66
PART	4	1	3	80.00	57.14	74.07
PREP	44	20	98	68.75	30.99	55.28
PRON	16	2	22	88.89	42.11	72.73
PUNCT	62	14	101	81.58	38.04	66.38
SPELL	33	2	34	94.29	49.25	79.71
UNK	4	0	12	100.00	25.00	62.50
VERB	23	19	56	54.76	29.11	46.56
VERB:FORM	32	2	30	94.12	51.61	80.81
VERB:SVA	31	5	17	86.11	64.58	80.73
VERB:TENSE	20	12	54	62.50	27.03	49.50
WO	6	4	28	60.00	17.65	40.54

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	4	0.00	0.00	0.00
M:ADV	3	1	4	75.00	42.86	65.22
M:CONJ	2	2	6	50.00	25.00	41.67
M:DET	48	14	56	77.42	46.15	68.18
M:NOUN	2	1	2	66.67	50.00	62.50
M:NOUN:POSS	2	0	3	100.00	40.00	76.92
M:OTHER	5	2	10	71.43	33.33	58.14
M:PART	1	1	1	50.00	50.00	50.00
M:PREP	8	5	21	61.54	27.59	49.38
M:PRON	9	2	12	81.82	42.86	69.23
M:PUNCT	47	6	76	88.68	38.21	70.15
M:VERB	4	8	7	33.33	36.36	33.90
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	5	2	10	71.43	33.33	58.14
R:ADJ	4	2	7	66.67	36.36	57.14
R:ADJ:FORM	1	0	1	100.00	50.00	83.33
R:ADV	2	5	5	28.57	28.57	28.57
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	7	3	40	70.00	14.89	40.23
R:MORPH	16	2	18	88.89	47.06	75.47
R:NOUN	15	19	18	44.12	45.45	44.38
R:NOUN:NUM	29	7	37	80.56	43.94	69.05
R:NOUN:POSS	1	1	2	50.00	33.33	45.45
R:ORTH	40	3	46	93.02	46.51	77.52
R:OTHER	41	56	170	42.27	19.43	34.22
R:PART	2	0	1	100.00	66.67	90.91
R:PREP	26	10	58	72.22	30.95	57.02
R:PRON	3	0	7	100.00	30.00	68.18
R:PUNCT	10	5	17	66.67	37.04	57.47
R:SPELL	33	2	34	94.29	49.25	79.71
R:VERB	15	4	44	78.95	25.42	55.56
R:VERB:FORM	29	1	28	96.67	50.88	81.92
R:VERB:SVA	31	5	17	86.11	64.58	80.73
R:VERB:TENSE	11	8	40	57.89	21.57	43.31
R:WO	6	4	28	60.00	17.65	40.54
U:ADJ	2	3	0	40.00	100.00	45.45
U:ADV	4	6	3	40.00	57.14	42.55
U:CONJ	0	2	1	0.00	0.00	0.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	17	11	30	60.71	36.17	53.46
U:NOUN	4	4	4	50.00	50.00	50.00
U:NOUN:POSS	1	1	5	50.00	16.67	35.71
U:OTHER	5	10	8	33.33	38.46	34.25
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	10	5	19	66.67	34.48	56.18
U:PRON	4	0	3	100.00	57.14	86.96
U:PUNCT	5	3	8	62.50	38.46	55.56
U:VERB	4	7	5	36.36	44.44	37.74
U:VERB:FORM	2	1	2	66.67	50.00	62.50
U:VERB:TENSE	4	2	4	66.67	50.00	62.50
UNK	4	0	12	100.00	25.00	62.50

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	179	25	219	87.75	44.97	73.72
R	437	104	768	80.78	36.27	64.86
U	73	80	158	47.71	31.60	43.30
UNK	7	0	13	100.00	35.00	72.92

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	5	10	50.00	33.33	45.45
ADJ:FORM	1	0	2	100.00	33.33	71.43
ADV	11	7	19	61.11	36.67	53.92
CONJ	3	2	8	60.00	27.27	48.39
CONTR	1	0	2	100.00	33.33	71.43
DET	82	21	130	79.61	38.68	65.71
MORPH	18	1	17	94.74	51.43	81.08
NOUN	22	18	29	55.00	43.14	52.13
NOUN:NUM	30	6	38	83.33	44.12	70.75
NOUN:POSS	6	0	11	100.00	35.29	73.17
ORTH	58	1	53	98.31	52.25	83.57
OTHER	114	94	273	54.81	29.46	46.76
PART	3	1	3	75.00	50.00	68.18
PREP	48	16	114	75.00	29.63	57.42
PRON	17	0	29	100.00	36.96	74.56
PUNCT	89	8	96	91.75	48.11	77.66
SPELL	33	2	34	94.29	49.25	79.71
UNK	7	0	13	100.00	35.00	72.92
VERB	26	8	85	76.47	23.42	52.63
VERB:FORM	30	2	34	93.75	46.88	78.12
VERB:SVA	33	3	17	91.67	66.00	85.05
VERB:TENSE	24	12	77	66.67	23.76	48.98
WO	35	2	64	94.59	35.35	70.85

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	1	0.00	0.00	0.00
M:ADV	5	1	5	83.33	50.00	73.53
M:CONJ	3	1	5	75.00	37.50	62.50
M:DET	53	7	56	88.33	48.62	75.93
M:NOUN	3	1	6	75.00	33.33	60.00
M:NOUN:POSS	3	0	3	100.00	50.00	83.33
M:OTHER	6	1	14	85.71	30.00	62.50
M:PART	1	1	1	50.00	50.00	50.00
M:PREP	12	3	22	80.00	35.29	63.83
M:PRON	11	0	14	100.00	44.00	79.71
M:PUNCT	69	4	69	94.52	50.00	80.23
M:VERB	5	2	11	71.43	31.25	56.82
M:VERB:FORM	1	0	0	100.00	100.00	100.00
M:VERB:TENSE	7	2	12	77.78	36.84	63.64
R:ADJ	4	2	8	66.67	33.33	55.56
R:ADJ:FORM	1	0	2	100.00	33.33	71.43
R:ADV	3	4	7	42.86	30.00	39.47
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	1	0	1	100.00	50.00	83.33
R:DET	10	3	40	76.92	20.00	49.02
R:MORPH	18	1	17	94.74	51.43	81.08
R:NOUN	16	14	19	53.33	45.71	51.61
R:NOUN:NUM	30	6	38	83.33	44.12	70.75
R:NOUN:POSS	2	0	2	100.00	50.00	83.33
R:ORTH	58	1	53	98.31	52.25	83.57
R:OTHER	90	43	214	67.67	29.61	53.83
R:PART	1	0	1	100.00	50.00	83.33
R:PREP	27	8	70	77.14	27.84	56.96
R:PRON	3	0	10	100.00	23.08	60.00
R:PUNCT	13	3	18	81.25	41.94	68.42
R:SPELL	33	2	34	94.29	49.25	79.71
R:VERB	18	3	62	85.71	22.50	54.88
R:VERB:FORM	27	1	32	96.43	45.76	78.95
R:VERB:SVA	33	3	17	91.67	66.00	85.05
R:VERB:TENSE	14	8	56	63.64	20.00	44.30
R:WO	35	2	64	94.59	35.35	70.85
U:ADJ	1	1	1	50.00	50.00	50.00
U:ADV	3	2	7	60.00	30.00	50.00
U:CONJ	0	1	0	0.00	100.00	0.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	19	11	34	63.33	35.85	54.91
U:NOUN	3	3	4	50.00	42.86	48.39
U:NOUN:POSS	1	0	6	100.00	14.29	45.45
U:OTHER	18	50	45	26.47	28.57	26.87
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	9	5	22	64.29	29.03	51.72
U:PRON	3	0	5	100.00	37.50	75.00
U:PUNCT	7	1	9	87.50	43.75	72.92
U:VERB	3	3	12	50.00	20.00	38.46
U:VERB:FORM	2	1	2	66.67	50.00	62.50
U:VERB:TENSE	3	2	9	60.00	25.00	46.88
UNK	7	0	13	100.00	35.00	72.92

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	177	178	352	49.86	33.46	45.41
Span-level detection	219	137	354	61.52	38.22	54.83
Token-level detection	263	119	413	68.85	38.91	59.66

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	44	23	86	65.67	33.85	55.28
R	104	130	226	44.44	31.52	41.07
U	29	25	40	53.70	42.03	50.88

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	3	5	40.00	28.57	37.04
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	3	4	3	42.86	50.00	44.12
CONJ	0	3	1	0.00	0.00	0.00
CONTR	1	0	2	100.00	33.33	71.43
DET	35	16	54	68.63	39.33	59.73
MORPH	6	3	14	66.67	30.00	53.57
NOUN	0	16	11	0.00	0.00	0.00
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	10	4	17	71.43	37.04	60.24
NOUN:POSS	1	0	5	100.00	16.67	50.00
ORTH	15	2	24	88.24	38.46	70.09
OTHER	10	69	51	12.66	16.39	13.26
PART	1	0	2	100.00	33.33	71.43
PREP	22	16	39	57.89	36.07	51.64
PRON	5	1	6	83.33	45.45	71.43
PUNCT	25	8	36	75.76	40.98	64.77
SPELL	11	6	26	64.71	29.73	52.38
VERB	1	10	11	9.09	8.33	8.93
VERB:FORM	11	6	6	64.71	64.71	64.71
VERB:SVA	7	2	4	77.78	63.64	74.47
VERB:TENSE	7	8	21	46.67	25.00	39.77
WO	3	1	12	75.00	20.00	48.39

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	1	1	0	50.00	100.00	55.56
M:CONJ	0	3	1	0.00	0.00	0.00
M:DET	14	6	26	70.00	35.00	58.33
M:NOUN	0	1	1	0.00	0.00	0.00
M:OTHER	0	0	6	100.00	0.00	0.00
M:PREP	4	2	14	66.67	22.22	47.62
M:PRON	3	0	3	100.00	50.00	83.33
M:PUNCT	20	6	30	76.92	40.00	64.94
M:VERB	0	4	2	0.00	0.00	0.00
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	0	0	2	100.00	0.00	0.00
R:ADJ	2	2	3	50.00	40.00	47.62
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	1	0	1	100.00	50.00	83.33
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	6	4	8	60.00	42.86	55.56
R:MORPH	6	3	14	66.67	30.00	53.57
R:NOUN	0	12	10	0.00	0.00	0.00
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	10	4	17	71.43	37.04	60.24
R:NOUN:POSS	0	0	5	100.00	0.00	0.00
R:ORTH	15	2	24	88.24	38.46	70.09
R:OTHER	10	66	43	13.16	18.87	14.01
R:PART	0	0	2	100.00	0.00	0.00
R:PREP	14	9	20	60.87	41.18	55.56
R:PRON	1	1	2	50.00	33.33	45.45
R:PUNCT	3	2	3	60.00	50.00	57.69
R:SPELL	11	6	26	64.71	29.73	52.38
R:VERB	1	3	7	25.00	12.50	20.83
R:VERB:FORM	8	6	6	57.14	57.14	57.14
R:VERB:SVA	7	2	4	77.78	63.64	74.47
R:VERB:TENSE	5	7	16	41.67	23.81	36.23
R:WO	3	1	12	75.00	20.00	48.39
U:ADJ	0	1	1	0.00	0.00	0.00
U:ADV	1	3	2	25.00	33.33	26.32
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	15	6	20	71.43	42.86	63.03
U:NOUN	0	3	0	0.00	100.00	0.00
U:NOUN:POSS	1	0	0	100.00	100.00	100.00
U:OTHER	0	3	2	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	4	5	5	44.44	44.44	44.44
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	2	0	3	100.00	40.00	76.92
U:VERB	0	3	2	0.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	2	1	3	66.67	40.00	58.82

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	45	23	93	66.18	32.61	54.88
R	139	95	216	59.40	39.15	53.83
U	33	19	42	63.46	44.00	58.30
UNK	2	0	3	100.00	40.00	76.92

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	2	5	60.00	37.50	53.57
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	3	3	3	50.00	50.00	50.00
CONJ	1	3	2	25.00	33.33	26.32
CONTR	1	0	2	100.00	33.33	71.43
DET	39	13	57	75.00	40.62	64.14
MORPH	9	3	14	75.00	39.13	63.38
NOUN	3	13	15	18.75	16.67	18.29
NOUN:INFL	1	0	1	100.00	50.00	83.33
NOUN:NUM	9	4	17	69.23	34.62	57.69
NOUN:POSS	1	0	5	100.00	16.67	50.00
ORTH	18	1	23	94.74	43.90	76.92
OTHER	21	45	47	31.82	30.88	31.63
PART	2	0	2	100.00	50.00	83.33
PREP	25	14	39	64.10	39.06	56.82
PRON	6	1	6	85.71	50.00	75.00
PUNCT	26	9	38	74.29	40.62	63.73
SPELL	15	4	22	78.95	40.54	66.37
UNK	2	0	3	100.00	40.00	76.92
VERB	1	7	12	12.50	7.69	11.11
VERB:FORM	12	5	6	70.59	66.67	69.77
VERB:SVA	9	2	4	81.82	69.23	78.95
VERB:TENSE	9	7	19	56.25	32.14	48.91
WO	3	1	10	75.00	23.08	51.72

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	1	0	0.00	100.00	0.00
M:CONJ	0	3	2	0.00	0.00	0.00
M:DET	15	5	26	75.00	36.59	61.98
M:NOUN	1	1	3	50.00	25.00	41.67
M:OTHER	0	0	7	100.00	0.00	0.00
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	4	2	15	66.67	21.05	46.51
M:PRON	3	0	3	100.00	50.00	83.33
M:PUNCT	20	7	30	74.07	40.00	63.29
M:VERB	0	4	2	0.00	0.00	0.00
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	0	0	3	100.00	0.00	0.00
R:ADJ	3	1	3	75.00	50.00	68.18
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	2	0	1	100.00	66.67	90.91
R:CONJ	1	0	0	100.00	100.00	100.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	7	3	8	70.00	46.67	63.64
R:MORPH	9	3	14	75.00	39.13	63.38
R:NOUN	2	11	12	15.38	14.29	15.15
R:NOUN:INFL	1	0	1	100.00	50.00	83.33
R:NOUN:NUM	9	4	17	69.23	34.62	57.69
R:NOUN:POSS	0	0	5	100.00	0.00	0.00
R:ORTH	18	1	23	94.74	43.90	76.92
R:OTHER	21	42	38	33.33	35.59	33.76
R:PART	1	0	1	100.00	50.00	83.33
R:PREP	16	7	20	69.57	44.44	62.50
R:PRON	2	1	2	66.67	50.00	62.50
R:PUNCT	3	2	5	60.00	37.50	53.57
R:SPELL	15	4	22	78.95	40.54	66.37
R:VERB	1	1	8	50.00	11.11	29.41
R:VERB:FORM	9	5	6	64.29	60.00	63.38
R:VERB:SVA	9	2	4	81.82	69.23	78.95
R:VERB:TENSE	7	7	13	50.00	35.00	46.05
R:WO	3	1	10	75.00	23.08	51.72
U:ADJ	0	1	1	0.00	0.00	0.00
U:ADV	1	2	2	33.33	33.33	33.33
U:CONTR	1	0	1	100.00	50.00	83.33
U:DET	17	5	23	77.27	42.50	66.41
U:NOUN	0	1	0	0.00	100.00	0.00
U:NOUN:POSS	1	0	0	100.00	100.00	100.00
U:OTHER	0	3	2	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	5	5	4	50.00	55.56	51.02
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	3	0	3	100.00	50.00	83.33
U:VERB	0	2	2	0.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	2	0	3	100.00	40.00	76.92
UNK	2	0	3	100.00	40.00	76.92

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	64	20	104	76.19	38.10	63.49
R	161	79	254	67.08	38.80	58.55
U	36	20	53	64.29	40.45	57.51
UNK	2	0	2	100.00	50.00	83.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	2	8	33.33	11.11	23.81
ADJ:FORM	0	0	3	100.00	0.00	0.00
ADV	4	2	5	66.67	44.44	60.61
CONJ	1	2	2	33.33	33.33	33.33
CONTR	1	0	3	100.00	25.00	62.50
DET	44	11	59	80.00	42.72	68.11
MORPH	9	3	16	75.00	36.00	61.64
NOUN	4	11	13	26.67	23.53	25.97
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	8	3	20	72.73	28.57	55.56
NOUN:POSS	1	0	7	100.00	12.50	41.67
ORTH	19	1	24	95.00	44.19	77.24
OTHER	36	37	72	49.32	33.33	45.00
PART	2	0	2	100.00	50.00	83.33
PREP	26	13	38	66.67	40.62	59.09
PRON	8	1	6	88.89	57.14	80.00
PUNCT	36	9	47	80.00	43.37	68.44
SPELL	17	3	21	85.00	44.74	72.03
UNK	2	0	2	100.00	50.00	83.33
VERB	2	9	15	18.18	11.76	16.39
VERB:FORM	12	2	7	85.71	63.16	80.00
VERB:SVA	9	2	4	81.82	69.23	78.95
VERB:TENSE	11	7	24	61.11	31.43	51.40
WO	9	1	15	90.00	37.50	70.31

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	1	2	2	33.33	33.33	33.33
M:DET	19	4	26	82.61	42.22	69.34
M:NOUN	2	1	2	66.67	50.00	62.50
M:OTHER	0	0	8	100.00	0.00	0.00
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	5	2	14	71.43	26.32	53.19
M:PRON	5	0	3	100.00	62.50	89.29
M:PUNCT	29	7	39	80.56	42.65	68.40
M:VERB	0	4	3	0.00	0.00	0.00
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	1	0	3	100.00	25.00	62.50
R:ADJ	1	1	3	50.00	25.00	41.67
R:ADJ:FORM	0	0	3	100.00	0.00	0.00
R:ADV	2	0	2	100.00	50.00	83.33
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	7	3	8	70.00	46.67	63.64
R:MORPH	9	3	16	75.00	36.00	61.64
R:NOUN	2	9	10	18.18	16.67	17.86
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	8	3	20	72.73	28.57	55.56
R:NOUN:POSS	0	0	6	100.00	0.00	0.00
R:ORTH	19	1	24	95.00	44.19	77.24
R:OTHER	36	33	58	52.17	38.30	48.65
R:PART	1	0	1	100.00	50.00	83.33
R:PREP	16	7	20	69.57	44.44	62.50
R:PRON	2	1	2	66.67	50.00	62.50
R:PUNCT	3	2	4	60.00	42.86	55.56
R:SPELL	17	3	21	85.00	44.74	72.03
R:VERB	2	1	10	66.67	16.67	41.67
R:VERB:FORM	9	2	7	81.82	56.25	75.00
R:VERB:SVA	9	2	4	81.82	69.23	78.95
R:VERB:TENSE	8	7	19	53.33	29.63	45.98
R:WO	9	1	15	90.00	37.50	70.31
U:ADJ	0	1	3	0.00	0.00	0.00
U:ADV	2	2	2	50.00	50.00	50.00
U:CONTR	1	0	2	100.00	33.33	71.43
U:DET	18	4	25	81.82	41.86	68.70
U:NOUN	0	1	1	0.00	0.00	0.00
U:NOUN:POSS	1	0	1	100.00	50.00	83.33
U:OTHER	0	4	6	0.00	0.00	0.00
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	5	4	4	55.56	55.56	55.56
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	4	0	4	100.00	50.00	83.33
U:VERB	0	4	2	0.00	0.00	0.00
U:VERB:FORM	1	0	0	100.00	100.00	100.00
U:VERB:TENSE	2	0	2	100.00	50.00	83.33
UNK	2	0	2	100.00	50.00	83.33

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	118	299	301	28.30	28.16	28.27
Span-level detection	170	247	288	40.77	37.12	39.98
Token-level detection	222	216	329	50.68	40.29	48.20

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	34	23	47	59.65	41.98	55.02
R	77	240	239	24.29	24.37	24.31
U	7	36	15	16.28	31.82	18.04

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	2	3	33.33	25.00	31.25
ADV	2	6	1	25.00	66.67	28.57
CONJ	0	1	2	0.00	0.00	0.00
DET	8	15	6	34.78	57.14	37.74
MORPH	3	5	3	37.50	50.00	39.47
NOUN	3	40	9	6.98	25.00	8.15
NOUN:INFL	0	2	11	0.00	0.00	0.00
NOUN:NUM	8	10	10	44.44	44.44	44.44
NOUN:POSS	0	2	15	0.00	0.00	0.00
ORTH	11	1	39	91.67	22.00	56.12
OTHER	16	119	34	11.85	32.00	13.56
PART	0	2	1	0.00	0.00	0.00
PREP	6	25	11	19.35	35.29	21.28
PRON	2	5	4	28.57	33.33	29.41
PUNCT	30	13	47	69.77	38.96	60.24
SPELL	14	6	75	70.00	15.73	41.42
VERB	3	22	9	12.00	25.00	13.39
VERB:FORM	3	6	4	33.33	42.86	34.88
VERB:INFL	2	0	3	100.00	40.00	76.92
VERB:SVA	0	9	7	0.00	0.00	0.00
VERB:TENSE	5	5	6	50.00	45.45	49.02
WO	1	3	1	25.00	50.00	27.78

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	0	0	1	100.00	0.00	0.00
M:DET	7	9	2	43.75	77.78	47.95
M:NOUN	0	0	2	100.00	0.00	0.00
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:OTHER	0	1	0	0.00	100.00	0.00
M:PREP	1	3	1	25.00	50.00	27.78
M:PRON	0	0	2	100.00	0.00	0.00
M:PUNCT	25	8	31	75.76	44.64	66.49
M:VERB	1	1	2	50.00	33.33	45.45
M:VERB:TENSE	0	1	0	0.00	100.00	0.00
R:ADJ	1	2	3	33.33	25.00	31.25
R:ADV	0	2	0	0.00	100.00	0.00
R:DET	0	2	2	0.00	0.00	0.00
R:MORPH	3	5	3	37.50	50.00	39.47
R:NOUN	3	34	7	8.11	30.00	9.49
R:NOUN:INFL	0	2	11	0.00	0.00	0.00
R:NOUN:NUM	8	10	10	44.44	44.44	44.44
R:NOUN:POSS	0	1	10	0.00	0.00	0.00
R:ORTH	11	1	39	91.67	22.00	56.12
R:OTHER	16	116	34	12.12	32.00	13.84
R:PART	0	2	0	0.00	100.00	0.00
R:PREP	4	17	9	19.05	30.77	20.62
R:PRON	2	1	2	66.67	50.00	62.50
R:PUNCT	3	4	9	42.86	25.00	37.50
R:SPELL	14	6	75	70.00	15.73	41.42
R:VERB	2	16	5	11.11	28.57	12.66
R:VERB:FORM	3	4	4	42.86	42.86	42.86
R:VERB:INFL	2	0	3	100.00	40.00	76.92
R:VERB:SVA	0	9	7	0.00	0.00	0.00
R:VERB:TENSE	4	3	5	57.14	44.44	54.05
R:WO	1	3	1	25.00	50.00	27.78
U:ADV	2	4	0	33.33	100.00	38.46
U:CONJ	0	1	1	0.00	0.00	0.00
U:DET	1	4	2	20.00	33.33	21.74
U:NOUN	0	6	0	0.00	100.00	0.00
U:NOUN:POSS	0	1	0	0.00	100.00	0.00
U:OTHER	0	2	0	0.00	100.00	0.00
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	1	5	1	16.67	50.00	19.23
U:PRON	0	4	0	0.00	100.00	0.00
U:PUNCT	2	1	7	66.67	22.22	47.62
U:VERB	0	5	2	0.00	0.00	0.00
U:VERB:FORM	0	2	0	0.00	100.00	0.00
U:VERB:TENSE	1	1	1	50.00	50.00	50.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	37	20	54	64.91	40.66	57.99
R	118	194	221	37.82	34.81	37.18
U	14	33	11	29.79	56.00	32.86
UNK	1	0	2	100.00	33.33	71.43

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	2	3	33.33	25.00	31.25
ADV	3	6	1	33.33	75.00	37.50
CONJ	0	1	2	0.00	0.00	0.00
DET	10	13	6	43.48	62.50	46.30
MORPH	3	4	1	42.86	75.00	46.88
NOUN	3	35	9	7.89	25.00	9.15
NOUN:INFL	0	1	11	0.00	0.00	0.00
NOUN:NUM	9	10	9	47.37	50.00	47.87
NOUN:POSS	2	2	13	50.00	13.33	32.26
ORTH	15	1	39	93.75	27.78	63.56
OTHER	30	93	29	24.39	50.85	27.22
PART	0	2	0	0.00	100.00	0.00
PREP	10	24	14	29.41	41.67	31.25
PRON	2	4	3	33.33	40.00	34.48
PUNCT	34	10	49	77.27	40.96	65.64
SPELL	23	1	69	95.83	25.00	61.17
UNK	1	0	2	100.00	33.33	71.43
VERB	9	17	9	34.62	50.00	36.89
VERB:FORM	4	5	4	44.44	50.00	45.45
VERB:INFL	3	0	2	100.00	60.00	88.24
VERB:SVA	2	8	6	20.00	25.00	20.83
VERB:TENSE	5	5	6	50.00	45.45	49.02
WO	1	3	1	25.00	50.00	27.78

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	0	0	1	100.00	0.00	0.00
M:DET	7	8	2	46.67	77.78	50.72
M:NOUN	0	0	2	100.00	0.00	0.00
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:OTHER	1	1	0	50.00	100.00	55.56
M:PREP	2	3	3	40.00	40.00	40.00
M:PRON	0	0	2	100.00	0.00	0.00
M:PUNCT	26	6	36	81.25	41.94	68.42
M:VERB	1	1	2	50.00	33.33	45.45
M:VERB:TENSE	0	1	0	0.00	100.00	0.00
R:ADJ	1	2	3	33.33	25.00	31.25
R:ADV	1	2	0	33.33	100.00	38.46
R:DET	0	2	2	0.00	0.00	0.00
R:MORPH	3	4	1	42.86	75.00	46.88
R:NOUN	3	29	7	9.38	30.00	10.87
R:NOUN:INFL	0	1	11	0.00	0.00	0.00
R:NOUN:NUM	9	10	9	47.37	50.00	47.87
R:NOUN:POSS	2	1	8	66.67	20.00	45.45
R:ORTH	15	1	39	93.75	27.78	63.56
R:OTHER	29	90	29	24.37	50.00	27.15
R:PART	0	2	0	0.00	100.00	0.00
R:PREP	6	16	11	27.27	35.29	28.57
R:PRON	2	0	1	100.00	66.67	90.91
R:PUNCT	4	4	8	50.00	33.33	45.45
R:SPELL	23	1	69	95.83	25.00	61.17
R:VERB	7	12	5	36.84	58.33	39.77
R:VERB:FORM	3	3	4	50.00	42.86	48.39
R:VERB:INFL	3	0	2	100.00	60.00	88.24
R:VERB:SVA	2	8	6	20.00	25.00	20.83
R:VERB:TENSE	4	3	5	57.14	44.44	54.05
R:WO	1	3	1	25.00	50.00	27.78
U:ADV	2	4	0	33.33	100.00	38.46
U:CONJ	0	1	1	0.00	0.00	0.00
U:DET	3	3	2	50.00	60.00	51.72
U:NOUN	0	6	0	0.00	100.00	0.00
U:NOUN:POSS	0	1	0	0.00	100.00	0.00
U:OTHER	0	2	0	0.00	100.00	0.00
U:PREP	2	5	0	28.57	100.00	33.33
U:PRON	0	4	0	0.00	100.00	0.00
U:PUNCT	4	0	5	100.00	44.44	80.00
U:VERB	1	4	2	20.00	33.33	21.74
U:VERB:FORM	1	2	0	33.33	100.00	38.46
U:VERB:TENSE	1	1	1	50.00	50.00	50.00
UNK	1	0	2	100.00	33.33	71.43

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	61	16	56	79.22	52.14	71.76
R	146	171	255	46.06	36.41	43.74
U	14	29	16	32.56	46.67	34.65
UNK	1	0	2	100.00	33.33	71.43

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	2	6	33.33	14.29	26.32
ADJ:FORM	1	0	0	100.00	100.00	100.00
ADV	3	4	1	42.86	75.00	46.88
CONJ	1	1	2	50.00	33.33	45.45
CONTR	0	0	3	100.00	0.00	0.00
DET	9	11	8	45.00	52.94	46.39
MORPH	4	2	2	66.67	66.67	66.67
NOUN	6	31	12	16.22	33.33	18.07
NOUN:INFL	0	1	11	0.00	0.00	0.00
NOUN:NUM	9	9	10	50.00	47.37	49.45
NOUN:POSS	2	2	14	50.00	12.50	31.25
ORTH	22	1	49	95.65	30.99	67.48
OTHER	47	83	43	36.15	52.22	38.52
PART	0	1	0	0.00	100.00	0.00
PREP	9	22	15	29.03	37.50	30.41
PRON	4	4	1	50.00	80.00	54.05
PUNCT	52	6	52	89.66	50.00	77.38
SPELL	24	1	68	96.00	26.09	62.50
UNK	1	0	2	100.00	33.33	71.43
VERB	10	15	12	40.00	45.45	40.98
VERB:FORM	5	4	4	55.56	55.56	55.56
VERB:INFL	3	0	2	100.00	60.00	88.24
VERB:SVA	2	6	6	25.00	25.00	25.00
VERB:TENSE	5	6	6	45.45	45.45	45.45
WO	2	4	0	33.33	100.00	38.46

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	1	0	1	100.00	50.00	83.33
M:DET	7	6	2	53.85	77.78	57.38
M:NOUN	3	0	3	100.00	50.00	83.33
M:NOUN:POSS	0	0	5	100.00	0.00	0.00
M:OTHER	1	1	1	50.00	50.00	50.00
M:PREP	3	2	4	60.00	42.86	55.56
M:PRON	2	0	0	100.00	100.00	100.00
M:PUNCT	42	5	36	89.36	53.85	78.95
M:VERB	2	1	3	66.67	40.00	58.82
M:VERB:TENSE	0	1	0	0.00	100.00	0.00
R:ADJ	1	2	3	33.33	25.00	31.25
R:ADJ:FORM	1	0	0	100.00	100.00	100.00
R:ADV	1	2	0	33.33	100.00	38.46
R:CONTR	0	0	3	100.00	0.00	0.00
R:DET	0	2	3	0.00	0.00	0.00
R:MORPH	4	2	2	66.67	66.67	66.67
R:NOUN	3	25	9	10.71	25.00	12.10
R:NOUN:INFL	0	1	11	0.00	0.00	0.00
R:NOUN:NUM	9	9	10	50.00	47.37	49.45
R:NOUN:POSS	2	1	9	66.67	18.18	43.48
R:ORTH	22	1	49	95.65	30.99	67.48
R:OTHER	45	80	41	36.00	52.33	38.40
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	4	15	11	21.05	26.67	21.98
R:PRON	2	0	1	100.00	66.67	90.91
R:PUNCT	6	1	11	85.71	35.29	66.67
R:SPELL	24	1	68	96.00	26.09	62.50
R:VERB	7	11	6	38.89	53.85	41.18
R:VERB:FORM	4	3	4	57.14	50.00	55.56
R:VERB:INFL	3	0	2	100.00	60.00	88.24
R:VERB:SVA	2	6	6	25.00	25.00	25.00
R:VERB:TENSE	4	4	6	50.00	40.00	47.62
R:WO	2	4	0	33.33	100.00	38.46
U:ADJ	0	0	3	100.00	0.00	0.00
U:ADV	2	2	0	50.00	100.00	55.56
U:CONJ	0	1	1	0.00	0.00	0.00
U:DET	2	3	3	40.00	40.00	40.00
U:NOUN	0	6	0	0.00	100.00	0.00
U:NOUN:POSS	0	1	0	0.00	100.00	0.00
U:OTHER	1	2	1	33.33	50.00	35.71
U:PREP	2	5	0	28.57	100.00	33.33
U:PRON	0	4	0	0.00	100.00	0.00
U:PUNCT	4	0	5	100.00	44.44	80.00
U:VERB	1	3	3	25.00	25.00	25.00
U:VERB:FORM	1	1	0	50.00	100.00	55.56
U:VERB:TENSE	1	1	0	50.00	100.00	55.56
UNK	1	0	2	100.00	33.33	71.43

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:44:05+00:00
Competition submission:	14
Competition phase:	3 - Open phase

Detailed results

Submission information

Results