BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	446	1243	3556	26.41	11.14	20.73
Span-level detection	607	1082	3676	35.94	14.17	27.49
Token-level detection	807	965	4521	45.54	15.15	32.50

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	101	270	745	27.22	11.94	21.67
R	334	940	2461	26.22	11.95	21.16
U	11	33	350	25.00	3.05	10.24

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	30	21	16.67	22.22	17.54
ADJ:FORM	0	4	7	0.00	0.00	0.00
ADV	8	27	30	22.86	21.05	22.47
CONJ	0	8	16	0.00	0.00	0.00
CONTR	3	12	7	20.00	30.00	21.43
DET	18	81	432	18.18	4.00	10.64
MORPH	15	34	111	30.61	11.90	23.29
NOUN	8	95	82	7.77	8.89	7.97
NOUN:INFL	1	0	17	100.00	5.56	22.73
NOUN:NUM	21	61	187	25.61	10.10	19.59
NOUN:POSS	5	20	40	20.00	11.11	17.24
ORTH	185	186	208	49.87	47.07	49.28
OTHER	13	122	700	9.63	1.82	5.19
PART	2	2	16	50.00	11.11	29.41
PREP	20	112	304	15.15	6.17	11.74
PRON	8	38	93	17.39	7.92	14.04
PUNCT	91	114	345	44.39	20.87	36.23
SPELL	4	2	287	66.67	1.37	6.35
VERB	9	97	167	8.49	5.11	7.50
VERB:FORM	6	50	137	10.71	4.20	8.17
VERB:INFL	2	0	5	100.00	28.57	66.67
VERB:SVA	5	16	106	23.81	4.50	12.82
VERB:TENSE	9	125	176	6.72	4.86	6.24
WO	7	7	62	50.00	10.14	28.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	6	3	0.00	0.00	0.00
M:ADV	0	9	8	0.00	0.00	0.00
M:CONJ	0	6	9	0.00	0.00	0.00
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	11	45	202	19.64	5.16	12.59
M:NOUN	0	12	10	0.00	0.00	0.00
M:NOUN:POSS	0	9	12	0.00	0.00	0.00
M:OTHER	0	18	43	0.00	0.00	0.00
M:PART	0	2	3	0.00	0.00	0.00
M:PREP	2	25	74	7.41	2.63	5.43
M:PRON	2	13	49	13.33	3.92	9.01
M:PUNCT	86	92	259	48.31	24.93	40.68
M:VERB	0	9	30	0.00	0.00	0.00
M:VERB:FORM	0	4	10	0.00	0.00	0.00
M:VERB:TENSE	0	19	33	0.00	0.00	0.00
R:ADJ	6	24	16	20.00	27.27	21.13
R:ADJ:FORM	0	4	7	0.00	0.00	0.00
R:ADV	8	16	10	33.33	44.44	35.09
R:CONJ	0	2	4	0.00	0.00	0.00
R:CONTR	3	7	2	30.00	60.00	33.33
R:DET	1	26	84	3.70	1.18	2.59
R:MORPH	15	34	111	30.61	11.90	23.29
R:NOUN	8	81	61	8.99	11.59	9.41
R:NOUN:INFL	1	0	17	100.00	5.56	22.73
R:NOUN:NUM	21	61	187	25.61	10.10	19.59
R:NOUN:POSS	5	11	19	31.25	20.83	28.41
R:ORTH	185	186	208	49.87	47.07	49.28
R:OTHER	13	104	637	11.11	2.00	5.81
R:PART	1	0	8	100.00	11.11	38.46
R:PREP	17	82	172	17.17	8.99	14.53
R:PRON	6	23	29	20.69	17.14	19.87
R:PUNCT	2	19	56	9.52	3.45	7.04
R:SPELL	4	2	287	66.67	1.37	6.35
R:VERB	9	87	122	9.38	6.87	8.74
R:VERB:FORM	6	44	124	12.00	4.62	9.09
R:VERB:INFL	2	0	5	100.00	28.57	66.67
R:VERB:SVA	5	16	106	23.81	4.50	12.82
R:VERB:TENSE	9	104	127	7.96	6.62	7.65
R:WO	7	7	62	50.00	10.14	28.00
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	0	2	12	0.00	0.00	0.00
U:CONJ	0	0	3	100.00	0.00	0.00
U:CONTR	0	4	5	0.00	0.00	0.00
U:DET	6	10	146	37.50	3.95	13.89
U:NOUN	0	2	11	0.00	0.00	0.00
U:NOUN:POSS	0	0	9	100.00	0.00	0.00
U:OTHER	0	0	20	100.00	0.00	0.00
U:PART	1	0	5	100.00	16.67	50.00
U:PREP	1	5	58	16.67	1.69	6.02
U:PRON	0	2	15	0.00	0.00	0.00
U:PUNCT	3	3	30	50.00	9.09	26.32
U:VERB	0	1	15	0.00	0.00	0.00
U:VERB:FORM	0	2	3	0.00	0.00	0.00
U:VERB:TENSE	0	2	16	0.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	124	249	779	33.24	13.73	25.89
R	451	804	2473	35.94	15.42	28.39
U	22	29	356	43.14	5.82	18.90
UNK	10	0	68	100.00	12.82	42.37

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	13	27	22	32.50	37.14	33.33
ADJ:FORM	0	4	8	0.00	0.00	0.00
ADV	12	26	29	31.58	29.27	31.09
CONJ	0	6	14	0.00	0.00	0.00
CONTR	2	12	9	14.29	18.18	14.93
DET	28	74	435	27.45	6.05	16.07
MORPH	20	27	111	42.55	15.27	31.35
NOUN	13	87	84	13.00	13.40	13.08
NOUN:INFL	1	0	17	100.00	5.56	22.73
NOUN:NUM	19	58	185	24.68	9.31	18.55
NOUN:POSS	5	14	39	26.32	11.36	20.83
ORTH	193	151	213	56.10	47.54	54.15
OTHER	49	103	717	32.24	6.40	17.83
PART	2	2	20	50.00	9.09	26.32
PREP	35	96	302	26.72	10.39	20.33
PRON	10	33	93	23.26	9.71	18.18
PUNCT	105	103	374	50.48	21.92	40.05
SPELL	12	1	283	92.31	4.07	17.29
UNK	10	0	68	100.00	12.82	42.37
VERB	23	81	177	22.12	11.50	18.67
VERB:FORM	14	45	135	23.73	9.40	18.18
VERB:INFL	2	0	5	100.00	28.57	66.67
VERB:SVA	10	14	103	41.67	8.85	23.92
VERB:TENSE	22	111	174	16.54	11.22	15.11
WO	7	7	59	50.00	10.61	28.69

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	6	3	0.00	0.00	0.00
M:ADV	2	9	7	18.18	22.22	18.87
M:CONJ	0	4	8	0.00	0.00	0.00
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	14	43	205	24.56	6.39	15.66
M:NOUN	0	10	10	0.00	0.00	0.00
M:NOUN:POSS	0	9	12	0.00	0.00	0.00
M:OTHER	0	16	48	0.00	0.00	0.00
M:PART	0	2	4	0.00	0.00	0.00
M:PREP	3	23	76	11.54	3.80	8.20
M:PRON	2	12	47	14.29	4.08	9.52
M:PUNCT	98	86	287	53.26	25.45	43.71
M:VERB	0	8	31	0.00	0.00	0.00
M:VERB:FORM	0	4	10	0.00	0.00	0.00
M:VERB:TENSE	5	16	31	23.81	13.89	20.83
R:ADJ	13	21	16	38.24	44.83	39.39
R:ADJ:FORM	0	4	8	0.00	0.00	0.00
R:ADV	10	15	10	40.00	50.00	41.67
R:CONJ	0	2	3	0.00	0.00	0.00
R:CONTR	2	7	2	22.22	50.00	25.00
R:DET	3	21	83	12.50	3.49	8.24
R:MORPH	20	27	111	42.55	15.27	31.35
R:NOUN	12	75	62	13.79	16.22	14.22
R:NOUN:INFL	1	0	17	100.00	5.56	22.73
R:NOUN:NUM	19	58	185	24.68	9.31	18.55
R:NOUN:POSS	5	5	18	50.00	21.74	39.68
R:ORTH	193	151	213	56.10	47.54	54.15
R:OTHER	49	87	646	36.03	7.05	19.77
R:PART	1	0	12	100.00	7.69	29.41
R:PREP	30	70	170	30.00	15.00	25.00
R:PRON	6	20	32	23.08	15.79	21.13
R:PUNCT	4	15	56	21.05	6.67	14.71
R:SPELL	12	1	283	92.31	4.07	17.29
R:VERB	22	72	130	23.40	14.47	20.83
R:VERB:FORM	14	39	122	26.42	10.29	20.11
R:VERB:INFL	2	0	5	100.00	28.57	66.67
R:VERB:SVA	10	14	103	41.67	8.85	23.92
R:VERB:TENSE	16	93	127	14.68	11.19	13.82
R:WO	7	7	59	50.00	10.61	28.69
U:ADJ	0	0	3	100.00	0.00	0.00
U:ADV	0	2	12	0.00	0.00	0.00
U:CONJ	0	0	3	100.00	0.00	0.00
U:CONTR	0	4	7	0.00	0.00	0.00
U:DET	11	10	147	52.38	6.96	22.73
U:NOUN	1	2	12	33.33	7.69	20.00
U:NOUN:POSS	0	0	9	100.00	0.00	0.00
U:OTHER	0	0	23	100.00	0.00	0.00
U:PART	1	0	4	100.00	20.00	55.56
U:PREP	2	3	56	40.00	3.45	12.82
U:PRON	2	1	14	66.67	12.50	35.71
U:PUNCT	3	2	31	60.00	8.82	27.78
U:VERB	1	1	16	50.00	5.88	20.00
U:VERB:FORM	0	2	3	0.00	0.00	0.00
U:VERB:TENSE	1	2	16	33.33	5.88	17.24
UNK	10	0	68	100.00	12.82	42.37

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	173	200	884	46.38	16.37	33.93
R	571	741	3062	43.52	15.72	32.15
U	46	24	502	65.71	8.39	27.78
UNK	17	0	73	100.00	18.89	53.80

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	14	25	32	35.90	30.43	34.65
ADJ:FORM	0	4	11	0.00	0.00	0.00
ADV	14	21	44	40.00	24.14	35.35
CONJ	1	5	21	16.67	4.55	10.87
CONTR	4	10	14	28.57	22.22	27.03
DET	40	66	487	37.74	7.59	21.03
MORPH	23	20	119	53.49	16.20	36.62
NOUN	21	77	112	21.43	15.79	20.00
NOUN:INFL	1	0	17	100.00	5.56	22.73
NOUN:NUM	20	49	201	28.99	9.05	20.12
NOUN:POSS	8	8	53	50.00	13.11	32.00
ORTH	206	138	255	59.88	44.69	56.07
OTHER	103	99	1073	50.99	8.76	25.96
PART	1	2	20	33.33	4.76	15.15
PREP	45	85	345	34.62	11.54	24.73
PRON	18	26	110	40.91	14.06	29.61
PUNCT	137	87	417	61.16	24.73	47.24
SPELL	12	0	295	100.00	3.91	16.90
UNK	17	0	73	100.00	18.89	53.80
VERB	29	72	233	28.71	11.07	21.77
VERB:FORM	19	38	148	33.33	11.38	24.05
VERB:INFL	2	0	6	100.00	25.00	62.50
VERB:SVA	13	13	119	50.00	9.85	27.54
VERB:TENSE	35	111	226	23.97	13.41	20.71
WO	24	9	90	72.73	21.05	48.78

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	5	3	16.67	25.00	17.86
M:ADV	1	8	13	11.11	7.14	10.00
M:CONJ	0	4	11	0.00	0.00	0.00
M:DET	20	37	216	35.09	8.47	21.55
M:NOUN	3	8	15	27.27	16.67	24.19
M:NOUN:POSS	1	6	13	14.29	7.14	11.90
M:OTHER	3	13	70	18.75	4.11	10.95
M:PART	0	2	5	0.00	0.00	0.00
M:PREP	6	21	84	22.22	6.67	15.15
M:PRON	7	7	55	50.00	11.29	29.66
M:PUNCT	121	67	304	64.36	28.47	51.40
M:VERB	2	7	46	22.22	4.17	11.90
M:VERB:FORM	1	2	13	33.33	7.14	19.23
M:VERB:TENSE	7	13	36	35.00	16.28	28.46
R:ADJ	13	20	24	39.39	35.14	38.46
R:ADJ:FORM	0	4	11	0.00	0.00	0.00
R:ADV	12	11	14	52.17	46.15	50.85
R:CONJ	1	1	5	50.00	16.67	35.71
R:CONTR	4	7	5	36.36	44.44	37.74
R:DET	6	20	95	23.08	5.94	14.63
R:MORPH	23	20	119	53.49	16.20	36.62
R:NOUN	17	68	79	20.00	17.71	19.50
R:NOUN:INFL	1	0	17	100.00	5.56	22.73
R:NOUN:NUM	20	49	201	28.99	9.05	20.12
R:NOUN:POSS	7	2	26	77.78	21.21	50.72
R:ORTH	206	138	255	59.88	44.69	56.07
R:OTHER	91	86	914	51.41	9.05	26.56
R:PART	0	0	11	100.00	0.00	0.00
R:PREP	34	62	197	35.42	14.72	27.64
R:PRON	6	19	39	24.00	13.33	20.69
R:PUNCT	9	18	84	33.33	9.68	22.39
R:SPELL	12	0	295	100.00	3.91	16.90
R:VERB	25	64	157	28.09	13.74	23.23
R:VERB:FORM	18	34	131	34.62	12.08	25.21
R:VERB:INFL	2	0	6	100.00	25.00	62.50
R:VERB:SVA	13	13	119	50.00	9.85	27.54
R:VERB:TENSE	27	96	168	21.95	13.85	19.65
R:WO	24	9	90	72.73	21.05	48.78
U:ADJ	0	0	5	100.00	0.00	0.00
U:ADV	1	2	17	33.33	5.56	16.67
U:CONJ	0	0	5	100.00	0.00	0.00
U:CONTR	0	3	9	0.00	0.00	0.00
U:DET	14	9	176	60.87	7.37	24.82
U:NOUN	1	1	18	50.00	5.26	18.52
U:NOUN:POSS	0	0	14	100.00	0.00	0.00
U:OTHER	9	0	89	100.00	9.18	33.58
U:PART	1	0	4	100.00	20.00	55.56
U:PREP	5	2	64	71.43	7.25	25.77
U:PRON	5	0	16	100.00	23.81	60.98
U:PUNCT	7	2	29	77.78	19.44	48.61
U:VERB	2	1	30	66.67	6.25	22.73
U:VERB:FORM	0	2	4	0.00	0.00	0.00
U:VERB:TENSE	1	2	22	33.33	4.35	14.29
UNK	17	0	73	100.00	18.89	53.80

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	196	328	1654	37.40	10.59	24.84
Span-level detection	266	258	1709	50.76	13.47	32.67
Token-level detection	349	211	2122	62.32	14.12	37.04

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	30	64	327	31.91	8.40	20.46
R	161	257	1157	38.52	12.22	26.92
U	5	7	170	41.67	2.86	11.21

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	2	8	50.00	20.00	38.46
ADJ:FORM	0	1	3	0.00	0.00	0.00
ADV	3	7	16	30.00	15.79	25.42
CONJ	0	1	5	0.00	0.00	0.00
CONTR	2	1	2	66.67	50.00	62.50
DET	8	27	194	22.86	3.96	11.70
MORPH	10	11	60	47.62	14.29	32.47
NOUN	5	30	35	14.29	12.50	13.89
NOUN:INFL	0	0	6	100.00	0.00	0.00
NOUN:NUM	11	15	99	42.31	10.00	25.70
NOUN:POSS	0	3	10	0.00	0.00	0.00
ORTH	98	54	94	64.47	51.04	61.25
OTHER	1	36	382	2.70	0.26	0.94
PART	0	0	7	100.00	0.00	0.00
PREP	9	27	128	25.00	6.57	16.01
PRON	5	6	48	45.45	9.43	25.77
PUNCT	26	31	149	45.61	14.86	32.26
SPELL	2	1	100	66.67	1.96	8.77
VERB	1	18	87	5.26	1.14	3.05
VERB:FORM	2	15	68	11.76	2.86	7.25
VERB:INFL	0	0	2	100.00	0.00	0.00
VERB:SVA	3	4	55	42.86	5.17	17.44
VERB:TENSE	6	37	80	13.95	6.98	11.63
WO	2	1	16	66.67	11.11	33.33

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	4	3	0.00	0.00	0.00
M:CONJ	0	1	1	0.00	0.00	0.00
M:DET	5	11	80	31.25	5.88	16.78
M:NOUN	0	2	3	0.00	0.00	0.00
M:NOUN:POSS	0	1	3	0.00	0.00	0.00
M:OTHER	0	6	26	0.00	0.00	0.00
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	1	4	34	20.00	2.86	9.09
M:PRON	1	2	23	33.33	4.17	13.89
M:PUNCT	23	27	113	46.00	16.91	34.23
M:VERB	0	2	15	0.00	0.00	0.00
M:VERB:FORM	0	2	8	0.00	0.00	0.00
M:VERB:TENSE	0	2	16	0.00	0.00	0.00
R:ADJ	2	2	6	50.00	25.00	41.67
R:ADJ:FORM	0	1	3	0.00	0.00	0.00
R:ADV	3	3	6	50.00	33.33	45.45
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	2	1	0	66.67	100.00	71.43
R:DET	0	14	35	0.00	0.00	0.00
R:MORPH	10	11	60	47.62	14.29	32.47
R:NOUN	5	27	24	15.62	17.24	15.92
R:NOUN:INFL	0	0	6	100.00	0.00	0.00
R:NOUN:NUM	11	15	99	42.31	10.00	25.70
R:NOUN:POSS	0	2	4	0.00	0.00	0.00
R:ORTH	98	54	94	64.47	51.04	61.25
R:OTHER	1	30	348	3.23	0.29	1.06
R:PART	0	0	4	100.00	0.00	0.00
R:PREP	7	22	70	24.14	9.09	18.13
R:PRON	4	3	17	57.14	19.05	40.82
R:PUNCT	2	3	23	40.00	8.00	22.22
R:SPELL	2	1	100	66.67	1.96	8.77
R:VERB	1	16	66	5.88	1.49	3.70
R:VERB:FORM	2	12	59	14.29	3.28	8.55
R:VERB:INFL	0	0	2	100.00	0.00	0.00
R:VERB:SVA	3	4	55	42.86	5.17	17.44
R:VERB:TENSE	6	35	59	14.63	9.23	13.10
R:WO	2	1	16	66.67	11.11	33.33
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	0	7	100.00	0.00	0.00
U:CONJ	0	0	3	100.00	0.00	0.00
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	3	2	79	60.00	3.66	14.71
U:NOUN	0	1	8	0.00	0.00	0.00
U:NOUN:POSS	0	0	3	100.00	0.00	0.00
U:OTHER	0	0	8	100.00	0.00	0.00
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	1	1	24	50.00	4.00	15.15
U:PRON	0	1	8	0.00	0.00	0.00
U:PUNCT	1	1	13	50.00	7.14	22.73
U:VERB	0	0	6	100.00	0.00	0.00
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	0	0	5	100.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	36	60	334	37.50	9.73	23.87
R	215	193	1153	52.70	15.72	35.83
U	8	5	173	61.54	4.42	17.17
UNK	7	0	49	100.00	12.50	41.67

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	4	1	9	80.00	30.77	60.61
ADJ:FORM	0	1	3	0.00	0.00	0.00
ADV	5	7	15	41.67	25.00	36.76
CONJ	0	1	4	0.00	0.00	0.00
CONTR	1	1	4	50.00	20.00	38.46
DET	13	23	192	36.11	6.34	18.62
MORPH	14	6	61	70.00	18.67	45.16
NOUN	6	25	36	19.35	14.29	18.07
NOUN:INFL	0	0	6	100.00	0.00	0.00
NOUN:NUM	9	13	100	40.91	8.26	22.84
NOUN:POSS	0	3	10	0.00	0.00	0.00
ORTH	101	34	92	74.81	52.33	68.89
OTHER	16	30	387	34.78	3.97	13.63
PART	0	0	9	100.00	0.00	0.00
PREP	15	21	127	41.67	10.56	26.22
PRON	5	5	49	50.00	9.26	26.60
PUNCT	28	29	157	49.12	15.14	33.90
SPELL	7	1	96	87.50	6.80	25.93
UNK	7	0	49	100.00	12.50	41.67
VERB	7	12	87	36.84	7.45	20.59
VERB:FORM	8	13	66	38.10	10.81	25.32
VERB:INFL	0	0	2	100.00	0.00	0.00
VERB:SVA	6	2	53	75.00	10.17	32.97
VERB:TENSE	12	29	79	29.27	13.19	23.53
WO	2	1	16	66.67	11.11	33.33

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	1	4	3	20.00	25.00	20.83
M:CONJ	0	1	1	0.00	0.00	0.00
M:DET	6	10	80	37.50	6.98	20.00
M:NOUN	0	1	3	0.00	0.00	0.00
M:NOUN:POSS	0	1	3	0.00	0.00	0.00
M:OTHER	0	6	28	0.00	0.00	0.00
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	1	4	33	20.00	2.94	9.26
M:PRON	1	2	22	33.33	4.35	14.29
M:PUNCT	25	26	124	49.02	16.78	35.41
M:VERB	0	2	13	0.00	0.00	0.00
M:VERB:FORM	0	2	8	0.00	0.00	0.00
M:VERB:TENSE	2	1	14	66.67	12.50	35.71
R:ADJ	4	1	6	80.00	40.00	66.67
R:ADJ:FORM	0	1	3	0.00	0.00	0.00
R:ADV	4	3	6	57.14	40.00	52.63
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	3	11	33	21.43	8.33	16.30
R:MORPH	14	6	61	70.00	18.67	45.16
R:NOUN	5	23	24	17.86	17.24	17.73
R:NOUN:INFL	0	0	6	100.00	0.00	0.00
R:NOUN:NUM	9	13	100	40.91	8.26	22.84
R:NOUN:POSS	0	2	4	0.00	0.00	0.00
R:ORTH	101	34	92	74.81	52.33	68.89
R:OTHER	16	24	349	40.00	4.38	15.24
R:PART	0	0	6	100.00	0.00	0.00
R:PREP	13	17	70	43.33	15.66	32.02
R:PRON	4	3	19	57.14	17.39	39.22
R:PUNCT	2	2	22	50.00	8.33	25.00
R:SPELL	7	1	96	87.50	6.80	25.93
R:VERB	7	10	68	41.18	9.33	24.48
R:VERB:FORM	8	10	57	44.44	12.31	29.20
R:VERB:INFL	0	0	2	100.00	0.00	0.00
R:VERB:SVA	6	2	53	75.00	10.17	32.97
R:VERB:TENSE	9	28	60	24.32	13.04	20.74
R:WO	2	1	16	66.67	11.11	33.33
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	0	0	6	100.00	0.00	0.00
U:CONJ	0	0	3	100.00	0.00	0.00
U:CONTR	0	0	4	100.00	0.00	0.00
U:DET	4	2	79	66.67	4.82	18.69
U:NOUN	1	1	9	50.00	10.00	27.78
U:NOUN:POSS	0	0	3	100.00	0.00	0.00
U:OTHER	0	0	10	100.00	0.00	0.00
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	1	0	24	100.00	4.00	17.24
U:PRON	0	0	8	100.00	0.00	0.00
U:PUNCT	1	1	11	50.00	8.33	25.00
U:VERB	0	0	6	100.00	0.00	0.00
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	1	0	5	100.00	16.67	50.00
UNK	7	0	49	100.00	12.50	41.67

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	61	40	388	60.40	13.59	35.76
R	259	167	1428	60.80	15.35	38.19
U	17	4	247	80.95	6.44	24.43
UNK	12	0	59	100.00	16.90	50.42

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	1	13	83.33	27.78	59.52
ADJ:FORM	0	1	5	0.00	0.00	0.00
ADV	6	6	23	50.00	20.69	38.96
CONJ	0	1	11	0.00	0.00	0.00
CONTR	1	1	5	50.00	16.67	35.71
DET	23	19	224	54.76	9.31	27.71
MORPH	16	4	64	80.00	20.00	50.00
NOUN	10	21	55	32.26	15.38	26.46
NOUN:INFL	0	0	6	100.00	0.00	0.00
NOUN:NUM	9	10	106	47.37	7.83	23.56
NOUN:POSS	0	3	15	0.00	0.00	0.00
ORTH	101	30	115	77.10	46.76	68.24
OTHER	37	25	541	59.68	6.40	22.40
PART	0	0	10	100.00	0.00	0.00
PREP	16	15	153	51.61	9.47	27.30
PRON	12	3	60	80.00	16.67	45.45
PUNCT	40	20	177	66.67	18.43	43.76
SPELL	7	0	101	100.00	6.48	25.74
UNK	12	0	59	100.00	16.90	50.42
VERB	8	9	119	47.06	6.30	20.51
VERB:FORM	11	10	72	52.38	13.25	32.93
VERB:INFL	0	0	3	100.00	0.00	0.00
VERB:SVA	8	1	63	88.89	11.27	37.38
VERB:TENSE	19	31	99	38.00	16.10	29.87
WO	8	0	23	100.00	25.81	63.49

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	4	4	0.00	0.00	0.00
M:CONJ	0	1	5	0.00	0.00	0.00
M:DET	10	7	86	58.82	10.42	30.49
M:NOUN	1	0	7	100.00	12.50	41.67
M:NOUN:POSS	0	1	3	0.00	0.00	0.00
M:OTHER	2	4	40	33.33	4.76	15.15
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	3	3	39	50.00	7.14	22.73
M:PRON	6	0	28	100.00	17.65	51.72
M:PUNCT	36	17	127	67.92	22.09	48.00
M:VERB	0	1	22	0.00	0.00	0.00
M:VERB:FORM	1	1	10	50.00	9.09	26.32
M:VERB:TENSE	2	1	14	66.67	12.50	35.71
R:ADJ	5	1	10	83.33	33.33	64.10
R:ADJ:FORM	0	1	5	0.00	0.00	0.00
R:ADV	5	2	10	71.43	33.33	58.14
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	1	0	50.00	100.00	55.56
R:DET	5	10	37	33.33	11.90	24.51
R:MORPH	16	4	64	80.00	20.00	50.00
R:NOUN	9	21	35	30.00	20.45	27.44
R:NOUN:INFL	0	0	6	100.00	0.00	0.00
R:NOUN:NUM	9	10	106	47.37	7.83	23.56
R:NOUN:POSS	0	2	6	0.00	0.00	0.00
R:ORTH	101	30	115	77.10	46.76	68.24
R:OTHER	33	21	469	61.11	6.57	22.98
R:PART	0	0	6	100.00	0.00	0.00
R:PREP	13	12	85	52.00	13.27	32.83
R:PRON	4	3	23	57.14	14.81	36.36
R:PUNCT	2	2	41	50.00	4.65	16.95
R:SPELL	7	0	101	100.00	6.48	25.74
R:VERB	7	8	81	46.67	7.95	23.65
R:VERB:FORM	10	8	61	55.56	14.08	34.97
R:VERB:INFL	0	0	3	100.00	0.00	0.00
R:VERB:SVA	8	1	63	88.89	11.27	37.38
R:VERB:TENSE	16	30	77	34.78	17.20	28.88
R:WO	8	0	23	100.00	25.81	63.49
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	1	0	9	100.00	10.00	35.71
U:CONJ	0	0	5	100.00	0.00	0.00
U:CONTR	0	0	5	100.00	0.00	0.00
U:DET	8	2	101	80.00	7.34	26.85
U:NOUN	0	0	13	100.00	0.00	0.00
U:NOUN:POSS	0	0	6	100.00	0.00	0.00
U:OTHER	2	0	32	100.00	5.88	23.81
U:PART	0	0	2	100.00	0.00	0.00
U:PREP	0	0	29	100.00	0.00	0.00
U:PRON	2	0	9	100.00	18.18	52.63
U:PUNCT	2	1	9	66.67	18.18	43.48
U:VERB	1	0	16	100.00	5.88	23.81
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	1	0	8	100.00	11.11	38.46
UNK	12	0	59	100.00	16.90	50.42

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	105	351	1147	23.03	8.39	17.07
Span-level detection	159	297	1180	34.87	11.87	25.13
Token-level detection	219	254	1495	46.30	12.78	30.37

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	31	76	265	28.97	10.47	21.41
R	70	262	766	21.08	8.37	16.17
U	4	13	116	23.53	3.33	10.64

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	7	4	30.00	42.86	31.91
ADJ:FORM	0	1	2	0.00	0.00	0.00
ADV	3	11	11	21.43	21.43	21.43
CONJ	0	4	8	0.00	0.00	0.00
CONTR	0	4	2	0.00	0.00	0.00
DET	7	18	159	28.00	4.22	13.16
MORPH	3	12	32	20.00	8.57	15.79
NOUN	1	27	29	3.57	3.33	3.52
NOUN:NUM	4	15	54	21.05	6.90	14.93
NOUN:POSS	0	5	12	0.00	0.00	0.00
ORTH	33	50	50	39.76	39.76	39.76
OTHER	2	39	216	4.88	0.92	2.62
PART	2	0	5	100.00	28.57	66.67
PREP	6	35	115	14.63	4.96	10.53
PRON	2	11	32	15.38	5.88	11.63
PUNCT	26	36	104	41.94	20.00	34.39
SPELL	1	1	63	50.00	1.56	6.94
VERB	4	28	61	12.50	6.15	10.36
VERB:FORM	1	11	54	8.33	1.82	4.85
VERB:SVA	2	4	36	33.33	5.26	16.13
VERB:TENSE	3	31	63	8.82	4.55	7.43
WO	2	1	35	66.67	5.41	20.41

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	1	0.00	0.00	0.00
M:ADV	0	2	4	0.00	0.00	0.00
M:CONJ	0	3	6	0.00	0.00	0.00
M:DET	4	11	84	26.67	4.55	13.51
M:NOUN	0	4	3	0.00	0.00	0.00
M:NOUN:POSS	0	2	4	0.00	0.00	0.00
M:OTHER	0	4	11	0.00	0.00	0.00
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	1	8	24	11.11	4.00	8.20
M:PRON	1	5	19	16.67	5.00	11.36
M:PUNCT	25	27	83	48.08	23.15	39.56
M:VERB	0	1	9	0.00	0.00	0.00
M:VERB:FORM	0	1	1	0.00	0.00	0.00
M:VERB:TENSE	0	7	14	0.00	0.00	0.00
R:ADJ	3	6	3	33.33	50.00	35.71
R:ADJ:FORM	0	1	2	0.00	0.00	0.00
R:ADV	3	7	3	30.00	50.00	32.61
R:CONJ	0	1	2	0.00	0.00	0.00
R:CONTR	0	2	1	0.00	0.00	0.00
R:DET	1	4	38	20.00	2.56	8.47
R:MORPH	3	12	32	20.00	8.57	15.79
R:NOUN	1	23	23	4.17	4.17	4.17
R:NOUN:NUM	4	15	54	21.05	6.90	14.93
R:NOUN:POSS	0	3	3	0.00	0.00	0.00
R:ORTH	33	50	50	39.76	39.76	39.76
R:OTHER	2	35	194	5.41	1.02	2.91
R:PART	1	0	2	100.00	33.33	71.43
R:PREP	5	25	65	16.67	7.14	13.16
R:PRON	1	5	7	16.67	12.50	15.62
R:PUNCT	0	8	14	0.00	0.00	0.00
R:SPELL	1	1	63	50.00	1.56	6.94
R:VERB	4	27	45	12.90	8.16	11.56
R:VERB:FORM	1	9	51	10.00	1.92	5.43
R:VERB:SVA	2	4	36	33.33	5.26	16.13
R:VERB:TENSE	3	23	43	11.54	6.52	10.00
R:WO	2	1	35	66.67	5.41	20.41
U:ADV	0	2	4	0.00	0.00	0.00
U:CONTR	0	2	1	0.00	0.00	0.00
U:DET	2	3	37	40.00	5.13	16.95
U:NOUN	0	0	3	100.00	0.00	0.00
U:NOUN:POSS	0	0	5	100.00	0.00	0.00
U:OTHER	0	0	11	100.00	0.00	0.00
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	0	2	26	0.00	0.00	0.00
U:PRON	0	1	6	0.00	0.00	0.00
U:PUNCT	1	1	7	50.00	12.50	31.25
U:VERB	0	0	7	100.00	0.00	0.00
U:VERB:FORM	0	1	2	0.00	0.00	0.00
U:VERB:TENSE	0	1	6	0.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	42	65	277	39.25	13.17	28.11
R	107	220	772	32.72	12.17	24.46
U	9	12	117	42.86	7.14	21.43
UNK	1	0	14	100.00	6.67	26.32

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	7	4	46.15	60.00	48.39
ADJ:FORM	0	1	3	0.00	0.00	0.00
ADV	5	11	11	31.25	31.25	31.25
CONJ	0	3	7	0.00	0.00	0.00
CONTR	0	4	2	0.00	0.00	0.00
DET	8	18	161	30.77	4.73	14.65
MORPH	3	10	31	23.08	8.82	17.44
NOUN	1	25	28	3.85	3.45	3.76
NOUN:NUM	2	15	52	11.76	3.70	8.20
NOUN:POSS	0	2	11	0.00	0.00	0.00
ORTH	37	43	52	46.25	41.57	45.23
OTHER	16	32	226	33.33	6.61	18.43
PART	2	0	7	100.00	22.22	58.82
PREP	13	28	114	31.71	10.24	22.34
PRON	4	8	31	33.33	11.43	24.10
PUNCT	33	29	113	53.23	22.60	41.88
SPELL	2	0	63	100.00	3.08	13.70
UNK	1	0	14	100.00	6.67	26.32
VERB	10	20	66	33.33	13.16	25.51
VERB:FORM	3	10	53	23.08	5.36	13.89
VERB:SVA	2	4	36	33.33	5.26	16.13
VERB:TENSE	9	26	61	25.71	12.86	21.43
WO	2	1	34	66.67	5.56	20.83

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	1	1	0.00	0.00	0.00
M:ADV	1	2	3	33.33	25.00	31.25
M:CONJ	0	2	5	0.00	0.00	0.00
M:DET	5	11	86	31.25	5.49	16.13
M:NOUN	0	3	2	0.00	0.00	0.00
M:NOUN:POSS	0	2	4	0.00	0.00	0.00
M:OTHER	0	3	12	0.00	0.00	0.00
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	1	7	27	12.50	3.57	8.33
M:PRON	1	4	18	20.00	5.26	12.82
M:PUNCT	31	23	92	57.41	25.20	45.72
M:VERB	0	1	11	0.00	0.00	0.00
M:VERB:FORM	0	1	1	0.00	0.00	0.00
M:VERB:TENSE	3	5	13	37.50	18.75	31.25
R:ADJ	6	6	3	50.00	66.67	52.63
R:ADJ:FORM	0	1	3	0.00	0.00	0.00
R:ADV	4	7	3	36.36	57.14	39.22
R:CONJ	0	1	2	0.00	0.00	0.00
R:CONTR	0	2	1	0.00	0.00	0.00
R:DET	0	4	39	0.00	0.00	0.00
R:MORPH	3	10	31	23.08	8.82	17.44
R:NOUN	1	22	23	4.35	4.17	4.31
R:NOUN:NUM	2	15	52	11.76	3.70	8.20
R:NOUN:POSS	0	0	2	100.00	0.00	0.00
R:ORTH	37	43	52	46.25	41.57	45.23
R:OTHER	16	29	202	35.56	7.34	20.10
R:PART	1	0	4	100.00	20.00	55.56
R:PREP	11	19	63	36.67	14.86	28.35
R:PRON	1	3	8	25.00	11.11	20.00
R:PUNCT	1	6	11	14.29	8.33	12.50
R:SPELL	2	0	63	100.00	3.08	13.70
R:VERB	9	19	48	32.14	15.79	26.63
R:VERB:FORM	3	8	50	27.27	5.66	15.46
R:VERB:SVA	2	4	36	33.33	5.26	16.13
R:VERB:TENSE	6	20	42	23.08	12.50	19.74
R:WO	2	1	34	66.67	5.56	20.83
U:ADV	0	2	5	0.00	0.00	0.00
U:CONTR	0	2	1	0.00	0.00	0.00
U:DET	3	3	36	50.00	7.69	23.81
U:NOUN	0	0	3	100.00	0.00	0.00
U:NOUN:POSS	0	0	5	100.00	0.00	0.00
U:OTHER	0	0	12	100.00	0.00	0.00
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	1	2	24	33.33	4.00	13.51
U:PRON	2	1	5	66.67	28.57	52.63
U:PUNCT	1	0	10	100.00	9.09	33.33
U:VERB	1	0	7	100.00	12.50	41.67
U:VERB:FORM	0	1	2	0.00	0.00	0.00
U:VERB:TENSE	0	1	6	0.00	0.00	0.00
UNK	1	0	14	100.00	6.67	26.32

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	50	47	314	51.55	13.74	33.24
R	148	198	996	42.77	12.94	29.27
U	19	9	177	67.86	9.69	30.84
UNK	2	0	8	100.00	20.00	55.56

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	6	8	50.00	42.86	48.39
ADJ:FORM	0	1	3	0.00	0.00	0.00
ADV	6	8	17	42.86	26.09	37.97
CONJ	1	2	7	33.33	12.50	25.00
CONTR	2	3	3	40.00	40.00	40.00
DET	9	16	177	36.00	4.84	15.73
MORPH	4	6	33	40.00	10.81	25.97
NOUN	2	24	31	7.69	6.06	7.30
NOUN:NUM	3	12	56	20.00	5.08	12.61
NOUN:POSS	2	0	15	100.00	11.76	40.00
ORTH	41	39	61	51.25	40.20	48.58
OTHER	34	28	389	54.84	8.04	25.34
PART	1	0	6	100.00	14.29	45.45
PREP	20	23	129	46.51	13.42	31.15
PRON	4	6	36	40.00	10.00	25.00
PUNCT	39	25	125	60.94	23.78	46.43
SPELL	2	0	69	100.00	2.82	12.66
UNK	2	0	8	100.00	20.00	55.56
VERB	13	18	88	41.94	12.87	28.89
VERB:FORM	5	7	59	41.67	7.81	22.32
VERB:SVA	2	4	41	33.33	4.65	14.93
VERB:TENSE	13	24	84	35.14	13.40	26.53
WO	8	2	50	80.00	13.79	40.82

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	1	0	0	100.00	100.00	100.00
M:ADV	1	1	8	50.00	11.11	29.41
M:CONJ	0	2	4	0.00	0.00	0.00
M:DET	5	9	90	35.71	5.26	16.56
M:NOUN	1	2	3	33.33	25.00	31.25
M:NOUN:POSS	1	0	5	100.00	16.67	50.00
M:OTHER	1	3	20	25.00	4.76	13.51
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	1	6	29	14.29	3.33	8.62
M:PRON	1	3	19	25.00	5.00	13.89
M:PUNCT	33	17	99	66.00	25.00	49.70
M:VERB	1	1	16	50.00	5.88	20.00
M:VERB:FORM	0	0	2	100.00	0.00	0.00
M:VERB:TENSE	4	3	17	57.14	19.05	40.82
R:ADJ	5	6	8	45.45	38.46	43.86
R:ADJ:FORM	0	1	3	0.00	0.00	0.00
R:ADV	5	5	2	50.00	71.43	53.19
R:CONJ	1	0	3	100.00	25.00	62.50
R:CONTR	2	2	2	50.00	50.00	50.00
R:DET	1	4	45	20.00	2.17	7.58
R:MORPH	4	6	33	40.00	10.81	25.97
R:NOUN	1	22	25	4.35	3.85	4.24
R:NOUN:NUM	3	12	56	20.00	5.08	12.61
R:NOUN:POSS	1	0	3	100.00	25.00	62.50
R:ORTH	41	39	61	51.25	40.20	48.58
R:OTHER	29	25	317	53.70	8.38	25.80
R:PART	0	0	3	100.00	0.00	0.00
R:PREP	14	16	74	46.67	15.91	33.65
R:PRON	1	3	11	25.00	8.33	17.86
R:PUNCT	3	8	16	27.27	15.79	23.81
R:SPELL	2	0	69	100.00	2.82	12.66
R:VERB	11	17	61	39.29	15.28	29.89
R:VERB:FORM	5	6	54	45.45	8.47	24.27
R:VERB:SVA	2	4	41	33.33	4.65	14.93
R:VERB:TENSE	9	20	59	31.03	13.24	24.46
R:WO	8	2	50	80.00	13.79	40.82
U:ADV	0	2	7	0.00	0.00	0.00
U:CONTR	0	1	1	0.00	0.00	0.00
U:DET	3	3	42	50.00	6.67	21.74
U:NOUN	0	0	3	100.00	0.00	0.00
U:NOUN:POSS	0	0	7	100.00	0.00	0.00
U:OTHER	4	0	52	100.00	7.14	27.78
U:PART	1	0	1	100.00	50.00	83.33
U:PREP	5	1	26	83.33	16.13	45.45
U:PRON	2	0	6	100.00	25.00	62.50
U:PUNCT	3	0	10	100.00	23.08	60.00
U:VERB	1	0	11	100.00	8.33	31.25
U:VERB:FORM	0	1	3	0.00	0.00	0.00
U:VERB:TENSE	0	1	8	0.00	0.00	0.00
UNK	2	0	8	100.00	20.00	55.56

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	76	271	422	21.90	15.26	20.15
Span-level detection	98	249	440	28.24	18.22	25.44
Token-level detection	126	235	511	34.90	19.78	30.27

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	21	62	110	25.30	16.03	22.68
R	54	201	264	21.18	16.98	20.18
U	1	8	48	11.11	2.04	5.88

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	6	6	0.00	0.00	0.00
ADJ:FORM	0	2	2	0.00	0.00	0.00
ADV	0	6	3	0.00	0.00	0.00
CONJ	0	0	3	100.00	0.00	0.00
CONTR	0	5	3	0.00	0.00	0.00
DET	2	17	71	10.53	2.74	6.71
MORPH	2	6	15	25.00	11.76	20.41
NOUN	0	17	10	0.00	0.00	0.00
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	6	18	20	25.00	23.08	24.59
NOUN:POSS	0	5	6	0.00	0.00	0.00
ORTH	30	26	19	53.57	61.22	54.95
OTHER	6	25	55	19.35	9.84	16.22
PART	0	1	3	0.00	0.00	0.00
PREP	4	19	50	17.39	7.41	13.70
PRON	0	14	9	0.00	0.00	0.00
PUNCT	20	25	45	44.44	30.77	40.82
SPELL	0	0	36	100.00	0.00	0.00
VERB	1	24	10	4.00	9.09	4.50
VERB:FORM	1	11	11	8.33	8.33	8.33
VERB:SVA	0	4	9	0.00	0.00	0.00
VERB:TENSE	0	39	26	0.00	0.00	0.00
WO	3	1	10	75.00	23.08	51.72

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	1	0.00	0.00	0.00
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	0	0	2	100.00	0.00	0.00
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	2	12	35	14.29	5.41	10.75
M:NOUN	0	1	2	0.00	0.00	0.00
M:NOUN:POSS	0	4	0	0.00	100.00	0.00
M:OTHER	0	3	6	0.00	0.00	0.00
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	0	5	16	0.00	0.00	0.00
M:PRON	0	2	5	0.00	0.00	0.00
M:PUNCT	19	21	35	47.50	35.19	44.39
M:VERB	0	2	3	0.00	0.00	0.00
M:VERB:FORM	0	1	1	0.00	0.00	0.00
M:VERB:TENSE	0	7	3	0.00	0.00	0.00
R:ADJ	0	4	4	0.00	0.00	0.00
R:ADJ:FORM	0	2	2	0.00	0.00	0.00
R:ADV	0	6	1	0.00	0.00	0.00
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	0	2	1	0.00	0.00	0.00
R:DET	0	4	9	0.00	0.00	0.00
R:MORPH	2	6	15	25.00	11.76	20.41
R:NOUN	0	15	8	0.00	0.00	0.00
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	6	18	20	25.00	23.08	24.59
R:NOUN:POSS	0	1	5	0.00	0.00	0.00
R:ORTH	30	26	19	53.57	61.22	54.95
R:OTHER	6	22	48	21.43	11.11	18.07
R:PART	0	0	2	100.00	0.00	0.00
R:PREP	4	12	27	25.00	12.90	21.05
R:PRON	0	12	3	0.00	0.00	0.00
R:PUNCT	0	3	8	0.00	0.00	0.00
R:SPELL	0	0	36	100.00	0.00	0.00
R:VERB	1	22	6	4.35	14.29	5.05
R:VERB:FORM	1	10	10	9.09	9.09	9.09
R:VERB:SVA	0	4	9	0.00	0.00	0.00
R:VERB:TENSE	0	31	20	0.00	0.00	0.00
R:WO	3	1	10	75.00	23.08	51.72
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	0	1	100.00	0.00	0.00
U:CONTR	0	2	2	0.00	0.00	0.00
U:DET	0	1	27	0.00	0.00	0.00
U:NOUN	0	1	0	0.00	100.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	0	0	1	100.00	0.00	0.00
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	0	2	7	0.00	0.00	0.00
U:PRON	0	0	1	100.00	0.00	0.00
U:PUNCT	1	1	2	50.00	33.33	45.45
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	0	1	3	0.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	24	59	119	28.92	16.78	25.26
R	70	183	267	27.67	20.77	25.95
U	3	7	51	30.00	5.56	15.96
UNK	1	0	3	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	5	6	16.67	14.29	16.13
ADJ:FORM	0	2	2	0.00	0.00	0.00
ADV	0	5	3	0.00	0.00	0.00
CONJ	0	0	3	100.00	0.00	0.00
CONTR	0	5	3	0.00	0.00	0.00
DET	4	16	75	20.00	5.06	12.58
MORPH	3	6	15	33.33	16.67	27.78
NOUN	1	16	12	5.88	7.69	6.17
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	7	18	20	28.00	25.93	27.56
NOUN:POSS	0	5	6	0.00	0.00	0.00
ORTH	31	21	20	59.62	60.78	59.85
OTHER	12	22	55	35.29	17.91	29.56
PART	0	1	3	0.00	0.00	0.00
PREP	5	17	49	22.73	9.26	17.61
PRON	0	13	9	0.00	0.00	0.00
PUNCT	22	24	52	47.83	29.73	42.64
SPELL	0	0	36	100.00	0.00	0.00
UNK	1	0	3	100.00	25.00	62.50
VERB	3	22	12	12.00	20.00	13.04
VERB:FORM	2	8	12	20.00	14.29	18.52
VERB:SVA	1	4	8	20.00	11.11	17.24
VERB:TENSE	1	38	27	2.56	3.57	2.72
WO	3	1	9	75.00	25.00	53.57

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	1	0.00	0.00	0.00
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	0	0	2	100.00	0.00	0.00
M:CONTR	0	1	0	0.00	100.00	0.00
M:DET	2	12	36	14.29	5.26	10.64
M:NOUN	0	1	3	0.00	0.00	0.00
M:NOUN:POSS	0	4	0	0.00	100.00	0.00
M:OTHER	0	3	7	0.00	0.00	0.00
M:PART	0	1	1	0.00	0.00	0.00
M:PREP	1	4	16	20.00	5.88	13.51
M:PRON	0	2	5	0.00	0.00	0.00
M:PUNCT	21	20	39	51.22	35.00	46.87
M:VERB	0	1	3	0.00	0.00	0.00
M:VERB:FORM	0	1	1	0.00	0.00	0.00
M:VERB:TENSE	0	7	4	0.00	0.00	0.00
R:ADJ	1	3	4	25.00	20.00	23.81
R:ADJ:FORM	0	2	2	0.00	0.00	0.00
R:ADV	0	5	1	0.00	0.00	0.00
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	0	2	1	0.00	0.00	0.00
R:DET	0	3	9	0.00	0.00	0.00
R:MORPH	3	6	15	33.33	16.67	27.78
R:NOUN	1	14	9	6.67	10.00	7.14
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	7	18	20	28.00	25.93	27.56
R:NOUN:POSS	0	1	5	0.00	0.00	0.00
R:ORTH	31	21	20	59.62	60.78	59.85
R:OTHER	12	19	47	38.71	20.34	32.79
R:PART	0	0	2	100.00	0.00	0.00
R:PREP	4	12	26	25.00	13.33	21.28
R:PRON	0	11	3	0.00	0.00	0.00
R:PUNCT	0	3	10	0.00	0.00	0.00
R:SPELL	0	0	36	100.00	0.00	0.00
R:VERB	3	21	8	12.50	27.27	14.02
R:VERB:FORM	2	7	11	22.22	15.38	20.41
R:VERB:SVA	1	4	8	20.00	11.11	17.24
R:VERB:TENSE	1	30	20	3.23	4.76	3.45
R:WO	3	1	9	75.00	25.00	53.57
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	0	1	100.00	0.00	0.00
U:CONTR	0	2	2	0.00	0.00	0.00
U:DET	2	1	30	66.67	6.25	22.73
U:NOUN	0	1	0	0.00	100.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	0	0	1	100.00	0.00	0.00
U:PREP	0	1	7	0.00	0.00	0.00
U:PRON	0	0	1	100.00	0.00	0.00
U:PUNCT	1	1	3	50.00	25.00	41.67
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	0	1	3	0.00	0.00	0.00
UNK	1	0	3	100.00	25.00	62.50

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	28	52	131	35.00	17.61	29.23
R	89	176	315	33.58	22.03	30.40
U	7	7	61	50.00	10.29	28.23
UNK	2	0	4	100.00	33.33	71.43

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	4	7	20.00	12.50	17.86
ADJ:FORM	0	2	3	0.00	0.00	0.00
ADV	0	4	4	0.00	0.00	0.00
CONJ	0	0	3	100.00	0.00	0.00
CONTR	0	4	4	0.00	0.00	0.00
DET	4	15	78	21.05	4.88	12.66
MORPH	3	6	16	33.33	15.79	27.27
NOUN	2	15	16	11.76	11.11	11.63
NOUN:INFL	1	0	0	100.00	100.00	100.00
NOUN:NUM	7	18	24	28.00	22.58	26.72
NOUN:POSS	0	3	8	0.00	0.00	0.00
ORTH	36	18	21	66.67	63.16	65.93
OTHER	18	25	78	41.86	18.75	33.58
PART	0	1	3	0.00	0.00	0.00
PREP	5	17	52	22.73	8.77	17.24
PRON	1	12	9	7.69	10.00	8.06
PUNCT	27	22	58	55.10	31.76	48.04
SPELL	0	0	37	100.00	0.00	0.00
UNK	2	0	4	100.00	33.33	71.43
VERB	4	17	13	19.05	23.53	19.80
VERB:FORM	2	8	13	20.00	13.33	18.18
VERB:SVA	2	4	9	33.33	18.18	28.57
VERB:TENSE	3	38	34	7.32	8.11	7.46
WO	8	2	17	80.00	32.00	61.54

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	2	2	0.00	0.00	0.00
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	0	0	2	100.00	0.00	0.00
M:DET	3	11	37	21.43	7.50	15.62
M:NOUN	0	1	3	0.00	0.00	0.00
M:NOUN:POSS	0	3	0	0.00	100.00	0.00
M:OTHER	0	3	9	0.00	0.00	0.00
M:PART	0	1	1	0.00	0.00	0.00
M:PREP	1	4	16	20.00	5.88	13.51
M:PRON	0	1	5	0.00	0.00	0.00
M:PUNCT	23	18	45	56.10	33.82	49.57
M:VERB	0	1	4	0.00	0.00	0.00
M:VERB:FORM	0	1	1	0.00	0.00	0.00
M:VERB:TENSE	1	6	5	14.29	16.67	14.71
R:ADJ	1	2	3	33.33	25.00	31.25
R:ADJ:FORM	0	2	3	0.00	0.00	0.00
R:ADV	0	4	2	0.00	0.00	0.00
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	0	2	1	0.00	0.00	0.00
R:DET	0	3	10	0.00	0.00	0.00
R:MORPH	3	6	16	33.33	15.79	27.27
R:NOUN	1	13	11	7.14	8.33	7.35
R:NOUN:INFL	1	0	0	100.00	100.00	100.00
R:NOUN:NUM	7	18	24	28.00	22.58	26.72
R:NOUN:POSS	0	0	7	100.00	0.00	0.00
R:ORTH	36	18	21	66.67	63.16	65.93
R:OTHER	16	22	65	42.11	19.75	34.33
R:PART	0	0	2	100.00	0.00	0.00
R:PREP	4	12	28	25.00	12.50	20.83
R:PRON	0	11	3	0.00	0.00	0.00
R:PUNCT	2	3	10	40.00	16.67	31.25
R:SPELL	0	0	37	100.00	0.00	0.00
R:VERB	4	16	8	20.00	33.33	21.74
R:VERB:FORM	2	7	12	22.22	14.29	20.00
R:VERB:SVA	2	4	9	33.33	18.18	28.57
R:VERB:TENSE	2	31	25	6.06	7.41	6.29
R:WO	8	2	17	80.00	32.00	61.54
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	0	0	1	100.00	0.00	0.00
U:CONTR	0	2	3	0.00	0.00	0.00
U:DET	1	1	31	50.00	3.12	12.50
U:NOUN	1	1	2	50.00	33.33	45.45
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	2	0	4	100.00	33.33	71.43
U:PREP	0	1	8	0.00	0.00	0.00
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	2	1	3	66.67	40.00	58.82
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	0	1	4	0.00	0.00	0.00
UNK	2	0	4	100.00	33.33	71.43

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	69	293	333	19.06	17.16	18.65
Span-level detection	84	278	347	23.20	19.49	22.35
Token-level detection	113	265	393	29.89	22.33	28.00

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	19	68	43	21.84	30.65	23.17
R	49	220	274	18.22	15.17	17.51
U	1	5	16	16.67	5.88	12.20

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	15	3	6.25	25.00	7.35
ADV	2	3	0	40.00	100.00	45.45
CONJ	0	3	0	0.00	100.00	0.00
CONTR	1	2	0	33.33	100.00	38.46
DET	1	19	8	5.00	11.11	5.62
MORPH	0	5	4	0.00	0.00	0.00
NOUN	2	21	8	8.70	20.00	9.80
NOUN:INFL	0	0	11	100.00	0.00	0.00
NOUN:NUM	0	13	14	0.00	0.00	0.00
NOUN:POSS	5	7	12	41.67	29.41	38.46
ORTH	24	56	45	30.00	34.78	30.85
OTHER	4	22	47	15.38	7.84	12.90
PART	0	1	1	0.00	0.00	0.00
PREP	1	31	11	3.12	8.33	3.57
PRON	1	7	4	12.50	20.00	13.51
PUNCT	19	22	47	46.34	28.79	41.30
SPELL	1	0	88	100.00	1.12	5.38
VERB	3	27	9	10.00	25.00	11.36
VERB:FORM	2	13	4	13.33	33.33	15.15
VERB:INFL	2	0	3	100.00	40.00	76.92
VERB:SVA	0	4	6	0.00	0.00	0.00
VERB:TENSE	0	18	7	0.00	0.00	0.00
WO	0	4	1	0.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	3	0	0.00	100.00	0.00
M:ADV	0	3	0	0.00	100.00	0.00
M:CONJ	0	2	0	0.00	100.00	0.00
M:DET	0	11	3	0.00	0.00	0.00
M:NOUN	0	5	2	0.00	0.00	0.00
M:NOUN:POSS	0	2	5	0.00	0.00	0.00
M:OTHER	0	5	0	0.00	100.00	0.00
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	0	8	0	0.00	100.00	0.00
M:PRON	0	4	2	0.00	0.00	0.00
M:PUNCT	19	17	28	52.78	40.43	49.74
M:VERB	0	4	3	0.00	0.00	0.00
M:VERB:TENSE	0	3	0	0.00	100.00	0.00
R:ADJ	1	12	3	7.69	25.00	8.93
R:ADV	2	0	0	100.00	100.00	100.00
R:CONJ	0	1	0	0.00	100.00	0.00
R:CONTR	1	2	0	33.33	100.00	38.46
R:DET	0	4	2	0.00	0.00	0.00
R:MORPH	0	5	4	0.00	0.00	0.00
R:NOUN	2	16	6	11.11	25.00	12.50
R:NOUN:INFL	0	0	11	100.00	0.00	0.00
R:NOUN:NUM	0	13	14	0.00	0.00	0.00
R:NOUN:POSS	5	5	7	50.00	41.67	48.08
R:ORTH	24	56	45	30.00	34.78	30.85
R:OTHER	4	17	47	19.05	7.84	14.81
R:PREP	1	23	10	4.17	9.09	4.67
R:PRON	1	3	2	25.00	33.33	26.32
R:PUNCT	0	5	11	0.00	0.00	0.00
R:SPELL	1	0	88	100.00	1.12	5.38
R:VERB	3	22	5	12.00	37.50	13.89
R:VERB:FORM	2	13	4	13.33	33.33	15.15
R:VERB:INFL	2	0	3	100.00	40.00	76.92
R:VERB:SVA	0	4	6	0.00	0.00	0.00
R:VERB:TENSE	0	15	5	0.00	0.00	0.00
R:WO	0	4	1	0.00	0.00	0.00
U:DET	1	4	3	20.00	25.00	20.83
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	0	0	1	100.00	0.00	0.00
U:PUNCT	0	0	8	100.00	0.00	0.00
U:VERB	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	0	0	2	100.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	22	65	49	25.29	30.99	26.25
R	59	208	281	22.10	17.35	20.95
U	2	5	15	28.57	11.76	22.22
UNK	1	0	2	100.00	33.33	71.43

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	14	3	12.50	40.00	14.49
ADV	2	3	0	40.00	100.00	45.45
CONJ	0	2	0	0.00	100.00	0.00
CONTR	1	2	0	33.33	100.00	38.46
DET	3	17	7	15.00	30.00	16.67
MORPH	0	5	4	0.00	0.00	0.00
NOUN	5	21	8	19.23	38.46	21.37
NOUN:INFL	0	0	11	100.00	0.00	0.00
NOUN:NUM	1	12	13	7.69	7.14	7.58
NOUN:POSS	5	4	12	55.56	29.41	47.17
ORTH	24	53	49	31.17	32.88	31.50
OTHER	5	19	49	20.83	9.26	16.67
PART	0	1	1	0.00	0.00	0.00
PREP	2	30	12	6.25	14.29	7.04
PRON	1	7	4	12.50	20.00	13.51
PUNCT	22	21	52	51.16	29.73	44.72
SPELL	3	0	88	100.00	3.30	14.56
UNK	1	0	2	100.00	33.33	71.43
VERB	3	27	12	10.00	20.00	11.11
VERB:FORM	1	14	4	6.67	20.00	7.69
VERB:INFL	2	0	3	100.00	40.00	76.92
VERB:SVA	1	4	6	20.00	14.29	18.52
VERB:TENSE	0	18	7	0.00	0.00	0.00
WO	0	4	0	0.00	100.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	3	0	0.00	100.00	0.00
M:ADV	0	3	0	0.00	100.00	0.00
M:CONJ	0	1	0	0.00	100.00	0.00
M:DET	1	10	3	9.09	25.00	10.42
M:NOUN	0	5	2	0.00	0.00	0.00
M:NOUN:POSS	0	2	5	0.00	0.00	0.00
M:OTHER	0	4	1	0.00	0.00	0.00
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	0	8	0	0.00	100.00	0.00
M:PRON	0	4	2	0.00	0.00	0.00
M:PUNCT	21	17	32	55.26	39.62	51.22
M:VERB	0	4	4	0.00	0.00	0.00
M:VERB:TENSE	0	3	0	0.00	100.00	0.00
R:ADJ	2	11	3	15.38	40.00	17.54
R:ADV	2	0	0	100.00	100.00	100.00
R:CONJ	0	1	0	0.00	100.00	0.00
R:CONTR	1	2	0	33.33	100.00	38.46
R:DET	0	3	2	0.00	0.00	0.00
R:MORPH	0	5	4	0.00	0.00	0.00
R:NOUN	5	16	6	23.81	45.45	26.32
R:NOUN:INFL	0	0	11	100.00	0.00	0.00
R:NOUN:NUM	1	12	13	7.69	7.14	7.58
R:NOUN:POSS	5	2	7	71.43	41.67	62.50
R:ORTH	24	53	49	31.17	32.88	31.50
R:OTHER	5	15	48	25.00	9.43	18.80
R:PREP	2	22	11	8.33	15.38	9.17
R:PRON	1	3	2	25.00	33.33	26.32
R:PUNCT	1	4	13	20.00	7.14	14.71
R:SPELL	3	0	88	100.00	3.30	14.56
R:VERB	3	22	6	12.00	33.33	13.76
R:VERB:FORM	1	14	4	6.67	20.00	7.69
R:VERB:INFL	2	0	3	100.00	40.00	76.92
R:VERB:SVA	1	4	6	20.00	14.29	18.52
R:VERB:TENSE	0	15	5	0.00	0.00	0.00
R:WO	0	4	0	0.00	100.00	0.00
U:DET	2	4	2	33.33	50.00	35.71
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	0	0	1	100.00	0.00	0.00
U:PUNCT	0	0	7	100.00	0.00	0.00
U:VERB	0	1	2	0.00	0.00	0.00
U:VERB:TENSE	0	0	2	100.00	0.00	0.00
UNK	1	0	2	100.00	33.33	71.43

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	34	61	51	35.79	40.00	36.56
R	75	200	323	27.27	18.84	25.03
U	3	4	17	42.86	15.00	31.25
UNK	1	0	2	100.00	33.33	71.43

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	14	4	12.50	33.33	14.29
ADV	2	3	0	40.00	100.00	45.45
CONJ	0	2	0	0.00	100.00	0.00
CONTR	1	2	2	33.33	33.33	33.33
DET	4	16	8	20.00	33.33	21.74
MORPH	0	4	6	0.00	0.00	0.00
NOUN	7	17	10	29.17	41.18	30.97
NOUN:INFL	0	0	11	100.00	0.00	0.00
NOUN:NUM	1	9	15	10.00	6.25	8.93
NOUN:POSS	6	2	15	75.00	28.57	56.60
ORTH	28	51	58	35.44	32.56	34.83
OTHER	14	21	65	40.00	17.72	31.96
PART	0	1	1	0.00	0.00	0.00
PREP	4	30	11	11.76	26.67	13.25
PRON	1	5	5	16.67	16.67	16.67
PUNCT	31	20	57	60.78	35.23	53.08
SPELL	3	0	88	100.00	3.30	14.56
UNK	1	0	2	100.00	33.33	71.43
VERB	4	28	13	12.50	23.53	13.79
VERB:FORM	1	13	4	7.14	20.00	8.20
VERB:INFL	2	0	3	100.00	40.00	76.92
VERB:SVA	1	4	6	20.00	14.29	18.52
VERB:TENSE	0	18	9	0.00	0.00	0.00
WO	0	5	0	0.00	100.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	3	0	0.00	100.00	0.00
M:ADV	0	3	0	0.00	100.00	0.00
M:CONJ	0	1	0	0.00	100.00	0.00
M:DET	2	10	3	16.67	40.00	18.87
M:NOUN	1	5	2	16.67	33.33	18.52
M:NOUN:POSS	0	2	5	0.00	0.00	0.00
M:OTHER	0	3	1	0.00	0.00	0.00
M:PART	0	1	0	0.00	100.00	0.00
M:PREP	1	8	0	11.11	100.00	13.51
M:PRON	0	3	3	0.00	0.00	0.00
M:PUNCT	29	15	33	65.91	46.77	60.92
M:VERB	1	4	4	20.00	20.00	20.00
M:VERB:TENSE	0	3	0	0.00	100.00	0.00
R:ADJ	2	11	3	15.38	40.00	17.54
R:ADV	2	0	0	100.00	100.00	100.00
R:CONJ	0	1	0	0.00	100.00	0.00
R:CONTR	1	2	2	33.33	33.33	33.33
R:DET	0	3	3	0.00	0.00	0.00
R:MORPH	0	4	6	0.00	0.00	0.00
R:NOUN	6	12	8	33.33	42.86	34.88
R:NOUN:INFL	0	0	11	100.00	0.00	0.00
R:NOUN:NUM	1	9	15	10.00	6.25	8.93
R:NOUN:POSS	6	0	10	100.00	37.50	75.00
R:ORTH	28	51	58	35.44	32.56	34.83
R:OTHER	13	18	63	41.94	17.11	32.50
R:PREP	3	22	10	12.00	23.08	13.27
R:PRON	1	2	2	33.33	33.33	33.33
R:PUNCT	2	5	17	28.57	10.53	21.28
R:SPELL	3	0	88	100.00	3.30	14.56
R:VERB	3	23	7	11.54	30.00	13.16
R:VERB:FORM	1	13	4	7.14	20.00	8.20
R:VERB:INFL	2	0	3	100.00	40.00	76.92
R:VERB:SVA	1	4	6	20.00	14.29	18.52
R:VERB:TENSE	0	15	7	0.00	0.00	0.00
R:WO	0	5	0	0.00	100.00	0.00
U:ADJ	0	0	1	100.00	0.00	0.00
U:DET	2	3	2	40.00	50.00	41.67
U:OTHER	1	0	1	100.00	50.00	83.33
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	0	0	1	100.00	0.00	0.00
U:PUNCT	0	0	7	100.00	0.00	0.00
U:VERB	0	1	2	0.00	0.00	0.00
U:VERB:TENSE	0	0	2	100.00	0.00	0.00
UNK	1	0	2	100.00	33.33	71.43

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:47:21+00:00
Competition submission:	1
Competition phase:	3 - Open phase

Detailed results

Submission information

Results