BEA 2019 Shared Task: Grammatical Error Correction

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	1819	1044	3047	63.53	37.38	55.74
Span-level detection	2112	755	2977	73.67	41.50	63.78
Token-level detection	2556	622	3505	80.43	42.17	68.08

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	634	248	676	71.88	48.40	65.52
R	1040	706	2057	59.56	33.58	51.58
U	145	90	314	61.70	31.59	51.82

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	6	12	28	33.33	17.65	28.30
ADJ:FORM	4	1	6	80.00	40.00	66.67
ADV	0	0	46	100.00	0.00	0.00
CONJ	0	2	20	0.00	0.00	0.00
CONTR	3	0	8	100.00	27.27	65.22
DET	197	88	372	69.12	34.62	57.64
MORPH	30	9	106	76.92	22.06	51.37
NOUN	4	11	95	26.67	4.04	12.58
NOUN:INFL	0	0	19	100.00	0.00	0.00
NOUN:NUM	101	47	119	68.24	45.91	62.19
NOUN:POSS	5	9	40	35.71	11.11	24.75
ORTH	207	180	185	53.49	52.81	53.35
OTHER	27	25	659	51.92	3.94	15.10
PART	10	8	16	55.56	38.46	51.02
PREP	121	90	271	57.35	30.87	48.95
PRON	25	17	95	59.52	20.83	43.40
PUNCT	564	269	325	67.71	63.44	66.81
SPELL	200	96	113	67.57	63.90	66.80
VERB	13	14	183	48.15	6.63	21.38
VERB:FORM	112	66	72	62.92	60.87	62.50
VERB:INFL	0	0	7	100.00	0.00	0.00
VERB:SVA	100	40	46	71.43	68.49	70.82
VERB:TENSE	81	56	155	59.12	34.32	51.66
WO	9	4	61	69.23	12.86	36.89

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	0	0	14	100.00	0.00	0.00
M:CONJ	0	0	10	100.00	0.00	0.00
M:DET	91	38	168	70.54	35.14	58.71
M:NOUN	0	0	7	100.00	0.00	0.00
M:NOUN:POSS	5	4	8	55.56	38.46	51.02
M:OTHER	0	2	51	0.00	0.00	0.00
M:PART	0	0	4	100.00	0.00	0.00
M:PREP	19	21	73	47.50	20.65	37.70
M:PRON	14	12	48	53.85	22.58	42.17
M:PUNCT	482	159	224	75.20	68.27	73.70
M:VERB	4	4	29	50.00	12.12	30.77
M:VERB:FORM	14	3	2	82.35	87.50	83.33
M:VERB:TENSE	5	5	36	50.00	12.20	30.86
R:ADJ	6	12	22	33.33	21.43	30.00
R:ADJ:FORM	4	1	6	80.00	40.00	66.67
R:ADV	0	0	17	100.00	0.00	0.00
R:CONJ	0	0	5	100.00	0.00	0.00
R:CONTR	2	0	2	100.00	50.00	83.33
R:DET	4	0	92	100.00	4.17	17.86
R:MORPH	30	9	106	76.92	22.06	51.37
R:NOUN	4	9	76	30.77	5.00	15.15
R:NOUN:INFL	0	0	19	100.00	0.00	0.00
R:NOUN:NUM	101	47	119	68.24	45.91	62.19
R:NOUN:POSS	0	5	25	0.00	0.00	0.00
R:ORTH	207	180	185	53.49	52.81	53.35
R:OTHER	27	23	592	54.00	4.36	16.48
R:PART	9	7	7	56.25	56.25	56.25
R:PREP	89	49	147	64.49	37.71	56.47
R:PRON	5	4	31	55.56	13.89	34.72
R:PUNCT	72	104	63	40.91	53.33	42.91
R:SPELL	200	96	113	67.57	63.90	66.80
R:VERB	9	10	138	47.37	6.12	20.18
R:VERB:FORM	96	60	67	61.54	58.90	60.99
R:VERB:INFL	0	0	7	100.00	0.00	0.00
R:VERB:SVA	100	40	46	71.43	68.49	70.82
R:VERB:TENSE	66	46	111	58.93	37.29	52.80
R:WO	9	4	61	69.23	12.86	36.89
U:ADJ	0	0	4	100.00	0.00	0.00
U:ADV	0	0	15	100.00	0.00	0.00
U:CONJ	0	2	5	0.00	0.00	0.00
U:CONTR	1	0	6	100.00	14.29	45.45
U:DET	102	50	112	67.11	47.66	62.04
U:NOUN	0	2	12	0.00	0.00	0.00
U:NOUN:POSS	0	0	7	100.00	0.00	0.00
U:OTHER	0	0	16	100.00	0.00	0.00
U:PART	1	1	5	50.00	16.67	35.71
U:PREP	13	20	51	39.39	20.31	33.16
U:PRON	6	1	16	85.71	27.27	60.00
U:PUNCT	10	6	38	62.50	20.83	44.64
U:VERB	0	0	16	100.00	0.00	0.00
U:VERB:FORM	2	3	3	40.00	40.00	40.00
U:VERB:TENSE	10	5	8	66.67	55.56	64.10

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	671	208	660	76.34	50.41	69.22
R	1267	473	1936	72.82	39.56	62.33
U	167	74	310	69.29	35.01	57.95
UNK	7	0	71	100.00	8.97	33.02

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	10	9	29	52.63	25.64	43.48
ADJ:FORM	3	1	7	75.00	30.00	57.69
ADV	3	0	43	100.00	6.52	25.86
CONJ	3	1	22	75.00	12.00	36.59
CONTR	3	0	8	100.00	27.27	65.22
DET	212	75	356	73.87	37.32	61.77
MORPH	35	6	104	85.37	25.18	57.76
NOUN	16	7	94	69.57	14.55	39.60
NOUN:INFL	1	0	18	100.00	5.26	21.74
NOUN:NUM	95	32	116	74.80	45.02	66.06
NOUN:POSS	9	5	36	64.29	20.00	44.55
ORTH	238	142	173	62.63	57.91	61.63
OTHER	134	13	628	91.16	17.59	49.63
PART	12	8	15	60.00	44.44	56.07
PREP	138	69	273	66.67	33.58	55.69
PRON	31	11	85	73.81	26.72	54.58
PUNCT	576	235	323	71.02	64.07	69.51
SPELL	238	12	74	95.20	76.28	90.70
UNK	7	0	71	100.00	8.97	33.02
VERB	35	12	179	74.47	16.36	43.53
VERB:FORM	116	48	64	70.73	64.44	69.38
VERB:INFL	1	0	6	100.00	14.29	45.45
VERB:SVA	99	29	47	77.34	67.81	75.23
VERB:TENSE	89	37	148	70.63	37.55	60.05
WO	8	3	58	72.73	12.12	36.36

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	5	100.00	0.00	0.00
M:ADV	2	0	11	100.00	15.38	47.62
M:CONJ	2	0	11	100.00	15.38	47.62
M:DET	99	32	154	75.57	39.13	63.71
M:NOUN	3	0	9	100.00	25.00	62.50
M:NOUN:POSS	5	3	7	62.50	41.67	56.82
M:OTHER	13	2	48	86.67	21.31	53.72
M:PART	0	0	4	100.00	0.00	0.00
M:PREP	23	17	75	57.50	23.47	44.57
M:PRON	15	8	44	65.22	25.42	49.67
M:PUNCT	485	138	230	77.85	67.83	75.62
M:VERB	4	4	27	50.00	12.90	31.75
M:VERB:FORM	13	3	1	81.25	92.86	83.33
M:VERB:TENSE	7	1	34	87.50	17.07	47.95
R:ADJ	9	9	20	50.00	31.03	44.55
R:ADJ:FORM	3	1	7	75.00	30.00	57.69
R:ADV	0	0	18	100.00	0.00	0.00
R:CONJ	1	0	6	100.00	14.29	45.45
R:CONTR	2	0	2	100.00	50.00	83.33
R:DET	8	0	92	100.00	8.00	30.30
R:MORPH	35	6	104	85.37	25.18	57.76
R:NOUN	12	6	73	66.67	14.12	38.22
R:NOUN:INFL	1	0	18	100.00	5.26	21.74
R:NOUN:NUM	95	32	116	74.80	45.02	66.06
R:NOUN:POSS	1	2	23	33.33	4.17	13.89
R:ORTH	238	142	173	62.63	57.91	61.63
R:OTHER	121	11	556	91.67	17.87	50.21
R:PART	11	7	7	61.11	61.11	61.11
R:PREP	103	35	148	74.64	41.04	64.13
R:PRON	7	2	28	77.78	20.00	49.30
R:PUNCT	78	92	60	45.88	56.52	47.68
R:SPELL	238	12	74	95.20	76.28	90.70
R:VERB	27	8	135	77.14	16.67	44.70
R:VERB:FORM	101	43	60	70.14	62.73	68.52
R:VERB:INFL	1	0	6	100.00	14.29	45.45
R:VERB:SVA	99	29	47	77.34	67.81	75.23
R:VERB:TENSE	68	33	105	67.33	39.31	58.93
R:WO	8	3	58	72.73	12.12	36.36
U:ADJ	1	0	4	100.00	20.00	55.56
U:ADV	1	0	14	100.00	6.67	26.32
U:CONJ	0	1	5	0.00	0.00	0.00
U:CONTR	1	0	6	100.00	14.29	45.45
U:DET	105	43	110	70.95	48.84	65.06
U:NOUN	1	1	12	50.00	7.69	23.81
U:NOUN:POSS	3	0	6	100.00	33.33	71.43
U:OTHER	0	0	24	100.00	0.00	0.00
U:PART	1	1	4	50.00	20.00	38.46
U:PREP	12	17	50	41.38	19.35	33.71
U:PRON	9	1	13	90.00	40.91	72.58
U:PUNCT	13	5	33	72.22	28.26	55.08
U:VERB	4	0	17	100.00	19.05	54.05
U:VERB:FORM	2	2	3	50.00	40.00	47.62
U:VERB:TENSE	14	3	9	82.35	60.87	76.92
UNK	7	0	71	100.00	8.97	33.02

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	749	144	752	83.87	49.90	73.82
R	1587	417	2264	79.19	41.21	66.87
U	212	61	408	77.66	34.19	61.92
UNK	8	0	81	100.00	8.99	33.06

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	9	8	36	52.94	20.00	39.82
ADJ:FORM	4	1	9	80.00	30.77	60.61
ADV	9	0	63	100.00	12.50	41.67
CONJ	8	1	21	88.89	27.59	61.54
CONTR	3	0	13	100.00	18.75	53.57
DET	247	60	382	80.46	39.27	66.51
MORPH	37	3	110	92.50	25.17	60.26
NOUN	23	3	114	88.46	16.79	47.72
NOUN:INFL	1	0	19	100.00	5.00	20.83
NOUN:NUM	97	24	128	80.17	43.11	68.41
NOUN:POSS	12	4	49	75.00	19.67	48.00
ORTH	308	129	196	70.48	61.11	68.38
OTHER	265	11	794	96.01	25.02	61.26
PART	9	7	13	56.25	40.91	52.33
PREP	149	55	289	73.04	34.02	59.41
PRON	49	7	88	87.50	35.77	67.87
PUNCT	670	193	357	77.64	65.24	74.79
SPELL	239	7	75	97.15	76.11	92.06
UNK	8	0	81	100.00	8.99	33.06
VERB	48	12	224	80.00	17.65	46.88
VERB:FORM	120	38	78	75.95	60.61	72.29
VERB:INFL	1	0	6	100.00	14.29	45.45
VERB:SVA	103	22	48	82.40	68.21	79.11
VERB:TENSE	105	32	207	76.64	33.65	61.05
WO	32	5	105	86.49	23.36	56.14

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	6	100.00	0.00	0.00
M:ADV	5	0	16	100.00	23.81	60.98
M:CONJ	7	0	13	100.00	35.00	72.92
M:DET	106	20	169	84.13	38.55	68.04
M:NOUN	4	0	14	100.00	22.22	58.82
M:NOUN:POSS	7	1	9	87.50	43.75	72.92
M:OTHER	16	2	60	88.89	21.05	54.05
M:PART	0	0	4	100.00	0.00	0.00
M:PREP	32	9	75	78.05	29.91	59.04
M:PRON	30	6	42	83.33	41.67	69.44
M:PUNCT	515	100	255	83.74	66.88	79.72
M:VERB	5	5	45	50.00	10.00	27.78
M:VERB:FORM	13	0	5	100.00	72.22	92.86
M:VERB:TENSE	9	1	39	90.00	18.75	51.14
R:ADJ	9	8	23	52.94	28.12	45.00
R:ADJ:FORM	4	1	9	80.00	30.77	60.61
R:ADV	1	0	22	100.00	4.35	18.52
R:CONJ	0	0	6	100.00	0.00	0.00
R:CONTR	2	0	5	100.00	28.57	66.67
R:DET	19	0	92	100.00	17.12	50.80
R:MORPH	37	3	110	92.50	25.17	60.26
R:NOUN	17	3	84	85.00	16.83	46.96
R:NOUN:INFL	1	0	19	100.00	5.00	20.83
R:NOUN:NUM	97	24	128	80.17	43.11	68.41
R:NOUN:POSS	3	3	29	50.00	9.38	26.79
R:ORTH	308	129	196	70.48	61.11	68.38
R:OTHER	241	9	674	96.40	26.34	62.92
R:PART	8	6	5	57.14	61.54	57.97
R:PREP	102	33	160	75.56	38.93	63.59
R:PRON	8	1	31	88.89	20.51	53.33
R:PUNCT	127	90	66	58.53	65.80	59.85
R:SPELL	239	7	75	97.15	76.11	92.06
R:VERB	37	7	149	84.09	19.89	51.10
R:VERB:FORM	105	37	69	73.94	60.34	70.75
R:VERB:INFL	1	0	6	100.00	14.29	45.45
R:VERB:SVA	103	22	48	82.40	68.21	79.11
R:VERB:TENSE	86	29	153	74.78	35.98	61.52
R:WO	32	5	105	86.49	23.36	56.14
U:ADJ	0	0	7	100.00	0.00	0.00
U:ADV	3	0	25	100.00	10.71	37.50
U:CONJ	1	1	2	50.00	33.33	45.45
U:CONTR	1	0	8	100.00	11.11	38.46
U:DET	122	40	121	75.31	50.21	68.46
U:NOUN	2	0	16	100.00	11.11	38.46
U:NOUN:POSS	2	0	11	100.00	15.38	47.62
U:OTHER	8	0	60	100.00	11.76	40.00
U:PART	1	1	4	50.00	20.00	38.46
U:PREP	15	13	54	53.57	21.74	41.44
U:PRON	11	0	15	100.00	42.31	78.57
U:PUNCT	28	3	36	90.32	43.75	74.47
U:VERB	6	0	30	100.00	16.67	50.00
U:VERB:FORM	2	1	4	66.67	33.33	55.56
U:VERB:TENSE	10	2	15	83.33	40.00	68.49
UNK	8	0	81	100.00	8.99	33.06

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	780	386	1404	66.90	35.71	56.95
Span-level detection	919	249	1366	78.68	40.22	66.05
Token-level detection	1139	170	1604	87.01	41.52	71.37

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	225	105	298	68.18	43.02	61.04
R	492	252	954	66.13	34.02	55.63
U	63	29	152	68.48	29.30	54.03

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	1	10	50.00	9.09	26.32
ADJ:FORM	1	0	4	100.00	20.00	55.56
ADV	0	0	26	100.00	0.00	0.00
CONJ	0	1	6	0.00	0.00	0.00
CONTR	2	0	3	100.00	40.00	76.92
DET	98	33	167	74.81	36.98	62.10
MORPH	19	3	52	86.36	26.76	59.75
NOUN	2	7	45	22.22	4.26	12.05
NOUN:INFL	0	0	7	100.00	0.00	0.00
NOUN:NUM	57	21	57	73.08	50.00	66.90
NOUN:POSS	2	4	8	33.33	20.00	29.41
ORTH	110	59	92	65.09	54.46	62.64
OTHER	14	16	352	46.67	3.83	14.40
PART	6	2	8	75.00	42.86	65.22
PREP	45	26	114	63.38	28.30	50.79
PRON	16	8	48	66.67	25.00	50.00
PUNCT	171	90	135	65.52	55.88	63.33
SPELL	82	37	31	68.91	72.57	69.61
VERB	6	5	88	54.55	6.38	21.74
VERB:FORM	62	31	33	66.67	65.26	66.38
VERB:INFL	0	0	3	100.00	0.00	0.00
VERB:SVA	53	14	22	79.10	70.67	77.26
VERB:TENSE	30	27	77	52.63	28.04	44.78
WO	3	1	16	75.00	15.79	42.86

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	0	8	100.00	0.00	0.00
M:CONJ	0	0	1	100.00	0.00	0.00
M:DET	45	17	61	72.58	42.45	63.56
M:NOUN	0	0	3	100.00	0.00	0.00
M:NOUN:POSS	2	2	1	50.00	66.67	52.63
M:OTHER	0	2	31	0.00	0.00	0.00
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	12	10	33	54.55	26.67	45.11
M:PRON	10	6	22	62.50	31.25	52.08
M:PUNCT	140	61	100	69.65	58.33	67.05
M:VERB	2	1	16	66.67	11.11	33.33
M:VERB:FORM	12	3	1	80.00	92.31	82.19
M:VERB:TENSE	2	3	18	40.00	10.00	25.00
R:ADJ	1	1	8	50.00	11.11	29.41
R:ADJ:FORM	1	0	4	100.00	20.00	55.56
R:ADV	0	0	10	100.00	0.00	0.00
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	2	0	42	100.00	4.55	19.23
R:MORPH	19	3	52	86.36	26.76	59.75
R:NOUN	2	5	34	28.57	5.56	15.62
R:NOUN:INFL	0	0	7	100.00	0.00	0.00
R:NOUN:NUM	57	21	57	73.08	50.00	66.90
R:NOUN:POSS	0	2	5	0.00	0.00	0.00
R:ORTH	110	59	92	65.09	54.46	62.64
R:OTHER	14	14	314	50.00	4.27	15.91
R:PART	6	1	3	85.71	66.67	81.08
R:PREP	28	12	60	70.00	31.82	56.45
R:PRON	3	2	17	60.00	15.00	37.50
R:PUNCT	30	28	22	51.72	57.69	52.82
R:SPELL	82	37	31	68.91	72.57	69.61
R:VERB	4	4	65	50.00	5.80	19.80
R:VERB:FORM	50	27	31	64.94	61.73	64.27
R:VERB:INFL	0	0	3	100.00	0.00	0.00
R:VERB:SVA	53	14	22	79.10	70.67	77.26
R:VERB:TENSE	26	21	58	55.32	30.95	47.79
R:WO	3	1	16	75.00	15.79	42.86
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	0	8	100.00	0.00	0.00
U:CONJ	0	1	4	0.00	0.00	0.00
U:CONTR	1	0	3	100.00	25.00	62.50
U:DET	51	16	64	76.12	44.35	66.58
U:NOUN	0	2	8	0.00	0.00	0.00
U:NOUN:POSS	0	0	2	100.00	0.00	0.00
U:OTHER	0	0	7	100.00	0.00	0.00
U:PART	0	1	3	0.00	0.00	0.00
U:PREP	5	4	21	55.56	19.23	40.32
U:PRON	3	0	9	100.00	25.00	62.50
U:PUNCT	1	1	13	50.00	7.14	22.73
U:VERB	0	0	7	100.00	0.00	0.00
U:VERB:FORM	0	1	1	0.00	0.00	0.00
U:VERB:TENSE	2	3	1	40.00	66.67	43.48

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	249	79	281	75.91	46.98	67.59
R	588	150	885	79.67	39.92	66.44
U	78	20	148	79.59	34.51	63.11
UNK	4	0	52	100.00	7.14	27.78

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	1	10	75.00	23.08	51.72
ADJ:FORM	0	0	5	100.00	0.00	0.00
ADV	1	0	25	100.00	3.85	16.67
CONJ	2	0	6	100.00	25.00	62.50
CONTR	2	0	3	100.00	40.00	76.92
DET	110	26	155	80.88	41.51	67.99
MORPH	21	3	52	87.50	28.77	62.13
NOUN	5	3	43	62.50	10.42	31.25
NOUN:INFL	0	0	6	100.00	0.00	0.00
NOUN:NUM	53	12	52	81.54	50.48	72.60
NOUN:POSS	4	2	6	66.67	40.00	58.82
ORTH	124	41	71	75.15	63.59	72.51
OTHER	64	9	335	87.67	16.04	46.31
PART	7	2	7	77.78	50.00	70.00
PREP	55	17	114	76.39	32.54	60.18
PRON	20	5	43	80.00	31.75	61.35
PUNCT	180	70	128	72.00	58.44	68.81
SPELL	93	6	16	93.94	85.32	92.08
UNK	4	0	52	100.00	7.14	27.78
VERB	18	4	88	81.82	16.98	46.39
VERB:FORM	60	25	31	70.59	65.93	69.61
VERB:INFL	0	0	3	100.00	0.00	0.00
VERB:SVA	52	8	25	86.67	67.53	82.02
VERB:TENSE	38	14	74	73.08	33.93	59.38
WO	3	1	16	75.00	15.79	42.86

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	1	0	7	100.00	12.50	41.67
M:CONJ	1	0	2	100.00	33.33	71.43
M:DET	53	13	54	80.30	49.53	71.43
M:NOUN	0	0	3	100.00	0.00	0.00
M:NOUN:POSS	2	1	1	66.67	66.67	66.67
M:OTHER	2	2	27	50.00	6.90	22.22
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	15	8	34	65.22	30.61	53.19
M:PRON	10	4	21	71.43	32.26	57.47
M:PUNCT	147	47	98	75.77	60.00	71.99
M:VERB	2	1	15	66.67	11.76	34.48
M:VERB:FORM	11	3	0	78.57	100.00	82.09
M:VERB:TENSE	5	0	16	100.00	23.81	60.98
R:ADJ	2	1	7	66.67	22.22	47.62
R:ADJ:FORM	0	0	5	100.00	0.00	0.00
R:ADV	0	0	11	100.00	0.00	0.00
R:CONJ	1	0	0	100.00	100.00	100.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	3	0	42	100.00	6.67	26.32
R:MORPH	21	3	52	87.50	28.77	62.13
R:NOUN	4	2	32	66.67	11.11	33.33
R:NOUN:INFL	0	0	6	100.00	0.00	0.00
R:NOUN:NUM	53	12	52	81.54	50.48	72.60
R:NOUN:POSS	1	1	3	50.00	25.00	41.67
R:ORTH	124	41	71	75.15	63.59	72.51
R:OTHER	62	7	295	89.86	17.37	48.97
R:PART	7	1	3	87.50	70.00	83.33
R:PREP	35	7	60	83.33	36.84	66.54
R:PRON	5	1	14	83.33	26.32	58.14
R:PUNCT	31	22	20	58.49	60.78	58.94
R:SPELL	93	6	16	93.94	85.32	92.08
R:VERB	14	3	66	82.35	17.50	47.30
R:VERB:FORM	49	22	30	69.01	62.03	67.49
R:VERB:INFL	0	0	3	100.00	0.00	0.00
R:VERB:SVA	52	8	25	86.67	67.53	82.02
R:VERB:TENSE	27	12	56	69.23	32.53	56.49
R:WO	3	1	16	75.00	15.79	42.86
U:ADJ	1	0	1	100.00	50.00	83.33
U:ADV	0	0	7	100.00	0.00	0.00
U:CONJ	0	0	4	100.00	0.00	0.00
U:CONTR	1	0	3	100.00	25.00	62.50
U:DET	54	13	59	80.60	47.79	70.87
U:NOUN	1	1	8	50.00	11.11	29.41
U:NOUN:POSS	1	0	2	100.00	33.33	71.43
U:OTHER	0	0	13	100.00	0.00	0.00
U:PART	0	1	3	0.00	0.00	0.00
U:PREP	5	2	20	71.43	20.00	47.17
U:PRON	5	0	8	100.00	38.46	75.76
U:PUNCT	2	1	10	66.67	16.67	41.67
U:VERB	2	0	7	100.00	22.22	58.82
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	6	2	2	75.00	75.00	75.00
UNK	4	0	52	100.00	7.14	27.78

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	289	42	327	87.31	46.92	74.48
R	741	112	1024	86.87	41.98	71.57
U	105	16	193	86.78	35.23	67.14
UNK	4	0	60	100.00	6.25	25.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	1	14	66.67	12.50	35.71
ADJ:FORM	0	0	5	100.00	0.00	0.00
ADV	4	0	35	100.00	10.26	36.36
CONJ	4	1	6	80.00	40.00	66.67
CONTR	2	0	4	100.00	33.33	71.43
DET	135	19	174	87.66	43.69	72.97
MORPH	23	1	55	95.83	29.49	66.09
NOUN	8	1	54	88.89	12.90	40.82
NOUN:INFL	0	0	7	100.00	0.00	0.00
NOUN:NUM	54	7	58	88.52	48.21	75.84
NOUN:POSS	4	2	13	66.67	23.53	48.78
ORTH	150	34	76	81.52	66.37	77.96
OTHER	147	8	404	94.84	26.68	62.77
PART	5	1	6	83.33	45.45	71.43
PREP	62	10	118	86.11	34.44	66.24
PRON	30	3	44	90.91	40.54	72.82
PUNCT	216	42	144	83.72	60.00	77.59
SPELL	91	1	17	98.91	84.26	95.59
UNK	4	0	60	100.00	6.25	25.00
VERB	25	3	116	89.29	17.73	49.41
VERB:FORM	58	20	37	74.36	61.05	71.25
VERB:INFL	0	0	3	100.00	0.00	0.00
VERB:SVA	57	6	24	90.48	70.37	85.59
VERB:TENSE	46	10	102	82.14	31.08	61.83
WO	12	0	28	100.00	30.00	68.18

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	3	0	9	100.00	25.00	62.50
M:CONJ	3	0	4	100.00	42.86	78.95
M:DET	58	7	67	89.23	46.40	75.32
M:NOUN	1	0	4	100.00	20.00	55.56
M:NOUN:POSS	2	0	2	100.00	50.00	83.33
M:OTHER	4	2	37	66.67	9.76	30.77
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	22	2	31	91.67	41.51	73.83
M:PRON	18	3	19	85.71	48.65	74.38
M:PUNCT	162	27	106	85.71	60.45	79.10
M:VERB	2	1	25	66.67	7.41	25.64
M:VERB:FORM	9	0	3	100.00	75.00	93.75
M:VERB:TENSE	5	0	17	100.00	22.73	59.52
R:ADJ	2	1	10	66.67	16.67	41.67
R:ADJ:FORM	0	0	5	100.00	0.00	0.00
R:ADV	1	0	13	100.00	7.14	27.78
R:CONJ	0	0	1	100.00	0.00	0.00
R:CONTR	1	0	0	100.00	100.00	100.00
R:DET	10	0	38	100.00	20.83	56.82
R:MORPH	23	1	55	95.83	29.49	66.09
R:NOUN	6	1	39	85.71	13.33	41.10
R:NOUN:INFL	0	0	7	100.00	0.00	0.00
R:NOUN:NUM	54	7	58	88.52	48.21	75.84
R:NOUN:POSS	2	2	5	50.00	28.57	43.48
R:ORTH	150	34	76	81.52	66.37	77.96
R:OTHER	138	6	346	95.83	28.51	65.09
R:PART	5	0	2	100.00	71.43	92.59
R:PREP	33	7	65	82.50	33.67	63.95
R:PRON	5	0	17	100.00	22.73	59.52
R:PUNCT	45	15	27	75.00	62.50	72.12
R:SPELL	91	1	17	98.91	84.26	95.59
R:VERB	21	2	74	91.30	22.11	56.15
R:VERB:FORM	49	20	33	71.01	59.76	68.44
R:VERB:INFL	0	0	3	100.00	0.00	0.00
R:VERB:SVA	57	6	24	90.48	70.37	85.59
R:VERB:TENSE	36	9	81	80.00	30.77	60.61
R:WO	12	0	28	100.00	30.00	68.18
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	0	0	13	100.00	0.00	0.00
U:CONJ	1	1	1	50.00	50.00	50.00
U:CONTR	1	0	4	100.00	20.00	55.56
U:DET	67	12	69	84.81	49.26	74.12
U:NOUN	1	0	11	100.00	8.33	31.25
U:NOUN:POSS	0	0	6	100.00	0.00	0.00
U:OTHER	5	0	21	100.00	19.23	54.35
U:PART	0	1	3	0.00	0.00	0.00
U:PREP	7	1	22	87.50	24.14	57.38
U:PRON	7	0	8	100.00	46.67	81.40
U:PUNCT	9	0	11	100.00	45.00	80.36
U:VERB	2	0	17	100.00	10.53	37.04
U:VERB:FORM	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	5	1	4	83.33	55.56	75.76
UNK	4	0	60	100.00	6.25	25.00

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	524	290	1001	64.37	34.36	54.80
Span-level detection	608	208	985	74.51	38.17	62.59
Token-level detection	721	176	1188	80.38	37.77	65.58

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	195	65	239	75.00	44.93	66.15
R	280	210	661	57.14	29.76	48.26
U	49	15	101	76.56	32.67	60.34

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	3	3	9	50.00	25.00	41.67
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	0	0	16	100.00	0.00	0.00
CONJ	0	1	8	0.00	0.00	0.00
CONTR	0	0	2	100.00	0.00	0.00
DET	58	17	134	77.33	30.21	58.94
MORPH	5	4	32	55.56	13.51	34.25
NOUN	1	3	32	25.00	3.03	10.20
NOUN:NUM	27	12	36	69.23	42.86	61.64
NOUN:POSS	1	4	10	20.00	9.09	16.13
ORTH	37	49	42	43.02	46.84	43.74
OTHER	1	6	208	14.29	0.48	2.11
PART	2	3	5	40.00	28.57	37.04
PREP	41	29	107	58.57	27.70	47.90
PRON	8	2	33	80.00	19.51	49.38
PUNCT	179	79	93	69.38	65.81	68.63
SPELL	49	27	23	64.47	68.06	65.16
VERB	3	6	71	33.33	4.05	13.64
VERB:FORM	33	19	32	63.46	50.77	60.44
VERB:SVA	35	7	15	83.33	70.00	80.28
VERB:TENSE	34	16	57	68.00	37.36	58.42
WO	4	2	36	66.67	10.00	31.25

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	0	5	100.00	0.00	0.00
M:CONJ	0	0	6	100.00	0.00	0.00
M:DET	30	9	72	76.92	29.41	58.14
M:NOUN	0	0	1	100.00	0.00	0.00
M:NOUN:POSS	1	1	3	50.00	25.00	41.67
M:OTHER	0	0	12	100.00	0.00	0.00
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	5	5	26	50.00	16.13	35.21
M:PRON	4	2	19	66.67	17.39	42.55
M:PUNCT	152	44	67	77.55	69.41	75.77
M:VERB	1	2	9	33.33	10.00	22.73
M:VERB:FORM	0	0	1	100.00	0.00	0.00
M:VERB:TENSE	2	2	16	50.00	11.11	29.41
R:ADJ	3	3	7	50.00	30.00	44.12
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	0	0	5	100.00	0.00	0.00
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	2	0	35	100.00	5.41	22.22
R:MORPH	5	4	32	55.56	13.51	34.25
R:NOUN	1	3	28	25.00	3.45	11.11
R:NOUN:NUM	27	12	36	69.23	42.86	61.64
R:NOUN:POSS	0	3	3	0.00	0.00	0.00
R:ORTH	37	49	42	43.02	46.84	43.74
R:OTHER	1	6	187	14.29	0.53	2.31
R:PART	2	3	2	40.00	50.00	41.67
R:PREP	29	22	60	56.86	32.58	49.49
R:PRON	2	0	8	100.00	20.00	55.56
R:PUNCT	21	32	17	39.62	55.26	42.00
R:SPELL	49	27	23	64.47	68.06	65.16
R:VERB	2	4	56	33.33	3.45	12.20
R:VERB:FORM	31	18	29	63.27	51.67	60.55
R:VERB:SVA	35	7	15	83.33	70.00	80.28
R:VERB:TENSE	26	14	37	65.00	41.27	58.30
R:WO	4	2	36	66.67	10.00	31.25
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	0	0	6	100.00	0.00	0.00
U:CONJ	0	1	0	0.00	100.00	0.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	26	8	27	76.47	49.06	68.78
U:NOUN	0	0	3	100.00	0.00	0.00
U:NOUN:POSS	0	0	4	100.00	0.00	0.00
U:OTHER	0	0	9	100.00	0.00	0.00
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	7	2	21	77.78	25.00	54.69
U:PRON	2	0	6	100.00	25.00	62.50
U:PUNCT	6	3	9	66.67	40.00	58.82
U:VERB	0	0	6	100.00	0.00	0.00
U:VERB:FORM	2	1	2	66.67	50.00	62.50
U:VERB:TENSE	6	0	4	100.00	60.00	88.24

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	202	57	236	77.99	46.12	68.52
R	352	137	635	71.98	35.66	59.80
U	54	14	103	79.41	34.39	62.94
UNK	0	0	11	100.00	0.00	0.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	1	12	83.33	29.41	60.98
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	2	0	14	100.00	12.50	41.67
CONJ	1	1	9	50.00	10.00	27.78
CONTR	0	0	2	100.00	0.00	0.00
DET	57	15	135	79.17	29.69	59.38
MORPH	6	1	30	85.71	16.67	46.87
NOUN	7	3	31	70.00	18.42	44.87
NOUN:NUM	25	9	35	73.53	41.67	63.78
NOUN:POSS	3	2	9	60.00	25.00	46.88
ORTH	54	43	50	55.67	51.92	54.88
OTHER	34	2	196	94.44	14.78	45.45
PART	2	3	6	40.00	25.00	35.71
PREP	44	20	108	68.75	28.95	53.92
PRON	10	1	29	90.91	25.64	60.24
PUNCT	181	72	97	71.54	65.11	70.16
SPELL	55	2	16	96.49	77.46	91.97
UNK	0	0	11	100.00	0.00	0.00
VERB	10	5	68	66.67	12.82	36.23
VERB:FORM	37	10	27	78.72	57.81	73.41
VERB:SVA	35	4	13	89.74	72.92	85.78
VERB:TENSE	33	12	53	73.33	38.37	62.03
WO	4	1	34	80.00	10.53	34.48

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	1	0	3	100.00	25.00	62.50
M:CONJ	1	0	5	100.00	16.67	50.00
M:DET	29	8	69	78.38	29.59	58.94
M:NOUN	2	0	1	100.00	66.67	90.91
M:NOUN:POSS	1	1	3	50.00	25.00	41.67
M:OTHER	6	0	13	100.00	31.58	69.77
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	5	3	26	62.50	16.13	39.68
M:PRON	5	1	17	83.33	22.73	54.35
M:PUNCT	150	41	70	78.53	68.18	76.22
M:VERB	1	2	8	33.33	11.11	23.81
M:VERB:FORM	0	0	1	100.00	0.00	0.00
M:VERB:TENSE	1	1	16	50.00	5.88	20.00
R:ADJ	5	1	8	83.33	38.46	67.57
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	0	0	5	100.00	0.00	0.00
R:CONJ	0	0	4	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	3	0	36	100.00	7.69	29.41
R:MORPH	6	1	30	85.71	16.67	46.87
R:NOUN	5	3	27	62.50	15.62	39.06
R:NOUN:NUM	25	9	35	73.53	41.67	63.78
R:NOUN:POSS	0	1	3	0.00	0.00	0.00
R:ORTH	54	43	50	55.67	51.92	54.88
R:OTHER	28	2	174	93.33	13.86	43.48
R:PART	2	3	3	40.00	40.00	40.00
R:PREP	33	15	61	68.75	35.11	57.69
R:PRON	2	0	8	100.00	20.00	55.56
R:PUNCT	24	28	17	46.15	58.54	48.19
R:SPELL	55	2	16	96.49	77.46	91.97
R:VERB	7	3	53	70.00	11.67	35.00
R:VERB:FORM	35	9	24	79.55	59.32	74.47
R:VERB:SVA	35	4	13	89.74	72.92	85.78
R:VERB:TENSE	26	11	33	70.27	44.07	62.80
R:WO	4	1	34	80.00	10.53	34.48
U:ADJ	0	0	2	100.00	0.00	0.00
U:ADV	1	0	6	100.00	14.29	45.45
U:CONJ	0	1	0	0.00	100.00	0.00
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	25	7	30	78.12	45.45	68.31
U:NOUN	0	0	3	100.00	0.00	0.00
U:NOUN:POSS	2	0	3	100.00	40.00	76.92
U:OTHER	0	0	9	100.00	0.00	0.00
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	6	2	21	75.00	22.22	50.85
U:PRON	3	0	4	100.00	42.86	78.95
U:PUNCT	7	3	10	70.00	41.18	61.40
U:VERB	2	0	7	100.00	22.22	58.82
U:VERB:FORM	2	1	2	66.67	50.00	62.50
U:VERB:TENSE	6	0	4	100.00	60.00	88.24
UNK	0	0	11	100.00	0.00	0.00

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	220	40	263	84.62	45.55	72.23
R	441	125	765	77.92	36.57	63.54
U	60	11	147	84.51	28.99	61.10
UNK	0	0	13	100.00	0.00	0.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	5	1	11	83.33	31.25	62.50
ADJ:FORM	3	1	0	75.00	100.00	78.95
ADV	4	0	21	100.00	16.00	48.78
CONJ	2	0	9	100.00	18.18	52.63
CONTR	0	0	2	100.00	0.00	0.00
DET	64	12	138	84.21	31.68	63.24
MORPH	6	1	33	85.71	15.38	44.78
NOUN	10	2	36	83.33	21.74	53.19
NOUN:NUM	25	6	38	80.65	39.68	66.84
NOUN:POSS	3	2	12	60.00	20.00	42.86
ORTH	76	39	57	66.09	57.14	64.08
OTHER	58	1	267	98.31	17.85	51.69
PART	1	3	5	25.00	16.67	22.73
PREP	47	16	118	74.60	28.48	56.35
PRON	13	0	31	100.00	29.55	67.71
PUNCT	207	63	108	76.67	65.71	74.19
SPELL	55	2	17	96.49	76.39	91.67
UNK	0	0	13	100.00	0.00	0.00
VERB	16	4	83	80.00	16.16	44.69
VERB:FORM	38	8	33	82.61	53.52	74.51
VERB:SVA	34	3	14	91.89	70.83	86.73
VERB:TENSE	39	9	76	81.25	33.91	63.52
WO	15	3	66	83.33	18.52	49.02

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	2	0	5	100.00	28.57	66.67
M:CONJ	2	0	6	100.00	25.00	62.50
M:DET	30	5	70	85.71	30.00	62.50
M:NOUN	1	0	2	100.00	33.33	71.43
M:NOUN:POSS	1	1	4	50.00	20.00	38.46
M:OTHER	5	0	14	100.00	26.32	64.10
M:PART	0	0	2	100.00	0.00	0.00
M:PREP	7	2	27	77.78	20.59	50.00
M:PRON	8	0	17	100.00	32.00	70.18
M:PUNCT	159	29	78	84.57	67.09	80.38
M:VERB	3	2	15	60.00	16.67	39.47
M:VERB:FORM	0	0	2	100.00	0.00	0.00
M:VERB:TENSE	2	1	19	66.67	9.52	30.30
R:ADJ	5	1	8	83.33	38.46	67.57
R:ADJ:FORM	3	1	0	75.00	100.00	78.95
R:ADV	0	0	7	100.00	0.00	0.00
R:CONJ	0	0	3	100.00	0.00	0.00
R:CONTR	0	0	1	100.00	0.00	0.00
R:DET	7	0	38	100.00	15.56	47.95
R:MORPH	6	1	33	85.71	15.38	44.78
R:NOUN	9	2	31	81.82	22.50	53.57
R:NOUN:NUM	25	6	38	80.65	39.68	66.84
R:NOUN:POSS	0	1	4	0.00	0.00	0.00
R:ORTH	76	39	57	66.09	57.14	64.08
R:OTHER	51	1	219	98.08	18.89	53.35
R:PART	1	3	2	25.00	33.33	26.32
R:PREP	34	13	67	72.34	33.66	58.82
R:PRON	2	0	8	100.00	20.00	55.56
R:PUNCT	40	32	17	55.56	70.18	57.97
R:SPELL	55	2	17	96.49	76.39	91.67
R:VERB	9	2	58	81.82	13.43	40.54
R:VERB:FORM	36	7	28	83.72	56.25	76.27
R:VERB:SVA	34	3	14	91.89	70.83	86.73
R:VERB:TENSE	33	8	49	80.49	40.24	67.07
R:WO	15	3	66	83.33	18.52	49.02
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	2	0	9	100.00	18.18	52.63
U:CONTR	0	0	1	100.00	0.00	0.00
U:DET	27	7	30	79.41	47.37	69.95
U:NOUN	0	0	3	100.00	0.00	0.00
U:NOUN:POSS	2	0	4	100.00	33.33	71.43
U:OTHER	2	0	34	100.00	5.56	22.73
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	6	1	24	85.71	20.00	51.72
U:PRON	3	0	6	100.00	33.33	71.43
U:PUNCT	8	2	13	80.00	38.10	65.57
U:VERB	4	0	10	100.00	28.57	66.67
U:VERB:FORM	2	1	3	66.67	40.00	58.82
U:VERB:TENSE	4	0	8	100.00	33.33	71.43
UNK	0	0	13	100.00	0.00	0.00

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	288	158	352	64.57	45.00	59.41
Span-level detection	322	124	349	72.20	47.99	65.58
Token-level detection	385	117	411	76.69	48.37	68.65

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	109	36	88	75.17	55.33	70.14
R	152	105	222	59.14	40.64	54.21
U	27	17	42	61.36	39.13	55.10

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	2	5	33.33	16.67	27.78
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	0	0	4	100.00	0.00	0.00
CONJ	0	0	4	100.00	0.00	0.00
CONTR	1	0	3	100.00	25.00	62.50
DET	32	17	63	65.31	33.68	54.98
MORPH	6	0	17	100.00	26.09	63.83
NOUN	0	1	9	0.00	0.00	0.00
NOUN:INFL	0	0	1	100.00	0.00	0.00
NOUN:NUM	12	3	18	80.00	40.00	66.67
NOUN:POSS	0	0	6	100.00	0.00	0.00
ORTH	35	30	14	53.85	71.43	56.63
OTHER	7	2	55	77.78	11.29	35.71
PART	1	2	3	33.33	25.00	31.25
PREP	27	13	36	67.50	42.86	60.54
PRON	1	4	9	20.00	10.00	16.67
PUNCT	111	50	39	68.94	74.00	69.90
SPELL	19	14	18	57.58	51.35	56.21
VERB	1	0	14	100.00	6.67	26.32
VERB:FORM	13	6	3	68.42	81.25	70.65
VERB:SVA	4	7	5	36.36	44.44	37.74
VERB:TENSE	15	6	16	71.43	48.39	65.22
WO	2	1	8	66.67	20.00	45.45

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	0	0	2	100.00	0.00	0.00
M:DET	12	6	31	66.67	27.91	52.17
M:NOUN	0	0	1	100.00	0.00	0.00
M:OTHER	0	0	6	100.00	0.00	0.00
M:PREP	2	2	14	50.00	12.50	31.25
M:PRON	0	3	5	0.00	0.00	0.00
M:PUNCT	92	25	23	78.63	80.00	78.90
M:VERB	0	0	2	100.00	0.00	0.00
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	1	0	2	100.00	33.33	71.43
R:ADJ	1	2	3	33.33	25.00	31.25
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	0	0	2	100.00	0.00	0.00
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	1	100.00	50.00	83.33
R:DET	0	0	13	100.00	0.00	0.00
R:MORPH	6	0	17	100.00	26.09	63.83
R:NOUN	0	1	7	0.00	0.00	0.00
R:NOUN:INFL	0	0	1	100.00	0.00	0.00
R:NOUN:NUM	12	3	18	80.00	40.00	66.67
R:NOUN:POSS	0	0	5	100.00	0.00	0.00
R:ORTH	35	30	14	53.85	71.43	56.63
R:OTHER	7	2	49	77.78	12.50	38.04
R:PART	1	2	2	33.33	33.33	33.33
R:PREP	24	7	15	77.42	61.54	73.62
R:PRON	0	1	3	0.00	0.00	0.00
R:PUNCT	16	24	11	40.00	59.26	42.78
R:SPELL	19	14	18	57.58	51.35	56.21
R:VERB	1	0	11	100.00	8.33	31.25
R:VERB:FORM	11	6	3	64.71	78.57	67.07
R:VERB:SVA	4	7	5	36.36	44.44	37.74
R:VERB:TENSE	12	5	12	70.59	50.00	65.22
R:WO	2	1	8	66.67	20.00	45.45
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	0	1	100.00	0.00	0.00
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	20	11	19	64.52	51.28	61.35
U:NOUN	0	0	1	100.00	0.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:PART	0	0	1	100.00	0.00	0.00
U:PREP	1	4	7	20.00	12.50	17.86
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	3	1	5	75.00	37.50	62.50
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	2	1	2	66.67	50.00	62.50

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	112	33	93	77.24	54.63	71.34
R	181	78	209	69.88	46.41	63.46
U	28	13	42	68.29	40.00	59.83
UNK	1	0	5	100.00	16.67	50.00

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	2	4	0.00	0.00	0.00
ADJ:FORM	0	0	2	100.00	0.00	0.00
ADV	0	0	4	100.00	0.00	0.00
CONJ	0	0	5	100.00	0.00	0.00
CONTR	1	0	3	100.00	25.00	62.50
DET	36	14	59	72.00	37.89	61.02
MORPH	7	0	17	100.00	29.17	67.31
NOUN	2	1	11	66.67	15.38	40.00
NOUN:INFL	1	0	1	100.00	50.00	83.33
NOUN:NUM	12	1	20	92.31	37.50	71.43
NOUN:POSS	0	0	6	100.00	0.00	0.00
ORTH	35	24	13	59.32	72.92	61.62
OTHER	19	1	57	95.00	25.00	60.90
PART	2	2	2	50.00	50.00	50.00
PREP	28	10	39	73.68	41.79	63.93
PRON	1	4	8	20.00	11.11	17.24
PUNCT	111	46	40	70.70	73.51	71.25
SPELL	28	3	9	90.32	75.68	86.96
UNK	1	0	5	100.00	16.67	50.00
VERB	3	0	14	100.00	17.65	51.72
VERB:FORM	15	4	2	78.95	88.24	80.65
VERB:SVA	4	6	5	40.00	44.44	40.82
VERB:TENSE	15	5	16	75.00	48.39	67.57
WO	1	1	7	50.00	12.50	31.25

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	1	100.00	0.00	0.00
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	0	0	3	100.00	0.00	0.00
M:DET	13	5	27	72.22	32.50	58.04
M:NOUN	1	0	3	100.00	25.00	62.50
M:OTHER	3	0	7	100.00	30.00	68.18
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	2	2	15	50.00	11.76	30.30
M:PRON	0	3	4	0.00	0.00	0.00
M:PUNCT	90	23	27	79.65	76.92	79.09
M:VERB	0	0	2	100.00	0.00	0.00
M:VERB:FORM	2	0	0	100.00	100.00	100.00
M:VERB:TENSE	1	0	2	100.00	33.33	71.43
R:ADJ	0	2	2	0.00	0.00	0.00
R:ADJ:FORM	0	0	2	100.00	0.00	0.00
R:ADV	0	0	2	100.00	0.00	0.00
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	1	100.00	50.00	83.33
R:DET	2	0	12	100.00	14.29	45.45
R:MORPH	7	0	17	100.00	29.17	67.31
R:NOUN	1	1	7	50.00	12.50	31.25
R:NOUN:INFL	1	0	1	100.00	50.00	83.33
R:NOUN:NUM	12	1	20	92.31	37.50	71.43
R:NOUN:POSS	0	0	5	100.00	0.00	0.00
R:ORTH	35	24	13	59.32	72.92	61.62
R:OTHER	16	1	48	94.12	25.00	60.61
R:PART	2	2	1	50.00	66.67	52.63
R:PREP	25	5	17	83.33	59.52	77.16
R:PRON	0	1	3	0.00	0.00	0.00
R:PUNCT	18	23	10	43.90	64.29	46.88
R:SPELL	28	3	9	90.32	75.68	86.96
R:VERB	3	0	11	100.00	21.43	57.69
R:VERB:FORM	13	4	2	76.47	86.67	78.31
R:VERB:SVA	4	6	5	40.00	44.44	40.82
R:VERB:TENSE	12	4	12	75.00	50.00	68.18
R:WO	1	1	7	50.00	12.50	31.25
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	0	1	100.00	0.00	0.00
U:CONTR	0	0	2	100.00	0.00	0.00
U:DET	21	9	20	70.00	51.22	65.22
U:NOUN	0	0	1	100.00	0.00	0.00
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	0	0	2	100.00	0.00	0.00
U:PREP	1	3	7	25.00	12.50	20.83
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	3	0	3	100.00	50.00	83.33
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	2	1	2	66.67	50.00	62.50
UNK	1	0	5	100.00	16.67	50.00

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	124	26	107	82.67	53.68	74.61
R	224	80	249	73.68	47.36	66.31
U	35	11	49	76.09	41.67	65.30
UNK	2	0	6	100.00	25.00	62.50

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	0	2	6	0.00	0.00	0.00
ADJ:FORM	0	0	3	100.00	0.00	0.00
ADV	0	0	6	100.00	0.00	0.00
CONJ	1	0	4	100.00	20.00	55.56
CONTR	1	0	4	100.00	20.00	55.56
DET	39	10	61	79.59	39.00	65.88
MORPH	7	0	17	100.00	29.17	67.31
NOUN	2	0	13	100.00	13.33	43.48
NOUN:INFL	1	0	1	100.00	50.00	83.33
NOUN:NUM	12	1	23	92.31	34.29	68.97
NOUN:POSS	2	0	8	100.00	20.00	55.56
ORTH	46	23	16	66.67	74.19	68.05
OTHER	30	1	75	96.77	28.57	65.50
PART	2	2	2	50.00	50.00	50.00
PREP	29	10	41	74.36	41.43	64.16
PRON	4	4	9	50.00	30.77	44.44
PUNCT	128	47	48	73.14	72.73	73.06
SPELL	31	3	7	91.18	81.58	89.08
UNK	2	0	6	100.00	25.00	62.50
VERB	4	0	16	100.00	20.00	55.56
VERB:FORM	19	3	4	86.36	82.61	85.59
VERB:SVA	4	4	6	50.00	40.00	47.62
VERB:TENSE	16	5	24	76.19	40.00	64.52
WO	5	2	11	71.43	31.25	56.82

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADJ	0	0	2	100.00	0.00	0.00
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	1	0	2	100.00	33.33	71.43
M:DET	14	3	28	82.35	33.33	63.64
M:NOUN	1	0	4	100.00	20.00	55.56
M:NOUN:POSS	2	0	0	100.00	100.00	100.00
M:OTHER	4	0	8	100.00	33.33	71.43
M:PART	0	0	1	100.00	0.00	0.00
M:PREP	2	2	16	50.00	11.11	29.41
M:PRON	3	3	5	50.00	37.50	46.88
M:PUNCT	92	18	34	83.64	73.02	81.27
M:VERB	0	0	3	100.00	0.00	0.00
M:VERB:FORM	4	0	0	100.00	100.00	100.00
M:VERB:TENSE	1	0	3	100.00	25.00	62.50
R:ADJ	0	2	3	0.00	0.00	0.00
R:ADJ:FORM	0	0	3	100.00	0.00	0.00
R:ADV	0	0	2	100.00	0.00	0.00
R:CONJ	0	0	2	100.00	0.00	0.00
R:CONTR	1	0	1	100.00	50.00	83.33
R:DET	2	0	12	100.00	14.29	45.45
R:MORPH	7	0	17	100.00	29.17	67.31
R:NOUN	0	0	7	100.00	0.00	0.00
R:NOUN:INFL	1	0	1	100.00	50.00	83.33
R:NOUN:NUM	12	1	23	92.31	34.29	68.97
R:NOUN:POSS	0	0	7	100.00	0.00	0.00
R:ORTH	46	23	16	66.67	74.19	68.05
R:OTHER	26	1	63	96.30	29.21	65.99
R:PART	2	2	1	50.00	66.67	52.63
R:PREP	25	5	19	83.33	56.82	76.22
R:PRON	0	1	3	0.00	0.00	0.00
R:PUNCT	29	29	10	50.00	74.36	53.51
R:SPELL	31	3	7	91.18	81.58	89.08
R:VERB	4	0	12	100.00	25.00	62.50
R:VERB:FORM	15	3	4	83.33	78.95	82.42
R:VERB:SVA	4	4	6	50.00	40.00	47.62
R:VERB:TENSE	14	4	19	77.78	42.42	66.67
R:WO	5	2	11	71.43	31.25	56.82
U:ADJ	0	0	1	100.00	0.00	0.00
U:ADV	0	0	3	100.00	0.00	0.00
U:CONTR	0	0	3	100.00	0.00	0.00
U:DET	23	7	21	76.67	52.27	70.12
U:NOUN	1	0	2	100.00	33.33	71.43
U:NOUN:POSS	0	0	1	100.00	0.00	0.00
U:OTHER	0	0	4	100.00	0.00	0.00
U:PREP	2	3	6	40.00	25.00	35.71
U:PRON	1	0	1	100.00	50.00	83.33
U:PUNCT	7	0	4	100.00	63.64	89.74
U:VERB	0	0	1	100.00	0.00	0.00
U:VERB:TENSE	1	1	2	50.00	33.33	45.45
UNK	2	0	6	100.00	25.00	62.50

OVERALL
	TP	FP	FN	P	R	F_0.5
Span-level correction	227	210	290	51.95	43.91	50.11
Span-level detection	263	174	277	60.18	48.70	57.47
Token-level detection	311	159	302	66.17	50.73	62.37

SPAN-LEVEL CORRECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	105	42	51	71.43	67.31	70.56
R	116	139	220	45.49	34.52	42.77
U	6	29	19	17.14	24.00	18.18

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	1	6	4	14.29	20.00	15.15
CONJ	0	0	2	100.00	0.00	0.00
DET	9	21	8	30.00	52.94	32.85
MORPH	0	2	5	0.00	0.00	0.00
NOUN	1	0	9	100.00	10.00	35.71
NOUN:INFL	0	0	11	100.00	0.00	0.00
NOUN:NUM	5	11	8	31.25	38.46	32.47
NOUN:POSS	2	1	16	66.67	11.11	33.33
ORTH	25	42	37	37.31	40.32	37.88
OTHER	5	1	44	83.33	10.20	34.25
PART	1	1	0	50.00	100.00	55.56
PREP	8	22	14	26.67	36.36	28.17
PRON	0	3	5	0.00	0.00	0.00
PUNCT	103	50	58	67.32	63.98	66.62
SPELL	50	18	41	73.53	54.95	68.87
VERB	3	3	10	50.00	23.08	40.54
VERB:FORM	4	10	4	28.57	50.00	31.25
VERB:INFL	0	0	4	100.00	0.00	0.00
VERB:SVA	8	12	4	40.00	66.67	43.48
VERB:TENSE	2	7	5	22.22	28.57	23.26
WO	0	0	1	100.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	0	0	1	100.00	0.00	0.00
M:DET	4	6	4	40.00	50.00	41.67
M:NOUN	0	0	2	100.00	0.00	0.00
M:NOUN:POSS	2	1	4	66.67	33.33	55.56
M:OTHER	0	0	2	100.00	0.00	0.00
M:PREP	0	4	0	0.00	100.00	0.00
M:PRON	0	1	2	0.00	0.00	0.00
M:PUNCT	98	29	34	77.17	74.24	76.56
M:VERB	1	1	2	50.00	33.33	45.45
R:ADJ	1	6	4	14.29	20.00	15.15
R:DET	0	0	2	100.00	0.00	0.00
R:MORPH	0	2	5	0.00	0.00	0.00
R:NOUN	1	0	7	100.00	12.50	41.67
R:NOUN:INFL	0	0	11	100.00	0.00	0.00
R:NOUN:NUM	5	11	8	31.25	38.46	32.47
R:NOUN:POSS	0	0	12	100.00	0.00	0.00
R:ORTH	25	42	37	37.31	40.32	37.88
R:OTHER	5	1	42	83.33	10.64	35.21
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	8	8	12	50.00	40.00	47.62
R:PRON	0	1	3	0.00	0.00	0.00
R:PUNCT	5	20	13	20.00	27.78	21.19
R:SPELL	50	18	41	73.53	54.95	68.87
R:VERB	2	2	6	50.00	25.00	41.67
R:VERB:FORM	4	9	4	30.77	50.00	33.33
R:VERB:INFL	0	0	4	100.00	0.00	0.00
R:VERB:SVA	8	12	4	40.00	66.67	43.48
R:VERB:TENSE	2	6	4	25.00	33.33	26.32
R:WO	0	0	1	100.00	0.00	0.00
U:CONJ	0	0	1	100.00	0.00	0.00
U:DET	5	15	2	25.00	71.43	28.74
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	0	10	2	0.00	0.00	0.00
U:PRON	0	1	0	0.00	100.00	0.00
U:PUNCT	0	1	11	0.00	0.00	0.00
U:VERB	0	0	2	100.00	0.00	0.00
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	0	1	1	0.00	0.00	0.00

SPAN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	108	39	50	73.47	68.35	72.39
R	146	108	207	57.48	41.36	53.32
U	7	27	17	20.59	29.17	21.88
UNK	2	0	3	100.00	40.00	76.92

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	5	3	28.57	40.00	30.30
CONJ	0	0	2	100.00	0.00	0.00
DET	9	20	7	31.03	56.25	34.09
MORPH	1	2	5	33.33	16.67	27.78
NOUN	2	0	9	100.00	18.18	52.63
NOUN:INFL	0	0	11	100.00	0.00	0.00
NOUN:NUM	5	10	9	33.33	35.71	33.78
NOUN:POSS	2	1	15	66.67	11.76	34.48
ORTH	25	34	39	42.37	39.06	41.67
OTHER	17	1	40	94.44	29.82	65.89
PART	1	1	0	50.00	100.00	55.56
PREP	11	22	12	33.33	47.83	35.48
PRON	0	1	5	0.00	0.00	0.00
PUNCT	104	47	58	68.87	64.20	67.89
SPELL	62	1	33	98.41	65.26	89.34
UNK	2	0	3	100.00	40.00	76.92
VERB	4	3	9	57.14	30.77	48.78
VERB:FORM	4	9	4	30.77	50.00	33.33
VERB:INFL	1	0	3	100.00	25.00	62.50
VERB:SVA	8	11	4	42.11	66.67	45.45
VERB:TENSE	3	6	5	33.33	37.50	34.09
WO	0	0	1	100.00	0.00	0.00

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:CONJ	0	0	1	100.00	0.00	0.00
M:DET	4	6	4	40.00	50.00	41.67
M:NOUN	0	0	2	100.00	0.00	0.00
M:NOUN:POSS	2	1	3	66.67	40.00	58.82
M:OTHER	2	0	1	100.00	66.67	90.91
M:PREP	1	4	0	20.00	100.00	23.81
M:PRON	0	0	2	100.00	0.00	0.00
M:PUNCT	98	27	35	78.40	73.68	77.41
M:VERB	1	1	2	50.00	33.33	45.45
R:ADJ	2	5	3	28.57	40.00	30.30
R:DET	0	0	2	100.00	0.00	0.00
R:MORPH	1	2	5	33.33	16.67	27.78
R:NOUN	2	0	7	100.00	22.22	58.82
R:NOUN:INFL	0	0	11	100.00	0.00	0.00
R:NOUN:NUM	5	10	9	33.33	35.71	33.78
R:NOUN:POSS	0	0	12	100.00	0.00	0.00
R:ORTH	25	34	39	42.37	39.06	41.67
R:OTHER	15	1	39	93.75	27.78	63.56
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	10	8	10	55.56	50.00	54.35
R:PRON	0	0	3	100.00	0.00	0.00
R:PUNCT	5	19	13	20.83	27.78	21.93
R:SPELL	62	1	33	98.41	65.26	89.34
R:VERB	3	2	5	60.00	37.50	53.57
R:VERB:FORM	4	8	4	33.33	50.00	35.71
R:VERB:INFL	1	0	3	100.00	25.00	62.50
R:VERB:SVA	8	11	4	42.11	66.67	45.45
R:VERB:TENSE	3	6	4	33.33	42.86	34.88
R:WO	0	0	1	100.00	0.00	0.00
U:CONJ	0	0	1	100.00	0.00	0.00
U:DET	5	14	1	26.32	83.33	30.49
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	0	10	2	0.00	0.00	0.00
U:PRON	0	1	0	0.00	100.00	0.00
U:PUNCT	1	1	10	50.00	9.09	26.32
U:VERB	0	0	2	100.00	0.00	0.00
U:VERB:FORM	0	1	0	0.00	100.00	0.00
U:VERB:TENSE	0	0	1	100.00	0.00	0.00
UNK	2	0	3	100.00	40.00	76.92

TOKEN-LEVEL DETECTION
OPERATION LEVEL
	TP	FP	FN	P	R	F_0.5
M	116	36	55	76.32	67.84	74.45
R	181	100	226	64.41	44.47	59.11
U	12	23	19	34.29	38.71	35.09
UNK	2	0	2	100.00	50.00	83.33

ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
ADJ	2	4	5	33.33	28.57	32.26
ADJ:FORM	1	0	1	100.00	50.00	83.33
ADV	1	0	1	100.00	50.00	83.33
CONJ	1	0	2	100.00	33.33	71.43
CONTR	0	0	3	100.00	0.00	0.00
DET	9	19	9	32.14	50.00	34.62
MORPH	1	1	5	50.00	16.67	35.71
NOUN	3	0	11	100.00	21.43	57.69
NOUN:INFL	0	0	11	100.00	0.00	0.00
NOUN:NUM	6	10	9	37.50	40.00	37.97
NOUN:POSS	3	0	16	100.00	15.79	48.39
ORTH	36	33	47	52.17	43.37	50.14
OTHER	30	1	48	96.77	38.46	74.26
PART	1	1	0	50.00	100.00	55.56
PREP	11	19	12	36.67	47.83	38.46
PRON	2	0	4	100.00	33.33	71.43
PUNCT	119	41	57	74.38	67.61	72.92
SPELL	62	1	34	98.41	64.58	89.08
UNK	2	0	2	100.00	50.00	83.33
VERB	3	5	9	37.50	25.00	34.09
VERB:FORM	5	7	4	41.67	55.56	43.86
VERB:INFL	1	0	3	100.00	25.00	62.50
VERB:SVA	8	9	4	47.06	66.67	50.00
VERB:TENSE	4	8	5	33.33	44.44	35.09

OPERATION + ERROR TYPE LEVEL
	TP	FP	FN	P	R	F_0.5
M:ADV	0	0	1	100.00	0.00	0.00
M:CONJ	1	0	1	100.00	50.00	83.33
M:DET	4	5	4	44.44	50.00	45.45
M:NOUN	1	0	4	100.00	20.00	55.56
M:NOUN:POSS	2	0	3	100.00	40.00	76.92
M:OTHER	3	0	1	100.00	75.00	93.75
M:PREP	1	3	1	25.00	50.00	27.78
M:PRON	1	0	1	100.00	50.00	83.33
M:PUNCT	102	26	37	79.69	73.38	78.34
M:VERB	0	2	2	0.00	0.00	0.00
M:VERB:TENSE	1	0	0	100.00	100.00	100.00
R:ADJ	2	4	2	33.33	50.00	35.71
R:ADJ:FORM	1	0	1	100.00	50.00	83.33
R:CONTR	0	0	3	100.00	0.00	0.00
R:DET	0	0	4	100.00	0.00	0.00
R:MORPH	1	1	5	50.00	16.67	35.71
R:NOUN	2	0	7	100.00	22.22	58.82
R:NOUN:INFL	0	0	11	100.00	0.00	0.00
R:NOUN:NUM	6	10	9	37.50	40.00	37.97
R:NOUN:POSS	1	0	13	100.00	7.14	27.78
R:ORTH	36	33	47	52.17	43.37	50.14
R:OTHER	26	1	46	96.30	36.11	72.22
R:PART	0	1	0	0.00	100.00	0.00
R:PREP	10	8	9	55.56	52.63	54.95
R:PRON	1	0	3	100.00	25.00	62.50
R:PUNCT	13	14	12	48.15	52.00	48.87
R:SPELL	62	1	34	98.41	64.58	89.08
R:VERB	3	3	5	50.00	37.50	46.88
R:VERB:FORM	5	7	4	41.67	55.56	43.86
R:VERB:INFL	1	0	3	100.00	25.00	62.50
R:VERB:SVA	8	9	4	47.06	66.67	50.00
R:VERB:TENSE	3	8	4	27.27	42.86	29.41
U:ADJ	0	0	3	100.00	0.00	0.00
U:ADV	1	0	0	100.00	100.00	100.00
U:CONJ	0	0	1	100.00	0.00	0.00
U:DET	5	14	1	26.32	83.33	30.49
U:OTHER	1	0	1	100.00	50.00	83.33
U:PART	1	0	0	100.00	100.00	100.00
U:PREP	0	8	2	0.00	0.00	0.00
U:PUNCT	4	1	8	80.00	33.33	62.50
U:VERB	0	0	2	100.00	0.00	0.00
U:VERB:TENSE	0	0	1	100.00	0.00	0.00
UNK	2	0	2	100.00	50.00	83.33

Submitted by:	cjbryant
Submitted at:	2019-08-07T14:43:42+00:00
Competition submission:	9
Competition phase:	3 - Open phase

Detailed results

Submission information

Results