SemEval 2018 Task 7 Results

Task 7 Subtask 1.1 Classification on clean data

Subtask 1.1: Ranking
Rank	Team/Participant	Best F1 score
1	ETH-DS3Lab (Team3DS)	81.7
2	UWNLP (UWIE)	78.9
3	SIRIUS-LTG-UiO	76.7
4	DMIR	74.9
5	Talla	74.2
6	MIT-MEDG	72.7
7	TakeLab	69.7
8	Texterra	64.9
9	GU IRLAB	60.9
10	sbuNLP	49.7
11	IRCMS	49.1
12	dhyani.2	48.1
13	NTNU	47.4
14	danish037	45.7
15	HeMu	45.2
16	University of Mannheim, Team Project	44.0
17	LaSTUS/TALN	43.2
18	DFKI	39.9
19	LTRC	37.3
20	BIT_NLP	32.9
21	likewind_1234	29.3
22	Vitk	29.0
23	hccl	28.1
24	xingwang	27.8
25	Team VCU -07	20.3
26	UKP	19.3
27	dragoni	18.0
28	angelocsc	15.0

Subtask 1.1: Submissions
Subm. Rank	Participant	Team	macro-average F1	Submission date	Submission file name
1	rotsztej	ETH-DS3Lab	81.7	2018-01-26 21:37:20.285988+00:00	submission_26.01.18-18.26.zip
2	rotsztej	ETH-DS3Lab	81.2	2018-01-25 15:52:09.874767+00:00	submission_22.01.18-16.45.zip
3	rotsztej	ETH-DS3Lab	80.8	2018-01-26 17:08:21.168791+00:00	submission_23.01.18-20.43.zip
4	luanyi	UWNLP	78.9	2018-01-28 00:13:17.171925+00:00	micro_task1_1.zip
5	luanyi	UWNLP	78.4	2018-01-27 23:55:15.990838+00:00	macro_task1_1.zip
6	SIRIUS	SIRIUS-LTG-UiO	76.7	2018-01-26 09:17:08.244580+00:00	RESULTS_FILE_M.txt.zip
7	hettinger	DMIR	74.9	2018-01-28 13:00:05.457459+00:00	prediction_1.1.final._l_tf5_wvf_rbf_pd.zip
8	SIRIUS	SIRIUS-LTG-UiO	74.7	2018-01-26 10:13:35.010242+00:00	RESULT_FILE_2_Fold4.txt.zip
9	bgalbraith	Talla	74.2	2018-01-25 23:36:55.451762+00:00	submission_1stage_ensemble_1.1.txt.zip
10	bgalbraith	Talla	73.9	2018-01-25 23:41:28.017454+00:00	submission_2stages_ensemble_1.1.txt.zip
11	bgalbraith	Talla	73.7	2018-01-24 22:41:36.005752+00:00	submission_ensemble_1.1.txt.zip
12	hettinger	DMIR	73.3	2018-01-28 13:03:07.243501+00:00	prediction_1.1.final._l_tf5_wvf_rbf_df.zip
13	jindi	MIT-MEDG	72.7	2018-01-28 15:28:51.473536+00:00	1.1.answers_for_submission_nodev.txt.zip
14	jindi	MIT-MEDG	72.3	2018-01-28 23:08:54.778340+00:00	1.1.answers_for_submission_dev_stratify.txt.zip
15	SIRIUS	SIRIUS-LTG-UiO	72.1	2018-01-26 09:16:46.821942+00:00	RESULT_FILE_2_Fold0_Best.txt.zip
16	jindi	MIT-MEDG	71.5	2018-01-28 19:47:15.479229+00:00	1.1.answers_for_submission_dev.txt.zip
17	mgluhak	TakeLab	69.7	2018-01-27 18:51:38.650837+00:00	svm1.1.zip
18	mgluhak	TakeLab	67.6	2018-01-28 20:29:10.871755+00:00	cnn_sumbissionsT1.1.zip
19	sysoev	Texterra	64.9	2018-01-26 16:00:57.082424+00:00	1.1-CNN.txt.zip
20	mgluhak	TakeLab	63.7	2018-01-27 19:01:37.899183+00:00	cnn_sumbissionsT1.1.zip
21	hettinger	DMIR	63.3	2018-01-28 11:23:18.023219+00:00	prediction_1.1.final_l_tf5_wvf_clstm.zip
22	sysoev	Texterra	62.4	2018-01-26 15:53:24.035342+00:00	1.1-4CNN.txt.zip
23	soldni	GU IRLAB	60.9	2018-01-28 18:22:59.168461+00:00	Archive.zip
24	sysoev	Texterra	55.8	2018-01-27 03:20:44.305969+00:00	1.1-LSTM.zip
25	Rayehe	sbuNLP	49.7	2018-01-28 14:33:41.256604+00:00	SBUnlp_7_1.1.txt.zip
26	ZhongboYin	IRCMS	49.1	2018-01-28 submitted by email	submit20180129_end.zip
27	dhyani.2		48.1	2018-01-29 04:56:00.868399+00:00	output_test_1.1_src1.1.1.2.txt.zip
27	ZhongboYin	IRCMS	48.1	2018-01-28 14:19:00.788546+00:00	submit20180128_end.zip
29	bn.barik	NTNU	47.4	2018-01-28 11:37:34.679905+00:00	1.1_test_out.zip
30	ZhongboYin	IRCMS	47.2	2018-01-28 17:39:40.515915+00:00	submit20180128_end2.zip
31	danish037		45.7	2018-01-28 23:25:55.291708+00:00	final_output_only_GP.txt.zip
32	HeMu		45.2	2018-01-29 07:35:10.202324+00:00	test.zip
33	danish037		45.1	2018-01-28 23:24:35.346473+00:00	final_output_gp_regex.txt.zip
34	Yuan	University of Mannheim, Team Project	44.0	2018-01-27 20:08:13.791478+00:00	subtask1.1svm0127_new.zip
34	Yuan	University of Mannheim, Team Project	44.0	2018-01-28 14:10:22.822170+00:00	subtask1.1svm0127_new.zip
36	abravo	LaSTUS/TALN	43.2	2018-01-28 19:30:51.678495+00:00	1.1.result_FINAL_TOKEN_POS_LEMMA.txt.zip
37	abravo	LaSTUS/TALN	42.0	2018-01-28 19:30:40.690851+00:00	1.1.result_FINAL_TOKEN_LEMMA_DEPFUNCT.txt.zip
38	abravo	LaSTUS/TALN	41.9	2018-01-28 19:30:27.180331+00:00	1.1.result_FINAL_TOKEN_POS_LEMMA_DEPFUNCT.txt.zip
39	danish037		40.8	2018-01-28 23:25:24.432735+00:00	final_output_nn_regex.txt.zip
40	HeMu		40.0	2018-01-23 14:57:25.310691+00:00	result.zip
41	trenslow	DFKI	39.9	2018-01-25 17:44:57.141732+00:00	11submission2.zip
42	trenslow	DFKI	39.3	2018-01-25 17:44:42.491467+00:00	11submission1.zip
43	trenslow	DFKI	39.2	2018-01-25 17:45:02.063788+00:00	11submission3.zip
44	pruthwik.mishra	LTRC	37.3	2018-01-28 12:12:19.126796+00:00	1.1.test.answers3.txt.zip
45	dhyani.2		35.4	2018-01-29 04:03:30.814765+00:00	output_test_1.1_src1.1.txt.zip
46	zhaohe1995	BIT_NLP	32.9	2018-01-28 14:10:40.070419+00:00	Subtask1.1.txt.zip
47	Yuan	University of Mannheim, Team Project	32.5	2018-01-28 14:09:50.806540+00:00	subtask1.1knn0127.zip
48	likewind_1234		29.3	2018-01-28 03:58:27.879428+00:00	task7_1.1.zip
49	phuonglh	Vitk	29.0	2018-01-25 15:16:56.784245+00:00	output.txt.zip
50	mingmingfu	hccl	28.1	2018-01-27 05:22:17.651217+00:00	gru1050.zip
51	xingwang		27.8	2018-01-26 19:50:12.406470+00:00	test1.1.v1_submit_jan26.zip
52	mingmingfu	hccl	26.8	2018-01-27 05:10:45.269426+00:00	merge.zip
53	Darshini	Team VCU -07	20.3	2018-01-26 18:08:50.796873+00:00	1.1.Submission1.zip
54	huber	UKP	19.3	2018-01-28 21:29:52.823638+00:00	1.1_CSB.zip
55	dragoni	NEUROSENT-PDI	18.0	2018-01-26 09:48:52.439328+00:00	task-1.1.zip
56	angelocsc		15.0	2018-01-22 07:01:08.120686+00:00	bow_dnn_6layer.txt.zip
57	Darshini	Team VCU -07	14.0	2018-01-26 18:15:58.913352+00:00	1.1.Submission2.zip
58	angelocsc		11.2	2018-01-22 06:49:04.585565+00:00	bow_dnn_6layer.txt.zip
59	angelocsc		0.0	2018-01-22 02:57:53.419263+00:00	train_submit.txt.zip