Metric	Score
F1	75.32
Likelihood	5.33
Accuracy	39.47
F2	77.59

Metric	Score
F1	67.24
Likelihood	1.02
Accuracy	37.24
F2	71.91

worst items

note: the gold standard is taken from the submission itself, not from the challenge data!

#	input	expected output	actual output	test-A F1
1	Avis juridique important \n \n \n \n \n | \n \n \n \n 31993L0046 \n \n Commission Directive 93/46/EEC of 22 June 1993 replacing and modifyin…	european_union health	health:0.166784108 media_informations:0.010000000 transportation:0.010000000 industry:0.010000000 work_and_employment:0.010000000 agricultur…	0.00
2	"COMMISSION OF THE EUROPEAN COMMUNITIES C0M(93) 303 final - SYN 455-457 Brussels,24 June 1993 Amended proposal for a COUNCIL REGULATION (EEC…	agriculture	health:0.010000000 media_informations:0.141774133 transportation:0.018082807 industry:0.039956294 work_and_employment:0.010000000 agricultur…	0.00
3	"CO:M.\AISSION OF THE EUROPEAN COI\t.\IDNITIES COM(93) 313 final Brussels, 30 June 1993 COMMISSION OPINION ON THE APPLICATION BY THE REPUBLI…	european_union foreign_policy	health:0.010000000 media_informations:0.089756265 transportation:0.011730977 industry:0.088083796 work_and_employment:0.010000000 agricultur…	0.00
4	11.10.1993    \n \n \n EN \n \n \n Official Journal of the European Communities \n \n \n L 253/1 \n \n \n \n \n \n COMMISSION REGULATION (EE…	european_union taxes law	health:0.024311882 media_informations:0.426908553 transportation:0.034650862 industry:0.101543605 work_and_employment:0.010189721 agricultur…	0.00
5	"COMMISSION OF THE EUROPEAN COMMUNITIES C0M(93) 285final Brussels, 5 JuI y 1993 Proposal for a COUNCIL DECISION on the conclusion, on behalf…	law	health:0.044343468 media_informations:0.046658330 transportation:0.045873579 industry:0.270141214 work_and_employment:0.018515868 agricultur…	0.00
6	"COMMISSION OF THE EUROPEAN COMMUNITIES C0M(93) 285final Brussels, 5 JuI y 1993 Proposal for a COUNCIL DECISION on the conclusion, on behalf…	law social_life	health:0.044343468 media_informations:0.046658330 transportation:0.045873579 industry:0.270141214 work_and_employment:0.018515868 agricultur…	0.00
7	"COMMISSION OF THE EUROPEAN COMMUNITIES C0M(93) 285final Brussels, 5 JuI y 1993 Proposal for a COUNCIL DECISION on the conclusion, on behalf…	law social_life	health:0.044343468 media_informations:0.046658330 transportation:0.045873579 industry:0.270141214 work_and_employment:0.018515868 agricultur…	0.00
8	"COMMISSION OF THE EUROPEAN COMMUNITIES C0M(93) 285final Brussels, 5 JuI y 1993 Proposal for a COUNCIL DECISION on the conclusion, on behalf…	law	health:0.044343468 media_informations:0.046658330 transportation:0.045873579 industry:0.270141214 work_and_employment:0.018515868 agricultur…	0.00
9	"COMMISSION OF THE EUROPEAN COMMUNITIES C0M(93) 285final Brussels, 5 JuI y 1993 Proposal for a COUNCIL DECISION on the conclusion, on behalf…	law social_life	health:0.044343468 media_informations:0.046658330 transportation:0.045873579 industry:0.270141214 work_and_employment:0.018515868 agricultur…	0.00
10	10. 8. 93 Official Journal of the European Communities No C 215/17 II (Preparatory Acts) COMMISSION Amended proposal for a Council Decision …	health	health:0.010000000 media_informations:0.697733581 transportation:0.290388703 industry:0.071007207 work_and_employment:0.056892931 agricultur…	0.00
11	No C 210/22 Official Journal of the European Communities 4. 8. 93 HAS DECIDED AS FOLLOWS: from the Structural Funds for the CSFs concerned, …	agriculture	health:0.010000000 media_informations:0.058071110 transportation:0.010000000 industry:0.010000000 work_and_employment:0.010000000 agricultur…	0.00
12	"Avis juridique important \n \n \n \n \n | \n \n \n \n 31993D0428 \n \n 93/428/Euratom: Commission Decision of 19 July 1993 on a procedure f…	energy	health:0.010000000 media_informations:0.027201237 transportation:0.014123794 industry:0.027168287 work_and_employment:0.010000000 agricultur…	0.00
13	No C 219/16 Official Journal of the European Communities 13. 8. 93 — any direct or indirect refund offees is prohibited. to the urgency of t…	agriculture	health:0.010000000 media_informations:0.046383880 transportation:0.010000000 industry:0.013016655 work_and_employment:0.010000000 agricultur…	0.00
14	"COMMISSION OF THE EUROPEAN COMMUNITIES C0M(93) 349 final Brussels, 20 July 1993 Amended proposal for a COUNCIL DIRECTIVE LAYING DOWN THE BA…	european_union law work_and_employment social_life	health:0.398108214 media_informations:0.010000000 transportation:0.010000000 industry:0.010000000 work_and_employment:0.363514274 agricultur…	0.00
15	"COMMISSION OF THE EUROPEAN COMMUNITIES COM(93) 299 final Brussels, 22 July 1993 Proposal for a COUNCIL REGULATION (EEC) amending Council re…	health economy	health:0.104726776 media_informations:0.010000000 transportation:0.010000000 industry:0.010000000 work_and_employment:0.014734656 agricultur…	0.00
16	Avis juridique important \n \n \n \n \n | \n \n \n \n 31993D0454 \n \n 93/454/EEC, Euratom: Commission Decision of 22 July 1993 defining tax…	european_union taxes media_informations	health:0.010000000 media_informations:0.213304177 transportation:0.010000000 industry:0.010000000 work_and_employment:0.010000000 agricultur…	0.00
17	No C 225/6 Official Journal of the European Communities 20. 8. 93 — refrain from taxing such profits, or them to comply with this Directive …	transportation	health:0.010000000 media_informations:0.038484894 transportation:0.026210275 industry:0.014619406 work_and_employment:0.010000000 agricultur…	0.00
18	"COMMISSION OF THE EUROPEAN COMMUNITIES lllp •KwMS COM(93) 362 final Brussels, 28 July 1993 m iBisl TACIS (Technical Assistance Programme to…	foreign_policy	health:0.026651986 media_informations:0.177393183 transportation:0.052498665 industry:0.117272355 work_and_employment:0.020696638 agricultur…	0.00
19	Avis juridique important \n \n \n \n \n | \n \n \n \n 31993D0426 \n \n 93/426/EEC: Commission Decision of 28 July 1993 granting the second C…	european_union	health:0.010684962 media_informations:0.310416996 transportation:0.110346407 industry:0.044855013 work_and_employment:0.031858139 agricultur…	0.00
20	Avis juridique important \n \n \n \n \n | \n \n \n \n 31993R2551 \n \n COMMISSION REGULATION (EEC) No 2551/93 of 10 August 1993 amending Ann…	taxes	health:0.010000000 media_informations:0.511236131 transportation:0.017925873 industry:0.023664819 work_and_employment:0.010000000 agricultur…	0.00
21	"COMMISSION OF THE EUROPEAN COMMUNITIES COM(93) 359 final Brussels, 1 September 1993 Proposal for a COUNCIL DECISION concerning the conclusi…	foreign_policy law agriculture	health:0.016656235 media_informations:0.597847223 transportation:0.064642556 industry:0.417781681 work_and_employment:0.010000000 agricultur…	0.00
22	"COMMISSION OF THE EUROPEAN COMMUNITIES COM(93) 359 final Brussels, 1 September 1993 Proposal for a COUNCIL DECISION concerning the conclusi…	foreign_policy law agriculture	health:0.016656235 media_informations:0.597847223 transportation:0.064642556 industry:0.417781681 work_and_employment:0.010000000 agricultur…	0.00
23	"COMMISSION OF THE EUROPEAN COMMUNITIES COM(93) 359 final Brussels, 1 September 1993 Proposal for a COUNCIL DECISION concerning the conclusi…	foreign_policy law agriculture	health:0.016656235 media_informations:0.597847223 transportation:0.064642556 industry:0.417781681 work_and_employment:0.010000000 agricultur…	0.00
24	"1. 10. 93 Official Journal of the European Communities No C 266/11 Proposal for a Council Decision on the implementation by the Me ber Stat…	research_science_and_technology	health:0.010000000 media_informations:0.804624021 transportation:0.035892885 industry:0.079116695 work_and_employment:0.010000000 agricultur…	0.00
25	"CSTÎY • COMMISSION OF THE EUROPEAN COMMUNITIES ?4 î1 - F COM(93) 435 final Brussels, 22 September 1993 IP lit £ -Ç- in MEDIUM-TERM ACTION P…	social_life	health:0.017215537 media_informations:0.376772314 transportation:0.055433426 industry:0.088368580 work_and_employment:0.020906292 agricultur…	0.00
26	"CSTÎY • COMMISSION OF THE EUROPEAN COMMUNITIES ?4 î1 - F COM(93) 435 final Brussels, 22 September 1993 IP lit £ -Ç- in MEDIUM-TERM ACTION P…	social_life economy	health:0.017215537 media_informations:0.376772314 transportation:0.055433426 industry:0.088368580 work_and_employment:0.020906292 agricultur…	0.00
27	"CSTÎY • COMMISSION OF THE EUROPEAN COMMUNITIES ?4 î1 - F COM(93) 435 final Brussels, 22 September 1993 IP lit £ -Ç- in MEDIUM-TERM ACTION P…	social_life	health:0.017215537 media_informations:0.376772314 transportation:0.055433426 industry:0.088368580 work_and_employment:0.020906292 agricultur…	0.00
28	27. 11. 93 Official Journal of the European Communities No C 321/15 on exploitation by fixing fishing opportunities in terms of restricted i…	european_union law economy	health:0.010000000 media_informations:0.010000000 transportation:0.010000000 industry:0.010000000 work_and_employment:0.010000000 agricultur…	0.00
29	"COMMISSION OF THE EUROPEAN COMVIUNITIES C0M(93) 457 final Brussels, 29 September 1993 GREEN PAPER ON THE EUROPEAN DIMENSION OF EDUCATION (p…	european_union research_science_and_technology	health:0.010000000 media_informations:0.010000000 transportation:0.010000000 industry:0.010000000 work_and_employment:0.010000000 agricultur…	0.00
30	"COMMISSION OF THE EUROPEAN COMMUNITIES C0M(93) 405 final Brussels» 29 September 1993 Amended proposal for a COUNCIL REGULATION (EEC) amendi…	transportation economy	health:0.010000000 media_informations:0.494181931 transportation:0.280431718 industry:0.017040860 work_and_employment:0.034160890 agricultur…	0.00
31	Avis juridique important \n \n \n \n \n | \n \n \n \n 31993R2806 \n \n COMMISSION REGULATION (EEC) No 2806/93 of 13 October 1993 amending Re…	economy	health:0.010000000 media_informations:0.021558572 transportation:0.010000000 industry:0.010000000 work_and_employment:0.010000000 agricultur…	0.00
32	"COMMISSION OF THE EUROPEAN COMMUNITIES COM(93) 519 final Brussels, 18 October 1993 K -J H # 4 ,*feë^tf Proposal for a COUNCIL REGULATION (E…	law foreign_policy	health:0.010000000 media_informations:0.011911284 transportation:0.010000000 industry:0.317129463 work_and_employment:0.010000000 agricultur…	0.00
33	"Avis juridique important \n \n \n \n \n | \n \n \n \n 31994D0226 \n \n 94/226/EEC: Commission Decision of 27 October 1993 concerning the gr…	european_union environment	health:0.010000000 media_informations:0.010000000 transportation:0.010000000 industry:0.010000000 work_and_employment:0.010000000 agricultur…	0.00
34	"COMMISSION OF THE EUROPEAN COMMUNITIES C0M(93) 516 final Brussels, 28 October 1993 ELEVENTH ANNUAL REPORT FROM THE COMMISSION TO THE EUROPE…	industry law economy	health:0.010000000 media_informations:0.280297905 transportation:0.035848249 industry:0.045894682 work_and_employment:0.014244631 agricultur…	0.00
35	"COMMISSION OF THE EUROPEAN COMMUNITIES C0M(93) 537 final - SYN 446 Brussels, 28 October 1993 Re-examined proposal for a COUNCIL PECI?)QN on…	research_science_and_technology	health:0.012391923 media_informations:0.418564767 transportation:0.130282164 industry:0.079899386 work_and_employment:0.394023240 agricultur…	0.00
36	"COMMISSION OF THE EUROPEAN COMMUNITIES COM(93) 530 final Brussels, 29 October 1993 FOURTH ANNUAL REPORT FROM THE COMMISSION ON THE IMPLEMEN…	european_union economy agriculture	health:0.010000000 media_informations:0.147112340 transportation:0.010000000 industry:0.111482255 work_and_employment:0.010000000 agricultur…	0.00
37	"COMMISSION OF THE EUROPEAN COMWDNITIES C0M(93) 570 final Brussels, 10 November 1993 LIST OF PROPOSALS PENDING BEFORE THE COUNCIL ON 31 OCTO…	european_union work_and_employment economy	health:0.010000000 media_informations:0.492336422 transportation:0.025155257 industry:0.388339162 work_and_employment:0.010000000 agricultur…	0.00
38	"COMMISSION OF THE EUROPEAN COMMUNITIES COM (93)509 fina Brussels, 15 November 1993 GREEN PAPER ON GUARANTEES FOR CONSUMER GOODS AND AFTER-S…	law	health:0.020425072 media_informations:0.346303552 transportation:0.086385891 industry:0.429599315 work_and_employment:0.017725136 agricultur…	0.00
39	"COMMISSION OF THE EUROPEAN COMMUNITIES C0MC93) 518fina Brussels, 16 November 1993 COMMUNICATION FROM THE COMMISSION TO THE COUNCIL AND THE …	social_life	health:0.010000000 media_informations:0.077200137 transportation:0.015356702 industry:0.194713339 work_and_employment:0.011128250 agricultur…	0.00
40	"COMMISSION OF THE EUROPEAN COMMUNITIES C0M(93) 576 final Brussels, 16 November 1993 Green Paper ACCESS OF CONSUMERS TO JUSTICE AND THE SETT…	law	health:0.019213986 media_informations:0.288679779 transportation:0.030497855 industry:0.082169145 work_and_employment:0.014425429 agricultur…	0.00