What is special about this competition?
This competition may lead to a fast-track publication in FIRE 2021. It is absolutely optional but highly recommended as the nature of the competition is to solve an open academic task in NLP. More information here
How many participants can be in a team?
Participants may join in teams of up to 7 people including all co-authors of the paper (if desired to submit a technical report)
How many submissions are allowed?
Please, see the standard limit at the ODS SoC Competition Platform page
May the participants use any sources of information on the Internet?
Yes, as long as they are properly referenced should the participants want to publish a paper on their system and results
How will the results be evaluated?
The primary metric is weighted F1 score.
Additionally, we observe a secondary (optional) metrics ROC-AUC score. The default value of this metrics will be 0. It will serve as a tiebreaker for submissions where F1 stays the same. It is also highly recommendable to track this metrics for those participants who plan to publish the report.
What else is needed to publish?
Technical reports MUST be accompanied by the system code. Please, see mode details here