<h3>Task Description</h3>

<p>This is <strong>Subtask A of a double-task competition</strong>!&nbsp;</p>

<p>With the growth of spread and importance of social media platforms, the effect of their misuse became more and more impactful. In particular, numerous posts contain abusive language towards certain users and hence worsen users&rsquo; experience from communication via such platforms, while other posts contain actual threats that potentially put platform users in danger. &nbsp;The Urdu language has more than 230 million speakers worldwide with vast representation on social networks and digital media.&nbsp;<br />
We encourage participants to propose methods that can automatically detect threat and abuse in Urdu language to avoid violence and outrageous consequences.</p>

<h3>The Task is divided into two Subtasks</h3>

<p>Participants may choose to participate in either one or both subtasks. However, <u>to be eligible for the ODS SoC Prize</u>, the participant (participating team) <strong>is required to register and submit solutions for both subtasks</strong>. Subtask B (Threat detection) is given more weight than Subtask A (abusive language detection). Additionally, publication at <a href="http://fire.irsi.res.in/fire/2021/hasoc">FIRE 2021</a>&nbsp;is strongly encouraged.&nbsp;</p>

<h3>Subtask A:</h3>

<p>Subtask A focuses on detecting Abusive language using Twitter tweets in Urdu language. This is a binary classification task in which participating systems are required to classify tweets into two classes, namely: Abusive and Non-Abusive</p>

<p><em>Abusive</em> - This Twitter post contains some sort of abusive content.<br />
<em>Non-Abusive</em> - This Twitter post does not contain any abusive or profane content.</p>

<p>We followed <a href="https://help.twitter.com/en/rules-and-policies/abusive-behavior">Twitter</a> definition to describe abusive comments towards an individual or groups to harass, intimidate, or silence someone else&rsquo;s voice.</p>

<p>Subtask B is linked <a href="https://ods.ai/competitions/urdu-hack-soc2021-threat">here</a>&nbsp;</p>

<h3>Technical Report Submission</h3>

<p>After the result submission deadline, participants are invited to submit <strong>an abstract</strong> and <strong>a technical report</strong> paper with a brief description of their approach and experiments for publication in the FIRE 2021 Proceedings. &nbsp; All the working notes will be published in <a href="http://ceur-ws.org/"><strong>CEUR Workshop Proceedings</strong></a>. Please, see more information on the publication submission [<a href="http://www.urduthreat2021.cicling.org/home">here</a>]</p>

<h3><br />
Timeline of the Competition and Beyond&nbsp;</h3>

<p>July 23 &nbsp;&ndash; training and test data release; submission platform opens<br />
August 6&nbsp;- checkpoint at SoC&nbsp;<br />
August 27 - result submission <strong>deadline&nbsp;</strong><br />
August 28 - results announced (for the private part of the test set)<br />
September 3-5 - presentations at ODS Summer of Code 2021 festival&nbsp;<br />
October 12 - paper (technical report) submission <strong>deadline </strong>for publication in Working Notes <a href="http://fire.irsi.res.in/fire/2021/hasoc">FIRE 2021</a>&nbsp;- OPTIONAL, encouraged! (there will be a workshop on academic paper writing)<br />
October 26 - review notifications<br />
November 2 &ndash; Camera Ready Due<br />
16-20 December - <a href="http://fire.irsi.res.in/fire/2021/hasoc">FIRE 2021</a>&nbsp;(Online Event)</p>

<h3>Contacts &nbsp;</h3>

<ul>
	<li>Oxana Vitman &nbsp;<a href="http://mailto:oksana.vittmann@gmail.com">oksana.vittmann@gmail.com</a> &nbsp;Competition Information Coordinator (primary contact - all questions)&nbsp;</li>
	<li>Alisa Zhila <a href="http://mailto:alisa.zhila@gmail.com">alisa.zhila@gmail.com</a> Competition Organizer (secondary contact)</li>
	<li>Maaz Amjad &nbsp;<a href="http://mailto:maazamjad@phystech.edu">maazamjad@phystech.edu</a> Dataset creator (questions on the collection procedure, data sources, etc.), representative of FIRE conference (questions on potential publications)</li>
	<li><a href="https://www.gelbukh.com">Alexander Gelbukh</a>&nbsp;<a href="http://mailto:gelbukh@gelbukh.com">gelbukh@gelbukh.com</a> &nbsp;Head of the <a href="https://nlp.cic.ipn.mx">Laboratory for Natural Language and Text Processing</a>&nbsp;at <a href="https://www.cic.ipn.mx/index.php/en/">CIC-IPN</a>&nbsp;(questions on Master and PhD programs)</li>
	<li><a href="http://www.cic.ipn.mx/~sidorov">Grigori Sidorov</a>&nbsp;<a href="http://mailto:sidorov@cic.ipn.mx">sidorov@cic.ipn.mx</a> Professor at the <a href="https://nlp.cic.ipn.mx">Laboratory for Natural Language and Text Processing</a>&nbsp;of <a href="https://www.cic.ipn.mx/index.php/en/">CIC-IPN</a>&nbsp; (questions on Master and PhD programs)</li>
	<li>ODS slack channel&nbsp;<a href="https://opendatascience.slack.com/archives/C027KDQ47MM"><strong>#proj_soc1_urdu</strong></a></li>
</ul>

We invite participation in the competition for text classification of tweets in Urdu. The task is composed of two binary classification subtasks: (A) abusive intent; (B) threatening intent.

Public Leaderboard

Private Leaderboard

User Agreement

I accept <a target="_blank" rel="noopener noreferrer" href="https://drive.google.com/file/d/1n-fPczc0u7vYGvOzUUGH55HCbuRlCp8x/view?usp=sharing">Terms of User Agreement</a>

Privacy Policy

I accept <a target="_blank" rel="noopener noreferrer" href="https://drive.google.com/file/d/1JifpdktW5xCMAYgxzomLhYQZuxSrp0Wi/view?usp=sharing">Privacy Policy</a>

Consent

I give my <a target="_blank" rel="noopener noreferrer" href="https://storage.yandexcloud.net/datasouls-ods/DataFest2021_pres/Consent.pdf">consent</a> to «Sorevnovaniya Analiza Dannykh» LLC to process and transfer my personal data (name, email, address) to the partners of the event for information interaction

first_name

First name

last_name

Last name

country

Country (lat)

city

City (lat)

email

Email

slack_name

Your ODS Slack nickname

study_place

Study place

study_specialty

Study specialty

work_place

Work place

work_position

Work position

expectations

Expectations

interests

Interests

preferred_language

Preferred language

about

About

Registration application for Data Fest & ODS Summer Of Code

Abusive and Threatening Language Detection for Tweets in Urdu Subtask A: Abusive Language Detection

#	Teams (14)	F1 Score	ROC AUC	Last	Entries
1	hate-alert	0.88062	0.92449	5y	5
2	SAKSHI SAKSHI	0.86853	0.93503	5y	1
3	decent gradients	0.86221	0.92194	5y	2
4	SATLab	0.85635	0.91744	5y	15
5	Jie Yi Xiang	0.85369	0.91481	5y	7
6	Vlad Balanda	0.84973	0.09456	5y	6
7	Muhammad Humayoun	0.82584	0.82436	5y	10
8	Igor Shatalin	0.82123	0.20775	5y	2
9	Alt-Ed	0.82073	0.89084	5y	4
10	Abhinav kumar	0.80857	0.90705	5y	6
11	Team data has been deleted	0.7916	0.90807	5y	1
12	Mikhail Sveshnikov	0.78684	0.88295	5y	2
13	Alisa Zhila	0.78684	0.88295	5y	2
14	Maria Potapova	0.69036	0.5	5y	2