Motivation and Aim

In the past couple of decades, the Indian NLP and Speech Technology community has shown an ever increasing interest in the development of Language Resources for Indian Languages. This has primarily been due to the fact that as the community grew, increasing research in and development of Language Technology brought out the acute awareness of a serious lack of appropriate resources across the languages of India. A number of initiatives have been taken to address this issue, by the Government of India as well as academia and the industry. Many of these initiatives have targeted specific NLP and Speech technologies, inculcating collaborations between several academic institutions across the country, and active involvement of industry partners. As expected, when a number of resources are simultaneously being developed by several research groups across many languages, the need for standards also takes on some urgency. In the past few years years, the Govt. of India, in consultation with the experts from academia and industry have taken lead in developing appropriate standards for NLP resources. This concentrated effort has resulted in a number resources, standards, tools and technologies becoming available for many Indian languages in the past few years. While the activity in the Indian Language community may still not be comparable to for example, the work done on European languages, we firmly believe that the community has come of age and is at a point where sharing of ideas and experience is necessary, not only within the community but with other communities working in similar situations, so that India can move forward in planning for the future language technology resources and requirement while maintaining its linguistic diversity.

India has 4 language families – Indo Aryan (76.87 % speakers), Dravidian (20.82 % speakers) being the major ones. These families have contributed 22 constitutionally recognized (‘scheduled’ or ‘national’) languages out of which Hindi has the ‘official’ status in addition to having the ‘national’ status. Besides these, India has 234 mother tongues reported by the recent census (2001), and many more (more than 1600) languages and dialects. Of the major Indian languages, Hindi is spoken in 10 (out of a total of 25) states of India with a total population of over 60 % followed by Telugu and Bangla. There are more than 18 scripts in India which need to be standardized and supported by technology. Devanagari is the largest script being used by more than 6 languages.

Indian languages are under the exclusive control of respective states they are spoken in. Therefore every state may decide on measures to promote its language. However, since these 22 languages are national (constituent) languages, the center (union of India) also has responsibility towards each of them, though it has certain additional responsibility towards Hindi which is national as well official language of the Indian union. From time to time, minor/neglected languages claim constituent status. The situation becomes more complex when such a language becomes the rallying point for the demand for a new state or autonomous region.

This complex linguistic scene in India is a source of tremendous pressure on the Indian government to not only have comprehensive language policies, but also to create resources for their maintenance and development. In the age of information technology, there is a greater need to have a fine balance between allocation of resources to each language keeping in view the political compulsions, electoral potential of a linguistic community and other issues.

Language promotion and maintenance by the Ministry of Human Resource Development

The MHRD through its language agency called CIIL and many academic institutions across the country has set up a Linguistic Data Consortium for Indian Languages (LDCIL). This consortium, being set up in the lines of the LDC at the University of Pennsylvania (USA), will not only create and manage large Indian languages databases, it will also provide a forum for researchers in India and other countries working on Indian languages to publish and build products for use based on such databases that would not otherwise be possible.

LDC-IL is expected to:

• Become a repository of linguistic resources in all Indian languages in the form of text, speech and lexical corpora.
• Facilitate creation of such databases by different organizations which could contribute and enrich the main LDC-IL repository.
• Set appropriate standards for data collection and storage of corpora for different research and development activities.
• Support language technology development and sharing of tools for language-related data collection and management.
• Facilitate training and manpower development in these areas through workshops, seminars etc. in technical as well as process related issues.
• Create and maintain the LDC-IL web-based services that would be the primary gateway for accessing its resources.
• Design or provide help in creation of appropriate language technology based on the linguistic data for mass use and
• Provide the necessary linkages between academic institutions, individual researchers and the masses.

The Technology Development for Indian Languages (TDIL) program of the Ministry of Communications and IT (MCIT)

The MCIT started a program called TDIL in 1991 for building technology solutions for Indian languages. The stated objective of the TDIL is

(i) to develop information processing tools and techniques,
(ii) to facilitate human-machine interaction without language barrier,
(iii) to create and access multilingual knowledge resources and integrate them to develop innovative user products and services.

The TDIL has made available in the public domain many basic software tools and fonts for 22 Indian languages. On the language resources funds, TDIL is running several language corpora projects in consortium mode. Some of the significant projects are:

• Development of LRs for English to Indian Languages Machine Translation (MT) System,
• Development of LRs Indian Language to Indian Language Machine Translation System
• Development of LRS Sanskrit-Hindi Machine Translation
• Development of LRs for Robust Document Analysis & Recognition System for Indian Languages
• Development of LRs for On-line handwriting recognition system
• Development of LRs Cross-lingual Information Access
• Development of Speech Corpora/Technologies
• Parallel Language Corpora development in all 22 national languages (ILCI)

Apart from the consortium-based efforts, there have been several specific institution/organization based efforts in developing standard resources for Indian Languages. Some prominent efforts include The Hindi Wordnet developed at IIT-Bombay, POS-Tagged Corpora developed in Bangla, Hindi and Sanskrit by Microsoft Research India in collaboration with Jawaharlal Nehru University, New Delhi.

WILDRE-1 (under LREC-2012, Istanbul, May21-17, 2012)

Given the amount of activity in the area of Language Technology Resources at the government, Institution, as well as individual researcher level, we organized the First Workshop in Istanbul in 2012. The workshop was a huge success in terms of large participation and number of submissions. For the half day workshop, we selected 8 full papers and 18 posters. The workshop featured three distinguished speakers in the inaugural session - Mrs. Swarn Lata (Head, TDIL, Dept of IT, Govt of India), Khalid Choukri, ELDA CEO, Prof. Pushpak Bhattacharyya, IIT Bombay. The workshop also featured a panel discussion on India and Europe - making a common cause in LTRs in which seven distinguished panelists participated - Kahlid Choukri, Joseph Mariani, Pushpak Bhattacharya, Swaran Lata, Monojit Choudhury, Zygmunt Vetulani, Dafydd Gibbon. The valedictory address was given by Nicoletta Calzolari, Director ILC-CNR, Italy.

WILDRE-2 (under LREC-2014, Reykjavik, Iceland, May26-31, 2014)

The 2nd Workshop for Indian Language Resources and Evaluation was organized on 27 May 2014, Harpa Conference Centre, Reykjavik, Iceland. The workshop was a big success with 7 full papers and 11 posters/demo selected for presentation in the half day workshop. Workshop featured prominent speakers like the inaugural address by Nicoletta Calzolari and keynote by Dafydd Gibbon. The panel discussion on “India and Europe - making a common cause in LTRs” was coordinated by Hans Uszkoreit and included among panelists the scholars like Joseph Mariani, Shyam Aggarwal, Zygmunt Vetulani, Dafydd Gibbon and Panchanan Mohanty. The second workhop was remarkable on another count. It saw a collaboration emerging between Indian and European partners on two platforms – the IMAGACT and the TypeCraft which led to joint poster presentations by the researchers from India and Europe. The seminar ended by valedictory address by Mrs Swaran Lata, head of the TDIL program of government of India.

Given the situation of Indian languages and the current scenario of language technology development in India, it is absolutely imperative that the Indian researchers present their data and research with the leading scholars in the world. We also feel that LREC is the best possible venue for such a workshop as the situation in Europe is comparable to India in terms of linguistic diversity and identity. ELRA and its associate organizations have been extremely active and successful in addressing the challenges and opportunities such a situation can often bring with it. Collocating WILRE-3 with LREC will give our research community an opportunity to interact with and learn from those involved in similar initiatives. LREC itself will also provide an exposure to challenges, and possible solutions globally, resulting in enriching and exchange of ideas.
Given the situation of Indian languages and the current scenario of language technology development in India, it is absolutely imperative that the Indian researchers present their data and research with the leading scholars in the world. We also feel that LREC is the best possible venue for such a workshop as the situation in Europe is comparable to India in terms of linguistic diversity and identity. ELRA and its associate organizations have been extremely active and successful in addressing the challenges and opportunities such a situation can often bring with it. Collocating WILRE-3 with LREC will give our research community an opportunity to interact with and learn from those involved in similar initiatives. LREC itself will also provide an exposure to challenges, and possible solutions globally, resulting in enriching and exchange of ideas.

Broader objectives of WILDRE-3 will be

• To map the status of Indian Language Resources
• To investigate challenges related to creating and sharing various levels of language resources
• To promote a dialogue between language resource developers and users
• To provide opportunity for researchers from India to collaborate with researchers from other parts of the world

Description of the Topic

WILDRE-3 will have a special focus on Demos of Indian Language Technology. In the past few years, as more resources have been developed and made available, there has been an increased activity in developing usable technology using these. WILDRE-3 would therefore like to encourage and widen the Demo track to allow the community to showcase their demos and have mutually beneficial interactions with each other as well as resource developers.

WILRE will invite technical, policy and position paper submissions on the following topics related to Indian Language Resources:

• Corpora - text, speech, multimodal, methodologies, annotation and tools
• Lexicons and Machine-readable dictionaries
• Ontologies
• Grammars
• Language resources for basic NLP, IR and Speech Technology tasks, tools and Infrastructure for constructing and sharing language resources
• Standards or specifications for language resources applications
• Licensing and copyright issues

Both submission and review processes handled electronically. The review process will be blind.  The workshop website will provide the submission guidelines and the link for the electronic submission.