French Treebank

A reference treebank for French starting with a tagged newspaper corpus of 1 Million words.

Laboratoire de linguistique formelle, Université de Paris.

No - but the current owners/custodians have contact information for data queries

Terms and conditions of use for internal research purposes of the French Treebank

In order to get an access to the CORPUS, the User agrees to these terms and conditions of use.

Article 1 – Definitions

1.1 CORPUS refers to: "Le corpus arboré pour le français" French Treebank described in annex and crafted by the Laboratoire de linguistique formelle and owned by the université de Paris.

1.2 Supplier refers to: Université Paris-Diderot – Paris 7 (Laboratoire de linguistique formelle)

Article 2 – Purpose of the agreement

This agreement describes the conditions in which Université Paris-Diderot – Paris 7 (the Supplier) provides the User a nonexclusive, nontransferable and personal right to use the CORPUS, whithout any cost, for research purposes only, valid worldwide. Specifications are described on the website of the Supplier.

Article 3 – Provision of the CORPUS

There is no such thing as a recording medium of the CORPUS. The provision is made possible by the delivery of a personal identification number (P-ID). This P-ID is delivered after having agreed to these terms and conditions of use by the User.

Since the User is given a P-ID by the Supplier, he can download the COPURS within thirty (30) days, and only three (3) times.

Article 4 – Intellectual property

The Supplier is the only owner of the rights attached to the CORPUS, guidelines included. This agreement does not imply the transfer of intellectual property to the User.

The User has a nonexclusive, nontransferable and personal right to use the CORPUS for his own research purposes only.

The User commits himself to never delete or amend the tags, copyright notes or any other distinct mark appended on the CORPUS.

Article 5 – User obligations

The User commits himself to use the CORPUS within the scope of a clear and identified project, and only for internal research purposes.

The User is not allowed to make any copy of the CORPUS except a safety one.

The User is not allowed to translate, adapt, dismantle or uncompile the CORPUS.

The User commits himself to not give up to anyone, even if the transaction is free of charge, the right to use granted by the present agreement.

The User commits himself to not use the CORPUS for any commercial or advertising purposes.

The User commits himself to redistribute to the Supplier any improved or enriched version he could make of the CORPUS. The User will do his best to share his experience of the use of the CORPUS with the Supplier (errors, mistakes…).

Article 6 – Related services

The present agreement does not include any maintenance contract or assistance with the use of the CORPUS.

Yet, the Supplier reachable through the contact form.

When a new version of the CORPUS is distributed, the Supplier will inform the User by email in order to provide him a chance to download it.

Article 7 – Guarantees and limitation of liability

The ressource is distributed with no guarantee and the Supplier is not responsible for the uses that will be made of it.

In no case the Supplier will be held responsible for any damages to the User caused by the use of the CORPUS.

Article 8 – Publications

In all the publications about the results related to the use of the CORPUS, the User has to mention that his studies were produced thanks to the CORPUS. He also commits himself to mention the name of the Supplier as the owner ot the intellectual property rights and make a reference to this publication: « Abeillé, A., L. Clément, and F. Toussenel. 2003. "Building a treebank for French", in A. Abeillé (ed) Treebanks, Kluwer, Dordrecht. (p. 165-187) ».

Article 9 – Duration

This agreement comes into effect at the time the personal identification number is given by the Supplier and is still valid during the whole term of the intellectual property rights that protect the CORPUS.

Article 10 – Disputes – Applicable Law

This agreement is subject to French laws and regulations.

In case of dispute over the reading or the execution of this agreement, the parties will do their best to find an amicable solution.

If this dispute longs more than two (2) months, the parties will have recourse at their initiative to the Court of Paris.

Annex: list of the resources of the CORPUS

Corpus over 21.550 sentences (664.533 tokens) from the newspaper Le Monde (1990-1993) tokenized, tagged and corrected for the compounds, categories and inflectional morphology, lemmas, constituants and grammatical functions; in three formats: original XML, Tiger-XML (searchable with Tiger-search), PTB (depleted);
Corpus of texts segmented into articles with TEI annotations (article, date, author, coverage) related to the files above;
Documentation about the annotated corpus with annotation choices, divided into three guidelines: Morphosyntactic annotations (simple words, compounds), Constituants annotations, Functions annotations.

No - the dataset curators describe the primary sources but they are fully private


IndoNLI

A Natural Language Inference Dataset for Indonesian.

Yes - it has a direct download link or links

cc-by-sa-3.0: Creative Commons Attribution Share Alike 3.0 Unported

cc-by-sa-4.0: Creative Commons Attribution Share Alike 4.0 International

Yes - their documentation/homepage/description is available

Yes - the dataset has the same license as the source material

web | wiki
web | news or magazine website


VilaQuAD: an extractive QA dataset from Catalan newswire

This dataset contains 2095 of Catalan language news articles along with 1 to 5 questions referring to each fragment (or context).
VilaQuad articles are extracted from the daily Vilaweb (www.vilaweb.cat) and used under CC-by-nc-sa-nd (https://creativecommons.org/licenses/by-nc-nd/3.0/deed.ca) licence.
This dataset can be used to build extractive-QA and Language Models.

Funded by the Generalitat de Catalunya, Departament de Polítiques Digitals i Administració Pública (AINA), MT4ALL and Plan de Impulso de las Tecnologías del Lenguaje (Plan TL).


Creative Commons

Creative Commons is a nonprofit organization that helps overcome legal obstacles to the sharing of knowledge and creativity to address the world’s pressing challenges.

Niger-Congo Arabic Basque Catalan Chinese English French Indic Indonesian Portuguese Spanish Vietnamese


The Hollywood Reporter Digital and Print Magazine

The Hollywood Reporter (THR) is an American digital and print magazine, and website, which focuses on the Hollywood film, television, and entertainment industries. It was founded in 1930 as a daily trade paper, and in 2010 switched to a weekly large-format print magazine with a revamped website. As of 2020, the day-to-day operations of the company are handled by Penske Media Corporation through a joint venture with MRC.

Northern America
United States of America

unknown: License information unavailable


Ekaia EHUko Zientzia eta Teknologia aldizkaria

Ekaia is a scientific journal created in 1989. It publishes original works on nature sciences, health sciences, exact sciences and technology.

Standard Basque, scientifical-technological domain

Edorta Ibarra Basabe

No - we would need to spontaneously reach out to the current owners/custodians

cc-by-nc-sa-4.0: Creative Commons Attribution Non Commercial Share Alike 4.0 International


The Language Archive

The Language Archive is part of the Max Planck Institute for Psycholinguistics in Nijmegen. It contains various materials, including: audio and video language corpus data from languages around the world; photographs, notes, experimental data, and other relevant information required to document and describe languages and how people use them; records of speech in everyday interactions in families and communities; naturalistic data from adult conversations from endangered and under-studied languages, and linguistic phenomena.


El Archivo y Biblioteca Nacionales de Bolivia

The National Archive and Library of Bolivia are located in Sucre. The institution was established in 1836. Its collections has 114,000 volumes.

Americas
Latin America and the Caribbean
Bolivia

A library, museum, or archival institute


Freelancer Market Place Website

Freelancer is an Australian freelance marketplace website, which allows potential employers to post jobs that freelancers can then bid to complete. Founded in 2009, its headquarters is located in Sydney, Australia, though it also has offices in Vancouver, London, Buenos Aires, Manila, and Jakarta.
Freelancer is a marketplace where employers and employees are able to find each other. The site allows employers to post work for site members who place bids in a competitive tender process. The site also allows members to host and enter contests for which prize money is offered as a reward. Freelancers and employers develop profiles on the site as they offer, win and complete work and write and receive reviews of people they work with or for. The site's members receive a finite number of bids to use on the site, which are periodically replenished. A series of account options are offered, ranging from free accounts through to professional subscriptions.

World-Wide
Australia
Germany
United Kingdom
United States of America
India


ffr dataset

FFR v1.0" is the first stage of a Fon-French translation model project, trained on https://github.com/bonaventuredossou/ffr-v1/tree/master/FFR-Dataset using neural machine translation with attention. While it could be observed that Masakhane https://www.masakhane.io/ (https://twitter.com/MasakhaneMt) , an online community of African researchers working on machine translation for African languages, have generated translation models and baselines from/to many African languages, however, the "Project FFR v1.0” is the first to make this effort on a large scale, by taking time to painstakingly amass a large training dataset and exploring techniques to work with the Fon diacritics for better translation accuracy in order to achieve a publishable model which may be used by people to a certain degree of reliability.

the data was curated from several sources that may or may not have copyright. Need to talk more with the contact person.

bible verses mixed with sentences from other domains


MERLOT Collection

The MERLOT collection consists of tens of thousands of discipline-specific learning materials, learning exercises, and Content Builder webpages, together with associated comments, and bookmark collections, all intended to enhance the teaching experience of using a learning material. All of these items have been contributed by the MERLOT member community, who have either authored the materials themselves, or who have discovered the materials, found them useful, and wished to share their enthusiasm for the materials with others in the teaching and learning community.

open license
copyright - all rights reserved


GeekWire Technology news

GeekWire is a fast-growing, national technology news site with strong roots in the Seattle region and a large audience of loyal, tech-savvy readers around the globe, who follow the site for breaking news, expert analysis and unique insights into the technology industry.

Founded in 2011, GeekWire is uniquely positioned to cover some of the most widely followed and innovative tech companies in the world, and one of the most vibrant startup markets in the country.

Our signature events bring out thousands of people to connect, learn, recruit, do business and have fun with a broad cross-section of the tech community. Our membership program includes some of the most respected figures in the technology community: top entrepreneurs, computer scientists and business leaders.

In addition to news coverage, GeekWire provides widely-used resources for the Pacific Northwest technology community, including the GeekWork job board, GeekWire 200 startup ranking, GeekWire Seattle engineering outpost list, the Startup List database, Service Provider Directory and GeekWire Calendar.


VietAI - Style Augmented Translation

The Our data contains roughly 3.3 million pairs of texts. After augmentation, the data is of size 26.7 million pairs of texts. A more detail breakdown of our data is shown in the table below. This is parallel text for English-Vietnamese that can be used for Machine Translation training.

web | content repository, archive, or collection


Repositório Digital Universidade Federal do Rio Grande do Sul LUME

LUME aims at collecting, preserving, disseminating and making available the access to academic, scientific, artistic and administrative documents, valuable research outputs and texts written in the University, as well as to historical collections and other relevant documents, even those not produced at UFRGS, to provide a variety of valuable resources.

LUME's digital collection is composed of texts, images, videos, moving images, and audio recordings, which are mostly open-source. The access to some information is restricted to UFRGS' registered users.


arabench

AraBench is an evaluation suite for dialectal Arabic to English machine translation. AraBench offers 4 coarse, 15 fine-grained and 25 city-level dialect categories, belonging to diverse genres, such as media, chat, religion and travel with varying level of dialectness.

Arabic ar-LEV ar-MSA ar-GLF ar-EG ar-MA ar-DZ ar-SD ar-TN ar-LB ar-LY ar-JO ar-IQ ar-QA ar-YE ar-OM ar-SA ar-SY ar-PS

Northern Africa
Western Asia
Algeria
Egypt
Morocco
Jordan
Sudan
Tunisia
Lebanon
Libya
Iraq
Qatar
Yemen
Oman
Saudi Arabia
Syria
Palestine

cc-by-4.0: Creative Commons Attribution 4.0 International


Basque language radio

Euskal Irratiak is an association of Basque language radio stations that have emerged from popular movements in the Northern Basque Country. It was created to share programs with each other and better address the issues that affect everyone.


masakhaner

This repository contains the code for training NER models, scripts to analyze the NER model predictions and the NER datasets for all the 10 languages listed below.

The code is based on HuggingFace implementation.

i do not know. will need to contact the data custodian to get more details.


The Global Times Daily Tabloid

The Global Times is a daily tabloid newspaper under the auspices of the Chinese Communist Party's flagship People's Daily newspaper, commenting on international issues from a nationalistic perspective. The newspaper has been the source of various incidents, including fabrications and disinformation.
The publication has been labelled as "China's Fox News" by some scholars and writers for its propagandistic slant and the monetization of nationalism. It is part of a broader set of Chinese state media outlets that constitute the Chinese government's propaganda apparatus


Dialnet

Dialnet is a portal for the dissemination of Hispanic scientific production whose operation began in 2001 specializing in human and social sciences.

Latin America and the Caribbean
Spain
Portugal


Neliti - Indonesian research repository

Neliti is a research repository of Indonesian journal articles, books, research reports, policy papers, conference papers and datasets from universities, government bodies, corporate publishers, and think tanks.

Formal, some articles are written in English, or partially in English (i.e. the abstract)

Maybe.
https://www.neliti.com/legal/copyright-policy states that "By permitting us to display and host content from your journal, conference or repository on the Platform you agree to allow others to view, download, share, and make use of any such Content. "


ACALAN African Academy of Languages

    To encourage the formulation and establishment of vigorous and articulated language policies and the sharing of experiences in policy-making and implementation in the Member States of the African Union, as a means of using African languages in a wider range of domains without abandoning the use of colonial languages.

    To identify vehicular cross-border languages and establish commissions to develop and promote them, on the basis that African languages will serve to forge the linguistic and cultural unity of Africa to maximise resources and minimise costs


A Million News Headlines ABC Australia

This contains data of news headlines published over a period of eighteen years (from 2003-02-19 to . Sourced from the Australian news source ABC (Australian Broadcasting Corporation).

cc0-1.0: Creative Commons Zero v1.0 Universal


zientzia kaiera

Zientzia Kaiera is a digital medium published by the Chair of Scientific Culture at the University of the Basque Country.

Euscampus and the Chair of Scientific Culture at the University of the Basque Country (Uxune Martinez)


South China Morning Post

The South China Morning Post (SCMP), with its Sunday edition, the Sunday Morning Post, is a Hong Kong–based English-language newspaper owned by Alibaba Group. Founded in 1903 by Tse Tsan-tai and Alfred Cunningham, it has remained Hong Kong's newspaper of record since British colonial rule. 251  Editor-in-chief Tammy Tam succeeded Wang Xiangwei in 2016. The SCMP prints paper editions in Hong Kong and operates an online news website.
The newspaper's circulation has been relatively stable for years—the average daily circulation stood at 100,000 in 2016. In a 2019 survey by the Chinese University of Hong Kong, the SCMP was regarded relatively as the most credible paid newspaper in Hong Kong.


Oarso Bidasoko Hitza

Monolingual newspaper in Basque that compiles town level news of the area of Bidasoa (towns included: Irun and Hondarribia) and Oarsoaldea (towns included:  Errenteria-Orereta, Pasaia, Lezo and Oiartzun) in Gipuzkoa, Basque Country.


Wikimedia Foundation

The nonprofit Wikimedia Foundation provides the essential infrastructure for free knowledge. It hosts Wikipedia, the free online encyclopedia, created, edited, and verified by volunteers around the world, as well as many other vital community projects.


book dash

Book Dash is a South African social impact publisher of free books for very young children. Our vision is that “Every child should own a hundred books by the age of five”, before they enter school!
To that end, Book Dash gathers creative professionals who volunteer to create new, African storybooks that anyone can freely translate and distribute. We employ our unique, 12-hour book-making methodology to create beautiful new books in just one day! Then, we share with the world, here on our website and in physical format for children to own.


Open Subtitles

A community repository for subtitles, with a total of 3.36 million subtitle files covering more than 60 languages

Arabic Basque Catalan English French Indic Indonesian Portuguese Spanish Vietnamese Chinese Hindi Malayalam Urdu Tamil Telugu Bengali

If you use the OpenSubtitle corpus: Please, add a link to http://www.opensubtitles.org/ to your website and to your reports and publications produced with the data! I promised this when I got the data from the providers of that website!

content repository, archive, or collection


webteb

WebTeb is an Arab internet website that produces and publishes medical, health news and information and lifestyle through various tools and topics such as symptom diagnosis, diseases, and medicines, as well as articles on medicine, health, beauty and some aspects of pregnancy and childbirt

Middle East and North Africa
Libya
Egypt
Tunisia
Algeria
United Arab Emirates
Saudi Arabia
Morocco
Mauritius
Mauritania
Iraq
Yemen
Syria
Palestine
Lebanon
Bahrain
Kuwait
Qatar


Vietnamese VLSP 2020 Machine Translation Monolingual Dataset

Vietnamese monolingual dataset consisting of 2 million samples crawled from Vietnamese websites in UTF-8 format.
Kho ngữ liệu đơn ngữ ở định dạng UTF-8 và bao gồm 2 triệu mẫu thu thập từ dữ liệu web tiếng Việt.


Biblioteca Nacional Mariano Moreno

The "Mariano Moreno" National Library (Spanish: Biblioteca Nacional "Mariano Moreno") is the largest library in Argentina. It is located in the barrio of Recoleta in Buenos Aires. The library is named after Mariano Moreno, one of the ideologists of the May Revolution[2] and its first director.

The National Library is an agency under the Ministry of Culture of Argentina.

May contain other languages of south america

Americas
Latin America and the Caribbean
Argentina

Biblioteca Nacional de la República Argentina


tvperu

TV Perú is the flagship television network of Peruvian state broadcaster IRTP. It is Peru's first channel and the one to have the widest coverage area in the country.

Instituto Nacional de Radio y Televisión del Perú

Queda plenamente prohibida la reproducción, distribución y transformación, total o parcial de los contenidos del sitio web, en cualquier soporte y/o por cualquier medio técnico, sin la autorización previa de TVPerú. El Usuario se compromete a respetar los derechos de propiedad intelectual de TVPerú y terceros, en concordancia a lo establecido en el Decreto Legislativo N° 822 “Ley Sobre el Derecho de Autor”.


almaany dictionary

Al-Maani is an online service directed to professional translators, students, and linguistic researchers. The service was built by experts in the field of language translation and search engine technologies.


LibreTexts

LibreTexts is a 501(c)(3) non-profit organization committed to freeing the textbook from the limitations and costs of traditional textbooks. Our open and freely accessible LibreTexts provide a more engaging learning experience for students without the financial burden.


The brWaC Corpus: A New Open Resource for Brazilian Portuguese

In this work, we present the construction process of a large Web corpus for Brazilian Portuguese, aiming to achieve a size comparable
to the state of the art in other languages. We also discuss our updated sentence-level approach for the strict removal of duplicated
content. Following the pipeline methodology, more than 60 million pages were crawled and filtered, with 3.5 million being selected.
The obtained multi-domain corpus, named brWaC, is composed by 2.7 billion tokens, and has been annotated with tagging and parsing
information. The incidence of non-unique long sentences, an indication of replicated content, which reaches 9% in other Web corpora,
was reduced to only 0.5%. Domain diversity was also maximized, with 120,000 different websites contributing content. We are making
our new resource freely available for the research community, both for querying and downloading, in the expectation of aiding in new
advances for the processing of Brazilian Portuguese.

No - the license of the source material actually prohibits re-use in this manner


This is the TV3parla speech corpus for Catalan prepared by Col·lectivaT. The audio segments were extracted from recordings the Catalan public television. We aligned the transcriptions with the recordings and extracted the corpus.
The owner of the contents is  Corporació Catalana de Mitjans Audiovisuals, SA
For more information refer to  Külebi, Öktem; 2018 https://www.isca-speech.org/archive/pdfs/iberspeech_2018/kulebi18_iberspeech.pdf

cc-by-nc-4.0: Creative Commons Attribution Non Commercial 4.0 International


Biblioteca Universidad Nacional de Colombia

El Sistema Nacional de Bibliotecas, SINAB, integra los recursos bibliográficos, el talento humano y la infraestructura física y tecnológica, necesarios para ofrecer información académica, artística, científica y los mejores servicios bibliotecarios que requiere la Universidad.

Administrar la infraestructura tecnológica en lo concerniente a los sistemas de información que soportan el Sistema Nacional de Bibliotecas, necesarios para el registro, la difusión y la utilización de las colecciones, las bases de datos y demás recursos electrónicos.
Gestionar la adquisición centralizada de bases de datos, publicaciones y otros recursos electrónicos pertinentes a los programas académicos y proyectos de investigación de la Universidad.
Diseñar y coordinar los programas y proyectos de Biblioteca Virtual relacionados tanto con el registro, organización, preservación y difusión de la producción académica de la Universidad, como con recursos cuyo acceso se ofrece a través de redes e iniciativas de cooperación bibliotecaria.
Formular y coordinar los Programas de ?Formación en información? y ?Formación bibliotecaria? con el fin de desarrollar competencias, habilidades y destrezas en el uso y manejo de la información en la comunidad universitaria.
Asesorar a las sedes de la Universidad y adelantar acciones conducentes a elevar la calidad y la cobertura de los servicios que ofrece el Sistema Nacional de Bibliotecas.
Las demás que se deriven de la Ley, los estatutos, reglamentos de la Universidad y aquellas que le deleguen las instancias competentes.

Spanish
English
Quechua
Arawakan languages
Arhuaco
Emberá-Catío

Multiple languages of South America are potentially included in the library resources

Americas
Latin America and the Caribbean
Colombia


arxiv

arXiv is a free distribution service and an open-access archive for 1,966,892 scholarly articles in the fields of physics, mathematics, computer science, quantitative biology, quantitative finance, statistics, electrical engineering and systems science, and economics. Materials on this site are not peer-reviewed by arXiv.


Newsweek News Magazine

Newsweek is a premier news magazine and website that has been bringing high-quality journalism to readers around the globe for over 80 years.

Newsweek provides the latest news, in-depth analysis and ideas about international issues, technology, business, culture and politics. In addition to its online and mobile presence, Newsweek publishes weekly English print editions in the United States, Europe/Middle East/Africa and Asia as well as editions in Japanese, Korean, Polish, Serbian and Spanish.

Since it was spun off from IBT Media in September 2018, Newsweek is owned by Dev Pragad, who serves as the CEO overseeing all of Newsweek's operations. Johnathan Davis is a passive shareholder with no operational role at Newsweek.


ViquiQuAD: an extractive QA dataset from Catalan Wikipedia

This dataset contains 3111 contexts extracted from a set of 597 high quality original (no translations) articles in the Catalan Wikipedia "Viquipèdia" (ca.wikipedia.org), and 1 to 5 questions with their answer for each fragment.

Viquipedia articles are used under CC-by-sa licence.

This dataset can be used to build extractive-QA and Language Models.

Funded by the Generalitat de Catalunya, Departament de Polítiques Digitals i Administració Pública (AINA), MT4ALL and Plan de Impulso de las Tecnologías del Lenguaje (Plan TL).


Bibliothèque nationale de France

The Bibliothèque nationale de France (French: [biblijɔtɛk nɑsjɔnal də fʁɑ̃s], "National Library of France"; BnF) is the national library of France, located in Paris. It is the national repository of all that is published in France and also holds extensive historical collections. The National Library of France is a public establishment under the supervision of the Ministry of Culture. Its mission is to constitute collections, especially the copies of works published in France that must, by law, be deposited there, conserve them, and make them available to the public. It produces a reference catalogue, cooperates with other national and international establishments, and participates in research programs. Gallica is the digital library for online users of the Bibliothèque nationale de France and its partners. It was established in October 1997. Today it has more than 6 million digitized materials of various types: books, magazines, newspapers, photographs, cartoons, drawings, prints, posters, maps, manuscripts, antique coins, scores, theater costumes and sets, audio and video materials. All library materials are freely available.

French English Chinese Portuguese Spanish Catalan Basque Arabic Vietnamese ar-CLS ar-MSA


Lexicon based sentiment analysis has some flaws such as it only takes the sentiment of each word without really put it on the context and the sentiment score produced is really dependent on the word weighting in the lexicon itself. But for doing analysis from scratch where we dont have the pre labelled data, it really expensive and complicated to do sentiment labelling for not specilized person. Therefore lexicon method come into handy for such scenario in doing sentiment analysis. Put in mind that this methods is minimal usage for learning.


Samanantar Indic Parallel Corpora

Samanantar is the largest publicly available parallel corpora collection for Indic languages: Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Oriya, Punjabi, Tamil, Telugu. The corpus has 49.6M sentence pairs between English to Indian Languages.

Indic Assamese Bengali Gujarati Hindi Kannada Malayalam Marathi Odia Punjabi Tamil Telugu

AI4Bharat is a voluntary community founded by faculty members at the Computer Science and Engineering department at Indian Institute of Technology, Madras.

Anoop Kunchukuttan; Mitesh Khapra; Pratyush Kumar; Divyanshu Kakwani

anoop.kunchukuttan@gmail.com; miteshk@cse.iitm.ac.in; pratyush@cse.iitm.ac.in; divkakwani@gmail.com

Yes - the dataset curators have obtained consent from the source material owners


Times Internet Limited (subsidiary of The Times Group)

Unless otherwise stated, copyright and all intellectual property rights in all material presented on the Site (including but not limited to text, audio, video or graphical images), trademarks and logos appearing on this Site are the property of Times Internet Limited, its parent, affiliates and associates and are protected under applicable Indian laws. You agree not to use any framing techniques to enclose any trademark or logo or other proprietary information of TIL; or remove, conceal or obliterate any copyright or other proprietary notice or any credit-line or date-line on other mark or source identifier included on the Site / Service, including without limitation, the size, color, location or style of all proprietary marks. Any infringement shall be vigorously defended and pursued to the fullest extent permitted by law.


Indonesian Frog Storytelling Corpus

Indonesian written and spoken corpus, based on the [twenty-eight pictures](http://compling.hss.ntu.edu.sg/who/david/corpus/pictures.pdf)

The storytelling survey was conducted in Malang in August 2011 and in Tokyo in September
and October 2011. The consultants were from different backgrounds (as for age, place of birth, place
of growing up, and mother tongue). All had received a high school-level or university-level education.
All could be classified as belonging to the middle class socially.

http://www.tufs.ac.jp/st/personal/13/david/papers/APLL5_davidmoeljadi.pdf

some transcribed spoken language and some written language


LIHKG

Most Popular Hong Kong Forum


Museo Casa de la Memoria

The
Museum

The House of Memory Museum was created in 2006 – as a project inside the Victim Assistance Program of Medellin City Hall – aiming to contribute from the memory exercise to open and plural dialogues, critical and reflective, to understanding and overcoming the armed conflict and the different violence of Medellin, Antioquia and our country.

We are a space inside the heart of the city where the memories of the armed conflict that our country lives, have a physical and symbolic place, from which we pretend to act in the cultural transformation that longs for Colombia.

We are Living Memories, see to not repeat. This space is a house of dialogue and encounter to understand what happened and is happening in our society, to rediscover hope and to think about other possible futures.

The House of Memory Museum is a political, pedagogical and social project, inclusive and representative, which contributes to the transformation of the war logics towards more civilized practices, through construction and circulation processes of the armed conflict memories, the construction of cultural expressions and commemorations; pedagogies design for cultural and social transformation, advocacy strategies implementation and social mobilization, for human rights and non-repetition guarantees; and definition and implementation of knowledge management processes, oriented to the circulation and democratization of the same.

Latin America and the Caribbean
Colombia


UNESCO Digital Library

The UNESCO Digital Library is a key tool for enabling UNESCO’s mission of building peace in the minds of people, in particular by “advancing the mutual knowledge and understanding, and encouraging cooperation among the nations in all branches of intellectual activity, including […] the exchange of publications, objects of artistic and scientific interest and other materials of information” (UNESCO Constitution).

In more concrete terms, it provides access to publications, documents and other materials either produced by UNESCO or pertaining to UNESCO’s fields of competence. These collections are accessible online or physically - at the library or the archives room.

Niger-Congo Indic Indonesian Portuguese Vietnamese English Arabic Chinese French Spanish

cc-by-3.0: Creative Commons Attribution 3.0 Unported


Indonesian News Articles 2017

Indonesian news articles published at 2017 contains published date, content, title, and source.


Global Voices Swahili

Global Voices is an international community of writers, bloggers and digital activists that aim to translate and report on what is being said in citizen media worldwide. It is a non-profit project started at the Berkman Center for Internet and Society at Harvard Law School that grew out of an international bloggers' meeting held in December 2004. The organization was founded by Ethan Zuckerman and Rebecca MacKinnon. In 2008, it became an independent non-profit incorporated in Amsterdam, Netherlands.


The Verge Vox Media

The Verge is an American technology news website operated by Vox Media, publishing news, feature stories, guidebooks, product reviews, consumer electronics news, and podcasts.
The website launched on November 1, 2011, and uses Vox Media's proprietary multimedia publishing platform Chorus. In 2014, Nilay Patel was named editor-in-chief and Dieter Bohn executive editor; Helen Havlak was named editorial director in 2017. The Verge won five Webby Awards for the year 2012 including awards for Best Writing (Editorial), Best Podcast for The Vergecast, Best Visual Design, Best Consumer Electronics Site, and Best Mobile News App.


newspaper in Basque of a region

It is a Basque language magazine published by the Goiena Communication Group in the Debagoiena region of Gipuzkoa.

Creative Commons Aitortu-Partekatu

2011ko ekainaren 27tik aurrerako goiena.eus-eko testuak lizentzia honekin daude babestuak: Creative Commons Aitortu-Partekatu, cc-by-sa. Iritzigileek, erantzunetan mezua lagatzen dutenek, argazkiak igotzen dituztenek... edozer bidaltzen dutela ere, lizentzia hau esleitzen diotela onartu behar dute. Hala ere, goiena.eus-ek ez ditu salbuespenak baztertzen eta, gertatzen badira, testu horiek argitaratzen direnean argi zehaztuko da hori. Jarri gurekin harremanetan kontaktu orriaren bidez hemen argitaratu nahi dituzun testuak salbuespen horien artean sartu behar direla uste baduzu. Blog komunitateko blog bakoitzak du jabe bat eta salbuetsita daude goiena.eus-eko lizentziapetik.

CC-by-sa laburdurak Creative Commons Aitortu-Partekatu lizentzia adierazten du. Definizio gehientsuenen arabera, eduki librea edo/eta copyleft terminoak aplika dakizkieke hemengo CC-by-sa testuei. Era berean, lizentzia honek Approved for Free Cultural Use etiketa darama, Erabilpen Kultural Librerako Baimendua. Etiketa hori Creative Commons erakundeak aukeratutako termino bat da, Wikipediarekin eta eduki libreen munduarekin bateragarria den edukia zehatz definitzeko sortua. The Open Knowledge Foundation delakoak argitaratutako Jakintza askearen definizioan ere (testua euskaraz) sartzen da gure lizentzia.

Funtsean honek zera esan nahi du: edonork erabil ditzake hemen agertzen diren testuak. Eskubidea duzu:
• Hemengo testuak norberak nahi duen tokian berrargitaratzeko.
• Testuen kopiak egiteko.
• Testuotan oinarritutako lan eratorriak egiteko, erabilpen komertzialak barne (liburu batean bildumaren bat egiteko, adibidez).
• Testuak, argazkiak, bideoak... erabiltzeko euskarazko Wikipedian artikuluak dokumentatzeko, hemen deskribatutako prozesua bururaino iristen denean.

Baina eskubide horiekin batera, betebeharrak daude:
• Egiletza aitortu behar duzu. Artikuluaren sinatzaileari zor zaio egiletza hori eta baita Goienari ere.
• Baldintza berean banatu behar duzu lan eratorria edo egiten duzun kopia edo dena delakoa.

Egiletza aitortu eta lizentziaren baldintzekin zuzen jokatzeko modu zuzen bat izan daiteke erabiltzaile izena aipatzea, lizentziaren aipu eta lotura eskaintzea. Adibidez, paperean inprimatuko bazenu, honela:
© Jose Maria Arizmendiarrieta
cc-by-sa Creative Commons Aitortu Partekatu
http://creativecommons.org/licenses/by-sa/3.0/deed.eu
goiena.eus-etik hartua: http://goiena.eus/xxxx-xxxx-xxxx

Interneten bada, estekak eginda URL horiekin:
© cc-by-sa Jose Maria Arizmendiarrieta: Creative Commons Aitortu-Partekatu. Hemendik hartua: goiena.eus

Aitortza eta eskubideak artikulugileei zor zaizkiela uste dugu, baina goiena.eus-eko jatorria aipatzea zuzena eta jatorra izango litzateke, eta eskertuko dizugu.


Softcatalà Catext

This repository collects some public domain sentences in Catalan language.


Recibrew

Food recipe in Indonesian


Constitución Política de Colombia 1991

The Political Constitution of Colombia of 1991 (Spanish: Constitución Política de Colombia de 1991), is the Constitution of the Republic of Colombia. It was promulgated in Constitutional Gazette number 114 on Thursday, July 4, 1991, and is also known as the Constitution of Human Rights. It replaced the Political Constitution of 1886 and was issued during the presidency of the liberal César Gaviria,[1] with ideas from the also liberal Luis Carlos Galán.

It is the constitution of a country, it is likely to be freely available.


Le Monde Newspaper

Le Monde is a French daily afternoon newspaper. It is the main publication of Le Monde Group and reported an average circulation of 323,039 copies per issue in 2009, about 40,000 of which were sold abroad. It has had its own website since 19 December 1995, and is often the only French newspaper easily obtainable in non-French-speaking countries. It is considered one of the French newspapers of record, along with Libération, and Le Figaro. It should not be confused with the monthly publication Le Monde diplomatique, of which Le Monde has 51% ownership, but which is editorially independent. A Reuters Institute poll in 2021 in France found that "Le Monde is the most trusted national newspaper".

https://moncompte.lemonde.fr/cgv#ancre_propriete

Le Monde est titulaire des droits de propriété intellectuelle sur tous les éléments qui composent ses publications, ses Produits et/ou Services et ses supports de communication, tels que texte, photographie, image, infographie, dessins, logo, enregistrement phonographique ou vidéographique, format éditorial, charte graphique, programme informatique ou toute autre création ou œuvre protégeable, ou s’est vu concéder les licences nécessaires sur les droits de propriété intellectuelle y afférents.

Qu’ils soient accessibles gratuitement ou non, toute reproduction, représentation, diffusion, traduction ou exploitation totale ou partielle, de quelque nature que ce soit et par quelque moyen que ce soit, de l’un quelconque de ces éléments, sans l’autorisation écrite et préalable du Monde, est strictement interdite et constituerait, au regard des articles L. 335-2 du Code de la propriété intellectuelle, un délit de contrefaçon passible de trois ans d’emprisonnement et 300 000 € d’amende.

Le Monde est en outre propriétaire exclusif des marques qu’il a déposées ou exploite régulièrement. Leur reproduction, usage ou apposition sans l’autorisation écrite et préalable du Monde, est strictement interdite et constituerait un acte de contrefaçon engageant la responsabilité civile de son auteur au titre de l’article L. 716-1 du Code de la propriété intellectuelle.

L’utilisation ou l’achat d’un Produit et/ou Service par un Utilisateur et/ou Client ne saurait conférer à celui-ci comme à quiconque, sur les éléments protégés susvisés, un droit autre que celui d’un usage strictement personnel, non collectif et non marchand. Pour toute demande d’autorisation relative aux éléments de propriété intellectuelle du Monde, merci de contacter le service commercial du Monde à l’adresse électronique suivante : droitsdauteur@lemonde.fr.


Biblioteca Universidad de los Andes

The library of the University of the Andes was born within the framework of the foundation of the University in 1948. It began its work in parallel with it, as a complement to the university system.

The provision of services provided by the Library System is focused on maintaining user satisfaction, with dynamic services aimed at continuous improvement of processes and focused on all interested parties as the main axis and objective of its work.

Potentially has other languages of Colombia


Zientzia.eus

Zientzia.eus is a website of the Elhuyar Foundation that provides up-to-date information on science and technology.

cc-by-nc-sa-3.0: Creative Commons Attribution Non Commercial Share Alike 3.0 Unported


Britain and UK Handbooks

This official annual reference book was first published in the 1946 by the British Information Service. Primarily for the overseas reader it was designed to answer questions about Britain which were most frequently asked in overseas countries by writers, teachers, their officials and administrators and their economists. In 1954, produced by the Central Statistical Office, it was distributed overseas in a limited free edition and was on sale through Her Majesty’s Stationery Office worldwide.

The National Library of Scotland collection covers the years 1954-2005. These volumes draw on a wide range of authoritative sources and provide a factual overview of the United Kingdom, whilst also covering the main aspects of government policy and the part played by Government in the life of the community. They do not, however, attempt to describe the part played by Britain in the Commonwealth or world affairs. Topics are consistent throughout the volumes and cover: the national economy; social welfare; defence; religion, science and the arts; broadcasting and the press, transport and communication; trade and industry. The volumes also include maps showing, for example, the major road and rail networks, conservation areas and population density.

While the contents refer to the UK as a whole, where separate facts and figures were available for England, Wales, Scotland and Northern Ireland these have also been included.

Northern Europe
England
Scotland
Wales
Northern Ireland

ogl-uk-3.0: Open Government Licence v3.0


Lot Of Indic Tweets

This dataset contains 79,45,718 (7.9 million) Telugu tweets and 1,76,54,722 (17.6 million) Hindi tweets. Telugu: LOIT contains most (>85%) of the Telugu tweets made between 2010–01–01 and 2019–06–25. Of these, 73,78,582 are tweets with unique text. Hindi: LOIT contains most of the Hindi tweets made between 2017–01–13 and 2018–12–31. Of these, 1,58,07,840 are tweets with unique text.

gpl-3.0-only: GNU General Public License v3.0 only


africanlp zenodo

This is a project that aims to curate African Natural Language Processing projects and data that is uploaded on Zenodo. Please fill free to tag this community when uploading.


ParlamentParla - Speech corpus of Catalan Parliamentary sessions

This is the ParlamentParla speech corpus for Catalan prepared by Col·lectivaT. The audio segments were extracted from recordings the Catalan Parliament (Parlament de Catalunya) plenary sessions. We aligned the transcriptions with the recordings and extracted the corpus. The content belongs to the Catalan Parliament and the data is released conforming their terms of use.

Preparation of this corpus was partly supported by the Department of Culture of the Catalan autonomous government, and the v2.0 was supported by the Barcelona Supercomputing Center, within the framework of the project AINA of the Departament de Polítiques Digitals.

As of v2.0 the corpus is separated into 211 hours of clean and 400 hours of other quality segments. Furthermore, each speech segment is tagged with its speaker and each speaker with their gender. The statistics are detailed in the readme file.

For more information, go to https://github.com/CollectivaT-dev/ParlamentParla or mail info@collectivat.cat.

Yes - the source material has an open license that allows re-use


bhaskar

Hindi news production


CGTN Cable TV News Service

China Global Television Network, or CGTN, is an international media organization launched on December 31, 2016. It aims to provide global audiences with accurate and timely news coverage as well as rich audiovisual services, promoting communication and understanding between China and the world, and enhancing cultural exchanges and mutual trust between China and other countries.

Headquartered in Beijing, CGTN has three production centers, located in Nairobi, Washington D.C. and London, all staffed with international professionals from around the world.

Adhering to the principles of objectivity, rationality and balance in reporting, CGTN endeavors to present information from diverse perspectives.

CGTN's TV channels are available in more than 160 countries and regions worldwide. It also incorporates the video news agency Global Video News Agency.

CGTN, a pioneer of media convergence in China, delivers digital content through CGTN Digital, which is accessible via CGTN.com, CGTN mobile applications, YouTube, Facebook, Twitter, Weibo and other social media platforms, with over 150 million followers across the globe.


TITML-IDN speech corpus

TITML-IDN contains Bahasa Indonesia speech data from 20 Indonesian speakers, 9. Each speaker was asked to read 343 phonetically balanced sentences most of which were selected from a text corpus.

Speech Resources Consortium, National Institute of Informatics

- “User” shall not execute any reproduction or modification of this corpus for sale or distribution to
the third party.
- This corpus shall be used only for research purpose.
-  Reports or publications referring to the results of studies conducted on this corpus shall cite the “Speech Corpus Name” shown above as the source of the speech material. Copies of unclassified reports or publications referring to these studies shall be made available to “NII”, when requested.


Igbo proverbs curated by Prof GMT Emezue

Igbo proverbs revised by Prof GMT Emezue. Contains both text and audio formats. About 2000 sentences available.

no homepage. Contact gmtemezue@yahoo.com


Royal Society Corpus

The Royal Society Corpus (RSC) 6.0 Open is based on the first centuries of the Philosophical Transactions of the Royal Society of London from its beginning in 1665 to 1920. It includes all publications of the journal written in English and containing running text. The Philosophical Transactions was the first periodical of scientific writing in England. Founded in 1665 by Henry Oldenburg, the first secretary of the Royal Society, it initially contained excerpts of letters of his scientific correspondence, reviews and summaries of recently-published books, and accounts of observations and experiments.

Common Language Resources and Technology Infrastructure


WEBMD Health and Wellbeign

WebMD has created an organization that we believe fulfills the promise of health information on the Internet. We provide credible information, supportive communities, and in-depth reference material about health subjects that matter to you. We are a source for original and timely health information as well as material from well known content providers.

The WebMD content staff blends award-winning expertise in journalism, content creation, community services, expert commentary, and medical review to give our users a variety of ways to find what they are looking for.

And that, we believe, requires dedicated, full-time staff professionals with state-of-the-art expertise in:

Health news for the public
Creating and maintaining up-to-date medical reference content databases
Medical imagery, graphics, and animation
Communities
Live web events
User experience
Interactive tools
Our board-certified physicians and award-winning journalists are solely dedicated to your daily information experience on WebMD. Our content staff includes individuals who hold advanced degrees in journalism, medical illustration, health communications, clinical informatics, nursing, and medicine. WebMD verifies the qualifications of all medical professionals on the site; including health professionals, experts, editorial professionals and contributors with a specialty license. Health Professionals, including those who write, review and edit our editorial content undergo credential verification by a third party.

Most of us at WebMD Health have spent our entire careers dedicated to helping people find the health and medical information, support, and services they need -- even before there was an Internet! We are dedicated to providing quality health information and to upholding the integrity of our editorial process.


Masakhane

Masakhane is a grassroots organisation whose mission is to strengthen and spur NLP research in African languages, for Africans, by Africans. Despite the fact that 2000 of the world’s languages are African, African languages are barely represented in technology. The tragic past of colonialism has been devastating for African languages in terms of their support, preservation and integration. This has resulted in technological space that does not understand our names, our cultures, our places, our history.

Masakhane roughly translates to “We build together” in isiZulu. Our goal is for Africans to shape and own these technological advances towards human dignity, well-being and equity, through inclusive community building, open participatory research and multidisciplinarity.

English French Niger-Congo Yoruba ChiShona Fon Igbo isiZulu Kinyarwanda Kirundi Lingala Swahili Xhosa Twi Wolof


almaany arabic dictionary

Al-Maani is an online service directed to professional translators, students, and linguistic researchers. The service was built by experts in the field of language translation and search engine technologies.


Bengali Question Answering Dataset

This dataset contains the data for the paper "Deep learning-based question answering system in Bengali". It is a translated version of SQuAD 2.0 dataset to the Bengali language. Preprocessing details can be found in the paper.

Link : https://zenodo.org/record/4557874#.YDVGxegzZPZ
Paper : https://www.tandfonline.com/doi/full/10.1080/24751839.2020.1833136


Gaceta del Congreso - Colombia

It is a file where the sessions of the Colombian Congress are summarized, this includes all the legislative acts approved by the organ

Unidad de Gaceta del Congreso de Colombia


ResearchGate for Scientists and Researchers

ResearchGate is for you: the scientist, the clinician, the student, the engineer, the public health worker, the lab technician, the computer scientist.

The work you do is important. But too often, you are overworked, underpaid, have low job security, and operate under high pressure. Becoming a researcher in the first place was no easy task, and access all too often relies on privilege. Our purpose is to make your life easier.

We offer a home for you—a place to share your work and connect with peers around the globe, traversing the borders and silos of science. We want to empower you to do your best work, advance your field, and make a better world for all.

For the intellectually curious, the seekers of truth, the geeks, the makers: our members offer you a treasure trove of knowledge in areas as diverse as materials science, agriculture, human health, and quantum physics.
We believe that science is humanity's most important tool. It's responsible for the great leaps we've made in understanding our universe, and the best means we have to meet the challenges of our future.

Still, it's not without problems. The systems powering research are too slow and inaccessible to address the global challenges of our time. Complicated funding processes and proprietary interests are hampering progress towards open science.

This is where we can make a difference. We strive to offer researchers access to one another and the resources they need to thrive. We strive to make science faster, fairer, and easier to discover and access.


HathiTrust Digital Library

Founded in 2008, HathiTrust is a not-for-profit collaborative of academic and research libraries preserving 17+ million digitized items. HathiTrust offers reading access to the fullest extent allowable by U.S. copyright law, computational access to the entire corpus for scholarly research, and other emerging services based on the combined collection. HathiTrust members steward the collection — the largest set of digitized books managed by academic and research libraries — under the aims of scholarly, not corporate, interests.


Wikpiedia in Chinese

Wikpiedia in Chinese


RiuNet Repositorio Institucional

RiuNet is intended to save the University community's production, personal or institutional, in collections. These can be made up of different types of documents such as Objects of learning (Polimedia, virtual labs and educational articles), theses, journal articles, maps, scholary works, creative works, institutional heritage, multimedia, teaching material, institutional production, electronic journals and conference proceedings.


Global Voices Spanish

Global Voices pages in Spanish


HAL archives ouvertes

HAL is an open archive where authors can deposit scholarly documents from all academic fields.

For the attention of the authors
    The deposit of the full text should be made in agreement with the co-authors and in the respect for the policy of the publishers.
    The deposit is subject of a control, HAL reserves the right to refuse items that do not meet the criteria of the archive.
    Any deposit is definitive, no withdrawals will be made after the on-line posting of the publication.
    Text files in pdf format or image files are sent to CINES for long-term archiving.

For the attention of the readers
    In a context of electronic distribution, each author keeps their intellectual property rights.

also has (much fewer) data in other BigScience languages

Moissonnage : conditions d’utilisation des données

Les métadonnées de HAL peuvent être consultées de façon totale ou partielle par moissonnage dans le respect du code de la propriété intellectuelle.
Pas d’utilisation commerciale des données extraites.
Obligation de citer la source (exemple : hal.archives-ouvertes.fr/hal-00000001).

multiple licenses
copyright - all rights reserved
open license
research use


UPCommons

UPC's institutional repository collects, manages, disseminates and preserves the UPC's teaching and research output in open access.

Portuguese Spanish English Catalan French

Latin America and the Caribbean
Americas
South America
Spain


Stack Exchange Website

Launched in 2010, the Stack Exchange network comprises 173 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Subscriber Content

You agree that any and all content, including without limitation any and all text, graphics, logos, tools, photographs, images, illustrations, software or source code, audio and video, animations, and product feedback (collectively, “Content”) that you provide to the public Network (collectively, “Subscriber Content”), is perpetually and irrevocably licensed to Stack Overflow on a worldwide, royalty-free, non-exclusive basis pursuant to Creative Commons licensing terms (CC BY-SA 4.0), and you grant Stack Overflow the perpetual and irrevocable right and license to access, use, process, copy, distribute, export, display and to commercially exploit such Subscriber Content, even if such Subscriber Content has been contributed and subsequently removed by you as reasonably necessary to, for example (without limitation):

    Provide, maintain, and update the public Network
    Process lawful requests from law enforcement agencies and government agencies
    Prevent and address security incidents and data security features, support features, and to provide technical assistance as it may be required
    Aggregate data to provide product optimization

This means that you cannot revoke permission for Stack Overflow to publish, distribute, store and use such content and to allow others to have derivative rights to publish, distribute, store and use such content. The CC BY-SA 4.0 license terms are explained in further detail by Creative Commons, and the license terms applicable to content are explained in further detail here. You should be aware that all Public Content you contribute is available for public copy and redistribution, and all such Public Content must have appropriate attribution.

As stated above, by agreeing to these Public Network Terms you also agree to be bound by the terms and conditions of the Acceptable Use Policy incorporated herein, and hereby acknowledge and agree that any and all Public Content you provide to the public Network is governed by the Acceptable Use Policy.


Smithsonian Institution

The Smithsonian Institution is the world’s largest museum, education, and research complex, with 21 museums and the National Zoo—shaping the future by preserving heritage, discovering new knowledge, and sharing our resources with the world.


The Daily Beast Media

The Daily Beast delivers award-winning original reporting and sharp opinion in the arena of politics, pop-culture and power. Always skeptical but never cynical, The Daily Beast reaches more than 1 million readers a day. Tracy Connor is Editor in Chief and Heather Dietrick is CEO. The Daily Beast is based in New York and is an operating business of IAC (NASDAQ: IACI).


The New York Times

The New York Times is an American daily newspaper based in New York City with a worldwide readership.[7][8] It was founded in 1851, by Henry Jarvis Raymond and George Jones, and was initially published by Raymond, Jones & Company. [9]

The Times has since won 132 Pulitzer Prizes, the most of any newspaper,[10] and has long been regarded within the industry as a national "newspaper of record".[11] It is ranked 18th in the world by circulation and 3rd in the U.S.[12]

The paper is owned by The New York Times Company, which is publicly traded. It has been governed by the Sulzberger family since 1896, through a dual-class share structure after its shares became publicly traded.[13] A. G. Sulzberger and his father, Arthur Ochs Sulzberger Jr.—the paper's publisher and the company's chairman, respectively—are the fifth and fourth generation of the family to head the paper.


Redalyc - Network of non-commercial Open Access scientific journals owned by the academy.

Redalyc is an indexing system that integrates high-quality scientific and editorial journals from Latin America into its index. After 16 years of giving visibility and supporting the consolidation of journals, it now exclusively integrates those that share the model. non-profit publication to preserve the academic and open nature of scientific communication, from any region.

Universidad Autónoma del Estado de México (UAEM)


cnnindonesia.com

Cable News Network Indonesia (known as CNN Indonesia) is a 24-hour Indonesian digital free-to-air and cable television news channel owned by Trans Media in collaboration with AT&T's WarnerMedia under its CNN license. Broadcasting from Trans Media studios in South Jakarta, the local franchise presents national and international content, focusing on general news, business, sports and technology.


African Union website

The African Union (AU) is a continental body consisting of the 55 member states that make up the countries of the African Continent. It was officially launched in 2002 as a successor to the Organisation of African Unity (OAU, 1963-1999).

Its website contains news items and reports that may be used as language resources

Arabic English French Niger-Congo Swahili ar-MSA

African Union

The content and all material available on this website cannot be used, transmitted or reproduced in whole or part, in any form or by any means, electronic or mechanical, including photocopying, recording or by for use in any information storage or retrieval system without permission in writing from the publisher except as provided in the Terms and Conditions of Use of the African Union websites.
News related content can be used as long as appropriate credit is given and the African Union is advised

The Emblem of the African Union and that of its organs, programmes or any activities are trademarked and / copyrighted and should not be altered in any manner or used for any communication or other purposes without approval from the African Union.

To request permission or to make additional enquiries, visit AU Legal Notices or send an email to the Directorate of Information & Communication DIC@africa-union.org

copyright - all rights reserved
open license


Nurition Fact

NUTRITIONFACTS.ORG is a science-based nonprofit organization founded by Michael Greger, M.D. FACLM, that provides free updates on the latest in nutrition research via bite-sized videos with captions offered in multiple languages, blogs, and infographics. We are a strictly non-commercial public service health charity. Nearly 2,000 videos on virtually every aspect of healthy eating are already available online, and new videos and blogs are uploaded every day. We also disseminate fact-based information through social media on the benefits of a whole food, plant-based diet for wellness, disease prevention, healthy weight management, and longevity, as well as maintain a Spanish-language site and operate several Chinese platforms.

Everything on the NutritionFacts.org website is free. There are no ads. There are no corporate sponsorships. To remain free of conflicts of interest, we chose to adopt a Wikipedia-type model where users make donations to support the public service we provide. NutritionFacts.org is a labor of love—a tribute to Dr. Greger’s grandmother whose own life was saved by improving her diet.


La Silla Vacía

La Silla Vacía (Spanish: "The Empty Chair") is a Colombian news website founded by journalist and writer Juanita León in 2009.[2] The site focuses primarily on Colombian politics.

La Silla Vacía describes itself as an "informative and interactive medium for people interested in Colombian political current issues," by focusing on "stories which actually describe the way power is exercised in Colombia: on political figures who pull the strings of power, strategies in order to reach and keep it, on ideas and interests which underlie the big decisions taken in the country," aiming to do "good journalism."[3]

Americas
Latin America and the Caribbean
South America
Colombia

Copyright 2021 © BLOGOSFERA PRODUCCIONES SAS - La Silla Vacía. Todos los derechos reservados.


National Digital Library of Theses and Dissertations in Taiwan

no email, click 'english' on the top right -> 'contact us' on the top right


TECA: Textual Entailment Catalan dataset

"Textual entailment (TE) in natural language processing is a directional relation between text fragments. The relation holds whenever the truth of one text fragment follows from another text. In the TE framework, the entailing and entailed texts are termed text (t) and hypothesis (h), respectively." From Wikpedia.
TECa contains two Catalan TE sub-datasets, catalan_TE1 and vilaweb_TE, containing 14997 and 6166 annotated pairs of sentences.
In TECa datasets, each sentence has three hypotheses, annotated as follows:
* "0": positive TE (Inference, text entails hypothesis)
* "1": non-TE (Neutral, text does not entail nor contradict)
* "2": negative TE (Contradiction, text contradicts hypothesis).
Source sentences are extracted from the Catalan Textual Corpus (https://doi.org/10.5281/zenodo.4519349), and from Vilaweb newswire.


Book Dash Books

Book Dash believes that every child should own one hundred books by the age of five.

To that end, we gather creative professionals who volunteer to create new, African storybooks that anyone can freely translate, print and distribute. In this way, we have vastly reduced the costs involved in putting high-quality books in children’s hands and hearts.

Niger-Congo isiZulu Xhosa Setswana Sesotho Afrikaans

it's not clear from their website what the license is. Will need to talk with them directly for that.

other
unclear what format the books are in.


Engadget technology blog

Engadget is a multilingual technology blog network with daily coverage of gadgets and consumer electronics. Engadget operates a total of ten blogs—four written in English and six international versions with independent editorial staff. Engadget has ranked among the top five in the "Technorati top 100"[1] and was noted in Time for being one of the best blogs of 2010.[2] It has been operated by Yahoo since September 2021.


Vietnamese poetry from fsoft AI lab

171188 poems with different genres: luc-bat, 5-chu, 7-chu, 8-chu, 4-chu


Emotion Recognition for Vietnamese Social Media Text

Emotion recognition is a higher approach or special case of sentiment analysis. In this task, the result is not produced in terms of either polarity: positive or negative or in the form of rating (from 1 to 5) but of a more detailed level of sentiment analysis in which the result are depicted in more expressions like sadness, enjoyment, anger, disgust, fear and surprise. Emotion recognition plays a critical role in measuring brand value of a product by recognizing specific emotions of customers’ comments. In this study, we have achieved two targets. First and foremost, we built a standard Vietnamese Social Media Emotion Corpus (UIT-VSMEC) with about 6,927 human-annotated sentences with six emotion labels, contributing to emotion recognition research in Vietnamese which is a low-resource language in Natural Language Processing (NLP).

Univeristy of Information Technology, VNH-HCM


Vietnamese Datasets for Evaluating Semantic Models of (Dis-)Similarity and Relatedness (ViCon and ViSim-400)

This dataset consists of two kinds of datasets: The first dataset, namely ViCon, comprises pairs of synonyms and antonymys across noun, verb, and adjective classes, offerring data to distinguish between similarity and dissimilarity. The second dataset ViSim-400 is a dataset of semantic relation pairs which contains degrees of similarity across five semantic relations, as rated by human judges.


Tokikom Zero kilometroko komunikazioa

Network composed of 76 Basque sources, including media, blogs, etc

Some portions are publicly distributable (CC-BY), but others are private, although content owners may be contacted.


PMC Article

PubMed Central (PMC) is a free archive of biomedical and life sciences journal literature at the U.S. National Institutes of Health's National Library of Medicine (NIH/NLM). It is a repository for journal literature deposited by participating publishers, as well as for author manuscripts that have been submitted in compliance with the NIH Public Access Policy and similar policies of other research funding agencies.

Articles in PMC usually include an explicit copyright statement. To see the details for any given record, see the “Copyright and License information” link on an article record. In the absence of a copyright statement, users should assume that standard copyright protection applies, unless the article contains an explicit statement to the contrary. In case of doubt, contact the journal publisher to verify the copyright status of an article.


African Minds publisher

African Minds is an open access, not-for-profit, publisher of scholarly books. African Minds publishes predominantly in the social sciences and its authors are typically African academics or those with a close affinity with the continent. African Minds offers innovative approaches to those frustrated by a lack of support from traditional publishers. At African Minds the emphasis is less on the commercial viability of publications than on fostering access, openness and debate in the pursuit of growing and deepening the African knowledge base.

a handful of books in French and Portuguese too


ekantipur.com

Kantipur (Nepali: कान्तिपुर) is a Nepali language daily newspaper,


Ixa taldea

Ixa is a research group from the University of the Basque Country which works in the area of Natural Language Processing since 1988.


Swahili News Classification Dataset by Davis David

Swahili-language news classification dataset created by Davis David, scraped from online websites.
Zenodo description:
"The Swahili news dataset was created to reduce the gap of using the Swahili language to create NLP technologies and help AI practitioners in Tanzania and across Africa continent to practice their NLP skills to solve different problems in organizations or societies related to Swahili language. Swahili News were collected from different websites that provide news in the Swahili language. I was able to find some websites that provide news in Swahili only and others in different languages including Swahili.

The dataset was created for a specific task of text classification, this means each news content can be categorized into six different topics (Local news, International news , Finance news, Health news, Sports news, and Entertainment news). The dataset comes with a specified train/test split. The train set contains 75% of the dataset and test set contains 25% of the dataset."

Please note also: the HuggingFace version at https://huggingface.co/datasets/swahili_news is outdated. An updated version, with deduplicated text and official splits, can be found at https://zenodo.org/record/5514203.

It links to https://creativecommons.org/licenses/by/4.0/legalcode


Reuters News Organisation

Reuters is an international news organization owned by Thomson Reuters. It employs around 2,500 journalists and 600 photojournalists in about 200 locations worldwide. Reuters is one of the largest news agencies in the world. The agency was established in London in 1851 by the German-born Paul Reuter. It was acquired by the Thomson Corporation in 2008 and now makes up the media division of Thomson Reuters.


Repositorio Institucional RIUnB

It is a set of services offered by the Central Library for the management and dissemination of the scientific production of the University of Brasília. All its contents are publicly available, and as they are widely accessible, they provide greater visibility and impact of the institution's scientific production. Its mission is to store, preserve, disseminate and give access to the scientific production of the University of Brasília in digital format. It intends to bring together, in a single place, the set of UnB publications.


Unsupervised Cross-lingual Representation Learning at Scale

This paper shows that pretraining multilingual
language models at scale leads to significant
performance gains for a wide range of cross-
lingual transfer tasks. We train a Transformer-
based masked language model on one hundred
languages, using more than two terabytes of fil-
tered CommonCrawl data. Our model, dubbed
XLM-R, significantly outperforms multilingual
BERT (mBERT) on a variety of cross-lingual
benchmarks, including +14.6% average accu-
racy on XNLI, +13% average F1 score on
MLQA, and +2.4% F1 score on NER. XLM-R
performs particularly well on low-resource lan-
guages, improving 15.7% in XNLI accuracy
for Swahili and 11.4% for Urdu over previ-
ous XLM models. We also present a detailed
empirical analysis of the key factors that are
required to achieve these gains, including the
trade-offs between (1) positive transfer and ca-
pacity dilution and (2) the performance of high
and low resource languages at scale. Finally,
we show, for the first time, the possibility of
multilingual modeling without sacrificing per-
language performance; XLM-R is very compet-
itive with strong monolingual models on the
GLUE and XNLI benchmarks. We will make
our code, data and models publicly available

Indic
Nepali (individual language)
Nepali (macrolanguage)


Trove National Library of Australia

Trove is a single point of entry to multiple collections of Australian digitised cultural artefacts, including 160 million newspapers articles from close to 1000 different newspaper titles. Trove has an API that provides data in a machine-readable form

Summary

Trove is a collaboration between the National Library of Australia (Library) and hundreds of partner institutions around Australia that brings together records and digitised content from libraries, museums, galleries, universities, archives, data repositories and other research and collecting organisations. Trove contains both digital copies of content, for example digitised newspapers, and links to items held in other collections.

Users are able to access and use Trove, and provide content and/or contribute to content.

Before you use Trove, please read the following terms and conditions (Terms of Use) which govern your use of Trove.
Terms of Use
1. Agreement

1.1 These Terms of Use constitute an agreement between you and the Library. By using and accessing any component of Trove, you agree to be bound by these Terms of Use. These Terms of Use apply irrespective of whether you have registered for a Trove user account.

1.2 These terms must be read in conjunction with any terms and conditions appearing on Trove and the Library website, including:

     (a) Copyright;

     (b) Disclaimer;

     (c) Privacy;

     (d) Privacy Policy.
2. Definitions

2.1 In these Terms of Use, except where the contrary intention is expressed, capitalised terms have the following meaning:

     (a) Copyright means the Trove copyright notice available at https://trove.nla.gov.au/about/policies/copyright

     (b) Disclaimer means the Trove disclaimer available at https://trove.nla.gov.au/general/about#disclaimer;

     (c) Library, we, our and us means the National Library of Australia (ABN 28 346 858 075) a body corporate established by the National Library Act 1960 (Cth);

     (d) Personal Information has the meaning given in the Privacy Act 1988 (Cth);

     (e) Privacy Policy means the Library's privacy policy available at https://www.nla.gov.au/policy-and-planning/privacy-policy;

     (f) Privacy means the Trove privacy information available at http://help.nla.gov.au/trove/our-policies/trove-privacy-statement;

     (g) Terms of Use means these terms of use that apply to the use of Trove;

     (h) Trove means the website of that name made available by the Library, and includes any other functions or services delivered by the Library or Trove Partners to you in connection with that service;

     (i) Trove Partners means the partner institutions who have entered into Trove Collaborative Services Agreements with the Library; and

     (j) User Content means any content uploaded (such as text corrections, comments, images, notes), posted or otherwise provided by you in relation to Trove.
3. Registration and account information

3.1 To use some of the features of Trove, such as creating lists, you will need to register and create a Trove user account.

3.2 In registering for an account, you may be required to provide some Personal Information, such as your email address. You should refer to the Privacy and the Privacy Policy for further information.

3.3 You agree to provide the Library with accurate and complete registration information, including a valid email address by which you can be contacted for administrative purposes. Accounts without a valid email address may be terminated in accordance with section 13.1. It is your responsibility to inform the Library of any changes to your registration information.

3.4 You agree not to create an account using false or misleading information or on behalf of someone other than yourself. Please note that using a pseudonym on Trove will not violate this section 3.4. 3.5 Subject to section 3.6, you must keep your account details (including username and password) confidential and not provide them to any other person.

3.6 Where the registered user is an organisation, the organisation is responsible for ensuring the security of the account details (including user name and password).

3.7 You are responsible for the security of your account details and any unauthorised use of your account, and the Library is not responsible for any unauthorised use of your account. You are entirely responsible for all activities that occur through your account.
4. Use of Trove

4.1 Your use of Trove is subject to the conditions set out in these Terms of Use.

4.2 If you use any content delivered by, or made available on, Trove, you must attribute the content, including with a link to Trove. In attributing any content you use, you must provide attribution to:

     (a) Trove;

     (b) the user or person that contributed the content; and

     (c) the substantive content author (if known).

4.3 Your use of Trove is voluntary and any User Content you upload is provided at your own cost and expense.

4.4 You agree, in using Trove, not to:

     (a) sell, rent, or otherwise offer Trove to others, without the Library's prior written consent;

     (b) use Trove in any unlawful, fraudulent, defamatory or harmful manner, including to post any User Content that is pornographic, obscene, threatening, offensive, invasive of privacy, or which would constitute or encourage a criminal offence, or give rise to liability under, or breach, any law;

     (c) post information about any other person on Trove without obtaining the prior consent of the person to whom the information pertains;

     (d) use Trove, or post any User Content that interferes with, impacts, harasses or intimidates other users of Trove or members of the public;

     (e) use any automated tool to access, copy or extract any content or information available on Trove, without the Library's prior written consent; or

     (f) introduce or permit the introduction of any virus, worm, trojan or other malicious code into Trove, or in any other manner whatsoever corrupt, degrade or disrupt Trove.

4.5 You agree and consent to the use of cookies by the Library for Trove.

4.6 You agree to comply with all applicable laws in using Trove.

4.7 You acknowledge that, in using Trove, the Library:

     (a) does not intend to edit, monitor, moderate or screen any content uploaded or made available on Trove, but reserves the right to do so;

     (b) is not responsible for any content uploaded or made available on Trove, or any content linked to it;

     (c) reserves the right to examine from time to time, some, or all, of the content uploaded or made available on Trove for compliance with these Terms of Use and to alter or change any content, including User Content uploaded by you, that may be objectionable or breach these Terms of Use. You consent to infringement of any moral rights arising from the alteration or change of the User Content by the Library; and

     (d) may remove any User Content at any time in its discretion, without providing notice to you.

4.8 You agree and consent to the Library using tools, including Google analytics, to track your behaviour and use of Trove and may use and share that information with others on a de-identified and non-attributable basis.

4.9 You agree and consent to the Library identifying you by your IP address and browser settings if you are misusing Trove or breaching these Terms of Use.

4.10 You understand that by making your user profile and/or User Content public that your personal information may be published overseas and you consent to such overseas disclosure of your personal information.

4.11 You acknowledge that the Library has the right to implement technical measures and mitigations which may affect your access to Trove if you use technical measures or other arrangements to circumvent or otherwise not comply with these Terms of Use.

4.12 Excluding the sale of books and the promotion of Library or Trove Partner events:

(a) Trove is provided solely for personal use; and

(b) you must not upload to Trove or otherwise distribute on or through Trove any content or material containing any advertising, promotion or solicitation for goods, services or funds, or solicitation for anyone to become members of any commercial enterprise or organisation, without the express written permission of the Library.

4.13 Any unauthorised use of any interactive area of Trove, or content delivered by, or made available on Trove, is expressly prohibited.

4.14 You must seek permission from the Library if you would like to use Trove in a way that is not outlined in these Terms of Use.
5. User Content

5.1 You represent and warrant that you have all necessary rights to upload the User Content to Trove and grant the rights required under these Terms of Use in relation to the User Content.

5.2 You grant to the Library a perpetual, irrevocable, worldwide, royalty free, non-exclusive licence to use, distribute, copy, preserve and sublicence any User Content you upload or otherwise contribute to Trove, including to allow the Library to licence your User Content under a Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) License (terms available here: https://creativecommons.org/licenses/by-nc/4.0/legalcode).
6. Intellectual property rights in Trove

6.1 The Library and its licensors own and retain all right, title and interest in and to:

     (a) the logos, design and architecture of Trove;

     (b) the Library's trademarks, including the Trove trademark;

     (c) any software provided through Trove; and

     (d) any content created by or on behalf of the Library, including Trove user guidance information, (collectively, the Library IP).

6.2 Except for any rights explicitly granted in writing by the Library under these Terms of Use or otherwise, you are not granted any rights in and to any Library IP.
7. Trademark licence

The following section 7 is only applicable to registered Trove Partners. If you are a Trove Partner, please refer to your Trove Collaborative Services Agreement for more information about your rights and obligations as a Trove Partner.

7.1 The Library grants you a non-transferable, non-exclusive licence while you remain a registered Trove Partner of Trove to display the Library's trademarks, including the Trove trademark, in relation to your use of Trove as permitted expressly in writing by the Library under these Terms of Use or otherwise.

7.2 Your use of the Library's trademarks, including the Trove trademark, is subject to the Library's brand guidelines as updated from time to time.

7.3 If the Library determines at any time that you are using or displaying any of the Library's trademarks, including the Trove trademark, in a manner that is or may be detrimental to the Library's interests, the Library may issue reasonable instructions concerning the manner, if any, in which you may continue the use of the Library's trademarks, including the Trove trademark. You must promptly comply with such instructions or cease the use or display of the relevant Library trademark.
8. Copyright

8.1 Nothing in these Terms of Use limits the copyright conditions outlined in Copyright.

8.2 You must ensure that your use or reproduction of any content delivered by, or made available on, Trove complies with the Copyright Act 1968 (Cth) and the copyright owner's licensing requirements. This includes, to the extent required, checking with and/or obtaining the copyright owner's consent before using or reproducing such content.
9. No warranty

9.1 The Library expressly disclaims any and all warranties of any kind, express or implied, in respect of Trove. 9.2 Without limiting section 9.1, the Library makes no warranty, express or implied, nor assumes any legal liability or responsibility in relation to the following:

     (a) that Trove or the Library's websites and servers are free of computer viruses or any other harmful components, defects or errors;

     (b) that any defects in Trove will be corrected;

     (c) that your access to Trove will be reliable, uninterrupted or error-free;

     (d) for any delays, inaccuracies, failures, errors, omissions, interruptions, deletions, defects, computer viruses or communication line failures; or

     (e) for any theft, destruction, damage or unauthorised access to your computer system or network.
10. Security

10.1 The Library does not accept responsibility for accidental or malicious damage that may arise to your local systems, data, software or hardware through accessing Trove and its content.

10.2 To maintain the security of Trove, and to assist in maintaining its availability, the Library uses software programs to monitor network traffic. The programs identify unauthorised attempts to upload or change information, deny service, or otherwise cause damage or access non-public information. Unauthorised attempts to upload or change information are strictly prohibited and may be punishable under legislation. The Library may provide information about possible violations of the law to law enforcement officials.

10.3 The Library reserves the right to limit or block automated requests submitted at a rate that negatively impacts service delivery to patrons.
11. Liability

11.1 The Library does not guarantee the accuracy or completeness of Trove or any content made available by, or accessible on, Trove.

11.2 To the extent permitted by law, the Library is not liable for any loss, injury, claim, liability or damage of any kind resulting from the use of Trove, or for any content available or accessible on Trove, including any privacy breach or infringement of copyright. The Library is not liable for any special, indirect, incidental or consequential loss or damages of any kind whatsoever (including, without limitation, legal fees) in any way due to, resulting from, or arising in connection with the use of or inability to use Trove.
12. Indemnity

12.1 To the extent permitted by law, you indemnify the Library, its officers, directors, employees, agents, distributors and affiliates, and any third party information providers to Trove, for any loss or damage suffered, or any costs or expenses incurred or resulting from any breach of these Terms of Use by you or your access or use of Trove, including any or all third party claims, demands, liabilities, costs or expenses arising directly or indirectly out of or in connection with your access or use of Trove.

12.2 You must cooperate with the Library as reasonably required in the defence of any third party claim.
13. Termination and suspension of access and removal of User Content

13.1 The Library reserves the right to:

     (a) withdraw, suspend or limit your access to or use of Trove;

     (b) limit, suspend, terminate, modify or delete your account, at its discretion, without providing notice to you.

13.2 The Library may, at its discretion, remove any User Content at any time without providing notice to you.

13.3 Without limiting sections 13.1 or 13.2, if the Library considers that you have committed a material breach of these Terms of Use, the Library may exercise its rights under section 13.1 and remove all of your User Content from Trove under section 13.2.

13.4 If:

     (a) your access to or use of Trove has been withdrawn, suspended or limited by the Library;

     (b) your account has been limited, suspended, terminated, modified or deleted by the Library; or

     (c) any of your User Content has been removed by the Library, you may not register for another Trove user account or add User Content to Trove, without the Library's prior written consent.
14. Appeal process

14.1 If your access to or use of Trove has been withdrawn, suspended or limited by the Library, or your account has been limited, suspended, terminated, modified or deleted by the Library, or your User Content has been removed from Trove by the Library, you may make a complaint to the Library in accordance with the Library's feedback procedure.

14.2 The Library will deal with and respond to your complaint in accordance with the Library's service charter.
15. Changes to the Terms of Use

15.1 The Library may change these Terms of Use at any time in its sole discretion.

15.2 The Library will notify you of any changes to these Terms of Use by adding a statement on Trove and the amended Terms of Use will take effect 5 working days (in the Australian Capital Territory) after the date on which the statement was added to Trove. If you do not agree to the updated Terms of Use, you must immediately cease using Trove.
16. Entire agreement

16.1 These Terms of Use constitute the entire agreement between the parties, and supersede all previous agreements relating to the use of Trove.
17. Severability

17.1 If any provision of these Terms of Use is deemed to be unenforceable for any reason by any court, the invalidity of the provision does not affect the validity of any other provisions in these Terms of Use, which remain in full effect.
18. Location of Trove

18.1 Trove is controlled and offered by the Library from Australia. The Library makes no representations that Trove is appropriate or available for use in other locations. Those who access or use Trove from other jurisdictions do so at their own volition and are responsible for complying with local law.
19. Governing Law

19.1 These Terms of Use are governed by the laws of the Australian Capital Territory.

19.2 You submit to the non-exclusive jurisdiction of the courts of the Australian Capital Territory.

Miscellaneous data (news articles, books, archived webpages, etc.)

Collection of miscellaneous data (news articles, books, archived webpages, etc.)


Science magazing AAAS academic journal.

Science has been at the center of important scientific discovery since its founding in 1880—with seed money from Thomas Edison. Today, Science continues to publish the very best in research across the sciences, with articles that consistently rank among the most cited in the world. In the last half century alone, Science published:

The entire human genome for the first time
Never-before seen images of the Martian surface
The first studies tying AIDS to human immunodeficiency virus
A trailblazer in online publishing as well, the Science family of publications has grown to include online journals Science Translational Medicine, Science Signaling, Science Immunology, Science Robotics and the open access journal Science Advances.

Science Translational Medicine is an essential platform for peer-reviewed, multidisciplinary research driving the latest medical advances. Science Signaling offers original review articles, protocols and teaching resources for the growing field of cellular signal transduction. Science Immunology publishes basic, translational and clinical research specifically about immunology across all organisms and model systems, including humans. Science Robotics covers new developments in robotics and related fields, with a dual focus on the science of robotics as well as introducing researchers more broadly to how robots can be used to accelerate scientific study. Science Advances represents the next generation of online publishing, with rapid publication of significant, full-length research that is available free to readers.

The Science family of journals is published by the American Association for the Advancement of Science (AAAS), the world’s oldest and largest general science organization. The nonprofit AAAS serves 10 million people through primary memberships and affiliations with some 262 scientific societies and academies.

A voice for science and scientists everywhere, AAAS fulfills its mission to “advance science and serve society” by communicating the value of science to the public, helping governments formulate science policy, promoting advancements in science education and diversity, and helping scientists develop their careers.

Science/AAAS

Science/AAAS 1200 New York Avenue NW Washington, DC 20005 Editorial: 202-326-6550 News: 202-326-6483  202-326-6417


Time News Magazine

Time (stylized in all caps) is an American news magazine and news website published and based in New York City. For nearly a century, it was published weekly, but by March 2020 it had switched to once every two weeks. It was first published in New York City on March 3, 1923, and for many years it was run by its influential co-founder, Henry Luce. A European edition (Time Europe, formerly known as Time Atlantic) is published in London and also covers the Middle East, Africa, and, since 2003, Latin America. An Asian edition (Time Asia) is based in Hong Kong.[2] The South Pacific edition, which covers Australia, New Zealand, and the Pacific Islands, is based in Sydney.

As of 2012, Time had a circulation of 3.3 million, making it the 11th-most-circulated magazine in the United States and the second-most-circulated weekly behind People. In July 2017, its circulation was 3,028,013; this was cut down to 2 million by late 2017. The print edition has a readership of 1.6 million, 1 million of whom are based in the United States.


Washington post WAPO

The Washington Post (also known as the Post and, informally, WaPo) is an American daily newspaper published in Washington, D.C. It is the most widely circulated newspaper within the Washington metropolitan area, and has a large national audience. Daily broadsheet editions are printed for D.C., Maryland, and Virginia.

The newspaper has won 69 Pulitzer Prizes, the second-most of any publication (after The New York Times). It is considered a newspaper of record in the US. Post journalists have also received 18 Nieman Fellowships and 368 White House News Photographers Association awards. The paper is well known for its political reporting and is one of the few remaining American newspapers to operate foreign bureaus.

The Post was founded in 1877. In its early years, it went through several owners and struggled both financially and editorially. Financier Eugene Meyer purchased it out of bankruptcy in 1933 and revived its health and reputation, work continued by his successors Katharine and Phil Graham (Meyer's daughter and son-in-law), who bought out several rival publications. The Post's 1971 printing of the Pentagon Papers helped spur opposition to the Vietnam War. Subsequently, in the best-known episode in the newspaper's history, reporters Bob Woodward and Carl Bernstein led the American press's investigation into what became known as the Watergate scandal, which resulted in the 1974 resignation of President Richard Nixon. The advent of the internet expanded the Post's national and international reach. In October 2013, the Graham family sold the newspaper to Nash Holdings, a holding company established by Jeff Bezos, for $250 million.

Northern America
United States of America
Canada


Mawdoo3, is an online Arabic content publisher, based in Jordan. Mawdoo3 was initially established in 2010 by Mohammad Jaber and Rami Al Qawasmi, and officially launched in 2012. The company claims to be the world's largest Arabic website. The company expanded its online Arabic content with over 140k articles to date

Middle East and North Africa
United Arab Emirates
Saudi Arabia
Libya
Algeria
Jordan
Palestine
Lebanon
Syria
Iraq
Yemen
Bahrain
Qatar
Oman
Egypt
Tunisia
Morocco
Comoros
Mauritania
Sudan
Kuwait


Apple Insider blog

AppleInsider is a news and rumor website that includes a forum for discussion of news stories and other community news. It has tons of resources, auctions, and news for anyone who wants to know about Apple. AppleInsider, as the name implies, has the inside scope about lots of different Apple-related info.
AppleInsider launched in 1997 and quickly grew to become one of the Internet's premier sources of information for all things Apple. Each month, AppleInsider caters to several million unique visitors including consumers, engineers, bankers, and CEOs of Fortune 500 companies.


Vietnamese Hate Speech Detection Dataset

In recent years, Vietnam witnesses the mass development of social network users on different social platforms such as Facebook, Youtube, Instagram, and Tiktok. On social media, hate speech has become a critical problem for social network users. To solve this problem, we introduce the ViHSD – a human-annotated dataset for automatically detecting hate speech on the social network. This dataset contains over 30,000 comments, each comment in the dataset has one of three labels: CLEAN, OFFENSIVE, or HATE. Besides, we introduce the data creation process for annotating and evaluating the quality of the dataset. Finally, we evaluated the dataset by deep learning models and transformer models.

No - the dataset curators kept the source data secret


Offenseval Dravidian

Gold standard corpus for offensive language identification of code-mixed text in Dravidian languages (Tamil-English, Malayalam-English, and Kannada-English).


Bloom Library

SIL International’s innovative Bloom software eases the process of bookmaking so that more people can participate – if you can type on a computer, you can create a book in Bloom.

Bloom users can create an original text or select a template, called a “shell book,” and insert culturally appropriate pictures and local translations of text. The books created can then be saved as a PDF and distributed in printed or electronic form.  It is also possible to use Bloom to create EPUBs and “talking books.”

SIL has been developing and using Bloom since 2011. For the All Children Reading Enabling Writers competition, SIL added features to let Bloom users create decodable texts and leveled readers. Literacy specialists can create “Reader Templates” that help writers create texts for specific languages that are decodable at various stages of learning and conform to leveling guidelines.

Swahili (individual language), Kiswahili

Odia (individual language), Oriya (individual language)

This resource includes books, primers, etc. in 422 languages that are templated such that they can be rapidly translated into many languages. It includes many languages that aren't listed here in this data catalogue interface in addition to the ones I have selected.

All of your book's content must be either in the public domain, your own content, or content that you have permission to republish. Your book's Credits or Title Page must give credit to images used and describe the terms under which they are being used in the book (e.g. Creative Commons license). The presence of an image on the Internet (a blog, news reports, a clipart site, etc.) does not give you the right to republish it here, even if you give credit. Nor does a site saying "Royalty Free".

There is a Bloom reader format. However Daniel Whitenack at SIL (dan_whitenack@sil.org) has access to and can parse the text portions of the books.