{"id":106017,"date":"2024-10-21T00:01:00","date_gmt":"2024-10-21T04:01:00","guid":{"rendered":"https:\/\/cdt.org\/?post_type=insight&p=106017"},"modified":"2025-05-07T13:02:31","modified_gmt":"2025-05-07T17:02:31","slug":"beyond-english-centric-ai-lessons-on-community-participation-from-non-english-nlp-groups","status":"publish","type":"insight","link":"https:\/\/cdt.org\/insights\/beyond-english-centric-ai-lessons-on-community-participation-from-non-english-nlp-groups\/","title":{"rendered":"Beyond English-Centric AI: Lessons on Community Participation from Non-English NLP Groups"},"content":{"rendered":"\n

This report brief was authored by Evani Radiya-Dixit, CDT Summer Fellow for the CDT AI Governance Lab<\/em><\/strong>.<\/p>\n\n\n\n

\"CDT<\/a>
CDT brief, entitled “Beyond English-Centric AI: Lessons on Community Participation from Non-English NLP Groups.” Black and white document on a grey background.<\/em><\/figcaption><\/figure>\n\n\n\n

<\/p>\n\n\n\n

Many leading language models are trained on nearly a thousand times more English text compared to text in other languages. These disparities in large language models have real-world impacts, especially for racialized and marginalized communities. For example, they have resulted in inaccurate medical advice<\/a> in Hindi, led to wrongful arrest because of mistranslations in Arabic<\/a>, and have been accused of fueling ethnic cleansing in Ethiopia due to poor moderation of speech that incites violence<\/a>.<\/p>\n\n\n\n

These harms reflect the English-centric nature of natural language processing (NLP) tools, which prominent tech companies often develop without centering or even involving non-English-speaking communities. In response, region- and language-specific research groups, such as Masakhane<\/a> and AmericasNLP<\/a>, have emerged to counter English-centric NLP by empowering their communities to both contribute to and benefit from NLP tools developed in their languages. Based on our research and conversations with these collectives, we outline promising practices that companies and research groups can adopt to broaden community participation in multilingual AI development.<\/p>\n\n\n\n

Read the full brief.<\/a><\/strong><\/em><\/p>\n","protected":false},"featured_media":106019,"template":"","content_type":[521],"area-of-focus":[834,10216,7253,77,7252],"class_list":["post-106017","insight","type-insight","status-publish","has-post-thumbnail","hentry","content_type-report","area-of-focus-ai-policy-governance","area-of-focus-cdt-ai-governance-lab","area-of-focus-content-moderation","area-of-focus-free-expression","area-of-focus-transparency-accountability"],"acf":[],"_links":{"self":[{"href":"https:\/\/cdt.org\/wp-json\/wp\/v2\/insight\/106017","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cdt.org\/wp-json\/wp\/v2\/insight"}],"about":[{"href":"https:\/\/cdt.org\/wp-json\/wp\/v2\/types\/insight"}],"version-history":[{"count":7,"href":"https:\/\/cdt.org\/wp-json\/wp\/v2\/insight\/106017\/revisions"}],"predecessor-version":[{"id":108745,"href":"https:\/\/cdt.org\/wp-json\/wp\/v2\/insight\/106017\/revisions\/108745"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cdt.org\/wp-json\/wp\/v2\/media\/106019"}],"wp:attachment":[{"href":"https:\/\/cdt.org\/wp-json\/wp\/v2\/media?parent=106017"}],"wp:term":[{"taxonomy":"content_type","embeddable":true,"href":"https:\/\/cdt.org\/wp-json\/wp\/v2\/content_type?post=106017"},{"taxonomy":"area-of-focus","embeddable":true,"href":"https:\/\/cdt.org\/wp-json\/wp\/v2\/area-of-focus?post=106017"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}