Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model
Üstün et al., 2024, Aya Model (Proceedings of the 62nd Annual Meeting of ACL (Volume 1: Long Papers))
Subscriber deck — free during early access
1 cards in “Limitations” · whole deck
Limitations
- What limitations of Aya do Üstün et al. acknowledge?101 languages are a tiny fraction of about 7,000 and ignore dialects; translated and safety data may skew towards Western cultural values; gendered languages and honorifics raise pronoun choices; and data per language remains very uneven, which can disadvantage lower-resourced languages.
- Üstün et al., 2024, Aya Model (Proceedings of the 62nd Annual Meeting of ACL (Volume 1: Long Papers)), Limitations, p. 15902
Source
- Ahmet Üstün, Viraat Aryabumi, Zheng-Xin Yong, Wei-Yin Ko, Daniel D’souza, Gbemileke Onilude, Neel Bhandari, Shivalika Singh, Hui-Lee Ooi, Amr Kayid, Freddie Vargus, Phil Blunsom, Shayne Longpre, Niklas Muennighoff, Marzieh Fadaee, Julia Kreutzer and Sara Hooker. 2024. Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 15894–15939. License: CC BY 4.0. Flashcards adapted from this work. doi:10.18653/v1/2024.acl-long.845 https://aclanthology.org/2024.acl-long.845/