Un vocabulario básico de los modelos grandes de lenguaje: una explicación y 25 términos Núria Bel Brown, Tom B.; Mann, Benjamin; Ryder, Nick; Subbiah, Melanie; Kaplan, Jared; Dhariwal, Prafulla; Neelakantan, Arvind; Shyam, Pranav; Sastry, Girish; Askell, Amanda; Agarwal, Sandhini; HerbertVoss, Ariel; Krueger, Gretchen; Henighan, Tom; Child, Rewon; Ramesh, Aditya; Ziegler, Daniel M.; Wu, Jeffrey; Winter, Clemens; Hesse, Christopher; Chen, Mark; Sigler, Eric; Litwin, Mateusz; Gray, Scott; Chess, Benjamin; Clark, Jack; Berner, Christopher; McCandlish, Sam; Radford, Alec; Sutskever, Ilya; Amodei, Dario (2020). «Language models are few-shot learners». En: Proceedings of the 34th International Conference on Neural Information Processing Systems (NIPS’20) [en línea]. Red Hook, NY: Curran Associates Inc., pp. 1877-1901. . [Consulta: 04/03/2025]. Hernández Fernández, Antoni; Ferrer i Cancho, Ramon (2023). «Lingüística quantitativa i lleis lingüístiques: de la lingüística a la intel·ligència artificial i la tecnoètica». Terminàlia [en línea], 27, pp. 7279. . [Consulta: 04/03/2025]. Kaplan, Jared; McCandlish, Sam; Henighan, Tom; Brown, Tom B.; Chess, Benjamin; Child, Rewon; Gray, Scott; Radford, Alec; Wu, Jeff; Amodei, Dario (2020). «Scaling laws for neural language models». arXiv:2001.08361 [en línea]. . [Consulta: 04/03/2025]. Kwiatkowski, Tom; Palomaki, Jennimaria; Redfield, Olivia; Collins, Michael; Parikh, Ankur; Alberti, Chris; Epstein, Danielle; Polosukhin, Illia; Devlin, Jacob; Lee, Kenton; Toutanova, Kristina; Jones, Llion; Kelcey, Matthew; Chang, Ming-Wei; Dai, Andrew M.; Uszkoreit, Jakob; Le, Quoc; Petrov, Slav (2019). «Natural questions: A benchmark for question answering research». Transactions of the Association for Computational Linguistics [en línea], 7, pp. 452-466. . [Consulta: 04/03/2025]. Longpre, Shayne; Hou, Le; Vu, Tu; Webson, Albert; Chung, Hyung Won; Tay, Yi; Zhou, Denny; Le, Quoc V.; Zoph, Barret; Wei, Jason; Roberts, Adam (2023). «The flan collection: Designing data and methods for effective instruction tuning». En: Proceedings of the 40th International Conference on Machine Learning (ICML’23) [en línea], artículo 941, pp. 22631-22648. . [Consulta: 04/03/2025]. McCoy, R. Thomas; Yao, Shunyu; Friedman, Dan; Hardy, Matthew; Griffiths, Thomas L. (2023). «Embers of autoregression: Understanding large language models through the problem they are trained to solve». arXiv:2309.13638 [en línea]. . [Consulta: 04/03/2025]. Metz, Rachel (2024). «OpenAI and the fierce AI industry debate over open source». Bloomberg. Newsletter Tech Daily [en línea]. . [Consulta: 04/03/2025]. Min, Sewon; Lyu, Xinxi; Holtzman, Ari; Artetxe, Mikel; Lewis, Mike; Hajishirzi, Hannaneh; Zettlemoyer, Luke (2022). «Rethinking the role of demonstrations: What makes in-context learning work?». En: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing [en línea]. Abu Dhabi: Association for Computational Linguistics. . [Consulta: 04/03/2025]. Mitchell, Tom (1997). Machine learning [en línea]. McGraw-Hill Science/Engineering/Math. . [Consulta: 04/03/2025]. Ouyang, Long; Wu, Jeff; Jiang, Xu; Almeida, Diogo; Wainwright, Carroll L.; Mishkin, Pamela; Zhang, Chong; Agarwal, Sandhini; Slama, Katarina; Ray, Alex; Schulman, John; Hilton, Jacob; Kelton, Fraser; Miller, Luke; Simens, Maddie; Askell, Amanda; Welinder, Peter; Christiano, Paul; Leike, Jan; Lowe, Ryan (2022). «Training language models to follow instructions with human feedback». En: Proceedings of the 36th International Conference on Neural Information Processing Systems (NIPS’22) [en línea]. Red Hook, NY: Curran Associates Inc., pp. 27730-27744. . [Consulta: 04/03/2025]. Pang, Bo; Lee, Lillian; Vaithyanathan, Shivakumar (2002). «Thumbs up? Sentiment classification using machine learning techniques». En: Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing (EMNLP 2002) [en línea]. S. l.: Association for Computational Linguistics, pp. 79-86. . [Consulta: 04/03/2025]. Radford, Alec; Narasimhan, Karthik; Salimans, Tim; Sutskever, Ilya (2018). «Improving language understanding by generative pre-training». OpenAI [en línea], pp. 1-12. . [Consulta: 04/03/2025]. Radford, Alec; Wu, Jeff; Child, Rewon; Luan, Davi; Amodei, Dario; Sutskever, Ilya (2019). «Language models are unsupervised multitask learners». OpenAI Blog [en línea]. . [Consulta: 04/03/2025]. Sileo, Damien (2024). «Tasksource: A large collection of NLP tasks with a structured dataset preprocessing framework». En: Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) [en línea]. Turín: ELRA and ICCL, pp. 15655-15684. . [Consulta: 04/03/2025]. Articles 37 Terminàlia núm. 31