International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
AN EMPIRICAL INVESTIGATION OF BIAS TRANSMISSION
MECHANISMS IN LARGE-SCALE LANGUAGE MODELS TRAINED ON MULTILINGUAL LOW-RESOURCE DATA STREAMS
Sanjeev Yadav1 , Mrs. Arifa Khan2
1Master of Technology, Computer Science and Engineering, Lucknow Institute of Technology, Lucknow, India
2Assistant Professor, Department of Computer Science and Engineering, Lucknow Institute of Technology, Lucknow, India
Abstract - The rapid advancement of multilingual large language models (LLMs) has significantly improved crosslingual information access and natural language understanding. However, these models are often trained on unevenly distributed multilingual datasets, where highresource languages dominate low-resource ones, leading to potential bias in information retrieval and generation. This studypresentsanempiricalinvestigationofbiastransmission mechanisms in large-scale multilingual LLMs, with a particular focus on systems integrated with retrievalaugmented generation (RAG) frameworks. The research adoptsacontrolledexperimentaldesigninwhichsemantically equivalentqueriesareexecutedacrossmultiplelanguagesto analyze variations in retrieved documents and generated responses. A multilingual dataset comprising both highresource and low-resource languages is utilized to evaluate model behavior. The study introduces quantitative and qualitative evaluation metrics, including retrieval language distribution, response similarity, information completeness, and contextual relevance. Experimental results reveal that multilingual LLMs exhibit a strong preference for highresource language sources during retrieval, which significantly influences the quality and completeness of generated responses. Furthermore, bias is observed to propagate through multiple stages, including training data, retrieval processes, and response generation. The findings highlight critical challenges in achieving equitable information representation and emphasize the need for improved multilingual training strategies and bias-aware retrievalmechanismsinlarge-scalelanguagemodels.
Key Words: Multilingual Large Language Models, Bias Transmission, Low-Resource Languages, RetrievalAugmented Generation, Cross-Lingual Information Retrieval, Information Disparity
1. INTRODUCTION
Therapidevolutionofmultilingual largelanguagemodels (LLMs)hastransformedthelandscapeofnaturallanguage processing by enabling systems to process, retrieve, and generate information across multiple languages within a unifiedframework.Thesemodelsareincreasinglydeployed in applications such as search engines, conversational
agents,andknowledgeretrievalsystems,wheretheyactas intermediaries between users and global information resources.However,despitetheircapabilities,multilingual LLMsofteninheritstructuralimbalancesfromthedataon whichtheyaretrained,leadingtounequalrepresentationof languagesandknowledgesources.Thissectionintroduces thebackground,problemcontext,researchgaps,objectives, andcontributionsofthestudy,focusingonbiastransmission mechanismsinmultilingualenvironments.
1.1 Background
ThedevelopmentofmultilingualLLMshasbeendrivenby theneedtosupportglobalcommunicationandinformation access across diverse linguistic communities. Advances in transformer-based architectures have enabled models to learnsharedrepresentationsacrosslanguages,facilitating cross-lingualunderstandingandtransferlearning(Vaswani et al., 2017). As a result, modern LLMs are capable of handlingdozensorevenhundredsoflanguages,significantly improvingaccessibilitytodigitalknowledgesystems.
1.1.1 Growth of Multilingual LLMs
Multilingual LLMs have evolved through large-scale pretraining on multilingual corpora collected from web data, books, and online repositories. These models leverage sharedembeddingspacestotransferknowledgefromhighresource languages to low-resource ones, improving performance in multilingual tasks such as translation and question answering. However, the growth of such models has also amplified concerns regarding the uneven distribution of training data, as high-resource languages dominatethelearningprocess,influencingmodelbehavior andknowledgerepresentation(Devlinetal.,2019).
1.1.2 Role in Global Information Access
Multilingual LLMs play a critical role in enabling global accesstoinformationbybridginglanguagebarriersindigital ecosystems.Theyallowuserstoretrieveandinteractwith knowledgeregardlessoftheirnativelanguage,supporting inclusive communication and knowledge dissemination. Nevertheless,theeffectivenessofthesesystemsdependson theavailabilityandqualityofmultilingualdata,whichvaries
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
significantlyacrosslanguages,potentiallylimitingequitable accesstoinformation(Joshietal.,2020).
1.1.3
Persistent Imbalance Between High-Resource and Low-Resource Languages
Despitetechnologicaladvancements,apersistentimbalance existsbetweenhigh-resourceandlow-resourcelanguagesin NLP systems. High-resource languages benefit from abundant digital data and well-developed linguistic tools, whereas low-resource languages often lack sufficient representation. This disparity affects model performance, leading to differences in accuracy, completeness, and contextualunderstandingacrosslanguages(Hedderichetal., 2021).
1.2
Problem Statement
Although multilingual LLMs aim to provide equitable informationaccess,theyoftenexhibitbiasesthatarisefrom dataimbalancesandsystemdesign.Thesebiasesinfluence how information is retrieved and presented, raising concerns about fairness and reliability in multilingual AI systems.
1.2.1
Bias in Training Data and Retrieval Systems
Bias in multilingual LLMs originates primarily from the uneven distribution of training data and the mechanisms usedinretrievalsystems.Sincemodelslearnpatternsfrom available data, the dominance of certain languages in trainingcorporaleadstostrongerrepresentationsforthose languages. Additionally, retrieval systems may prioritize documentsfromhigh-resourcelanguagesduetotheirhigher availabilityandindexingfrequency(Benderetal.,2021).
1.2.2 Unequal Information Representation Across Languages
The imbalance in data distribution results in unequal information representation across languages. Multilingual LLMsmayprovidemoredetailedandaccurateresponsesin languages with extensive datasets while generating less comprehensive outputs for underrepresented languages. Thisdisparitycanaffectusers’accesstoreliableinformation and reinforce existing inequalities in digital knowledge systems(HovyandSpruit,2016).
1.2.3 Language Preference in LLM Outputs
LanguagepreferencereferstothetendencyofLLMstofavor certainlanguagesduringretrievalandresponsegeneration. Inmultilingualsettings,modelsmaydefaulttohigh-resource languageswhenrelevantinformationisscarceinthequery language,therebyinfluencingthediversityandneutralityof generatedoutputs(Conneauetal.,2020).
2. RELATED WORK
Thestudyofmultilinguallargelanguagemodels(LLMs)and bias transmission is grounded in a rich body of research spanning natural language processing (NLP), machine learning,andinformationretrieval.Thissectionreviewskey developmentsinLLMarchitectures,multilingualmodeling techniques, bias in AI systems, and retrieval-augmented frameworks,withparticularemphasisonchallengesrelated tomultilingualbiasandinformationdisparity.
2.1 Evolution of LLMs and Multilingual NLP
ThefieldofNLPhasundergoneasignificanttransformation with the introduction of deep learning techniques, particularly transformer-based architectures, which have enabled the development of large-scale language models capableofhandlingcomplexlinguistictasks.
2.1.1 Transformer-Based Models
Transformer-basedmodelsrepresentamajoradvancement in NLP due to their ability to capture long-range dependenciesintextusingself-attentionmechanisms.Unlike earliersequence-basedmodels,transformersprocessentire sequencesinparallel,improving efficiencyand contextual understanding.Thisarchitecturehasbecomethefoundation for modern LLMs, enabling large-scale pre-training on massive corpora and significantly enhancing performance across tasks such as translation, summarization, and questionanswering(Vaswanietal.,2017).
2.1.2 Cross-Lingual Learning
Cross-lingual learning has emerged as a key technique in multilingual NLP, allowing models to transfer knowledge across languages by learning shared semantic representations.Thisapproachenablesmodelstrainedon high-resource languages to generalize to low-resource languages,reducingtheneedforlanguage-specificmodels. Cross-lingual embeddings and multilingual pre-training strategies have played a crucial role in enabling LLMs to operate effectively in multilingual environments (Ruder, VulićandSøgaard,2019).
2.2 Multilingual Language Models
Multilingual language models are designed to process multiplelanguageswithinasinglearchitecture,leveraging shared representations to enable cross-lingual tasks and improveaccessibilitytolanguagetechnologies.
2.2.1 Shared Embeddings and Transfer Learning
Afundamentalconceptinmultilingualmodelsistheuseof sharedembeddingspaces,wherewordsorsentencesfrom differentlanguagesaremappedintoacommonvectorspace. Thisallowssemanticallysimilarconceptsacrosslanguages to be represented closely, facilitating cross-language
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
understanding. Transfer learning further enhances this capability by enabling knowledge learned from highresourcelanguagestoimproveperformanceinlow-resource languages, making multilingual models more efficient and scalable(Conneauetal.,2020).
2.2.2 Performance Imbalance Across Languages
Despite these advancements, multilingual models often exhibitunevenperformanceacrosslanguages.High-resource languagesbenefitfromlargertrainingdatasets,resultingin better accuracy and richer contextual understanding. In contrast,low-resourcelanguagesoftensufferfromlimited representation,leadingtoreducedmodelperformanceand lessreliable outputs. This imbalance remainsa significant challengeinmultilingualNLP(Pires,SchlingerandGarrette, 2019).
2.3 Bias in AI and NLP Systems
Bias in artificial intelligence has become a critical area of research, particularly as AI systems are increasingly deployedinreal-worldapplicationsthatinfluencedecisionmakingandinformationaccess.
2.3.1
Data Bias
Databiasariseswhentrainingdatasetsareimbalancedor unrepresentative of the diversity present in real-world scenarios.InNLP,thisoftenoccurswhencertainlanguages, cultures,ortopicsareoverrepresentedinthetrainingdata. As a result, models may learn skewed patterns and reproduce these biases in their outputs, affecting fairness andreliability(Barocas,HardtandNarayanan,2019).
2.3.2
Linguistic and Cultural Bias
Linguistic and cultural biases emerge when AI systems reflect dominant language structures or cultural perspectivesembeddedinthedata.MultilingualLLMsmay prioritizenarrativesandviewpointsassociatedwithwidely represented languages, potentially marginalizing lessrepresentedculturesandlinguisticcommunities.Suchbiases caninfluencehowinformationisinterpretedandpresented, raisingconcernsaboutinclusivityinAIsystems(Mehrabiet al.,2021).
2.4 High- vs Low-Resource Language Challenges
The distinction between high-resource and low-resource languages is a fundamental issue in multilingual NLP, influencing both model development and performance outcomes.
2.4.1
Data Scarcity
Low-resource languages often lack sufficient digital text data, annotated corpora, and linguistic tools required for trainingrobustNLPmodels.Thisscarcitylimitstheabilityof
machine learning systems to learn accurate linguistic patterns, resulting in weaker performance compared to high-resourcelanguagesthathaveabundantdata(Joshiet al.,2020).
2.4.2 Model Generalization Issues
Duetolimitedtrainingdata,modelstrainedonlow-resource languages may struggle to generalize across different contextsandtasks.Evenwithcross-lingualtransferlearning, the lack of diverse and high-quality data can lead to incomplete or inconsistent representations, affecting the reliabilityofmodeloutputsintheselanguages(Hedderichet al.,2021).
2.5 Retrieval-Augmented Generation (RAG)
Retrieval-Augmented Generation (RAG) has emerged as a powerful framework for enhancing the capabilities of languagemodelsbyintegratingexternalknowledgesources duringresponsegeneration.
2.5.1 Architecture and Advantages
RAG systems combine a document retriever with a generativelanguagemodel.Theretrieveridentifiesrelevant documentsfromaknowledgebase,andthegeneratoruses thisinformationtoproducecontextuallyenrichedresponses. Thisapproachimprovesfactualaccuracy,reducesreliance on memorized knowledge, and enables dynamic access to up-to-date information, making it particularly useful for knowledge-intensivetasks(Lewisetal.,2020).
2.5.2 Multilingual Retrieval Limitations
Inmultilingualsettings,RAGsystemsfacechallengesrelated tounevendocumentdistributionacrosslanguages.Retrieval mechanismsmayfavordocumentswritteninhigh-resource languagesduetotheirgreateravailability,leadingtobiased informationselection.Thislimitationcanaffectthediversity andaccuracyofgeneratedresponses,especiallyforqueries inlow-resourcelanguages(Asaietal.,2021).
2.6 Existing Studies on Multilingual Bias
Recentresearchhasincreasinglyfocusedonunderstanding howmultilingualLLMshandleinformationacrossdifferent languagesandidentifyingpatternsofbiasintheiroutputs.
EmpiricalstudieshaveshownthatmultilingualLLMsoften generate different responses for semantically equivalent queriesacrosslanguages.Thesedifferencesmaymanifestin terms of response length, detail, and factual accuracy, indicatinginconsistenciesinknowledgerepresentationand modelbehavioracrosslanguages(Blodgettetal.,2020).
A recurring finding in multilingual bias research is the dominanceofhigh-resourcelanguagesinbothtrainingdata and model outputs. Models tend to rely more heavily on
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
information from these languages, even when processing queries in other languages. This dominance can reinforce existinginequalitiesinglobalinformationsystemsandlimit therepresentationofdiverselinguisticperspectives(Bender etal.,2021).
3. METHODOLOGY
Thissectionoutlinesthemethodologicalframeworkadopted toinvestigatebiastransmissionmechanismsinmultilingual large language models (LLMs). The study employs a structuredexperimentaldesignthatintegratesmultilingual datasets,retrieval-augmentedarchitectures,andsystematic evaluation techniques. The methodology is designed to ensurereproducibility,comparability,andempiricalrigorin analyzingcross-lingualvariationsinmodelbehavior.
3.1 Research Design
The research design defines the overall strategy used to conducttheinvestigationandachievethestudyobjectives. Inthiswork,acombinationofempiricalandexperimental approaches is adopted to analyze how multilingual LLMs processandgenerateinformationacrossdifferentlanguages.
3.1.1
Empirical and Experimental Approach
The study follows an empirical approach based on observable and measurable evidence derived from controlledexperiments.Ratherthanrelyingontheoretical assumptions, the research evaluates model behavior by executing multilingual queriesand analyzingoutputs. The experimentalsetupenablessystematicobservationofhow biasemergesduringdifferentstagesofprocessing,including retrieval and generation. Quantitative metrics and qualitative analysis are combined to provide a comprehensiveunderstandingofmultilingualbiaspatterns.
3.1.2 Cross-Lingual Comparative Analysis
A cross-lingual comparative framework is employed to examine differences in model outputs across languages. Semantically equivalent queries are executed in multiple languages, and the resulting responses are compared in terms of content, completeness, and relevance. This approachallowsthestudytoisolatetheimpactoflanguage onretrieval andgeneration processes,therebyidentifying disparities arising from linguistic differences and data distribution.
3.2 Experimental Framework
Theexperimentalframeworkdefinesthestructuredpipeline usedtoevaluatebiastransmissioninmultilingualLLMs.It consists of sequential stages that simulate real-world interactionwithlanguagemodels.
3.3 Dataset Preparation
Dataset preparation is a critical component of the methodology,asthequalityanddistributionofdatadirectly influencemodelbehaviorandbiaspatterns.
3.3.1 Multilingual Corpus (High + Low-Resource Languages)
Thestudyutilizesamultilingualcorpusthatincludesboth high-resource and low-resource languages. High-resource languagesarecharacterizedbyabundantdigitalcontentand well-developed linguistic resources, while low-resource languages have limited representation. Including both categories allows for comparative analysis of model performanceandbiasacrossdifferentlinguisticcontexts.
3.3.2 Data Sources: Web, Encyclopedias, Articles
Thedatasetisconstructedfromdiverseandreliablesources such as web documents, online encyclopedias, and news articles.Thesesourcesprovideabroadrangeoftopicsand perspectives, ensuring that the dataset reflects real-world information diversity. The use of heterogeneous data sources enhances the robustness of the experimental evaluation.
3.3.3 Balanced vs Imbalanced Distribution
Toanalyzetheimpactofdatadistributiononbias,thestudy considersbothbalancedandimbalanceddatasetscenarios. In balanced datasets, languages are equally represented, whereas in imbalanced datasets, high-resource languages dominate. Comparing these scenarios helps identify how data distribution affects retrieval behavior and response generationinmultilingualmodels.
3.4 Query Construction
Query construction is essential for ensuring fair and consistentevaluationacrosslanguages.
3.4.1 Semantically Equivalent Multilingual Queries
The study designs a set of queries that are semantically equivalent across multiple languages. Each query conveys thesamemeaningregardlessofthelanguageused,enabling direct comparison of model responses. This ensures that observeddifferencesinoutputsareduetomodelbehavior ratherthanvariationsinqueryintent.
3.4.2 Human-Verified Translations
To maintain accuracy and consistency, all multilingual queries are validated through human verification. This process ensures that translations preserve the original meaning and contextual nuances. Human validation minimizestranslationerrorsandenhancesthereliabilityof cross-lingualcomparisons.
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
3.5 Model and Architecture
The selection of model architecture plays a crucial role in analyzingbiastransmission,particularlyinmultilingualand retrieval-basedsystems.
3.5.1 Transformer-Based LLM
The study employs a transformer-based large language model,whichutilizesself-attentionmechanismstocapture contextual relationships within text. This architecture enables efficient processing of multilingual input and supportscomplexlanguageunderstandingtasks,makingit suitableforcross-lingualevaluation.
3.5.2 Retrieval-Augmented Generation (RAG)
A retrieval-augmented generation (RAG) framework is integratedintothemodeltoenhanceknowledgeaccess.In thisarchitecture,relevantdocumentsareretrievedfroman external corpus and provided as context for response generation.Thisapproachallowsthemodeltoincorporate externalknowledgedynamically,improvingfactualaccuracy andenablinganalysisofretrieval-basedbias.
3.5.3 Embedding-Based Document Retrieval
Theretrievalcomponentusesembedding-basedtechniques toidentifyrelevantdocuments.Queriesanddocumentsare converted into vector representations, and similarity measures are used to retrieve the most relevant content. Thismethodenablesefficientcross-lingualretrievalbutmay introducebiasifcertainlanguagesareoverrepresentedin thedataset.
3.6 Experimental Setup
The experimental setup defines the computational environmentandexecution workflowusedtoconductthe study.
3.6.1 Hardware and Software Environment
The experiments are conducted in a high-performance computing environment equipped with multi-core processors, sufficient memory, and GPU acceleration to support efficient model inference. The implementation is carried out using programming languages and libraries suitableforNLPanddeeplearningtasks,ensuringscalability andreproducibility.
3.6.2
Execution Pipeline
The execution pipeline follows a structured workflow in which multilingual queries are processed sequentially through the system. Each query undergoes encoding, document retrieval, context integration, and response generation.Theoutputsarethenstoredandanalyzedusing predefined evaluation metrics. This pipeline ensures
consistent processing across languages and facilitates systematiccomparisonofresults.
4. EVALUATION METRICS
Evaluation metrics are essential for systematically measuringhowmultilinguallargelanguagemodels(LLMs) behaveacrossdifferentlinguisticcontexts.Inthisstudy,the evaluationframeworkisdesignedtocapturebiasatmultiple stages of the pipeline, including document retrieval and responsegeneration.Themetricscombinequantitativeand qualitative measures to assess disparities in language representation,contentquality,andcontextualalignment.By structuring the evaluation into retrieval-level, responselevel, and bias-specific indicators, the study provides a comprehensivemechanismtoanalyzebiastransmissionin multilingualenvironments.
4.1 Retrieval Bias Metrics
Retrieval bias metrics are used to evaluate how the document retrieval component behaves when processing multilingual queries. Since retrieval plays a crucial role in shapingthefinaloutputinretrieval-augmentedsystems,any biasatthisstagecanpropagateintogeneratedresponses.
4.1.1 Language Distribution of Retrieved Documents
Languagedistributionreferstotheproportionofretrieved documents belonging to each language for a given query. This metric helps identify whether the retrieval system favorscertainlanguagesoverothers.Ideally,thedistribution should reflect the language of the query or maintain a balanced representation across languages. However, in practice,retrievalsystemsoftenreturnahigherproportion of documents from high-resource languages due to their greater availability in the dataset. Measuring this distributionenablesthedetectionoflanguageimbalanceat theretrievalstage.
4.1.2 Language Dominance Ratio
Thelanguagedominanceratioquantifiestheextenttowhich asinglelanguagedominatestheretrieveddocumentset.Itis typicallycalculatedastheratioofdocumentsretrievedinthe most frequent language to the total number of retrieved documents.Ahighdominanceratioindicatesthatthesystem heavilyreliesononelanguage,whichmayleadtobiasedor less diverse information in the generated response. This metricisparticularlyusefulforidentifyingwhetherretrieval mechanisms disproportionately prioritize high-resource languages.
4.2 Response-Level Metrics
Response-level metrics evaluate the quality and characteristics of the outputs generated by the language model.Thesemetricsfocusoncomparingresponsesacross
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
languagestoidentify differencesincontent,accuracy,and relevance.
4.2.1 Response Similarity Score (Cross-Language)
The response similarity score measures the semantic similarity between responses generated for equivalent queries in different languages. This metric is typically computed using embedding-based similarity techniques, which capture the underlying meaning of the responses rather than exact textual matches. A high similarity score indicates consistent knowledge representation across languages,whilealowscoresuggestsdivergenceinmodel outputs.Thismetriciscrucialforidentifyinginconsistencies inmultilingualresponsegeneration.
4.2.2
Information Completeness
Information completeness assesses the extent to which a response includes all relevant facts or details required to answeraquery.Thismetricevaluateswhetherresponsesin different languages provide equally comprehensive information. In many cases, responses in high-resource languages tend to be more detailed, while those in lowresource languages may omit important information. Measuring completeness helps identify disparities in knowledgecoverageacrosslanguages.
4.2.3
Contextual Relevance
Contextual relevance evaluates how well the generated response aligns with the intent of the query. This metric considers whether the response accurately addresses the question and maintains coherence with the provided context.Differencesincontextualrelevanceacrosslanguages may indicate that the model interprets queries differently depending on the language, which can be a sign of bias in understandingorretrievalprocesses.
4.3 Bias Measurement Indicators
Biasmeasurementindicatorsprovidehigher-levelinsights into how bias manifests across the entire multilingual pipeline. These indicators integrate observations from retrievalandresponsemetricstoidentifysystemicpatterns ofbias.
4.3.1 Cross-Language Variation
Cross-language variation refers to differences in model outputs when the same query is presented in different languages. This variation can be observed in terms of responselength,detail,accuracy,andstructure.Significant variation indicates that the model does not treat all languages equally, which may result from differences in trainingdataorretrievalbehavior.Analyzingthisvariation helps in understanding the extent of inconsistency in multilingualsystems.
4.3.2 Dominant-Language Influence
Dominant-languageinfluencemeasurestheextenttowhich high-resourcelanguagesaffecttheretrievalandgeneration processes,evenwhenqueriesareissuedinotherlanguages. Forexample,themodelmayretrievedocumentsprimarilyin adominantlanguageandusethemtogenerateresponses, thereby shaping the output with perspectives from that language. This indicator highlights the indirect impact of dataimbalanceonmultilingualmodelbehavior.
4.3.3 Knowledge Inconsistency
Knowledgeinconsistencyreferstodiscrepanciesinfactual informationorinterpretationacrossresponsesgeneratedin differentlanguages.Suchinconsistenciesmayarisewhenthe model retrieves different sources or prioritizes certain knowledge representations over others. This indicator is criticalforevaluatingthereliabilityofmultilingualLLMs,as inconsistent knowledge across languages can undermine usertrustandaffectthefairnessofinformationaccess.
5. RESULTS AND ANALYSIS
Thissectionpresentstheempiricalfindingsobtainedfrom the multilingual experimental framework. The analysis focusesonhowbiasmanifestsacrossdifferentstagesofthe pipeline,includingdocumentretrieval,responsegeneration, and cross-lingual comparison. The results highlight systematic disparities between high-resource and lowresourcelanguages,demonstratinghowbiasistransmitted and amplified within multilingual large language models (LLMs).
5.1 Retrieval Behavior Across Languages
Theretrievalstageplaysacriticalroleinshapingthefinal outputofretrieval-augmentedsystems.Theanalysisreveals thatdocumentretrievalisnotuniformlydistributedacross languages, leading to significant bias in the information providedtothelanguagemodel.
5.1.1 Dominance of High-Resource Language Documents
The experimental results indicate that a majority of retrieved documents belong to high-resource languages, even when queries are issued in other languages. This dominance is primarily due to the higher availability and indexingofdocumentsinsuchlanguageswithinthedataset. As a result, the retrieval system tends to prioritize these sources, which subsequently influence the generated responses.
5.1.2 Cross-Lingual Retrieval Imbalance
A clear imbalance is observed in cross-lingual retrieval performance,wherequeriesinlow-resourcelanguagesoften retrieve documents from high-resource languages rather
International Research
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net
thantheirnativelanguage.Thisbehaviorsuggeststhatthe retrieval system relies more on data availability than linguistic alignment, leading to reduced representation of low-resourcelanguagecontent.
Table 1: Retrieval Language Distribution (Sample Observation)
5.2 Response Variation
Analysis
Thedifferencesobservedduringretrievaldirectlyinfluence thequalityandcharacteristicsofgeneratedresponses.The analysishighlightsvariationsinresponselength,detail,and completenessacrosslanguages.
5.2.1 Differences in Response
Quality and Length
Responses generated for high-resource languages are generally longer, more detailed, and contextually richer compared to those generated for low-resource languages. Thisisbecausethemodelhasaccesstomorecomprehensive retrievedinformationandstrongertrainingrepresentations fortheselanguages.Incontrast,responsesinlow-resource languagestendtobeshorterandlessinformative.
5.2.2 Missing or Incomplete Information in LowResource Languages
Asignificantissueidentifiedintheanalysisisthepresenceof incompleteormissinginformationinresponsesgenerated for low-resource languages. In many cases, key facts or contextual details available in high-resource language responsesareabsent.Thisdiscrepancyhighlightshowdata scarcity and retrieval limitations affect knowledge representation.
Table 2: Response Variation Across Languages
English 120 High High
Hindi 105 Moderate Moderate
Spanish 115 High High
Swahili 85 Low Low
5.3 Bias Transmission Mechanisms
Theexperimentalfindingsconfirmthatbiasisnotconfined to a single stage but is transmitted through multiple componentsofthemultilingualLLMpipeline.
5.3.1 From Training Data
Biasoriginatesfromthetrainingdata,wherehigh-resource languages dominate the dataset. This imbalance leads to strongerlinguisticrepresentationsandknowledgecoverage for these languages, influencing how the model interprets andgeneratesresponses.
5.3.2
From Retrieval Stage
During the retrieval stage, bias is amplified as the system prioritizesdocumentsfromdominantlanguagesduetotheir higheravailability.Thisresultsinskewedcontextualinput forthelanguagemodel,whichdirectlyaffectsthegenerated output.
5.3.3 From Generation Stage
At the generation stage, the model synthesizes responses basedonbothitsinternalknowledgeandretrievedcontent. Iftheinputisbiasedtowardcertainlanguages,theoutput will reflect this bias, leading to unequal information representationacrosslanguages.
5.4 Comparative Analysis
To summarize the observed disparities, a comparative analysis is conducted between high-resource and lowresourcelanguagesacrosskeyperformancedimensions.
Table 3: Comparative Analysis of Language Performance
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
Thecomparisonclearlyshowsthathigh-resourcelanguages achieve better performance in retrieval and response generation, while low-resource languages are more susceptible to bias and information loss. This disparity highlights the need for improved data balancing, retrieval strategies,andbiasmitigationtechniquesinmultilingualAI systems.
6. CONCLUSION
This study presented an empirical investigation of bias transmission mechanisms in multilingual large language models(LLMs),withaparticularfocusonsystemsintegrated with retrieval-augmented generation (RAG). The findings demonstratethatbiasinmultilingualLLMsisamulti-stage phenomenonthatoriginatesfromimbalancedtrainingdata andpropagatesthroughretrievalandresponsegeneration processes.High-resourcelanguages,duetotheirdominance in training datasets and external knowledge sources, significantly influence both document retrieval and generatedoutputs.Asaresult,responsesintheselanguages tend to be more detailed, accurate, and contextually rich comparedtothoseinlow-resourcelanguages.
The experimental analysis revealed that retrieval systems frequently prioritize documents from high-resource languages, even when queries are issued in low-resource languages,leadingtocross-lingualretrievalimbalance.This bias directly affects the quality and completeness of generatedresponses,causinginconsistenciesininformation representation across languages. Furthermore, responselevel evaluation highlighted variations in semantic consistency, contextual relevance, and knowledge completeness,indicatingthatmultilingualLLMsdonottreat alllanguagesequally.
Overall, the study confirms that bias transmission is not limitedtoasinglecomponentbutisembeddedthroughout theentiremultilingualprocessingpipeline.Thesefindings emphasize the need for balanced multilingual datasets, improved retrieval mechanisms, and bias-aware model architectures to ensure fair and equitable access to informationacrossdiverselinguisticcommunities.
7. FUTURE SCOPE OF RESEARCH
Futureresearchshouldfocusondevelopingbiasmitigation strategiestailoredtomultilingualLLMs,particularlyforlowresourcelanguages.Oneimportantdirectionisthecreation ofmorebalancedandrepresentativemultilingualdatasets that reduce the dominance of high-resource languages. Additionally, improving cross-lingual retrieval techniques canhelpensurethatrelevantdocumentsareretrievedfrom diverselinguisticsourcesratherthanpredominantlyfrom dominantlanguages.
REFERENCES
1. Asai, A., Hashimoto, K., Hajishirzi, H., Socher, R. and Xiong, C., 2021. Learning to retrieve reasoning paths over Wikipedia graph for question answering. In: Proceedings of the International Conference on LearningRepresentations(ICLR).
2. Barocas,S.,Hardt,M.andNarayanan,A.,2019.Fairness andmachinelearning:Limitationsandopportunities. Cambridge,MA:MITPress.
3. Bender,E.M.,2019.The#BenderRule:Onnamingthe languageswestudyandwhyitmatters.TheGradient.
4. Bender, E.M., Gebru, T., McMillan-Major, A. and Shmitchell, S., 2021. On the dangers of stochastic parrots: Can language models be too big?. In: Proceedings of the ACM Conference on Fairness, Accountability, and Transparency (FAccT), pp. 610–623.
5. Blodgett,S.L.,Barocas,S.,DauméIII,H.andWallach,H., 2020.Language(technology)ispower:Acriticalsurvey of“bias”inNLP.In:ProceedingsoftheACL,pp.5454–5476.
6. Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F. and Grave, E., 2020. Unsupervisedcross-lingualrepresentationlearningat scale.In:ProceedingsofACL,pp.8440–8451.
7. Devlin,J.,Chang,M.W.,Lee,K.andToutanova,K.,2019. BERT:Pre-trainingofdeepbidirectionaltransformers forlanguageunderstanding.In:ProceedingsofNAACLHLT,pp.4171–4186.
8. Hedderich, M.A., Lange, L., Adel, H., Strötgen, J. and Klakow, D., 2021. A survey on recent approaches for naturallanguageprocessinginlow-resourcescenarios. In:ProceedingsofNAACL-HLT,pp.2545–2568.
9. Hovy, D. and Spruit, S.L., 2016. The social impact of naturallanguageprocessing.In:ProceedingsofACL,pp. 591–598.
10. Joshi,P.,Santy,S.,Budhiraja,A.,Bali,K.andChoudhury, M.,2020.Thestateandfateoflinguisticdiversityand inclusionintheNLPworld.In:ProceedingsofACL,pp. 6282–6293.
Anotherpromisingareaistheintegrationoffairness-aware learning algorithms that explicitly account for linguistic diversityduringmodeltrainingandinference.Expandingthe evaluationframeworktoincludemorelanguagesandrealworld applications will further enhance the robustness of findings.Finally,incorporatinghuman-in-the-loopvalidation and culturally aware AI design can contribute to building moreinclusiveandreliablemultilinguallanguagesystems.
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 13 Issue: 04 | Apr 2026 www.irjet.net p-ISSN: 2395-0072
11. Lewis,P.,Perez,E.,Piktus,A.,Petroni,F.,Karpukhin,V., Goyal, N., Küttler, H. and Lewis, M., 2020. Retrievalaugmented generation for knowledge-intensive NLP tasks.In:Advancesin Neural Information Processing Systems(NeurIPS).
12. Mehrabi,N.,Morstatter,F.,Saxena,N.,Lerman,K.and Galstyan, A., 2021. A survey on bias and fairness in machinelearning.ACMComputingSurveys,54(6),pp. 1–35.
13. Pires, T., Schlinger, E. and Garrette, D., 2019. How multilingualismultilingualBERT?.In:Proceedingsof ACL,pp.4996–5001.
14. Ruder, S., Vulić, I. and Søgaard, A., 2019. A survey of cross-lingual word embedding models. Journal of ArtificialIntelligenceResearch,65,pp.569–631.
15. Vaswani,A.,Shazeer,N.,Parmar,N.,Uszkoreit,J.,Jones, L., Gomez, A.N., Kaiser, Ł. and Polosukhin, I., 2017. Attention is all you need. In: Advances in Neural InformationProcessingSystems(NeurIPS),pp.5998–6008.
16. Qazi,I.A.,Khan,Z.,Ghani,A.,Raza,A.A.,Sajjad,W.and Azeemi, A.H., 2026. Large language models show Dunning-Kruger-like effects in multilingual factchecking.ScientificReports,16,p.7594.
17. Xu, Y., Hu, L., Zhao, J. and others, 2025. A survey on multilinguallargelanguagemodels:corpora,alignment, andbias.FrontiersofComputerScience,19,p.1911362.
18. Zhou, D. and Zhang, Y., 2024. Political biases and inconsistencies in bilingual GPT models. Scientific Reports,14,p.25048.
19. Perez-Toro,P.A.,Dineley,J.,Iniesta,R.andothers,2025. Exploring biases in multilingual depression corpora usingLLMs.ScientificReports.
20. Zubiaga,A.,2024.Natural language processinginthe era of large language models. Frontiers in Artificial Intelligence,6,p.1350306.
21. Nie,S.,Fromm,M.,Welch,C.,Görge,R.,Karimi,A.and Flek, L., 2024. Do multilingual large language models mitigate stereotype bias?. Proceedings of ACL Workshop.
22. Usman,M.,Ahmad,M.,Sidorov,G.andGelbukh,I.,2025. Multilingual hate speech detection using LLMs. Computers,14(7),p.279.
23. Ye, Y., Gu, H. and Zhao, J., 2025. Exploring cultural commonsense in multilingual large language models. InformationSystems.
24. Li,X.,Wang,Y.,Zhang,Q.andothers,2025.MKE-PLLM: A benchmark for multilingual knowledge editing in LLMs.Neurocomputing,651,p.130979.
25. Lyu,J.,Dost,K.,Koh,Y.S.andWicker,J.,2024.Regional biasinmonolingualEnglishlanguagemodels.Machine Learning,113,pp.6663–6696.
26. Cui,X.,Huang,Z.andAdel, N.,2025.Biasin,biasout: Annotationbiasinmultilinguallargelanguagemodels. arXivpreprintarXiv:2511.14662.
27. Gamboa,L.C.L.,Feng,Y.andLee,M.,2025.Socialbiasin multilinguallanguagemodels:Asurvey.arXivpreprint arXiv:2508.20201.
28. Zhang,H.,Chen,K.,Bai,X.andothers,2026.Mitigating translationesebiasinmultilingualLLMs.arXivpreprint arXiv:2603.10351.
29. Wang,X.,Liu,Y.andLi,J.,2023.Cross-lingualtransfer learning for low-resource NLP: A survey. IEEE TransactionsonKnowledgeandDataEngineering.
30. Hu, J., Ruder, S. and Siddhant, A., 2020. XTREME: A massively multilingual benchmark for NLP. ProceedingsofICML.
31. Liang, P., Bommasani, R. and others, 2022. On the opportunities and risks of foundation models. arXiv preprintarXiv:2108.07258.
32. Bommasani, R., Hudson, D.A. and others, 2021. Foundationmodels:Opportunitiesandrisks.Stanford CRFMReport.
33. Brown, T.B., Mann, B., Ryder, N. and others, 2020. Languagemodelsarefew-shotlearners.NeurIPS.
34. Raffel, C., Shazeer, N., Roberts, A. and others, 2020. ExploringthelimitsoftransferlearningwithT5.JMLR.
35. Scao, T.L. and others, 2022. BLOOM: A multilingual languagemodel.arXivpreprintarXiv:2211.05100.