AI & ML
Assessing the Impact of Retrieval-Augmented Generation on Algorithmic Problem-Solving
arXiv cs.HC0 views
arXiv:2611.09791v1 Announce Type: cross Abstract: Competitive programming problems pose distinctive challenges for Large Language Models, as they demand not only proficient code generation but also advanced algorithmic reasoning. This study presents a Retrieval-Augmented Generation approach specifically designed to enhance the capacity of Large Language Models to address such problems. Our approach integrates an embedding-based retrieval mechanism and a similarity search algorithm to identify analogous problems within a knowledge database, employing a dynamically adjusted threshold to mitigate retrieval noise. We conducted an evaluation using the CodeContests dataset, focusing on the test split problems that exhibit similarity to instances from the training split. The experimental framework considered three conditions: (i) problems provided solely with their original descriptions, (ii) problems supplemented with randomly selected examples from the training split, and (iii) problems augmented with similar examples retrieved through the proposed method. In addition, we incorporated a Min-K membership inference analysis to examine whether the generated code solutions were influenced by potential memorization of training data within the evaluated Large Language Models. This complementary perspective enables a deeper understanding of model behavior by distinguishing genuine generalization through retrieval from implicit recall of pretraining samples. Performance was assessed using both pass rates and the CodeForces Elo rating of the problems. The results provide empirical evidence that similarity-based retrieval substantially enhances Large Language Models performance in competitive programming scenarios, offering an scalable framework for improving code generation in algorithmic problem-solving contexts.
Source:https://arxiv.org/abs/2611.09791PreviousWhat to Delegate, What to Preserve: Human Preferences for Agentic AI Across Everyday Life and WorkNextHexTiles and Semantic Icons for MAUP-Aware Multivariate Geospatial Visualizations
Related posts

Nvidia drops ~5% pre-market after its board opens a probe into Jensen Huang; Nvidia previously dismissed the interactions as "nothing unusual or unexpected" (Demetri Sevastopulo/Financial Times)
0Techmeme

Nvidia Senior Director Madison Huang, daughter of Jensen, cancels a high-profile Seoul appearance citing a "family matter", throwing the event into disarray (Yoolim Lee/Bloomberg)
0Techmeme

Jensen Huang maintains deep control over Nvidia, managing 60+ direct reports and owning a 3.56% stake, presenting a challenge for Nvidia's 10-person board (New York Times)
0Techmeme

Amsterdam police arrested between 150 and 200 protesters for trespassing and violence at a Microsoft data center construction site owned by Pure Data Centers (Jowi Morales/Tom's Hardware)
0Techmeme

The US OCC grants Coinbase full approval for a trust bank charter; sources say it could expand Coinbase's stablecoin business and let it issue stablecoins (Olga Kharif/Bloomberg)
0Techmeme

US voters in Harwood, North Dakota rejected a ballot measure that opposed Applied Digital's $3B data center, set to open in 2027, bucking a nationwide backlash (Miriam Waldvogel/Washington Post)
0Techmeme