research-papers
In recent years, LLMs have become instrumental across various industries, revolutionizing fields such as customer service, healthcare, and legal document processing. However, a significant challenge lies in their ability to adapt to highly specialized tasks, where domain-specific knowledge is essential for accuracy. This is where Retrieval Augmented Fine-Tuning (RAFT) steps
research-papers
Original Paper: https://arxiv.org/abs/2405.18137 By: Kazuki Egashira, Mark Vero, Robin Staab, Jingxuan He, Martin Vechev Abstract: Quantization leverages lower-precision weights to reduce the memory usage of large language models (LLMs) and is a key technique for enabling their deployment on commodity hardware. While LLM quantization'
research-papers
Original Paper: https://arxiv.org/abs/2311.11538 By: Jiahao Yu, Yuhang Wu, Dong Shu, Mingyu Jin, Sabrina Yang, Xinyu Xing Abstract: In the rapidly evolving landscape of artificial intelligence, ChatGPT has been widely used in various applications. The new feature - customization of ChatGPT models by users to cater
research-papers
Original Paper: https://arxiv.org/abs/2402.04291 By: Wei Huang, Yangdong Liu, Haotong Qin, Ying Li, Shiming Zhang, Xianglong Liu, Michele Magno, Xiaojuan Qi Abstract: Pretrained large language models (LLMs) exhibit exceptional general language processing capabilities but come with significant demands on memory and computational resources. As a powerful
research-papers
Original Paper: https://arxiv.org/abs/2305.09993 By: Weijia Xu, Andrzej Banburski-Fahey, Nebojsa Jojic Abstract: We introduce Reprompting, an iterative sampling algorithm that automatically learns the Chain-of-Thought (CoT) recipes for a given task without human intervention. Through Gibbs sampling, Reprompting infers the CoT recipes that work consistently well for
research-papers
Original Paper: https://arxiv.org/abs/2404.14219 By: Marah Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Jianmin Bao, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Qin Cai, Martin Cai, Caio César Teodoro Mendes, Weizhu
research-papers
Original Paper: https://arxiv.org/abs/2402.18510 By: Kaiyue Wen, Xingyu Dang, Kaifeng Lyu Abstract: This paper investigates the gap in representation powers of Recurrent Neural Networks (RNNs) and Transformers in the context of solving algorithmic problems. We focus on understanding whether RNNs, known for their memory efficiency in
research-papers
Original Paper: https://arxiv.org/abs/2401.00595 By: Moran Mizrahi, Guy Kaplan, Dan Malkin, Rotem Dror, Dafna Shahaf, Gabriel Stanovsky Abstract: Recent advances in large language models (LLMs) have led to the development of various evaluation benchmarks. These benchmarks typically rely on a single instruction template for evaluating all
research-papers
Original Paper: https://arxiv.org/abs/2311.04934 By: In Gim, Guojun Chen, Seung-seob Lee, Nikhil Sarda, Anurag Khandelwal, Lin Zhong Abstract: We present Prompt Cache, an approach for accelerating inference for large language models (LLM) by reusing attention states across different LLM prompts. Many input prompts have overlapping text
research-papers
Original Paper: https://arxiv.org/abs/2404.14464 By: Li Jiapeng, Liu Runze, Li Yabo, Zhou Tong, Li Mingling, Chen Xiang Abstract: Multi-hop question answering is a knowledge-intensive complex problem. Large Language Models (LLMs) use their Chain of Thoughts (CoT) capability to reason complex problems step by step, and retrieval-augmentation
research-papers
Original Paper: https://arxiv.org/abs/2311.08097 By: Leonardo Ranaldi, Giulia Pucci, Federico Ranaldi, Elena Sofia Ruzzetti, Fabio Massimo Zanzotto Abstract: Reasoning methods, best exemplified by the well-known Chain-of-Thought (CoT), empower the reasoning abilities of Large Language Models (LLMs) by eliciting them to solve complex tasks in a step-by-step
research-papers
Original Paper: https://arxiv.org/abs/2404.12065 By: M. Abdul Khaliq, P. Chang, M. Ma, B. Pflugfelder, F. Miletić Abstract: The escalating challenge of misinformation, particularly in the context of political discourse, necessitates advanced solutions for fact-checking. We introduce innovative approaches to enhance the reliability and efficiency of multimodal