Research Papers

Iteration of Thought: Leveraging Inner Dialogue for Autonomous Large Language Model Reasoning

Training Language Models to Self-Correct via Reinforcement Learning

To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning

A Comprehensive Evaluation of Quantized Instruction-Tuned Large Language Models: An Experimental Analysis up to 405B

Large Language Monkeys: Scaling Inference Compute with Repeated Sampling

What is the Role of Small Models in the LLM Era: A Survey

Agent Workflow Memory

Achieving Peak Performance for Large Language Models: A Systematic Review

Strategic Chain-of-Thought: Guiding Accurate Reasoning in LLMs through Strategy Elicitation

Large Language Model-Based Agents for Software Engineering: A Survey

Beyond Preferences in AI Alignment

RAGEval: Scenario Specific RAG Evaluation Dataset Generation Framework

LLM Pruning and Distillation in Practice: The Minitron Approach

Controllable Text Generation for Large Language Models: A Survey

Challenges and Responses in the Practice of Large Language Models

Re-ranking methods

Query Transformations: Rewriting, Step-back Prompting, and Sub-query Decomposition

RAG-Fusion (Fusion Retrieval RAG)

Enhancing Robustness in Large Language Models: Prompting for Mitigating the Impact of Irrelevant Information

RAGEval: Scenario Specific RAG Evaluation Dataset Generation Framework

RAGChecker: A Fine-grained Framework for Diagnosing Retrieval-Augmented Generation

Automated Design of Agentic System

Automated Design of Agentic Systems

Graph Retrieval-Augmented Generation: A Survey

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery

LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs

A Survey on Employing Large Language Models for Text-to-SQL Tasks

A Survey of NL2SQL with Large Language Models: Where are we, and where are we going?

HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extraction

Conversational Prompt Engineering

Medical Graph RAG: Towards Safe Medical Large Language Model via Graph Retrieval-Augmented Generation

Transformer Explainer: Interactive Learning of Text-Generative Models

Know Your Limits: A Survey of Abstention in Large Language Models

EfficientRAG: Efficient Retriever for Multi-Hop Question Answering

Conversational Prompt Engineering

Self-Taught Evaluators

Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters

Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Models

From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future

From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future

RAG Foundry: A Framework for Enhancing LLMs for Retrieval Augmented Generation

ShieldGemma: Generative AI Content Moderation Based on Gemma

Improving Retrieval Augmented Language Model with Self-Reasoning

Prover-Verifier Games improve legibility of LLM outputs

Adaptive Retrieval-Augmented Generation for Conversational Systems

ThinK: Thinner Key Cache by Query-Driven Pruning

Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judge

Machine Unlearning in Generative AI: A Survey

MindSearch: Mimicking Human Minds Elicits Deep AI Searcher

PersonaGym: Evaluating Persona Agents and LLMs

Concise Thoughts: Impact of Output Length on LLM Reasoning and Cost

Recursive Introspection: Teaching Language Model Agents How to Self-Improve

Generation Constraint Scaling Can Mitigate Hallucination

Context Embeddings for Efficient Answer Generation in RAG

Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approach

Does Refusal Training in LLMs Generalize to the Past Tense?

LazyLLM: Dynamic Token Pruning for Efficient Long Context LLM Inference

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Weak-to-Strong Reasoning

Mindful-RAG: A Study of Points of Failure in Retrieval Augmented Generation

NeedleBench: Can LLMs Do Retrieval and Reasoning in 1 Million Context Window?

SpreadsheetLLM: Encoding Spreadsheets for Large Language Models

Speculative RAG: Enhancing Retrieval Augmented Generation through Drafting

Distilling System 2 into System 1

Exploring Advanced Large Language Models with LLMsuite

Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems

RouteLLM: Learning to Route LLMs with Preference Data

Tree Search For Language Model Agents

LLM Critics Help Catch LLM Bugs

From Artificial Needles to Real Haystacks: Improving Retrieval Capabilities in LLMs by Finetuning on Synthetic Data

Following Length Constraints in Instructions

CodeGemma: Open Code Models Based on Gemma

PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers

Soft Prompt Tuning for Augmenting Dense Retrieval with Large Language Models

Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teaching

Be like a Goldfish, Don't Memorize! Mitigating Memorization in Generative LLMs

On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey

Discovering Preference Optimization Algorithms with and for Large Language Models

Extreme Compression of Large Language Models via Additive Quantization

Mixture-of-Agents Enhances Large Language Model Capabilities

SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals

MedPromptExtract (Medical Data Extraction Tool): Anonymization and Hi-fidelity Automated data extraction using NLP and prompt engineering

Understanding RAFT - Retrieval Augmented Fine-Tuning

RAFT: Adapting Language Model to Domain Specific RAG

Exploiting LLM Quantization

Assessing Prompt Injection Risks in 200+ Custom GPTs

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Sampling

BiLLM: Pushing the Limit of Post-Training Quantization for LLMs

RNNs are not Transformers (Yet): The Key Bottleneck on In-context Retrieval

State of What Art? A Call for Multi-Prompt LLM Evaluation

Prompt Cache: Modular Attention Reuse for Low-Latency Inference

Tree of Reviews: A Tree-based Dynamic Iterative Retrieval Framework for Multi-hop Question Answering

Empowering Multi-step Reasoning across Languages via Tree-of-Thoughts

CYBERSECEVAL 2: A Wide-Ranging Cybersecurity Evaluation Suite for Large Language Models

Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences

RAGAR, Your Falsehood RADAR: RAG-Augmented Reasoning for Political Fact-Checking using Multimodal Large Language Models

How to Use a Custom Grading Criteria to Evaluate LLM Responses (LLM-as-a-Judge)

On the Empirical Complexity of Reasoning and Planning in LLMs

WizardLM: Empowering Large Language Models to Follow Complex Instructions

From Noise to Clarity: Unraveling the Adversarial Suffix of Large Language Model Attacks via Translation of Text Embeddings

H2O-Danube-1.8B Technical Report

Ever: Mitigating Hallucination in Large Language Models through Real-Time Verification and Rectification

Prompt Stealing Attacks Against Text-to-Image Generation Models

Universal and Transferable Adversarial Attacks on Aligned Language Models

Post-Semantic-Thinking: A Robust Strategy to Distill Reasoning Capacity from Large Language Models

RoT: Enhancing Large Language Models with Reflection on Search Trees

Analyzing Toxicity in Deep Conversations: A Reddit Case Study

Direct Preference Optimization: Your Language Model is Secretly a Reward Model

AI Safety: Necessary, but insufficient and possibly problematic

LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understanding

MACM: Utilizing a Multi-Agent System for Condition Mining in Solving Complex Mathematical Problems

Many-Shot Jailbreaking (Anthropic Research)

Demystifying Chains, Trees, and Graphs of Thoughts

Breaking Down the Defenses: A Comparative Survey of Attacks on Large Language Models

ReFT: Representation Finetuning for Language Models

Mistral 7B: Foundation Model Research Paper Summary

TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting

TopicGPT: A Prompt-based Topic Modeling Framework

All Artificial, Less Intelligence: GenAI through the Lens of Formal Verification

IterAlign: Iterative Constitutional Alignment of Large Language Models

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Overview of Prompt Engineering Techniques

Automated Black-box Prompt Engineering for Personalized Text-to-Image Generation

SD4Match: Learning to Prompt Stable Diffusion Model for Semantic Matching

Prompt Engineering for Healthcare: Methodologies and Applications

LAMPER: LanguAge Model and Prompt EngineeRing for zero-shot time series classification

BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIP

Multimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image Restoration

SAMAug: Point Prompt Augmentation for Segment Anything Model

HD-Painter: High-Resolution and Prompt-Faithful Text-Guided Image Inpainting with Diffusion Models

LLM Guided Evolution -- The Automation of Models Advancing Models

DP-OPT: Make Large Language Model Your Privacy-Preserving Prompt Engineer

AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detection

RAFT: Adapting Language Model to Domain Specific RAG

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training

Plum: Prompt Learning using Metaheuristic

The Impact of Prompts on Zero-Shot Detection of AI-Generated Text

Exploring Prompt Engineering Practices in the Enterprise

TCP:Textual-based Class-aware Prompt tuning for Visual-Language Model

Jailbreaking ChatGPT via Prompt Engineering: An Empirical Study

RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation

Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models

Can Large Language Models Reason and Plan?

Exploring LLM-based Agents for Root Cause Analysis

Query-Dependent Prompt Evaluation and Optimization with Offline Inverse RL

Soft-prompt Tuning for Large Language Models to Evaluate Bias

ChatGPT4PCG 2 Competition: Prompt Engineering for Science Birds Level Generation

GPT-4 Technical Report

LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models

Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs through a Global Scale Prompt Hacking Competition

Inferring Properties of Graph Neural Networks

Prompt Injection attack against LLM-integrated Applications

Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generation

Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers

Consistency-guided Prompt Learning for Vision-Language Models

Everything of Thoughts: Defying the Law of Penrose Triangle for Thought Generation

Gemma: Open Models Based on Gemini, Research and Technology

Tree of Attacks: Jailbreaking Black-Box LLMs Automatically

Prompt Engineering a Prompt Engineer

GTBench: Uncovering the Strategic Reasoning Limitations of LLMs via Game-Theoretic Evaluations

Token-Level Adversarial Prompt Detection Based on Perplexity Measures and Contextual Information

DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning

Boosting of Thoughts: Trial-and-Error Problem Solving with Large Language Models

LLM evaluation too expensive? Here's how we solve this.

Retrieval-Augmented Thought Process as Sequential Decision Making

Large Language Models are Few-shot Generators: Proposing Hybrid Prompt Algorithm To Generate Webshell Escape Samples

Exploring EFL students' prompt engineering in human-AI story writing: an Activity Theory perspective

EntGPT: Linking Generative Large Language Models with Knowledge Bases

Alphazero-like Tree-Search can Guide Large Language Model Decoding and Training

A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications

Factuality of Large Language Models in the Year 2024

Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling

GuReT: Distinguishing Guilt and Regret related Text

Wordflow: Social Prompt Engineering for Large Language Models

Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineering

Prompt Design and Engineering: Introduction and Advanced Methods

Enhancing Large Language Models for Clinical Decision Support by Incorporating Clinical Practice Guidelines

Knowledge Fusion of Large Language Models

DiffusionGPT: LLM-Driven Text-to-Image Generation System

Evidence to Generate (E2G): A Single-agent Two-step Prompting for Context Grounded and Retrieval Augmented Reasoning

Mixtral of Experts

Jatmo: Prompt Injection Defense by Task-Specific Finetuning

STAMP: Differentiable Task and Motion Planning via Stein Variational Gradient Descent

Text2MDT: Extracting Medical Decision Trees from Medical Texts

If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agents

Principled Instructions Are All You Need for Questioning LLaMA-1/2, GPT-3.5/4

Adversarial Prompt Tuning for Vision-Language Models

A Novel Approach for Rapid Development Based on ChatGPT and Prompt Engineering

Founder-GPT: Self-play to evaluate the Founder-Idea fit

Prompting Hard or Hardly Prompting: Prompt Inversion for Text-to-Image Diffusion Models

ULTRA-DP: Unifying Graph Pre-training with Multi-task Graph Dual Prompt

Rethinking Visual Prompt Learning as Masked Visual Token Modeling

LLMs Can Understand Encrypted Prompt: Towards Privacy-Computing Friendly Transformers

Prompt Engineering-assisted Malware Dynamic Analysis Using GPT-4

Maatphor: Automated Variant Analysis for Prompt Injection Attacks

Enhancing Medical Task Performance in GPT-4V: A Comprehensive Study on Prompt Engineering Strategies

Practical Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibration

PathFinder: Guided Search over Multi-Step Reasoning Paths

KnowGPT: Knowledge Injection for Large Language Models

EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM

Generalized Graph Prompt: Toward a Unification of Pre-Training and Downstream Tasks on Graphs

Prompt-In-Prompt Learning for Universal Image Restoration

PEACE: Prompt Engineering Automation for CLIPSeg Enhancement in Aerial Robotics

Image-Object-Specific Prompt Learning for Few-Shot Class-Incremental Learning

PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization

SPROUT: Authoring Programming Tutorials with Interactive Visualization of Large Language Model Generation Process

Prompting AI Art: An Investigation into the Creative Skill of Prompt Engineering

Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision

ImageDream: Image-Prompt Multi-view Diffusion for 3D Generation

What we learned from speaking to 50+ LLM developers building RAG apps.

PromptCARE: Prompt Copyright Protection by Watermark Injection and Verification

Deficiency of Large Language Models in Finance: An Empirical Examination of Hallucination

How to Prompt LLMs for Text-to-SQL: A Study in Zero-shot, Single-domain, and Cross-domain Settings

Probabilistic Tree-of-thought Reasoning for Answering Knowledge-intensive Complex Questions

Prompt a Robot to Walk with Large Language Models

To be or not to be? an exploration of continuously controllable prompt engineering

Fine-tuning Language Models for Factuality

Promise: Prompt-driven 3D Medical Image Segmentation Using Pretrained Image Foundation Models

Automatic Root Cause Analysis via Large Language Models for Cloud Incidents

Semi-Structured Chain-of-Thought: Integrating Multiple Sources of Knowledge for Improved Language Model Reasoning

A Step Closer to Comprehensive Answers: Constrained Multi-Stage Question Decomposition with Large Language Models

Testing LLMs on Code Generation with Varying Levels of Prompt Specificity

A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions

Large Language Models and Prompt Engineering for Biomedical Query Focused Multi-Document Summarisation

Black-Box Prompt Optimization: Aligning Large Language Models without Model Training

Chain-of-Thought Reasoning is a Policy Improvement Operator

AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectors

Tensor Trust: Interpretable Prompt Injection Attacks from an Online Game

Robust Safety Classifier for Large Language Models: Adversarial Prompt Shield

Prompt-Engineering and Transformer-based Question Generation and Evaluation

Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answering

Unleashing the potential of prompt engineering in Large Language Models: a comprehensive review

Batch Prompting: Efficient Inference with Large Language Model APIs

An LLM can Fool Itself: A Prompt-Based Adversarial Attack

The Foundation Model Transparency Index

NLPBench: Evaluating Large Language Models on Solving NLP Problems

Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting

Last One Standing: A Comparative Analysis of Security and Privacy of Soft Prompt Tuning, LoRA, and In-Context Learning

OpenAgents: An Open Platform for Language Agents in the Wild

Prompt Packer: Deceiving LLMs through Compositional Instruction with Hidden Attacks

Autonomous Tree-search Ability of Large Language Models

PromptTTS 2: Describing and Generating Voices with Text Prompt

Prompt Engineering or Fine Tuning: An Empirical Assessment of Large Language Models in Automated Software Engineering Tasks

Mistral 7B

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Guiding Large Language Models via Directional Stimulus Prompting

Reinforcement Learning in the Era of LLMs: What is Essential? What is needed? An RL Perspective on RLHF, Prompting, and Beyond

LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models

Text-driven Prompt Generation for Vision-Language Models in Federated Learning

Walking Down the Memory Maze: Beyond Context Limit through Interactive Reading

Understanding prompt engineering may not require rethinking generalization

Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models

Large Language Models as Analogical Reasoners

Prompt-tuning latent diffusion models for inverse problems

SPELL: Semantic Prompt Evolution based on a LLM

AutoHall: Automated Hallucination Dataset Generation for Large Language Models

Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution

Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models

ResearDesign Guidelines for Prompt Engineering Text-to-Image Generative Models

Enhancing Zero-Shot Chain-of-Thought Reasoning in Large Language Models through Logic

Chain-of-Verification Reduces Hallucination in Large Language Models

Text Summarization: LLM Failure Cases and Detection Methods

Chain-of-Verification Reduces Hallucination in Large Language Models

Exploring the Relationship between LLM Hallucinations and Prompt Linguistic Nuances: Readability, Formality, and Concreteness

Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers

Temporal evolution of depolarization and magnetic field of FRB 20201124A

Re-Reading Improves Reasoning in Large Language Models

Language Prompt for Autonomous Driving

From Sparse to Dense: GPT-4 Summarization with Chain of Density Prompting

Layout and Task Aware Instruction Prompt for Zero-shot Document Image Question Answering

Prompt-based Node Feature Extractor for Few-shot Learning on Text-Attributed Graphs

Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models

Tree-of-Mixed-Thought: Combining Fast and Slow Thinking for Multi-hop Visual Reasoning

StyleDiffusion: Prompt-Embedding Inversion for Text-Based Editing

FoodGPT: A Large Language Model in Food Testing Domain with Incremental Pre-training and Knowledge Graph Prompt

Graph of Thoughts: Solving Elaborate Problems with Large Language Models

Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Training

Boosting Logical Reasoning in Large Language Models through a New Framework: The Graph of Thought

SGL-PT: A Strong Graph Learner with Graph Prompt Tuning

From Prompt Injections to SQL Injection Attacks: How Protected is Your LLM-Integrated Web Application?

Exploring the Intersection of Large Language Models and Agent-Based Modeling via Prompt Engineering

IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models

You Only Prompt Once: On the Capabilities of Prompt Learning on Large Language Models to Tackle Toxic Content

Large Language Model Prompt Chaining for Long Legal Document Classification

AutoHint: Automatic Prompt Optimization with Hint Generation

An automatically discovered chain-of-thought prompt generalizes to novel models and datasets

Attention Is All You Need

Reverse Stable Diffusion: What prompt was used to generate this image?

Promptly: Using Prompt Problems to Teach Learners How to Effectively Utilize AI Code Generators

Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation

A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models

Chit-Chat or Deep Talk: Prompt Engineering for Process Mining

Prompt Middleware: Mapping Prompts for Large Language Models to UI Affordances

A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineering

ProRes: Exploring Degradation-aware Visual Prompt for Universal Image Restoration

Compositional Exemplars for In-context Learning

Cases of EFL Secondary Students' Prompt Engineering Pathways to Complete a Writing Task with ChatGPT

Temporal Data Meets LLM -- Explainable Financial Time Series Forecasting

Safeguarding Crowdsourcing Surveys from ChatGPT with Prompt Injection