Haziqa Sajid

Contributing Writer @ Athina AI Hub

Haziqa Sajid
Query Construction in Retrieval-Augmented Generation (RAG)

blogs

Query Construction in Retrieval-Augmented Generation (RAG)

Query construction forms the backbone of modern information retrieval systems, particularly in Retrieval-Augmented Generation (RAG). At its core, query construction transforms natural language inputs into structured queries that databases and retrieval systems understand. This transformation bridges the communication gap between humans and machines, enabling more accurate and relevant information retrieval.

By Haziqa Sajid
Weight-Decomposed Low-Rank Adaptation (DoRA): A Smarter Way to Fine-Tune LLMs

blogs

Weight-Decomposed Low-Rank Adaptation (DoRA): A Smarter Way to Fine-Tune LLMs

Parameter-efficient fine-tuning (PEFT) methods address the challenge of fine-tuning large language models (LLMs) for specific downstream tasks when the cost of training all model parameters becomes prohibitive.  Fine-tuning large language models with billions of parameters can be computationally expensive, require significant storage, and lead to overfitting, especially when adapting to

By Haziqa Sajid