Added 2 sections; added logo

docs/section1/Common Terminology/RAG.md

@@ -0,0 +1,35 @@
+# Retrieval-Augmented Generation: Enhancing LLMs with External Knowledge
+
+**Retrieval-Augmented Generation (RAG)** is an Artificial Intelligence (AI) approach that **combines information retrieval with language generation** to create more accurate and contextually relevant outputs. It enhances Large Language Models (LLMs) by integrating them with external data sources.
+
+Here's a breakdown of what RAG means:
+
+- **Purpose and Goal**
+    
+    - The primary goal of RAG is to **enhance the accuracy and relevance of LLM responses** by "grounding" their outputs in up-to-date and specific real-world data.
+    - LLMs, by themselves, are limited to the knowledge contained in their training data, which can become outdated or lack domain-specific information. They can also sometimes generate plausible-sounding but incorrect information, a phenomenon known as "hallucinations," or provide vague and generic responses.
+    - RAG addresses these limitations by allowing LLMs to retrieve and incorporate current and specific information from various external sources, such as databases, documentation, and APIs. This process helps minimize contradictions and inconsistencies in the generated text, improving its quality and reliability.
+- **How RAG Works** RAG operates by following a series of steps to enhance generative AI outputs:
+    
+    1. **Data Collection:** First, all necessary external data for the application is gathered. This could include user manuals, product databases, or FAQs.
+    2. **Data Chunking:** The gathered data is then broken down into smaller, more manageable pieces or "chunks".
+    3. **Embedding and Indexing:** Each of these text chunks is converted into **numerical representations called vector embeddings**. Embeddings are dense, continuous vectors in a lower-dimensional space that capture semantic relationships, meaning similar data points are located closer together in this space. These embeddings are then stored and indexed in a **vector database**.
+    4. **Retrieval:** When a user poses a query, it is also converted into a vector embedding. The vector database then uses algorithms to quickly find the most similar stored vectors (i.e., relevant data chunks) to the query vector. This process is known as **vector search** or **semantic search**, as it looks for meaning rather than just keywords.
+    5. **Generation:** The retrieved text chunks, along with the original user query, are then fed into the LLM. The LLM uses this augmented context to generate a coherent, precise, and contextually relevant response. This effectively instructs the generative model to prioritise the retrieved information before giving its response, making it less likely to hallucinate or rely solely on its internal training data.
+- **Benefits of Using RAG**
+    
+    - **Access to Fresh Information:** RAG overcomes the limitation of LLMs being confined to their pre-trained data by providing them with up-to-date information.
+    - **Factual Grounding:** It helps LLMs remain factually accurate, even when dealing with complex or specific domain knowledge.
+    - **Improved Relevance, Accuracy, and Quality:** By grounding the LLM in relevant external knowledge, RAG significantly enhances the quality of generated text, making it more reliable and useful.
+    - **Efficient Inference:** RAG allows for faster and more efficient inference because the LLM doesn't need to re-process an entire massive dataset for every query. Once embeddings are created and stored, retrieval is quick.
+- **Role in LLMs and AI Agents**
+    
+    - RAG is a key technique for extending LLMs and providing them with "external memory" beyond their core training dataset.
+    - It is particularly useful for conversational AI, recommendation engines, and chatbots, allowing them to provide real-time, contextual answers.
+    - RAG also enhances the capabilities of **AI agents** by providing them with dynamic access to external context, which is crucial for agents to perform tasks, solve problems, and adapt to changing circumstances.
+- **Challenges**
+    
+    - Implementing RAG systems can involve **integration complexity**, especially when dealing with multiple external data sources in various formats.
+    - The **quality of the input data is critical**; poor or biased source content will lead to inaccurate responses. Human oversight is crucial for data curation to ensure reliability.
+
+In essence, RAG acts as a bridge, combining the broad language capabilities of LLMs with specific, accurate, and current information from external sources, making AI systems more reliable and effective for real-world applications.