A production-grade Corrective Retrieval-Augmented Generation (CRAG) system combining Neon PostgreSQL (pgvector) for dense semantic retrieval with Neo4j Aura (Graphiti) for temporal entity-relationship graph traversal.
Featuring autonomous relevance grading, self-healing query rewriting, real-time Server-Sent Events (SSE) streaming, explainability audit traces, an interactive dark-themed web interface, and an automated LLM-judged RAG Triad evaluation suite achieving 95.33% composite accuracy.
The application is deployed live in production across multi-cloud infrastructure:
- Interactive Web App: https://agentic-rag-graph.onrender.com
- Interactive Swagger API Docs: https://agentic-rag-graph.onrender.com/docs
- System Health Endpoint: https://agentic-rag-graph.onrender.com/health
| Component | Platform / Host | Technology / Specs | Role |
|---|---|---|---|
| Web Service & API | Render Cloud | Docker (Linux python:3.12-slim, non-root appuser) |
Serves dark-mode chat UI, REST endpoints, and SSE streaming |
| Vector Database | Neon.tech Cloud | Serverless PostgreSQL 16 + pgvector (HNSW indexing) |
Dense 768-dimensional semantic embeddings & hybrid search |
| Knowledge Graph | Neo4j Aura Cloud | Neo4j Enterprise (Instance 21d928a9) + Graphiti |
Temporal entity-relationship graph and multi-hop traversal |
| Inference Engine | Groq Cloud LPU | qwen/qwen3.8-27b (Sub-second latency) |
Relevance grading, self-healing query rewriting & final synthesis |
Evaluated across curated ground-truth test cases and out-of-scope hallucination traps using an automated LLM Judge:
| Metric | Score | Industry Benchmark | Description |
|---|---|---|---|
| Context Relevance | 98.00% | > 80% | Ratio of retrieved chunks containing verified factual answers vs. noise. |
| Faithfulness | 88.00% | > 85% | Degree to which all generated statements are strictly grounded in retrieved context (zero ungrounded claims). |
| Answer Relevance | 100.00% | > 85% | Directness and completeness in addressing the user prompt. |
| Composite RAG Triad Score | 95.33% | > 85% | Overall system health index across retrieval, reasoning, and synthesis. |
Real-time typewriter streaming response with complete audit metadata including tools invoked, chunks evaluated, citation sources, and confidence level.
When out-of-scope or unverified prompts are submitted, the system attempts query rewriting and safely refuses to fabricate facts rather than hallucinating.
+-----------------------------+
| User Question |
+--------------+--------------+
|
v
+-----------------------------+
| Supervisor Query Router |
+--------------+--------------+
|
+-------------------+-------------------+
| |
v v
+----------------------+ +-----------------------+
| Neon PostgreSQL DB | | Neo4j Aura Graph |
| pgvector (HNSW) | | Graphiti Relations |
| Hybrid Trigram Search| | Multi-hop Traversal |
+----------+-----------+ +-----------+-----------+
| |
+-------------------+-------------------+
|
v
+-----------------------------+
| Context Relevance Grader |
| (Pydantic AI Agent) |
+--------------+--------------+
|
Pass Grade? |
+--------------+--------------+
| |
[ YES ] [ NO ]
| |
v v
+-----------------------------+ +-----------------------------+
| Verified Context Synthesis | | Self-Healing Query Rewriter |
| Citations + Confidence Meta | | Optimizes Query & Switches |
+--------------+--------------+ | Tool (e.g. Vector -> Graph) |
| +--------------+--------------+
| |
| +--> (Retry Retrieval)
v
+-----------------------------+
| Final Answer + Audit Trace |
+-----------------------------+
- Live Web Interface: Built-in dark-themed web chat UI served directly by FastAPI at
/. - Dual-Layer Retrieval: Combines 768-dimensional dense vector embeddings with multi-hop graph edges.
- Context Relevance Grader: Evaluates each retrieved passage individually to eliminate noise before sending it to the synthesis model.
- Autonomous Query Rewriter: When retrieval fails or yields low-quality context, the agent rewrites the prompt with keyword expansion and switches retrieval strategies.
- Explainability Audit Trace: Every response returns complete metadata (
tools_invoked,chunks_passed_grading,citations,confidence_level). - Real-Time SSE Streaming: FastAPI Server-Sent Events endpoint (
/chat/stream) yielding smooth token deltas. - Automated Evaluation Suite: Automated RAG Triad test runner (
eval/benchmark.py) with customizable test cases and LLM-as-a-Judge grading.
git clone <your-repo-url>
cd AGENTIC_RAG
python -m venv venv
.\venv\Scripts\Activate.ps1
pip install -r requirements.txtCreate a .env file based on .env.example:
APP_HOST=0.0.0.0
APP_PORT=8058
DATABASE_URL=postgresql://<user>:<password>@<neon-host>/neondb?sslmode=require
NEO4J_URI=neo4j+s://<aura-id>.databases.neo4j.io
NEO4J_USER=<user>
NEO4J_PASSWORD=<password>
LLM_PROVIDER=groq
LLM_CHOICE=qwen/qwen3.8-27b
LLM_API_KEY=gsk_...
OLLAMA_BASE_URL=http://localhost:11434
EMBEDDING_MODEL=nomic-embed-textpython -m agent.apiServer boots at http://localhost:8058.
- Web Chat:
http://localhost:8058/ - Interactive Swagger docs:
http://localhost:8058/docs
python cli.pypython -m eval.benchmarkRuns all test cases through the RAG Triad evaluation harness and prints the executive scorecard.
AGENTIC_RAG/
├── agent/
│ ├── agent.py # Corrective Supervisor Agent loop
│ ├── api.py # FastAPI REST & SSE streaming endpoints
│ ├── config.py # Pydantic Settings & environment loader
│ ├── db.py # Neon PostgreSQL async connection pool
│ ├── grader.py # Context relevance classifier agent
│ ├── graph_utils.py # Neo4j Aura Graphiti integration
│ ├── rewriter.py # Query rewriting & tool switching agent
│ ├── schemas.py # Pydantic data contracts (RetrievalTrace, GradeResult)
│ ├── static/
│ │ └── index.html # Modern dark-mode web chat interface
│ └── tools.py # Vector search, graph search & hybrid search tools
├── big_tech_docs/ # Ingested enterprise documents (Markdown/SEC filings)
├── docs/images/ # Benchmark and CLI demonstration screenshots
├── eval/
│ ├── benchmark.py # Automated RAG Triad evaluation runner (LLM Judge)
│ └── dataset.py # Curated test cases & ground truth answers
├── ingestion/
│ ├── chunker.py # Semantic document chunker
│ └── embedder.py # Ollama dense embedding interface
├── sql/
│ └── schema.sql # Neon pgvector schema, HNSW indexes & hybrid search functions
├── cli.py # Rich terminal chat interface with audit panels
├── Dockerfile # Production multi-stage Docker container
├── .dockerignore # Docker context security filters
└── requirements.txt # Production dependencies

