01LIVE · LANGGRAPH AGENT
FinReport Agent
Answers questions about company annual reports, citing the pages it used. It plans its searches, checks it found the right passages, does every calculation with a calculator tool and verifies its numbers against the report.
70%
numerical questions right (plain RAG: 50%)
66%
with a 4B model on my laptop GPU (RAG: 36%)
145
held-out FinanceBench questions, p < 0.01
- Hybrid search (bge-small + BM25) over 84 public filings, with full-page context so tables are never cut in half.
- My first 30-question run overstated the gain for the large model. On all 145 it helps on numerical questions but not qualitative ones, so simple lookups are now routed to plain RAG.
- Also deployed as a streaming FastAPI service in Docker on Azure Container Apps (metrics, API keys), and as an MCP server that Claude Desktop or other agents can use.
- LangGraph
- LangChain
- RAG
- ChromaDB
- FastAPI
- Docker
- Azure
- MCP
- Groq
- Ollama
finreport-agent.streamlit.app