Financial document copilot

Summary

Research across filings, transaction documents and earnings material.

Analysts needed to reconcile long documents, tables and recordings while keeping findings traceable to their sources.

A retrieval and extraction system for financial documents and audio, with model routing and page, paragraph or table references in the interface.

Tech Stack

  • Python
  • OpenAI
  • Cohere
  • Anthropic
  • ElevenLabs
  • Retrieval-Augmented Generation (RAG)
  • Milvus Vector Database
  • Prompt Engineering
  • AWS
  • Apache Tika
  • PostgreSQL
  • OCR

Tech Challenge

  • Accuracy and Verifiability. Financial data must be trustworthy and traceable back to original sources.
  • Latency at Scale. Queries must return within seconds, even as the document database grows.
  • Unstructured Complexity. Relevant data is buried across diverse formats: scanned PDFs, Excel models, and regulatory filings.
  • Financial Fluency. The assistant must speak the language of finance and understand domain-specific workflows.
  • Multi-Tier Reasoning. Some tasks require simple entity extraction, while others involve deep reasoning or synthesis.

Solution

  • Deployed a real-time RAG pipeline using Milvus for storing vector embeddings of financial documents such as SEC filings, investor reports, CIMs, and earnings call transcripts.
  • Implemented a multi-model architecture where different LLMs are used based on task complexity—fast models for basic tasks, and advanced models like GPT-4o or Claude Opus for deeper financial analysis.
  • Developed a dynamic orchestration layer to intelligently route user queries to the most suitable LLM, based on intent detection and query complexity scoring.
  • Enabled secure ingestion and parsing of financial documents using OCR, PDF extractors, and Excel parsers, allowing users to upload confidential information and receive structured summaries or metrics.
  • Created a chat-based user interface for financial professionals to interact with the assistant, ask natural language questions, and receive structured, sourced answers with citations and highlights from original documents.
  • Task-specific model adaptation supports financial extraction tasks, including EBITDA, risk factors and contract clauses. Source-linked outputs remain available for analyst review.
  • Linked generated outputs to their source locations—pages, paragraphs or tables—for analyst review.

Impact

Outcome

A research interface connecting financial-document answers to their source material.

Published

DRL Team