Finansi.bg Leveraged AI to Transform Financial Data Processing, Achieving 250k Users in Just One Year

Finansi.bg faced the formidable task of developing a platform that could efficiently extract and present critical financial data from a vast and diverse set of documents. The primary challenge was dealing with inconsistently structured data across 2 million documents, where not all pages held relevant information. This required a sophisticated solution to accurately sift through the noise and extract only the most pertinent data. Additionally, the platform needed to maintain high Google rankings, deliver exceptional site speed, and ensure a seamless user experience across all major browsers, all while controlling costs in processing and managing this extensive data.

To address these challenges, we employed a data-driven approach leveraging advanced AI and data processing tools. We integrated a monolithic architecture using Laravel and employed AI-driven data processing to efficiently manage and categorize the vast datasets, which included over 2 million records in the document database.

Key technologies included Retrieval Augmented Generation (RAG) for enhanced data retrieval and VoyageAI, which provided superior results compared to traditional OpenAI embeddings. These tools, combined with Azure for scalable cloud services and ChromaDB for vector-based data retrieval, allowed us to streamline the process of extracting, organizing, and analyzing financial information with unprecedented accuracy and efficiency.

By using VoyagerAI and ChromaDB, we automated the extraction of key financial data from over half a million documents, significantly reducing manual effort and ensuring high accuracy. An entire pipeline was developed to sanitize and normalize the data, which was then processed by multiple algorithms to produce standardized outputs.

Throughout the process, error detection algorithms flagged documents or pages for manual review, ensuring the highest level of data integrity. Out of all processed documents (over than 2 million), fewer than 8k required human intervention, highlighting the efficiency and accuracy of the automated system.

Our innovative approach reduced the expected data processing costs by 80% through the application of various resource optimization techniques, making the solution highly cost-efficient. By calculating the wages of manual data processors, it was evident that handling this volume manually would have been prohibitively expensive and time-consuming.

In contrast, our AI-driven solution slashed costs by 99.1%, reducing the expense from an estimated 2 million euros to just 18k euros. This automation accomplished in a fraction of the time what would have taken a team of employees over a year to process manually. This not only made the project financially viable but also ensured timely and scalable data handling for ongoing operations.

The team achieved a 98-speed rating by leveraging modern tools like Next.js, React and TailwindCSS, optimizing the platform for rapid performance across all major browsers. This focus on cross-browser compatibility ensures a seamless and responsive experience on any device or browser. The result is a highly efficient platform that exceeds industry standards for speed and usability, driving user engagement and satisfaction.