Scaling email data extraction using LLMs at Foxintelligence

At a glance

Foxintelligencepart of NielsenIQ, enhances digital brand and retailer performance with privacy-first market and shopper insights worldwide.

Challenge

Foxintelligence faced challenges in processing unstructured data, like customer emails, efficiently, with manual processes limiting scalability without added staff.

Solution

Firemind proposed a proof-of-concept using AWS services and a serverless architecture to automate data processing for Fox Intelligence.

Services used
  • Amazon Bedrock
  • Amazon Kendra
  • AWS Lambda
  • Amazon API Gateway
Outcomes
  • Scalable LLM solution capable of replacing 6,000 parsers.
  • Amazon Bedrock LLMs enhance data accuracy.
Business challenges

Automating email data extraction for greater efficiency

 
Foxintelligence was facing challenges in efficiently processing and extracting insights from their unstructured data, particularly customer email communications. Their manual, time-consuming processes were hindering their ability to scale operations without increasing headcount and full-time employee (FTE) hours. They sought a solution to automate these tasks and free up their team to focus on higher-value work.
 

What our customers say

Hear directly from those who’ve experienced our services. Discover how we’ve made a difference for our clients.

Solution

AI-powered insight extraction made easy

Firemind engaged Foxintelligence to address their challenges in efficiently processing and extracting insights from their unstructured data, particularly customer email communications. Foxintelligence, an innovative organisation rapidly advancing into the world of AI and machine learning, had an internal innovation department that was exploring the potential of these technologies to improve their operations and to gain a competitive edge.

Firemind proposed a comprehensive proof-of-concept solution leveraging various AWS services to create a scalable, serverless system. The first step was to establish a robust data ingestion pipeline that could handle any text documents, including unstructured data. This was achieved by utilising Amazon S3 to ingest and store the documents, such as customer emails, as they were uploaded.

To enable smart semantic search capabilities, Firemind implemented Amazon Kendra, which allowed the large language model to efficiently retrieve the most relevant documents from the data repository. This was a crucial component, as it provided the foundation for the chain-of-thought reasoning process that was at the heart of the solution.

The user interface was developed using React and hosted on Amazon S3, with the content delivered through a CloudFront distribution. This frontend was secured using AWS WAF and integrated with Amazon Cognito, ensuring that only authenticated users could access the system. The UI provided a prompt-based experience, allowing Foxintelligence’s team to easily enter queries and retrieve responses from the large language model.

At the core of the solution was the use of the Claude V2 model, hosted on Amazon Bedrock. This powerful large language model was leveraged to reason over the data retrieved by the semantic search, providing contextual responses to the user prompts. The combination of Kendra’s search capabilities and the LLM’s reasoning abilities enabled Foxintelligence’s team to extract valuable insights from their unstructured data, automating manual tasks and freeing them up to focus on higher-value work.

The entire system was designed with a serverless architecture, utilising AWS Lambda and Amazon API Gateway to handle the backend processing and API requests. This approach ensured scalability, cost-efficiency, and ease of maintenance, aligning with Firemind’s commitment to AWS best practices and methodologies.

Through this proof-of-concept, Firemind demonstrated how Foxintelligence could leverage the power of generative AI and AWS services to streamline their internal operations and scale their business without the need to increase their full-time employee headcount. The solution provided a flexible and secure platform that empowered Fox Intelligence’s team to extract insights and automate manual tasks, ultimately driving greater efficiency and productivity within the organisation.

Streamlined data processing

Firemind's solution allowed Foxintelligence to automate the ingestion and interpretation of their unstructured data, such as customer emails, freeing up their team to focus on more strategic initiatives. The integration of AWS services like Amazon Kendra and Amazon Bedrock provided a scalable and efficient way to extract valuable insights from the data.

Increase in productivity

By implementing a prompt-based user interface, Firemind empowered Foxintelligence's team to easily interact with the large language model and retrieve relevant information. This enabled them to complete manual tasks more quickly and with greater accuracy, leading to a significant increase in productivity and a reduction in headcount requirements.

Get in touch

Want to learn more?

Seen a specific case study or insight and want to learn more? Or thinking about your next project? Drop us a message below!