Job Description
Mission
Design, build, and optimize scalable data ingestion and document processing solutions that transform large volumes of unstructured insurance data into structured, AI-ready information. Enable downstream AI and retrieval systems by leveraging OCR, document intelligence, vector databases, and cloud-native data pipelines.
Responsibilities:
- Design and implement scalable data ingestion pipelines for processing high volumes of unstructured documents, including PDFs, scans, emails, and Office files.
- Integrate, configure, and optimize OCR and document extraction technologies to maximize text extraction accuracy and document understanding.
- Build automated workflows for document parsing, text cleaning, normalization, semantic chunking, and metadata enrichment.
- Develop connectors and integrations for document sources such as SharePoint, email systems, and enterprise repositories.
- Design and maintain vector database schemas and retrieval mechanisms to support Retrieval-Augmented Generation (RAG) solutions and AI applications.
- Ensure document processing pipelines meet enterprise security, compliance, performance, and availability requirements.
- Implement monitoring, validation, and quality-control mechanisms to identify and manage low-confidence OCR and extraction results.
- Optimize data processing workflows for scalability, reliability, and low-latency operations.
- Collaborate with AI Engineers, Backend Engineers, and Platform teams to deliver end-to-end AI-powered document processing solutions.
- Develop and maintain cloud-native data ingestion solutions on public cloud platforms.
