Lead Data Engineer

Job Title: Lead Data Engineer

Key Skills: Azure Databricks, DBT, Snowflake, Python, Terraform, Data Architecture

Experience: 8+ YOE.

Location: Costa Rica, Peru, Colombia, and Bolivia.

Mode: Remote.

We at Coforge are hiring Lead Data Engineer (#22145) with the following skill set.

Key Responsibilities

· Lead and mentor a team of Data Engineers, driving technical excellence, code quality, and engineering best practices.

· Own the end-to-end architecture and design of the data platform, ensuring scalability, reliability, and alignment with business objectives.

· Take full ownership of solution delivery, from architecture and design to deployment and production support.

· Define and drive data migration strategies from Snowflake and SSIS to Azure Databricks and DBT.

· Design and oversee the implementation of scalable data pipelines, data models, and enterprise data solutions.

· Lead Infrastructure as Code initiatives using Terraform to ensure consistency, automation, and scalability across environments.

· Establish architectural standards, design patterns, and governance practices across the data ecosystem.

· Ensure reliable and efficient integration between legacy platforms and Azure-based environments.

· Drive CI/CD adoption and oversee release management processes for data platforms and pipelines.

· Act as the primary technical escalation point for complex issues and long-term platform stability.

· Collaborate closely with product, architecture, business, and engineering stakeholders to deliver enterprise-grade solutions.

· Maintain architecture documentation, design standards, and implementation guidelines.

Required Skills Qualifications

· 8+ years of experience in Data Engineering, including 2-3+ years in a Lead or Staff-level role.

· Proven experience leading the design and implementation of large-scale enterprise data platforms.

· Strong hands-on expertise with Azure Databricks, DBT, Snowflake, Python, and SQL.

· Experience delivering large-scale data transformation programs involving thousands of DBT models and data pipelines processing terabytes of data daily.

· Deep understanding of data architecture, data modeling, ETL/ELT frameworks, and distributed data systems.

· Extensive experience with Terraform and Infrastructure as Code (IaC) principles.

· Experience leading cloud migration initiatives, preferably from AWS to Azure.

· Strong experience with Git-based version control and CI/CD pipelines.

· Strong analytical and problem-solving skills with the ability to make architectural decisions and trade-offs.

· Excellent communication and stakeholder management skills.

· Experience working in insurance or financial services environments, including domains such as claims, underwriting, policies, and risk management.

· Experience leading engineering teams and demonstrating measurable delivery success.

· Experience managing and mentoring team members across different performance levels, driving growth, development, and continuous improvement.

Preferred Skills

· Experience implementing data governance, observability, and data quality frameworks.

· Strong understanding of security and compliance standards within insurance or financial services organizations.

· Experience working with real-time and streaming technologies such as Kafka, Event Hubs, or Delta Live Tables.

· Familiarity with Lakehouse architectures and cloud cost/performance optimization strategies.

· Experience operating in hybrid cloud or multi-cloud environments.

Posted On: 14-08-2026

At Coforge, we hire professionals based solely on their skills and qualifications and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.