AdTech Client #1 | Senior Data Engineer
Senior Data Engineer for an AdTech company, building large-scale data processing systems with Spark, Flink, AWS.
On behalf of AdTech Client #1 , SD Solutions is looking for a talented Senior Data Engineer. SD Solutions is a staffing company operating globally. Contact us to get more details about the benefits we offer.
Responsibilities
You will own end-to-end data pipelines — from data ingestion and processing to reliable delivery into analytics and reporting systems — while contributing to platform architecture, scalability decisions, and best practices in data engineering and AI-assisted development. You will design, build, and maintain large-scale data processing systems using Java, Scala (with Spark and Flink) , and Python , developing robust ETL/ELT pipelines, real-time and batch processing solutions, and efficient data workflows.
You will work with high-volume advertising data, implementing solutions for publishers management, bidding logic data processing, reporting, audience analytics, and customer-facing data products. You will integrate with external data sources and third-party services, optimize query performance, ensure data quality and reliability, and solve complex production and scalability challenges.
You will write high-quality, testable code, improve observability (logs, metrics, tracing), monitor production data systems, and actively participate in technical design reviews and cross-team discussions.
Requirements
6+ years of total commercial development experience 4+ years of commercial development experience with Java, Scala (Spark and Flink preferred) , and Python Strong knowledge of SQL and NoSQL databases (experience with Vertica and MongoDB is highly valued) Solid experience with AWS cloud platform (or equivalent cloud technologies) Experience designing and implementing scalable data architectures and distributed systems Strong understanding of data processing patterns, performance optimization, and data quality practices Open-minded, eager to learn, and flexible personality with a “can-do” attitude Self-starter, able to work independently and multitask effectively Passionate about learning new technologies Nice-to-have skills: Experience with Hadoop and Kafka Experience with Kubernetes Experience with Git, GitLab, Grafana, InfluxDB, Kibana BSc in Computer Science, Software Engineering, or equivalent About the company: A large-scale advertising technology company building audience intelligence and campaign automation tools for brands, agencies, and publishers across multiple digital channels.
The platform processes vast data volumes to enable programmatic decisions and measurable business outcomes at a global level. By applying for this position, you agree to the terms outlined in our Privacy Policy. hr/privacy-notice , and make sure you understand its contents. If you have any questions or concerns regarding our Privacy Policy, please feel free to contact us.