Senior Data Engineer

Job Summary

A company is looking for a Senior Data Engineer.

Key Responsibilities

• Partner with various teams to gather data requirements and build scalable data models and applications
• Design and implement data pipelines for ETL processes and real-time data processing using Apache Spark Streaming
• Develop data governance procedures and mentor junior data engineers

Required Qualifications

• A BE in Computer Science or equivalent with 8+ years of experience as a Data Engineer or in a similar role
• Experience building scalable data pipelines in Spark using scheduling tools like Airflow
• Familiarity with Databricks and modern databases (e.g., Redshift, Dynamo DB, Mongo DB, Postgres)
• Proficient in programming languages such as Python/Scala and strong SQL skills
• Experience with large-scale data processing systems (batch and streaming)