Senior Data Engineer - job 3 of 21

Job Summary

A company is looking for a Senior Data Engineer (Remote).

Key Responsibilities

• Develop and maintain a unified data platform using Azure Databricks for efficient data storage, processing, and analysis
• Design, develop, and maintain scalable data pipelines and implement ETL processes to ensure data integrity and quality
• Utilize technologies like Spark, Kafka, and Airflow for large-scale data processing and troubleshoot systems for smooth operation

Required Qualifications

• 5+ years of development experience with Python, Scala, Java, or C#, preferably Python
• 5+ years of experience with Databricks, Snowflake, BigQuery, Apache Spark, HIVE, Hadoop, Cloudera, or RedShift
• Proficiency in high-performance data pipeline design and mastery of pipeline guarantees
• Experience in a containerized environment like Docker, Rancher, or Kubernetes
• Bachelor's degree in Computer Science or related field, or equivalent combination of education and experience