Data Engineer - job 4 of 6

Job Summary

A company is looking for a Data Engineer (ETL and Spark) to join their team.

Key Responsibilities

• Design, build, and maintain systems for data collection, storage, and processing
• Ensure data accessibility, reliability, and security for analysis
• Build data pipelines, manage databases, and implement data quality checks

Required Qualifications

• 5+ years of experience in data engineering
• Experience developing ETL and ELT pipelines
• Proficiency with Spark, GraphDB, and Azure Databricks
• Expertise in data partitioning and data conflation
• Experience developing Python scripts and training LLMs with structured and unstructured datasets