Databricks Architect

Job Summary

A company is looking for a Databricks Architect to design and implement data solutions for complex business problems.

Key Responsibilities

• Design and architect scalable and secure Databricks solutions while optimizing performance, cost, and reliability
• Implement DevOps processes on the Databricks platform and manage curation pipelines across programs
• Drive performance initiatives and provide recommendations for tuning opportunities and performance environment creation

Required Qualifications

• 12+ years of experience in architecture, design, and data engineering development of large-scale data ecosystems
• Hands-on experience with Databricks and DataOps architecture
• Good exposure to AWS and experience with Hadoop environments
• Knowledge of Databricks platform, Unity Catalog migration, and Spark Streaming pipeline design