Data Engineer (MySQL)

Solvd Inc. is a premier software engineering company. We have 8 offices across the globe and over 800 international employees on staff. With over 12 years of experience, highly skilled teams around the world and deep industry knowledge, we help clients create software that improves their operations and opens new markets. We have built an impressive roster of digital-native enterprise clients including some of the biggest brands in retail and social media.

We are looking for a Data Engineer (MySQL) to join our growing team.

• Data Lake Design & Architecture: 
• Design a scalable and efficient data lake architecture to store ONIX data in MySQL. 
• Define the schema, tables, indexing strategies, partitioning and relationships to optimize data storage and retrieval. 
• Data Mapping: 
• Analyze ONIX data (XML) and map it to MySQL tables and fields. 
• Ensure data integrity and consistency during the mapping process. 
• Data Ingestion Pipeline: 
• Develop data ingestion pipelines for both on-demand and periodic updates (e.g., daily, hourly). 
• Integrate support for additional data formats (CSV, Google Sheets, Excel). 
• Stored Procedures and Queries: 
• Write efficient stored procedures, queries, and joins to process and format data. 
• Optimize database performance for large datasets. 
• API Development: 
• Design and build RESTful APIs to expose formatted data from MySQL. 
• Ensure APIs are scalable, secure, and well-documented. 
• Consulting: 
• Act as a consultant to the client, providing guidance on best practices for database design, data ingestion, and API development. 
• Collaborate with the client’s team to understand requirements and deliver solutions. 
• Testing and Validation: 
• Perform thorough testing of the data lake, ingestion pipelines, and APIs. 
• Validate data accuracy, consistency, and performance. 
• Documentation: 
• Create detailed documentation for the data lake architecture, ingestion pipelines, stored procedures, and APIs. 
• Provide training and support to the client’s team. 

• At least 4 years of experience in software engineering.
• Proficiency in RDBMS (database design, stored procedures, query optimization).
• Experience with data ingestion pipelines (ETL/ELT) and tools (e.g., Apache NiFi, Talend, custom scripts).
• Strong knowledge of data mapping and data modeling.
• Expertise in API development (RESTful APIs, GraphQL).
• Proficiency in Python, Java, or Node.js for backend development.
• Experience with XML parsing and handling other data formats (CSV, Excel, Google Sheets).
• Advanced knowledge of SQL (joins, subqueries, indexing, partitioning).
• Experience with database performance tuning and scalability.
• Strong communication and client-facing skills.
• Problem-solving and analytical abilities.
• Ability to work independently and deliver results in a remote environment.

• Experience with cloud-based database solutions such as AWS RDS, Google Cloud SQL, or Azure Database for MySQL.
• Familiarity with containerization and orchestration (Docker, Kubernetes).
• Experience with real-time data processing technologies (Kafka, Apache Flink).