Sr. Data Engineer

We Are Hiring!
Job Vacancy at Miswag
Job Title: Senior Data Engineer
Department: Tech
Location: Baghdad, Al-Dora
Working Hours: (09:00 A.m. – 05:00 P.m.)
Working Days: Sunday – Thursday

Job Summary:
As a Senior Data Engineer, you will be instrumental in designing and constructing robust data pipelines, ensuring the efficient management of our data workflow, and maintaining the integrity and reliability of our data infrastructure. Using tools like Rudderstack, MySQL, ClickHouse, and AWS, you will empower our teams by making data accessible and actionable.

Key Responsibilities:
– Design, build, and maintain efficient, reusable, and reliable ETL pipelines.
– Manage data warehousing solutions and handle large-scale data migrations.
– Utilize expertise in databases such as MySQL, ClickHouse (or any OLAP solutions), and AWS services like Athena to optimize data storage and retrieval.
– Implement solutions for data collection, integration, and staging using Rudderstack.
– Collaborate with cross-functional teams to transform data into a meaningful asset for business insights.
– Leverage Docker and Kubernetes for scalable deployment and management of applications.
– Ensure data integrity and compliance with data governance and security standards.
– Mentor junior engineers and promote a culture of continuous learning within the team.
– Build and define data retention policies to manage the lifecycle of data.

Qualifications:
– Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
– 4+ years of experience as a data engineer in a data-intensive environment.
– Proficient in SQL and experience with relational databases, preferably MySQL.
– Extensive experience with ETL techniques and tools.
– Strong understanding of OLAP technologies, preferably ClickHouse.
– Experience with Docker, Kubernetes, and AWS cloud services.
– Proficiency with version control systems, preferably Git.
– Experience in building and optimizing data pipelines, architectures, and data sets.
– Strong problem-solving skills and attention to detail.

Preferred Skills:
– Experience with data orchestration tools like Apache Airflow.
– Knowledge of Large Language Models (LLMs) is a plus.
– Dedication to automation and creating repeatable processes.
– Experience with real-time data streaming platforms like Kafka.