Data Engineer

Halyk Finance announces a vacancy for the position of Data Engineer.

Responsibilities

• Participate in the development of the reporting system
• Develop and maintain batch ETL processes (Python, SQL, Airflow)
• Develop and maintain data stream processing (Python, RabbitMQ)
• Improve and develop the data warehouse, build data marts
• Integrate new data sources into DWH
• Implement data quality checks DQ
• Introduce new data tools in the company
• Build communication processes with customers during work

Requirements

• Good knowledge of SQL - window functions, complex joins and subqueries, experience in optimizing large SQL queries.
• Understanding the principles of relational and columnar DBMS, experience in designing DWH data modeling, layering
• Good knowledge of Python (skills in working with Pandas will be a plus), experience in building data pipelines using Airflow
• Proficiency in tools - Git, Docker, skills in working with NoSQL DBMS.
• Knowledge of technologies DBT, Debezium, Greenplum, Spark, Data Lake, k8s, PowerBI, Apache NiFi

Conditions

• office work,
• work schedule 5/2 09:00 – 18:00
• development and career growth
• annual bonus
• bonuses based on annual results
• professional development at the expense of the Company