Dodaj ogłoszenie

Data Engineer

Grafton Recruitment
Pracy w Śląskie Stała

Opis

For one of our Client we are looking for Data Engineer who will join a new team where will be to develop a part of a distributed system that serves the hospitality industry. The system consists of many domain-oriented microservices developed under a few cross functional teams and will be responsible for:

- Design, implementation and maintenance ETL pipelines that will allow to validate and transform data,
- Analyzing source records and build proper data models suitable for given business needs,
- Design of data marts for analytical purposes,
- Providing scalable solutions that will allow to process data in near real time,
- Give guidance for and coach other developers.

Technologies used: Spark, Spark Streaming, Kafka, Airflow, AWS Glue, Redshift, Athena, S3, Python, SQL

Wymagania

- Hands-on experience with Big Data tools and streaming technologies: Spark, Kafka, Airflow, etc
- Experience with AWS services such as Glue, Redshift, EMR, Athena, S3, etc
- Being fluent in Python
- Have a mathematical and analytical predisposition in the context of data processing and data transformation
- Excellent knowledge of SQL, relational databases, data warehouse modeling
- Some experience with data lake platforms and distributed systems
- The capability of writing clean code along with tests
- Being an open-minded, proactive person

Lokalizacja

Katowice

Informacje

  • Grafton Recruitment
  • Pracy w Śląskie
  • Kategoria: Inżynieria
  • Wynagrodzenie: Od 0 PLN do 19000 PLN
  • Rodzaj pracy: Stała