Airflow / Spark / Scala (regular)
We code, test and support . We specialize in IT outsourcing and work with clients all around the world . Our offices are in : Warsaw (Poland), Manila (Philippines) and Chicago (USA).
Right now, we hire over 120 people and this number is still growing ️! We started in 1997 and in 2022 we celebrate our 25th Anniversary .
We Code Success! That’s our mission . We want everyone who is related to our company to be successful in whatever they choose to do (as an employee or even later as a former employee).
As Azure Data Engineer you will be technical analysiing and the implementation of the ETL processes for the solution synchronizing the data between the client internal systems (e.
g. SAP, Simplement etc.) and cloud (Salesforce) via Azure platform;
You will be cooperating with a team working in an Agile Methodology;
You will be supporting the system during its lifecycle (maintenance / development);
You will be writing and analyzing existing scripts for Azure DataBricks processing of the data;
You will be writing unit tests for scripts for Azure DataBricks;
You will be supporting Airflow based solution.
3+ years of experience as data engineer with Azure DataBricks involved;
Writing notebooks in Azure DataBricks;
Experience with Airflow, Spark, Docker;
Knowledge of Python / PySpark / Scala for Azure DataBricks;
Familiarity with frameworks / libraries such as : pandas, pyspark, pytest;
Very good communication skills in English;
Experience with Azure API Management is a plus;
Knowledge of C# programming language is a plus (for supporting related solution).
We offer :
Flexible working conditions;
Stable employment (employment contract or B2B);
Private healthcare, Multisport card and trainings.