As a Senior Big Data Engineer , you will live on the front lines of the products we create, and build features used by millions of people every day.
Our project is about migrating data from several sources : PostgresDB, MongoDB, AWS Cloud Watch and Salesforce to Google Cloud Platform (GCP).
The main goal is to develop a generic platform for future integration in various regions, now focus on the UK region. And the final goal is to provide the ability to create specific custom reports and analytics for users.
Project technologies and tools
Cloud Storage (GCS)
Apache Beam SDK (Java 8)
Cloud Composer / Apache Airflow
Looker (analog of Tableau)
Other GCP services used in the project : Cloud Load Balancing, Compute Engine, Cloud FireStore, Data Loss, Cloud IAM, Monitoring, Key Management Service, Error Reporting, Loggin
Solution architecture design
Other interaction with the customer development team
3+ years of experience in Java or Python
Experience with HIVE, Spark will be a plus
Experience with Apache Hadoop will be a plus
Strong communication skills
Good spoken and written English
Competitive compensation depending on experience and skills
Individual career path
Unlimited access to LinkedIn learning solutions
Social package - medical insurance, sports
Compensation for sick lists and regular vacations
English classes with native speakers (certified English teachers)
Flexible work hours