Senior Scala Big Data Engineer

VirtusLab

Odesa, UA

4 днів тому

source : Just Join IT

Hadoop or Cloud solutions (regular)

Spark (advanced)

Would you like to wrangle terabytes of data in minutes using cutting-edge technologies?

Would you like to join a team of talented and passionate Software Engineers?

Developing your programming skills, building and maintaining data lakes, data platforms and applications for various modern and highly-funded companies?

Using FP and type safety to make sure your applications are correct and do that in a company developing Scala 3?

If you are a Scala developer who would like to get into Big Data or a Data Engineer who wants to learn more about Scala (or both!) then we are looking for someone just like you.

If you're not yet fully convinced here's how the work at our company looks like through our team members eyes

You'll join the Data department at VirtusLab where we are providing Big Data and Machine Learning consulting services for various UK, EU and US clients.

Available Projects :

1. A huge retailer, with tons of data stored in a large, on-prem Hadoop Cluster, which we're extending with cutting edge, flexible, cloud-based solutions.

We're responsible for creating large business aggregates for different e-commerce domains. Additionally, we cooperate with data scientists to optimise operations across a number of business areas (from van deliveries to in-store security).

Tech stack : Scala, Spark, Hadoop, Kafka, Kubernetes, Azure

2. Our main goal is to develop a generic Big Data ingestion and transformation framework for a new, highly funded, UK-based, insurance company.

We work across two teams : one responsible for developing the framework and extending the capabilities of the platform and another one focusing on using the framework to ingest hundreds of datasets from various data sources.

There are lots of greenfield areas and possibilities to impact the whole company.

Tech stack : Scala, Spark (mostly Core, some SQL), AWS (EMR, EC2, S3, Codebuild)

What & how?

On premise and cloud based infrastructures (project dependent, but Scala and Spark are the main technologies)

Professional and comprehensive monitoring, logging and alerting

Evolutionary Agile approach to software delivery

Great teamwork and knowledge sharing

Contributions to the open-source software communities

What we expect?

Ability and eager to lead by example

Hands-on experience in designing and development of scalable, distributed, highly available solutions

Interest in solving challenging data engineering problems using state-of-the-art techniques

Grounded knowledge and understanding of data structures, algorithms and distributed computing

Fluent with Scala and / or Spark

Functional Programming mind-set is a nice to have

Able to develop and maintain high-quality code

Can communicate with the business using good English (both written and verbal)

Experienced in using big data and cloud solutions (eg Hadoop, AWS, Azure)

Has a deep understanding of data-intensive distributed systems

What's on offer?

Flexible hybrid work model - you decide where & when to start the work. You can work remotely or join us in one of our modern offices (Krakow, Rzeszow, Kielce;

Wroclaw, Katowice, Warsaw and Gdansk - soon!), always located in the city centres. Just choose what suits you best!

Language lessons - we refund up to 500 PLN (per quarter) for learning all languages you would like to take! What’s more, we refund up to 1 000 PLN (per quarter) for learning the English language.

Virtusity our training division - we really value the personal growth of our #VLteam. That’s why we have a rich offer of internal courses , workshops etc.

technical, as well as soft skills training) conducted by our employees.

Training Package - use our training budget of up to 2 500 PLN (yearly) and 24 paid work hours for your development. You can choose the training from our Virtusity portfolio or external conferences, courses, workshops etc.

Home office reimbursement - you can rent all the necessary equipment from our offices, but you can also get up to 800 PLN financial support to set up your WFH.

Multisport card or MyBenefit points - do you like sports and want free unlimited admission to sports facilities in your city?

Or maybe you prefer the cinema, SPA in the mountains, delicious dinner or Allegro shopping? At VirtusLab, you decide whether you choose a sports card or vouchers for countless attractions.

Private healthcare - our insurer's offer allows you to have free health advice, treatments, diagnostic tests etc., in more than 1,500 clinics operating all over the country.

Stretching - feeling tense or tired? Take a break from work and join our online stretching sessions.

Building tech community - we run 9 meetup groups in Kraków, Kielce, and Rzeszów and support many other local initiatives.

We also contribute to numerous open-source projects (world-famous solutions and create our own ones). Check out also Sphere.

it - our unique platform with tech videos and online events.

Having fun together - cycling tours, kayaking, fun at rope park, pizza party or a mountain trip with SPA? Yes, we've got it all.

It's never boring with #VLteam!

We do not expect you to qualify for all of the above points. A good understanding of some of these areas and a willingness to develop expertise in others may be sufficient.

We are not concerned with your education or any other formalism. What we are concerned with are your passion, knowledge and experience.

Повідомте про це

Thank you for reporting this job!

Your feedback will help us improve the quality of our services.

Моя електронна адреса

Клацнувши по кнопці "# кнопка", я даю згоду neuvoo на обробку моїх даних та надсилання сповіщень електронною поштою, як це детально описано в Політиці конфіденційності neuvoo. Я можу будь-коли відкликати свою згоду або скасувати підписку.

Продовжити