We are looking for people who:

• For several years are programming in technologies run on JVM
• Have experience in Scala or want to develop in this direction
• Have experience in the Big Data ecosystem (Hadoop, Spark, Airflow)
• Have knowledge of GCP (Dataproc, Dataflow, BigQuery, Pubsub) will be an added advantage
• Have ideas and willingness to get involved in designing solutions architecture
• Are looking for effective solutions to the requirements set by users
• Are interested in a variety of tools and the possibility of using them appropriately to the problem
• Are maintaining good programming practices
• Like to share their knowledge and experience with others
• Want to constantly develop and update their knowledge
• Know English at B2 level

Opis oferty  

As part of the Data & AI area, we implement projects based on the practical "data science" and "artificial intelligence" applications of an unprecedented scale in Poland. Data & AI is a group of over 100 experienced BigData engineers organized into over a dozen teams with various specializations. Some of them build dedicated tools for creating and launching BigData processes or implementing ML models for the entire organization. Others work closer to the client and are responsible for the implementation of the search engine, creating recommendations, building a buyer profile or developing an experimental platform. There are also research teams in the area whose aim is to find solutions to non-trivial problems requiring the use of machine learning.

Zakres obowiązków

1. A system that provides the ability to materialize events (received from microservices) into a form that allows building tables using Big Data tools. Our daily challenges are the scale of traffic, information structuring and stream synchronization of collections between on-premises solutions and public cloud environments 
2. Metadata aggregation processes, integrated with Allegro's data platform to support tools and processes in the areas of: Data Quality, Data Lineage and Data Governance