This is a fantastic opportunity for a Data Engineer with big-data experience to join our growing data science team and contribute towards building a data-enabled technology platform for the automotive wholesale industry.

You will be responsible for expanding and optimising our data and data pipeline architecture while ensuring data quality with rigorous testing of data and data-processing code. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimising data systems and building them from the ground up.

You will work with truly awesome Business and Technology teams and will play a key role in surfacing the information hidden in vast amounts of data. Your primary focus will be on transforming tables and streams of data into well-designed data models in a variety of database systems, including Google BigQuery, PostgreSQL, and Elastic search. In addition to typical SQL queries and analytical functions, these transformations also include the application of machine-learning models to enrich the data. As such, candidates with an interest in machine learning are well suited for this opportunity.

As a Data Engineer you will:

Create and maintain optimal data pipeline architecture

Assemble large, complex data sets that meet functional / non-functional business requirements

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Python, and Google-Cloud big-data technologies, e.g., BigQuery, GCS, Dataflow/Apache Beam, etc.

Contribute to building and maintaining a system for continuous integration and deployment of changes to data systems

Build analytics tools that utilize the data pipeline to provide actionable insights

Work with stakeholders including the product, operations, and development teams to assist with data-related technical issues and support their data infrastructure needs

Create data management tools for analysts and data scientists that assist them in building and optimizing our product into an innovative industry leader

Work with data and analytics experts to strive for greater functionality in our data systems