25th October 2022
Data Engineer
Big Data
London
£60k per annum
Mid-level Data Engineer
60K
Hybrid, London.
Spencer Rose are looking for a Data Engineer to join a world-class Data Science team in a Machine Learning Environment. The Data Engineer will evolve the design and development of data and machine learning products to support business strategies, as well as ensuring that the data and machine learning services are scalable, reliable and robust.
The Data Engineer will have the following responsibilities:
Build pipelines for data cleansing, transformation and aggregation to deliver business and client-facing insights and reports.
Develop AWS serverless solutions for data services.
Work closely with Data Scientists/Machine Learning Engineers to build feature engineering, machine learning training and deployment pipelines.
Develop and manage new data source ingestion pipelines when they are occasionally required.
Rotational responsibility to monitoring production pipelines and AWS EMR clusters owned by the team.
The Data Engineer will have the following skills:
Degree in computer science, information technology, engineering or equivalent.
At least 2 years of experience in Scala/Python programming
Comfortable working with Linux and bash Scripting
Familiarity with data structures and algorithms Desired Skillset
Experience with AWS
Familiarity with Apache Spark, Apache Kafka
Experience in Microservice development
Experience in machine learning
Familiarity with SQL
Exposure to Terraforms
Consultant -
Telephone:
Share This Position
