Browse Jobs

Connecting you with the best creative freelance and permanent roles is our job. Let us help you find yours!



Senior Data Engineer


Feb 01, 2019



Agent: Emma B.

Job #: 143482

Salary: Up to £75,000

Job Description

Our client is looking for a Senior Data Engineer to join their central London team. You'll split your time across being an expert data engineer and also guiding and mentoring more junior members of the team. Having leadership skills isn't essential but it is much preferred.

You will be responsible for writing production-ready code to acquire, cleanse, manipulate, store and retrieve data, using leading edge open source and PaaS tools, in the cloud and using a range of data sources.

You'll be working closely with a team of front end and full stack developers, data engineers and data scientists, as well as UX & UI professionals.

Experience required for the role 

  • Demonstrable experience of leading, developing and delivering data driven solutions
  • Extensive, demonstrable experience of designing and implementing data processing pipelines
  • Extensive experience in a mainstream object-oriented language, e.g. Java, Python.
  • Confidence working on the command line (OSX, Linux)
  • Extensive experience working in a cloud environment, preferably AWS
  • Extensive experience of using PaaS services from providers such as AWS, e.g. Lambda, EMR, Batch, Kinesis
  • Extensive experience with agile methodologies
  • Data modelling / schema design (relational and NoSQL)
  • SQL and NoSQL databases (e.g. Cassandra, MongoDB) and their PaaS equivalents
  • Experience of API and microservice design
  • A talent for designing effective system architectures

Desirable Skills and Knowledge

  • Open source messaging and stream processing frameworks (e.g. Kafka, Storm, Beam) and their PaaS equivalents
  • Parallel analytics and query frameworks (Hadoop, Spark, Hive, Pig) and their PaaS equivalents
  • Graph databases and data warehousing experience
  • Linked Data/RDF, RDFS

Want more details about this and other opportunities?
Meet Emma Baggs!