Back to jobs

Data Engineer - Big Data

Job description

Data Engineer

About the role

We are working a data driven energy organisation who process large volumes of high frequency consumption data alongside analytics of static and dynamic reference data. Due to their expansion they are now seeking a Data Engineer to join the team in Southampton

Main responsibilities

Developing a "big data" AWS based infrastructure that delivers optimised outputs in a performant and resilient ecosystem. You will then be able to write complex queries to present or extract data based on the data science or business needs of the organisation.

Experience required

You will be looking for an exciting green-field opportunity to work within a big data architecture that will be at the heart of the organisation's success.

You will have recent business or academic experience of working with big data sets, creating big data warehouses, and ETL routines. You will have experience of working on a big data platform.

Essential skills:

  • Apache SPARK, Hadoop, MapReduce, Hive, at least one NoSQL Database and at least one Relational Database
  • At least one of these programming languages Python, Scala or Java.
  • AWS, Azure or GCP (any of the cloud-based platforms) we be desirable but not essential

If you would like to be considered for this opportunity then please send your CV to WilkinChan@SpectrumIT.co.uk or call 02380 765 292 if you wish to be considered for this position.