Job description
Data Engineer
About the role
We are working a data driven energy organisation who process large volumes of high frequency consumption data alongside analytics of static and dynamic reference data. Due to their expansion they are now seeking a Data Engineer to join the team in Southampton
Main responsibilities
Developing a "big data" AWS based infrastructure that delivers optimised outputs in a performant and resilient ecosystem. You will then be able to write complex queries to present or extract data based on the data science or business needs of the organisation.
Experience required
You will be looking for an exciting green-field opportunity to work within a big data architecture that will be at the heart of the organisation's success.
You will have recent business or academic experience of working with big data sets, creating big data warehouses, and ETL routines. You will have experience of working on a big data platform.
Essential skills:
- Apache SPARK, Hadoop, MapReduce, Hive, at least one NoSQL Database and at least one Relational Database
- At least one of these programming languages Python, Scala or Java.
- AWS, Azure or GCP (any of the cloud-based platforms) we be desirable but not essential
If you would like to be considered for this opportunity then please send your CV to WilkinChan@SpectrumIT.co.uk or call 02380 765 292 if you wish to be considered for this position.