Job description
Data Engineer
A leading security software company are looking for an Data Engineer to join their growing organisation.
The Data Engineer will join an established data science team and own the transformation tooling and work with various domain specialists to improve, optimise and validate the core capabilities of our platform.
This is a great opportunity for an experienced Data Engineer to join a growing organisation, with opportunities to manage bespoke data driven projects.
As a Data Engineer you will support the data science team in developing ETL pipelines for customers.
The role of Data Engineer will involve:
- Developing monitoring tools to allow timely response to service breakdown
- Perform dimensional modelling - building fact, dimension and aggregate tables for common operations
- Transforming client business requirements into optimal data solutions
- Design, implementation and maintenance of database extract and load processes (ETL) using our ETL language and tools - Develop functions / procedures used by said ETL processes
- Develop and manage data delivery services
- Getting up to speed with new ETL and stream processing tools and languages like Benthos and Bloblang
- Cross-functional collaboration to fulfil joint change request assignments
- Extracting and processing data from various databases and other external sources with good optimisation techniques to speed up query execution
- Developing reports and data extracts as the business requires
- Communicating with external and internal stakeholders
- Create dashboard visualisation
The successful Data Engineer will have;
- Highly proficient in ETL process development
- Strong SQL is essential
- Experience with T-SQL
- Scripting Languages - experience with Python, Bash or PowerShell
- Strong experience with ETL tools such as Spark, AirFlow, Flink, AWS Glue, Informatica, SSIS or other ETL tools
- Highly proficient in Data Modelling
- Performance tuning experience
- Experience working with large, complex data sets (Terabytes to Petabytes scale)
- Strong problem solving skills
- Good understanding of data governance concepts such as data ownership, data stewardship etc
- Strong communication, presentation and stakeholder management skills
The role of Data Engineer is paying up to £80,000 depending on experience and fantastic benefits which include; Bonus, 25 days annual leave, Enhanced Pension Contribution, Catered Lunch and more.
This role offers hybrid working with candidates required to be available to commute to offices in Basingstoke.
To be considered please forward your CV to CameronElloway@SpectrumIT.co.uk or call Cameron on 02380 765 301.
