Support data science and business intelligence in the aquistion of data from a multi-site environment · Drive automation and the development of infrastructure as code ·
Work with a team to ensure code is managed and that source control is adhered to ·
Ensure that networking, edge computing and containers are in place to support data flows onwards to cloud environments ·
Proactively drive an agile environment
Administer and interrogate mongodb
API design and development
Design, manage and support data/pipelines to data lake
Support the implementation of aquistion tooling such as Microsoft Azure IoT Hub · Support and work within an Azure environment
Collaborate with multiple business teams including data science, trading analysts, operations and business intelligence
Drive proactive and innovative solutions to drive improvements to process and streamling and automation of activities ·
Work alongside existing teams to build and exploit a corporate Azure datalake Requirements: · Significant experience gained from a Data Engineer role within a controlled environment adhering change management processes is essential ·
Experience of code management and deployment is required · Linux, Windows, Docker and Kubernetes experience are a must ·
Experience of managing data pipelines and cloud ETL solutions is essential · Microsoft Azure data tools experience is required (data factory, data bricks, IoT Hub) ·
Experience of data modelling, database design and managing relational databases and NoSQL databases are a must
Mongo dB experience is essential
Experience of developing and using restful API is required ·
A relevant quantitative Degree such as Maths, Physics, Computer Science or Engineering would be ideal Experience of multi-site industrial or process industries would be beneficial
OPC experience would be advantageous ·
Experience gained from agile environments is preferred
Automation tooling (e.g. puppet) experience would be ideal
Experience of developing infrastructure as code would be advantageous · Source control management experience is preferred · Software development experience with Python is ideal
Test driven development and continuous integration experience would be beneficial
More Information
- Address Middlesbrough, UK
- Industry Information Technology
- Experience 5 - 10 Years
