Senior Data Engineer
Abingdon-on-Thames, England, United Kingdom
Senior Data Engineer
Location: Hybrid, with 2 days per month to be onsite (Abingdon)
We have the pleasure to be representing a business that is on a mission to increase the number of people who can live longer, healthier lives and reduce unnecessary medical costs while doing so. To help with the success of this strategy They are recruiting for a Senior Data Engineer that will take a pivotal role in driving the Data team forward.
Responsibilities:
Lead Cloud Data Warehouse Project : Take charge of leading the Cloud data warehouse project through its next phase of development, ensuring its scalability, reliability, and performance meet the highest standards.
Ownership of Data Management : Assume ownership of all aspects of data management, serving as the go-to person for any data queries from the internal team. Your expertise will ensure seamless data operations and accessibility.
Support and Prioritise BAU Workloads : Provide support to the team and assist in prioritising Business as Usual (BAU) workloads, ensuring efficiency and alignment with organisational goals.
Setting Technical Direction : Define the technical direction of the systems and tools utilised by the team, particularly as we advance towards leveraging Machine Learning (ML) and Artificial Intelligence (AI) technologies.
Required Experience:
To excel in this role, you should have demonstrable experience with the following:
Snowflake : Proficiency in Snowflake, including its setup, configuration, and optimisation, is essential to drive the data platform forward.
DBT (Data Build Tool) : Solid understanding and experience with DBT for managing transformations and orchestrating data pipelines.
Python : Strong programming skills in Python for scripting, automation, and data manipulation tasks.
Beneficial Experience:
While not mandatory, familiarity with the following technologies and tools would be advantageous:
Dagster (or similar Orchestration Tools) : Experience with Dagster or other orchestration tools like Airflow for managing complex data workflows and pipelines.
Qlik Sense Cloud (or similar Reporting Tools) : Knowledge of Qlik Sense Cloud or similar reporting tools such as Tableau for generating insightful data visualizations and reports.
Fivetran (or similar Data Movement Platforms) : Understanding of Fivetran or alternative data movement platforms like AirByte for efficient and reliable data ingestion.
AWS : Familiarity with Amazon Web Services (AWS) cloud infrastructure and services.
CI/CD Pipelines : Experience in setting up Continuous Integration/Continuous Deployment (CI/CD) pipelines for automating software delivery processes.
Microsoft SSIS/SSRS : Proficiency in Microsoft SQL Server Integration Services (SSIS) and/or SQL Server Reporting Services (SSRS) for data integration and reporting tasks.
If you are looking for an opportunity to grow in to the Head of Data, then this is a role for you.