Data Engineer
London Area, United Kingdom
Contract Data Engineer:
Fintech | AWS | Airflow | Glu
This dynamic FinTech are looking to add to their already strong DataOps team. As a Data Engineer, you will be working closely with devOps and analytics teams building out and supporting the Data Warehouse (Redshift, migrating to Snowflake), core data pipelines, and supporting our data infrastructure, and analytics capabilities. The role will also have DBA responsibilities for databases across our estate on Aurora MySQL, RDS MySQL, PostgreSQL, MSSQL.
You will be responsible for (not limited to):
Contributing to the data architecture, and evolution of our Data technology stack
Working and communicating effectively with other data engineers, DevOps engineers, data modellers, data scientists and analysts
Designing and building new data pipelines as well as maintenance and support of existing data pipelines
Administration and monitoring of their Data Warehouse, and other key data infrastructure
DBA activities for Production and non-production databases (RDS, MySQL, PostgreSQL, Aurora), including management of access, database, monitoring and platform
Working incidents in a timely fashion and dealing with ad-hoc requests
About You
We’re looking for an experienced Data Engineer with excellent knowledge of Snowflake, AWS, Python, and Apache Airflow who is ready to lead by example and is used to rolling up their sleeves to get things done.
The successful candidate must have the right to work in the UK and meet the following criteria:
Required Skills & Experience:
Working experience of core AWS services (S3, EC2, VPC, RDS, Lambda)
Expert knowledge of AWS Redshift, Snowflake Cloud Data warehouse (Both preferable)
Experience in designing and implementing data warehouses, data marts or data lakes
Data-modelling techniques (Relational, 3NF and dimensional modelling, Kimball, DV 2.0 etc.)
Strong experience in building robust and scalable ELT/ETL data pipelines
Proficient coding in - python, Apache Spark and expert knowledge of SQL and good experience with shell-scripting languages
Working knowledge of orchestration tools, e.g. Apache Airflow
Experience of ETL/ELT tooling – for example Pentaho, AWS Glue, DBT, airflow etc.
GIT and experience in building CI/CD pipelines
DBA Experience in AWS cloud environment managing AWS Aurora, and Amazon RDS (MySQL, Postgres, MSSQL)
Desired:
Experience of financial services or consumer finance
IaaC such as Terraform or AWS CloudFormation
Knowledge of visualization tools, e.g. Tableau, Looker, Power BI, AWS QuickSight
Exposure to streaming: Apache Kafka, AWS MSK
Docker
Understanding of SCRUM and Agile principles and collaboration tools like JIRA software and Confluence.
What's in it for you?
The chance to make a real impact in a growing business on a mission to change the face of the consumer finance industry forever.
A flat and collaborative team structure fuelled by an exciting mix of people welcoming both experienced people from the industry with both feet on the ground and tech-savvy dreamers who pave way for the new stuff. Come as you are and be yourself.
A unique opportunity to carve out your own dream job by simply making things happen at a pivotal time when the company´s future is being shaped. We look for the brightest and smartest who tell us what to do.
Flexible working locations including remote and at our We Work Office
Free tea and coffee, beer, and prosecco at our We Work office