Senior Data Engineer
London Area, United Kingdom
Data Engineer
Embark on a Rewarding Journey with MIKI Travel: Where Your Career Takes Flight. At MIKI Travel, our 55+ years of expertise make us a trailblazing wholesale travel provider, curating unforgettable global adventures. As a premier private travel company with a presence in 36 offices, we invite you to be part of our legacy of excellence. Immerse yourself in crafting tailor-made tours, group excursions, and ground services that redefine travel experiences. Join our dynamic team driven by a commitment to innovation, customer satisfaction, and lasting partnerships. Fuel your career with opportunities for growth, powered by values of quality, innovation, and commitment that shape the Miki way.
Job Purpose
As a Data Engineer you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to enable efficient data ingestion, processing, storage, and analysis. The ideal candidate will have a strong background in data engineering, including expertise in building and optimizing ETL processes, data warehousing, and working with big data technologies.
Main Responsibilities
● Collaborate with business stakeholders to gather and analyse business requirements,
translating them into specific data needs.
● Work closely with application developers to explore data opportunities and ensure
seamless integration of data pipelines with existing systems and applications.
● Lead end-to-end processes following the CRISP-DM process model to deliver high-
quality datasets and their applications.
● Design and implement robust ETL/ELT pipelines from a variety of data sources,
including RDBMS, texts, spreadsheets, and API endpoints, into the data warehouse.
● Utilise workflow management tools to build, test, deploy, and maintain scheduled
jobs, ensuring timely data delivery.
● Support data analysts in utilising datasets for insights and visualisations, leveraging
BI tools.
● Respond to requests and queries from the business on the support ticket platform.
● Conduct reviews of existing code, processes, and datasets to optimise resources and
improve data quality.
● Stay updated with the latest technologies, tools, and best practices in data
engineering to enhance the business value of data assets.
Relevant skills / Characteristics
Technical skills
● Advanced proficiency in SQL for data querying and transformation.
● Programming skills in Python, including experience with basic libraries like os, csv,
and pandas.
● Experience with Apache Airflow for workflow management.
● Experience with enterprise DBMS (e.g., DB2, MS SQL Server) and cloud data warehouses, particularly Google BigQuery.
● Proficiency in Google Cloud Platform services, such as IAM, Cloud Storage, Cloud Functions, Cloud Scheduler, Cloud Run, Cloud SQLand Cloud Monitoring.
● Basic bash scripting for Linux server interaction.
● Familiarity with Git for version control.
● Experience with BI tools such as Tableau (Desktop/Server/Cloud), Looker Studio, and
Power BI for data visualisation and reporting.
● Experience in Azure DevOps and Data Factory is a plus.
● Experience with Docker and Kubernetes for creating portable and scalable
environments is a plus.
● Experience with ETL tools like Pentaho Data Integration is a plus.
Soft skills
● Analytical thinking with a keen attention to detail and a problem-solving mindset.
● Excellent communication skills, both verbal and written.
● Independent worker with a willingness to take ownership.
● Ability to manage multiple priorities and tasks efficiently.
● Eager to support and uplift IT and business team members.
Required experience / knowledge
● Degree in Computer Science or a related field (or equivalent professional experience or certifications).
● 3-5 years of experience in data engineering or a related role.
● Previous work experience in the travel and hospitality industry is a plus.