Senior Data Engineer
united kingdom
Are you passionate about leveraging data to drive meaningful impact? Do you thrive in a collaborative environment, eager to tackle complex challenges alongside talented teams? If so, we have an exciting opportunity for you!
As a Senior Data Engineer at CleeAI, you'll be at the forefront of transforming raw data into actionable insights that power our decision-making processes and enhance user experiences. Collaborating closely with Software Engineers, Data Scientists, and Product Managers, you'll play a pivotal role in optimizing growth strategies and refining our products for our extensive user base.
In this role, you'll have the chance to work with cutting-edge technologies and methodologies, all while contributing to a culture of innovation and excellence. Whether it's architecting robust data pipelines, optimizing data storage and retrieval systems, or implementing scalable solutions, your expertise will directly impact our company's success and our users' satisfaction.
Join us as we embark on this thrilling journey of discovery and innovation. Together, we'll push the boundaries of what's possible with data engineering, shaping the future of AI
Responsibilities:
Productionising and scaling Neo4j / graph databases / deep learning on knowledge graphs
Productionising open source LLMs
AWS Infrastructure - S3, SQS, ECS, RDS, Terraform and containerisation
Develop and maintain ETL pipeline infrastructure ideally with SQS / similar queueing communication mechanisms
Hardcore ETL especially with unstructured text
Productionising NLP models such as Hugging Face and spacy
Scraping infrastructure and execution
Requirements:
Bachelor's or Master's degree in Mathematics, Computer Science, Engineering, or a related field.
5 Years+ working as a data engineer ideally in a senior capacity
Strong experience of Python
Deep knowledge of NLP such as hugging face and spacy
AWS - ETL Processes (Glue, Lambda etc.), ECS, S3, Database Solutions (Redshift, RDS)
Vector Databases a big plus
Familiar with Graph Data Structure and Algorithms
Benefits:
Competitive salary and benefits package, including health insurance, life insurance, enhanced employers pension contribution after probation.
Opportunities for professional development and career advancement.
A collaborative and inclusive work environment that values diversity and creativity.
Exciting projects and challenges that make a real impact on our business and industry.