Product Design

10000+ Available Jobs for "Lead Data Engineer - Python, Databricks"

Kainos

Lead Data Engineer

External
External

Join Kainos and Shape the Future At Kainos, we’re problem solvers, innovators, and collaborators - driven by a shared mission to create real impact. Whether we’re transforming...

The BoroughAny

William Alexander

Data Governance Consultant - Databricks, Microsoft Purview & Enterprise Data Platforms

External
External

Job DescriptionData Governance Consultant - Databricks, Microsoft Purview & Enterprise Data Platforms Our client, a leading London Market insurer, is seeking an experienced Data...

LondonAny

Hackajob Ltd

Lead Data Engineer

External
External

Job Descriptionhackajob is partnering directly with Kainos to hire for this role.Join Kainos and Shape the FutureAt Kainos, we're problem solvers, innovators, and collaborators -...

Westminster AbbeyAny

Jobleads-UK

Databricks Platform Engineer — Hybrid London (FinOps & Security)

External
External

Sagacity is seeking a Data Platform Engineer to design, build and operate the Databricks Lakehouse platform powering client analytics, predictive modelling, and AI work. You will...

Greater LondonAny

17918

Lead Data Engineer

External
External

Lead Data Engineer - Up to 85K + Hybrid (2 days in office), 15% Pension, Private Healthcare + Microsoft Certifications - Leeds Central We are looking for a highly motivated and...

LeedsAny

Jobleads-UK

Senior Data Engineer: Azure Databricks Platform Lead

External
External

Talensa, partnered with a specialist B2B Financial Services tech platform, is seeking a Senior / Data Engineer to own an Azure Databricks-based data platform and BI layer. You...

Greater LondonWork From Home

17918

Data Engineer

External
External

Data Engineer 6 Month Contract Location: Home / Malvern (onsite 3 days a week) Rate: £550 - £600 per day (Inside IR35) Skills: SC Clearance, Python, SQL, Databricks, AWS, Data...

WellsAny

Talensa

Senior Data Engineer: Azure Databricks Platform Lead

External
External

Talensa, partnered with a specialist B2B Financial Services tech platform, is seeking a Senior / Data Engineer to own an Azure Databricks-based data platform and BI layer. You...

South East EnglandAny

NTT

Databricks Solution Architect

External
External

Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making...

The BoroughAny

WNS Global Services

Lead Data Engineer

External
External

Company DescriptionWNS (Holdings) Limited (NYSE: WNS), is a leading Business Process Management (BPM) company. We combine our deep industry knowledge with technology and analytics...

The BoroughAny

BSI Group

Databricks Platform Manager - ML Ops

External
External

We exist to create positive change for people and the planet. Join us and make a difference too!Job Title: Databricks Platform Manager - ML OpsLocation: London/Milton Keynes /...

Milton KeynesWork From Home

Tenth Revolution Group

Data Engineer

External
External

Job DescriptionData EngineerUp to £60,000We are working with an organisation that is going through an exciting period of growth and continued investment across its technology and...

CoventryAny

Infosys Technologies

Senior Technology Architect_ Databricks

External
External

Job DescriptionRole –Senior Databricks ArchitectTechnology – Databricks (Spark, PySpark/SQL) and data lake architecturesLocation – London, UKCompensation – Competitive (including...

Frank Whipple EstateAny

The Nippon Telegraph And Telephone Corporation (NTT)

Databricks Solution Architect

External
External

Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making...

WhitehallAny

Hackajob Ltd

Software Engineer III - Cloud Data Platform (AWS/Databricks, Terraform)

External
External

Job Descriptionhackajob is partnering directly with JPMorganChase to hire for this role.JOB DESCRIPTIONYour expertise in cloud infrastructure and data platforms can shape how an...

GlasgowAny

External
Kainos

Lead Data Engineer

Kainos

AnyThe Borough
The Borough
Any
Posted 7 days ago by Kainos

Job Description

Join Kainos and Shape the Future At Kainos, we’re problem solvers, innovators, and collaborators - driven by a shared mission to create real impact. Whether we’re transforming digital services for millions, delivering cutting-edge Workday solutions, or pushing the boundaries of technology, we do it together.We believe in a people-first culture, where your ideas are valued, your growth is supported, and your contributions truly make a difference. Here, you’ll be part of a diverse, ambitious team that celebrates creativity and collaboration.Ready to make your mark? Join us and be part of something bigger.As a Lead Data Engineer (Consultant) at Kainos you will be responsible for designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in agile teams, Lead Data Engineers provide strong development leadership for team members and take responsibility for the quality of the codebase as well as the match to user needs.Your responsibilities will include:Taking responsibility for the development of whole components or subsystems within a team. Development incorporates design, code, test and defect resolution.Focusing on hands-on design and development, using open source and commercial platforms.Defining and enforcing development best practice and coaching team members to ensure consistency.Working with project architects, taking responsibility for non-functional needs of ETL/ELT data processing pipelines such as robustness and performance.Taking responsibility for standards and execution of unit and integration testing done within the team.Taking responsibility for software product due diligence and integration.Leading troubleshooting and tuning of activities.Working with Operations teams to ensure the application software is operationally ready.Working with Security Architects and accreditors to ensure compliance with relevant legal and security requirementsAdvising customers and managers and other team members of the estimated effort and technical implications of user stories and user journeys.Contributing to technical proposals as part of the sales process.Managing, coaching and developing a small number of staff, with a focus on managing employee performance and assisting in their career development. You’ll also provide direction for your team as you solve problems togetherMinimum (essential) requirements:Experience of leading a team of engineers in the implementation of data-intensive system componentsExperience of applying standards for design (patterns), development, (style guides) and operational readiness (automation, deployment)Proficient software development experience in one of Java, Scala, or PythonSoftware development experience with data-processing platforms from vendors including Informatica,Azure Databricks or any relevant ETL toolsExpert in SQL or SQL extensions for analytical use caseExpert understanding of distributed data stores and data processing frameworksAbility to simply and clearly communicate technical design both written and verballyProficient in designing analytical and operational data modelsA keen interest in AI technologiesDesirable:Comfortable with Data Warehouse methods and techniquesActively shares their thoughts and views on data practicesAWS/Azure/GCP Certified in Data Services Expertise in continuous improvement and sharing input on data best practiceParticipation in development and/or technology communitiesPractical experience with AI technologies, tools, processes and deliveryWho you are:Our vision is to enable outstanding people to create digital solutions that have a positive impact on people’s lives. Our values aren't abstract; they are the behaviours we expect from each other every day, and underpin everything that we do. We expect everyone to display our values by being determined in how obstacles are overcome; honest when dealing with others; respectful of how you treat others; creative to find solutions to complex problems and cooperative by sharing information, knowledge and experience. These values, applied collectively, help to produce an outstanding Kainos person, team and culture. About usKainos is a high-growth IT services company providing digital technology solutions and agile software development to enterprise customers. Across our 30-year history, we have worked on transformational projects across government, NHS and a myriad of private sector clients.  Embracing our differences   At Kainos, we believe in the power of diversity, equity and inclusion. We are committed to building a team that is as diverse as the world we live in, where everyone is valued, respected, and given an equal chance to thrive.   We actively seek out talented people from all backgrounds, regardless of age, race, ethnicity, gender, sexual orientation, religion, disability, or any other characteristic that makes them who they are.   We also believe every candidate deserves a level playing field.  Our friendly talent acquisition team is here to support you every step of the way, so if you require any accommodations or adjustments, we encourage you to reach out.  We understand that everyone's journey is different, and by having a private conversation we can ensure that our recruitment process is tailored to your needs.Job SummaryJob number: JR_15870Date posted : 2025-12-19Profession: Data & Artificial IntelligenceEmployment type: Full time