Back External
External

Lead Data Engineer

Lorien Resourcing

AnyThe Borough
Any
Posted by Lorien Resourcing

Job Description

Sector: Software EngineeringReference: BBBH175804_1788884005 Lead Data Engineer - Must be DV Clearable - 5 days a week on-site Hands‑on technical leadership building data systems that actually workWe're looking for a Lead Data Engineer to join an enterprise data engineering capability and play a critical role in designing, building, and improving real‑world data systems.This is not a line‑management role. Instead, it's a senior, hands‑on technical leadership position for someone with deep data engineering experience who leads through delivery, judgement, and technical credibility rather than hierarchy.You'll work in a complex environment spanning legacy platforms, modern cloud services, and evolving data needs. The challenge isn't greenfield design - it's improving what exists, fixing what's broken, and helping teams use data more effectively and responsibly. This role suits someone who enjoys rolling up their sleeves, tackling difficult problems, and seeing things through end‑to‑end. What you'll be doing You'll act as a senior technical anchor for data engineering work, contributing directly while guiding others through example.You will:Design, build, and enhance enterprise‑scale data pipelines, platforms, and data servicesLead complex data engineering work end‑to‑end - from problem definition and exploration through build, testing, and operational useWork directly with technical and non‑technical stakeholders to translate real operational problems into effective data solutionsAnalyse and synthesise complex datasets from multiple sources, shaping how data is structured, validated, and consumedProvide technical leadership and direction to data engineers and adjacent roles through design decisions, code, and delivery supportImprove data sharing, onboarding of new data sources, and interoperability across teams and systemsIntroduce and evaluate new tools, patterns, and technologies where they genuinely add value - balancing innovation with pragmatismBuild robust, production‑grade solutions, not proofs of conceptTreat metadata, lineage, and data quality as first‑class engineering problemsDiagnose and resolve complex data and platform issues, often in constrained or imperfect environmentsContribute to an inclusive, supportive engineering culture with high technical standards What we're looking for This role is for a genuine practitioner who enjoys doing the work and raising standards around them.Essential experience:Significant, hands‑on experience as a Senior or Lead Data Engineer working on complex, real‑world systemsStrong Python and Spark skills, with evidence of building and maintaining production data pipelinesDeep understanding of the full data engineering lifecycle: ingestion, transformation, storage, serving, and reuseStrong experience designing data integrations, including working with diverse data sources and legacy systemsProven ability to design and apply data models that support analysis, operational use, and long‑term maintainabilitySolid understanding of data security, compliance, and governance, built into systems by designExperience working within established data development practices (version control, testing, deployment, change management)Ability to communicate clearly between highly technical teams and non‑technical stakeholdersPersistence and resilience when dealing with messy data, legacy constraints, and organisational complexity Desirable experience Experience with cloud‑based data ecosystems (including AWS services) alongside existing legacy platformsExposure to large‑scale enterprise data or analytics platformsRotating across teams or problem domains, adapting to different delivery contextsFamiliarity with emerging or advanced data engineering approaches (including agentic or autonomous patterns), though this is not essentialIf you enjoy solving hard data problems, working closely with people, and delivering practical solutions in imperfect environments, this role offers both challenge and impact. If interested, apply now!Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy.