Product Design

10000+ Available Jobs for "lead data engineer python databricks"

MarkIT Placements

Senior Software Engineer Python

External
External

Job DescriptionMy client is looking for a Senior Software Engineer Backend LeaningContract may also be considered.What You Will Be DoingYou'll sit at the core of their product,...

DidcotAny

JP Morgan Chase

Python / Java Lead Software Engineer - (Cloud Data Platform — AWS/Databricks/Terraform)

External
External

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the...

The BoroughAny

NTT

QE AI Engineer (Python)

External
External

The team you'll be working with: As a QE AI Engineer, you will join a Quality Engineering team focused on modern software delivery, automation, and AI-enabled engineering across...

The BoroughAny

MarkIT Placements

Senior Software Engineer Python

External
External

Job Description My client is looking for a Senior Software Engineer Backend Leaning Contract may also be considered. What You Will Be Doing You'll sit at the core of their...

ChiltonAny

17918

Senior Software Engineer Python

External
External

My client is looking for a Senior Software Engineer Backend Leaning Contract may also be considered. What You Will Be Doing You'll sit at the core of their product, building the...

DidcotAny

Jobleads-UK

Senior Backend Engineer (Python)

External
External

About Nevis Nevis is building the world's first AI wealth management platform. We are building the system financial advisors will run on for the next decade. Our AI completes...

Greater LondonAny

Jobleads-UK

Senior Software Engineer (Python)

External
External

Darktrace is a global leader in AI-driven cybersecurity, helping organizations stay ahead of evolving threats every day. Darktrace was built on a genuinely differentiated idea:...

UnitedKingdomAny

Client Server

Backend Software Engineer Python Data R&D

External
External

Job DescriptionBackend Software Engineer / Developer (Python Data R&D) Cambridge onsite to £55kWould you like to work on Greenfield projects at the cutting edge of medical...

CambridgeAny

Jobleads-UK

Data Engineer III — Python & Databricks Pipelines

External
External

JPMorganChase's Investment Banking Data Products team is seeking a Software Engineer III to design and deliver reliable data collection, storage, and analytics solutions that are...

AuchentibberAny

Jobleads-UK

Senior Python Data Engineer - ETL/Big Data, Flexible

External
External

Solirius Reply, part of the Reply Group, is seeking an experienced Python Developer with significant data engineering experience to join a high-performing engineering team. You...

Greater LondonAny

17918

Backend Software Engineer Python Data R&D

External
External

Backend Software Engineer / Developer (Python Data R&D) Cambridge onsite to £55k Would you like to work on Greenfield projects at the cutting edge of medical technology? You could...

UnitedKingdomAny

Client Server

Backend Software Engineer Python R&D

External
External

Job DescriptionBackend Software Engineer / Developer (Python R&D) Cambridge to £65kAre you a backend focussed Software Engineer who enjoys problem solving and working on complex...

Church EndAny

Client Server

Senior Backend Software Engineer Python

External
External

Senior Backend Software Engineer / Developer (Python) London / WFH to 120kAre you a technologist with start-up experience looking for your next opportunity?You could be...

The BoroughWork From Home

Client Server

Backend Software Engineer Python R&D

External
External

Job DescriptionBackend Software Engineer / Developer (Python R&D) Cambridge to £65kAre you a backend focussed Software Engineer who enjoys problem solving and working on complex...

CambridgeAny

Jobleads-UK

Associate Backend Software Engineer (Python)

External
External

At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can...

ManchesterAny

External
MarkIT Placements

Senior Software Engineer Python

MarkIT Placements

AnyDidcot
Didcot
Any
Posted 19 days ago by MarkIT Placements

Job Description

Job Description

My client is looking for a Senior Software Engineer Backend LeaningContract may also be considered.What You Will Be DoingYou'll sit at the core of their product, building the systems that make advanced AI usable in the real world. If you enjoy owning backend services end to end, care deeply about reliability and API quality in a high-impact environment, this role offers both autonomy and real impact.Requirements Backend Architecture & APIs (Primary Focus) Design and evolve scalable backend services in Python using FastAPI for high-availability, high-throughput workloads.Build well-versioned RESTful APIs aligned to OpenAPI/Swagger, with strong conventions for consistency, idempotency, and backward compatibility.Implement authentication and authorization using OAuth2/OIDC, session management, and fine-grained permissions.Design and maintain event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations.Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale.Introduce caching, rate limiting, and queuing to meet performance budgets and latency goals.Integrate with AI pipelines and model-serving endpoints, including streaming responses, async inference jobs, and robust error/retry semantics.Palantir Foundry Integration Work with Palantir Foundry to build and maintain data pipelines, ontologies, and integrations that connect backend services to Foundry-based analytics and workflows.Leverage Foundry's APIs and tooling to support data modelling, transformation, and secure data exchange across the platform.Security & Reliability Write secure, well-tested code (unit, integration, end-to-end) and uphold coding standards through code reviews.Contribute to logging, metrics, and alerting (Prometheus/Grafana, ELK/OpenSearch) for the services you build.Support compliance readiness (ISO 27001, GDPR) through secure-by-default design.Cross-Functional & Process Collaborate closely with the engineering team, product and leadership to scope, sequence, and deliver outcomes.Translate product requirements into technical plans, breaking work into milestones with measurable success criteria.Mentor engineers on backend design and API ergonomics.Infrastructure Contributions (optional) Ship services via Docker containers with clean, minimal builds.Contribute to IaC (Terraform/CloudFormation) and CI/CD pipelines (GitHub Actions/Argo CD) alongside the DevOps team.Support cloud operations with sensible defaults, cost awareness, and environment promotion across dev/staging/prod.Required Skills & Experience SC Clearance or the ability to obtain SC (and later DV).5+ years of professional software engineering experience, with a strong focus on backend development in Python and with event-driven architectures.Proven experience designing and operating production REST APIs with OpenAPI/Swagger.Deep understanding of relational database design, indexing, performance tuning, and migrations (PostgreSQL).Proficiency with containerisation (Docker) and Git-based workflows.Experience with API versioning, security, documentation strategies, and automated testing.Strong problem-solving skills and the ability to work independently with high ownership.Soft Skills High-agency engineer who owns outcomes end to end.Pragmatic, research-driven approach with a bias to ship and iterate.Clear communicator who can talk to stakeholders of varying technical backgrounds.Comfortable defining SLAs, making trade-offs explicit, and operating production systems.Benefits include:Rapid career progression and personal growthFlexible working hoursOpportunity to shape the future of a fast-growing businessHybrid working modelCompany pension (NEST) with 4% employer contributionPrivate Healthcare29 days holiday + public holidaysTPBN1_UKTJ