10000+ Available Jobs for "Senior Data Engineer, Python, Spark"

17918

Senior Software Engineer Python

External
External

My client is looking for a Senior Software Engineer Backend Leaning Contract may also be considered. What You Will Be Doing You'll sit at the core of their product, building the...

UnitedKingdomWork From Home

MarkIT Placements

Senior Software Engineer Python

External
External

Job Description My client is looking for a Senior Software Engineer Backend Leaning Contract may also be considered. What You Will Be Doing You'll sit at the core of their...

ChiltonAny

Jobleads-UK

Senior Backend Engineer (Python)

External
External

About Nevis Nevis is building the world's first AI wealth management platform. We are building the system financial advisors will run on for the next decade. Our AI completes...

Greater LondonAny

Jobleads-UK

Senior Python Data Engineer - ETL/Big Data, Flexible

External
External

Solirius Reply, part of the Reply Group, is seeking an experienced Python Developer with significant data engineering experience to join a high-performing engineering team. You...

Greater LondonAny

Jobleads-UK

Specialist Software Engineer (Python)

External
External

Specialist Software Engineer Cambridge, UK | HybridJoin a cutting-edge R&D team developing next-generation cybersecurity technology designed to tackle sophisticated, real-world...

CambridgeAny

17918

Senior Backend Software Engineer Python

External
External

Senior Backend Software Engineer / Developer (Python) London / WFH to £120k Are you a technologist with start-up experience looking for your next opportunity? You could be...

ClerkenwellWork From Home

Jobleads-UK

Senior Data Engineer — Snowflake, Python & Dashboards

External
External

PJT Partners ищет опытного инженера данных для руководства архитектурой Snowflake в Лондоне. Ваша задача — спроектировать схемы, RBAC и пайплайны на Python, интеграции через API и...

Greater LondonAny

Senior Data Engineer - Python, Airflow, Pyspark, SQL

Senior Data Engineer - Python, SQL, Airflow, Azure, Pyspark, KubernetesSalary: Up to £72,000 per annum Benefits: Excellent benefits package including annual bonus, free onsite...

HeathfieldFull Time

Jobleads-UK

Python Data Engineer - ETL & Spark | SC/DV Clearance

External
External

Jobtailor is seeking a data-focused Python engineer to design, build, and maintain high-quality data processing solutions in a secure environment. You will develop scalable...

Greater LondonAny

Client Server

Backend Software Engineer Python Data R&D

External
External

Job DescriptionBackend Software Engineer / Developer (Python Data R&D) Cambridge onsite to £55kWould you like to work on Greenfield projects at the cutting edge of medical...

CambridgeAny

Jobleads-UK

Senior Data Engineer - End-to-End ETL (Python/SQL) Remote UK

External
External

Principle HR is seeking a senior data engineer to own end-to-end data infrastructure for a global tech company. You will design and scale ETL pipelines and data models that...

Greater LondonWork From Home

Jobleads-UK

Senior Python Data Platform Engineer for Finance Data Lakes

External
External

Enfint, a hedge fund building a modern medallion architecture data platform, seeks a senior backend engineer to design and develop data platform components with Python in our...

Greater LondonAny

Client Server

Backend Software Engineer Python R&D

External
External

Job DescriptionBackend Software Engineer / Developer (Python R&D) Cambridge to £65kAre you a backend focussed Software Engineer who enjoys problem solving and working on complex...

Church EndAny

Jobleads-UK

Senior Lead Data Platform Engineer - Java/Python

External
External

JPMorgan Chase & Co. in London seeks a Senior Lead Software Engineer to design, build, and enhance data engineering solutions within the Data Platform & Strategy team of Corporate...

Greater LondonAny

Jobleads-UK

Associate Backend Software Engineer (Python)

External
External

At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can...

ManchesterAny

External

Senior Software Engineer Python

17918

Work From HomeUnitedKingdom
UnitedKingdom
Work From Home
Posted 3 days ago by 17918

Job Description

My client is looking for a Senior Software Engineer Backend Leaning Contract may also be considered. What You Will Be Doing You'll sit at the core of their product, building the systems that make advanced AI usable in the real world. If you enjoy owning backend services end to end, care deeply about reliability and API quality in a high-impact environment, this role offers both autonomy and real impact. Requirements Backend Architecture & APIs (Primary Focus) Design and evolve scalable backend services in Python using FastAPI for high-availability, high-throughput workloads. Build well-versioned RESTful APIs aligned to OpenAPI/Swagger, with strong conventions for consistency, idempotency, and backward compatibility. Implement authentication and authorization using OAuth2/OIDC, session management, and fine-grained permissions. Design and maintain event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. Introduce caching, rate limiting, and queuing to meet performance budgets and latency goals. Integrate with AI pipelines and model-serving endpoints, including streaming responses, async inference jobs, and robust error/retry semantics. Palantir Foundry Integration Work with Palantir Foundry to build and maintain data pipelines, ontologies, and integrations that connect backend services to Foundry-based analytics and workflows. Leverage Foundry's APIs and tooling to support data modelling, transformation, and secure data exchange across the platform. Security & Reliability Write secure, well-tested code (unit, integration, end-to-end) and uphold coding standards through code reviews. Contribute to logging, metrics, and alerting (Prometheus/Grafana, ELK/OpenSearch) for the services you build. Support compliance readiness (ISO 27001, GDPR) through secure-by-default design. Cross-Functional & Process Collaborate closely with the engineering team, product and leadership to scope, sequence, and deliver outcomes. Translate product requirements into technical plans, breaking work into milestones with measurable success criteria. Mentor engineers on backend design and API ergonomics. Infrastructure Contributions (optional) Ship services via Docker containers with clean, minimal builds. Contribute to IaC (Terraform/CloudFormation) and CI/CD pipelines (GitHub Actions/Argo CD) alongside the DevOps team. Support cloud operations with sensible defaults, cost awareness, and environment promotion across dev/staging/prod. Required Skills & Experience SC Clearance or the ability to obtain SC (and later DV). 5+ years of professional software engineering experience, with a strong focus on backend development in Python and with event-driven architectures. Proven experience designing and operating production REST APIs with OpenAPI/Swagger. Deep understanding of relational database design, indexing, performance tuning, and migrations (PostgreSQL). Proficiency with containerisation (Docker) and Git-based workflows. Experience with API versioning, security, documentation strategies, and automated testing. Strong problem-solving skills and the ability to work independently with high ownership. Soft Skills High-agency engineer who owns outcomes end to end. Pragmatic, research-driven approach with a bias to ship and iterate. Clear communicator who can talk to stakeholders of varying technical backgrounds. Comfortable defining SLAs, making trade-offs explicit, and operating production systems. Benefits include: Rapid career progression and personal growth Flexible working hours Opportunity to shape the future of a fast-growing business Hybrid working model Company pension (NEST) with 4% employer contribution Private Healthcare 29 days holiday + public holidays TPBN1_UKTJ