Location-Basildon, UK -5 days from Office

JD:

Mandatory Skills :

AWS Lambda, Datalake house Architecture, ETL Concepts

Overview

• We are seeking a talented and experienced to join the Data Solutions domain in EMEA In this role you will design build


• Data Lakehouse Engineer and optimize scalable Lakehouse and data platform solutions that enable data driven decision-making across the organization.


• You will collaborate closely with cross functional teams to create resilient ingestion and transformation pipelines while ensuring reliability performance and highquality data across the ecosystem

Key Responsibilities

• Contribute to the design and implementation of Lakehouse integration architectures including data flows process flows and ELT/ETL patterns


• Build optimize and maintain scalable data pipelines for ingestion processing and storage across data lake and Lakehouse layers


• Implement and uphold data governance security lineage and compliance best practices throughout the data lifecycle


• Monitor troubleshoot and finetune data workflows compute jobs and storage layers to ensure high performance and reliability


• Provide production support ensuring robust system observability with proactive detection and resolution of issues


• Collaborate with platform analytics and engineering teams to ensure efficient data modeling table design and storage optimization eg Iceberg Delta patterns

Technical Qualifications

• 7 years of experience in a data engineering or similar role within a fast paced enterprise scale environment


• Bachelors or Masters degree in Computer Science Data Engineering or a related technical field


• Strong Proficiency in SQL and Data Integration Platforms such as IBM Streamsets or Informatica with thorough understanding of data transformation and orchestration processes


• Extensive Experience with AWS services including IAM Lambda EKS S3 Data Lake EMR PySpark MWAA and Lakehouse technologies, Apache Iceberg


• Proven expertise with Snowflake including performance tuning and efficient query design Experience with batch pipelines eg StreamSets and streaming technologies eg Kafka

Nice to have

• Data Transformation Frameworks such as DBT


• Experience with both batch StreamSets and streaming Kafka data solutions


• Familiarity with data modelling concepts Inmon Kimball Data Vault etc


• Exposure to CICD or Infrastructure a scode Terraform or any other is a plus


• Application Performance Monitoring Framework experience is a plus


• Knowledge of data quality and security best practices is advantageous


• Ability to understand complex architecture solutions and make sound estimates for the implementation

Non Technical Skills

• Strong attention to detail with a proactive approach to identifying and resolving problems


• A genuine interest in emerging data technologies and a curiosity about continuous improvements


• Excellent verbal and written communication skills


• Attention to detail mindset proactively identify problems evaluate solutions


• Comfort working in an AI empowered automation driven environment

Skills

Mandatory Skills :

AWS Lambda, Data lakehouse Architecture, ETL Concepts