We are seeking a hands-on Senior Data Engineer contractor to join our Financial Crime Risk (FCR) Technology engineering team.
The role is focused on supporting, enhancing and evolving critical data platforms that underpin Financial Crime Risk capabilities including Transaction Monitoring and Screening solutions. You will contribute to the development, maintenance and operational support of enterprise-scale data pipelines that ingest, transform and manage data from multiple internal and external sources.
Working closely with technology, platform and business stakeholders, you will deliver reliable, scalable and high-quality data solutions while ensuring operational stability of production systems. This role requires a strong engineering mindset, a passion for solving complex data challenges and a commitment to maintaining resilient production platforms.
Key Responsibilities
· Support and enhance data engineering solutions that enable Financial Crime Risk technology platforms.
· Design, develop and maintain scalable and resilient data ingestion, transformation and reconciliation pipelines.
· Integrate data from multiple internal and external providers into existing FCR platforms and data stores.
· Transform and curate raw source data to align with target business and technical data models.
· Migrate and modernise existing data pipelines as enterprise ingestion and/or transformation frameworks, tooling and standards evolve.
· Develop and optimise complex SQL transformations and large-scale distributed data processing workloads.
· Implement robust data quality controls, validation frameworks, reconciliation processes and monitoring capabilities.
· Perform root cause analysis and troubleshoot complex data and platform issues across development, testing and production environments.
· Participate in production support activities, operational incident management and on-call support rotations.
· Improve platform reliability, observability and operational processes through automation and engineering best practices.
· Collaborate with data architects, platform engineers, business stakeholders and delivery teams to deliver high-quality outcomes.
· Contribute to source control, CI/CD pipelines, automated testing and release management practices.
· Promote engineering excellence through knowledge sharing, continuous improvement and technical leadership within the team.
Core Skills & Experience
· Data Engineering
o Strong hands-on experience developing enterprise-scale data engineering solutions.
o Advanced SQL development skills with experience processing and analysing large datasets.
o Strong Python development skills for data processing, automation and integration.
o Experience building and maintaining complex ETL and ELT pipelines.
o Strong understanding of data integration patterns and multi-source data processing.
o Experience working with structured, semi-structured and large-volume datasets.
o Strong understanding of data modelling principles and data access patterns.
· Cloud and Platform Technologies
o Experience working with AWS services, particularly: Amazon S3, Amazon RDS, EKS, EC2, lambda and IAM
o Experience developing and supporting cloud-based data platforms.
o Experience working with source control systems and modern software development practices.
· Data Quality and Operational Excellence
o Strong experience implementing data quality controls and validation frameworks.
o Experience designing reconciliation processes, control totals and load assurance mechanisms.
o Experience troubleshooting production issues and supporting critical business systems.
o Experience participating in operational support and incident management processes.
· Engineering Practices
o Experience with CI/CD pipelines and automated deployment practices.
o Experience working with Agile delivery methodologies.
o Strong stakeholder engagement and communication skills.
o Ability to balance delivery outcomes with operational stability and platform resilience.
Desirable Skills and Experience
· Experience with Apache Spark or distributed data processing frameworks.
· Experience with orchestration technologies such as:
o Apache Airflow
o Argo Workflows
o Control-M or equivalent
· Experience with AWS Glue.
· Experience using Trino or Presto.
· Experience working with containerised workloads and Kubernetes platforms, preferably AWS EKS.
· Experience modernising or migrating enterprise data pipelines to new ingestion, orchestration or cloud-based platforms.
· Experience with OpenSearch / Elasticsearch platforms.
· Experience working within banking, financial services or regulated environments.
· Exposure to Financial Crime Risk technologies and business processes.
· Exposure to Actimize, ActOne, Quantexa or similar financial crime platforms.