Data Engineer (Big Data & AWS Cloud)

About the Role

We seek a skilled Data Engineer to join the Legal and Corporate Technology team. You will shape how enterprise data is engineered, governed and activated to deliver value across customer, risk and operational domains.

We seek a Data Engineer with hands-on experience in Hadoop, Python, PySpark, ETL, Big Data technologies, and the AWS Cloud stack. You will combine technical expertise with delivery ownership, working with product and service owners and business stakeholders to translate complex requirements into scalable, reliable data products.

You will also shape how Agentic AI and Generative AI are adopted to improve engineering productivity and quality across the data lifecycle. This role pairs hands-on data engineering with AI adoption strategies (including Claude Code) to deliver scalable, secure and resilient data solutions that generate measurable business value.

About You

You are passionate about cutting-edge technology and want to join a data engineering team that encourages innovation and supports growth. You bring strong technical expertise, a product mindset and a clear desire to learn.

You take ownership of assigned initiatives, deliver on time and manage technical and business expectations when timelines slip or issues arise.

Your Key Responsibilities Include

• Design, build, and support cloud native, event driven data platforms and APIs

• Develop and operate scalable data pipelines and storage solutions on AWS

• Build high quality, secure, and maintainable code with strong performance and reliability

• Optimise data pipelines, queries, and algorithms for scalability and cost efficiency

• Produce and review technical designs, documentation, and operational runbooks

• Apply responsible AI, privacy, and data governance controls in regulated environments

• Collaborate with delivery, product, architecture, security, and platform teams

• Participate in code reviews, uplift engineering standards, and mentor others

• Contribute to the strategic evolution of the data platform and engineering practices

What Do You Need to Succeed in the Role

• Experience with technologies such as Python, SQL, Scala, AWS S3, Glue, Redshift, DBT and Git

• Hands-on experience with DevOps pipelines, particularly Jenkins and CI/CD practices

• Strong experience designing and implementing data lakes, data warehouses, and lakehouse architecture on AWS

• Experience with DevOps pipelines, particularly Jenkins, GitHub Actions and CI/CD

• Expert-level understanding of data modelling, data warehousing, and Big Data concepts

• Strong understanding of security, governance, and compliance requirements within regulated environments

• Experience working with Agile delivery methodologies and tools such as Jira and Confluence

• Experience integrating AI capabilities into enterprise cloud platforms while ensuring performance, resilience, security, and cost optimisation