Senior Data Engineer reference: R0072433

Join us, be part of more. We’re so much more than an energy company. We’re a family of brands revolutionising how we power the planet. We're energisers. One team of 21,000 colleagues that's energising a greener, fairer future by creating an energy system that doesn’t rely on fossil fuels, whilst living our powerful commitment to igniting positive change in our communities. Here, you can find more purpose, more passion, and more potential. That why working here is #MoreThanACareer. We do energy differently - we do it all. We make it, store it, move it, sell it, and mend it.  An opportunity to play your part – We are seeking a highly skilled Senior Data Engineer to join our dynamic DTS team at Centrica. In this role, you will collaborate closely with our platform and architecture teams to design, develop, implement, and support an operational framework that facilitates the productionisation of large-scale data transformation jobs and pipelines within a big data environment. Your responsibilities will include designing, building, documenting, deploying, and managing data structures, data transformation pipelines, and data transformation jobs. Additionally, you will play a crucial role in supporting and mentoring junior team members, fostering their growth and development. Location: UK, Windsor (talk to us about flexible working) The day to day: Design, develop, own, and improve the framework and toolset used to implement, operate, and document data transformation jobs in our big data environment. Establish, implement, and support automation frameworks that enable continuous integration, deployment, and monitoring of our data transformation jobs. Drive the implementation of development tools, processes, and best practices across the team. Collaborate with our platform and architecture teams to establish best practices and the most efficient methods of operating data transformation jobs in our big data environment. Build, maintain, and support data engineering jobs and pipelines that source data from our business systems and processes, transform, and publish it in alignment with our logical and physical data models. Support the productionisation of data transformation jobs and pipelines, ensuring robust unit, integration, and regression testing, as well as providing support to our operational teams around the jobs running in production. Support and mentor our Data Engineers as they analyse data to build robust, scalable, and secure data transformation jobs. Assist the consumers of curated data across our business, ensuring they have accurate documentation and a thorough understanding of the data they consume. Interact with various business stakeholders to understand the data landscape and requirements of the wider business. About You Advanced skills in writing complex, optimised queries and managing large-scale data transformations. Strong experience in Python, particularly for data wrangling, orchestration, and automation. Expertise in frameworks like Apache Spark, with proven experience in performance tuning and efficient data pipeline development. Hands-on experience with Microsoft HDInsight or equivalent Hadoop/Spark cloud-based services. Proficient in building and orchestrating scalable notebooks and jobs within a collaborative environment. Deep understanding of dbt for transforming, testing, and documenting data within a modern data stack. Deep understanding of data modelling principles, with experience in normalizing complex data structures to ensure data integrity, reduce redundancy, and optimise query performance across enterprise datasets. Experience in developing robust and reusable transformation frameworks that enforce data governance, consistency, and maintainability. Good working knowledge of continuous integration/continuous deployment processes, version control systems (e.g., Git), and deployment pipelines for data infrastructure. Familiarity with data lake and data warehouse architectures, with experience ingesting and transforming data from various structured and unstructured sources. Event-Driven Architectures: Knowledge of event-driven architectures and pub/sub patterns (e.g., Kafka, Event Hubs) is a plus. Experience in customer data platforms or customer information platforms (CIP) is highly desirable. What's in it for you? Enjoy a generous market salary, along with fantastic growth opportunities and a vibrant work environment! Added Car Allowance program to make your commute and adventures even better. Power up your pay with a 15% Employee Energy Allowance, surpassing the government's price cap! Secure your future with our comprehensive pension plan, designed for peace of mind. Elevate your health with our fully-funded company healthcare plan, prioritizing your well-being. Recharge with a generous 25-day holiday allowance, plus public holidays, and even purchase up to 5 extra days for extended relaxation! Experience unparalleled work-life balance with an exceptional selection of flexible benefits, from tech treats and eco-friendly car leases to travel insurance for your adventures! Why should you apply?     We’re not a perfect place – but we’re a people place. Our priority is supporting all of the different realities our people face. Life is about so much more than work. We get it. That why we’ve designed our total rewards to give you the flexibility to choose what you need, when you need it, making sure that you and your family are supported not only financially, but physically and emotionally too. Visit the link below to discover why we’re a great place to work and what being part of more means for you.    https://www.morethanacareer.energy/centrica   If you're full of energy, fired up about sustainability, and ready to craft not only a better tomorrow, but a better you, then come and find your purpose in a team where your voice matters, your growth is non-negotiable, and your ambitions are our priority. Help us, help you. We would love for you to share any information about yourself throughout our recruitment process so that we can better understand you and help shape your journey. We’re a family of brands revolutionising how we power the planet. When it comes to energy, no one does it like us. We make it, store it, move it, sell it and mend it. We’re made up of 12 different businesses, but united by our purpose as Centrica. We’re energisers. Our journey to a greener, fairer future is powered by individuals like you. Through innovative green products, intelligent energy solutions and developing smarter ways to use and save energy, we’re not just part of the energy transition, we’re leading it. Our commitment goes beyond sustainability. Together we’re bringing our collective energies to create positive change in our local communities. If you immerse yourself in our fight to change tomorrow, you might just find your why. We’re looking for people to add to our culture – not fit in with it. We're building a community where you can be unapologetically you, where differences are celebrated, and where everyone can belong. Real inclusivity also means supporting the different realities our people face. That why we have the UK best Carers Policy and are continually building our approach to flexibility and wellbeing. Of course, we love having fun too. We’re a people place after all.