Senior Data Engineer

The Company

Nigel Wright Tech are delighted to be partnering with a leading financial services business in the North East as they look to hire a Senior Data Engineer. 

The Role

Key Responsibilities include: 

• Data Migration Planning: You’ll collaborate with stakeholders to understand the big picture and develop detailed, strategic data migration plans. You’ll take charge of migrating data from M&A into our proprietary Gateway SQL database.
• Data Mapping & Transformation: Designing and implementing data mapping and transformation processes will be a major part of your role as you move data from legacy systems to modern platforms.
• ETL (Extract, Transform, Load) Processes: You’ll build and optimise ETL scripts and tools to ensure seamless data flow—extracting from the source, transforming to meet business needs, and loading it into target systems.
• Data Quality Assurance: Accuracy is key. You’ll perform validation checks to ensure that all data is correct and complete throughout the migration.
• Troubleshooting: Got a knack for problem-solving? You’ll identify and fix issues like data corruption or system incompatibility to keep everything running smoothly.
• Performance Optimization: Your role will include keeping an eye on the performance of migration processes, optimizing for speed and efficiency, and minimizing any downtime.
• Documentation: You’ll document everything—your processes, procedures, and outcomes—so that the migration journey is clear and trackable.
• Collaboration: You won’t be doing this alone! You’ll work alongside business analysts, DBAs, developers, and others to make sure every migration project is executed flawlessly.
• Compliance and Security: With data at the core, you’ll ensure every migration aligns with data governance policies and security standards, staying compliant with regulations.
• Post-Migration Support: Even after migration, you’ll play a critical role in optimizing system performance and resolving any issues that may arise
• CI/CD: As part of our endeavour towards creating production-grade software, you will be involved in DevOps activities such as version control and migration of code artefacts to live environments.

The Requirements

This is a fantastic opportunity for somebody who is looking for more technical responsibility, who will have space to shape the future platform Key requirements include: 

• Strong SQL and Python skills
• Exposure to ADF, Azure Databricks or Microsoft Fabric 
• Understanding of Data Modelling and ETL/ELT concepts
• Comfortable taking ownership of technical requirements and diagnosing complex data engineering issues 
• Experience within regulated environments would be desirable