Job Overview:

We are seeking a highly skilled and experienced Senior ETL Developer to join our team. The ideal candidate will have a deep understanding of ETL processes, data integration, and database management within an Azure cloud environment and central SQL database. You will be responsible for designing, developing, and optimizing ETL pipelines and ensuring the seamless integration and automated processing of data from various sources into a central SQL Database. You will be working with a distributed team, so leading teams from a technical perspective and experience working with teams across multiple time zones is expected. As app modernization is currently being delivered using Microsoft Power Platform and automated workflows will be supported using Azure OpenAI, experience in both of these technologies is highly desired.

Key Responsibilities:

• ETL Design & Development:
• Design, develop, and maintain robust ETL processes to extract, transform, and ingest data from diverse sources into a SQL database with a common data model.
• Build scalable ETL pipelines to support automated data ingestion and integrations at scale.
• Develop dashboards and notification mechanisms to alert stakeholders when automated ETL processes fail.
• Data Management & Integration:
• Collaborate with data architects, business analysts, and stakeholders to understand data requirements and ensure customer requirements are met.
• Perform data profiling, analysis, and validation to ensure accuracy and consistency.
• Performance Optimization:
• Optimize ETL processes for performance, reliability, and scalability.
• Address bottlenecks, fine-tune SQL queries, and ensure efficient data flows.
• Documentation & Quality Assurance:
• Create and maintain detailed documentation of ETL designs, workflows, and data mappings.
• Implement and enforce data quality checks to ensure the accuracy and integrity of data.
• Collaboration:
• Work closely with cross-functional teams to ensure alignment on data needs and requirements.
• Mentor junior developers and assist in code reviews and technical guidance.

Required Qualifications

• Technical Expertise:
• Proficiency in Microsoft ETL tools such as Power Automate, Azure Data Factory, and Fabric, or equivalent.
• Advanced knowledge of SQL, and database platforms like SQL Server.
• Familiarity with low-code development platforms like Power Platform is a plus.
• Familiarity ing leveraging Azure OpenAI to automate workflows such as unstructured data categorization and coding considered an asset.
• Experience:
• 8–10 years of hands-on experience in ETL development, data integration, and data warehousing projects.
• Solid experience with Power Platform and OpenAI powered workflow automation.
• Problem-Solving:
• Proven ability to troubleshoot and resolve ETL pipeline issues effectively.
• Soft Skills:
• Strong communication and stakeholder management skills.
• Ability to work independently and lead projects in a collaborative environment.

Preferred Qualifications:

• Experience with cloud-based ETL solutions in Azure such as Power Platform Dataverse, Azure Data Factory, or Fabric.
• Knowledge of scripting languages like Perl Scripts and AccessDB and its macros for translation from legacy tools.
• Familiarity with agile development methodologies and tools like Azure DevOps.