Extensive experience in data engineering with a strong focus on designing and implementing complex and scalable data solutions using AWS services like MWAA and Lambda, RDS (7+ years).
Proficient in Databricks (5+ years) using pyspark, Delta tables, Unity catalog, SQL Warehouse for optimizing data pipelines, ensuring high performance, managing big data processing tasks in an optimized manner, and writing reusable framework.
Proficient in Snowflake (4+ years) and Snowpark for optimizing queries, schemas, and implementing security layers.
Strong architectural knowledge coupled with RBAC concepts
Strong SQL skills with the ability to write, optimize, and troubleshoot complex queries.
Demonstrated problem-solving skills with the ability to analyze, diagnose, and resolve technical issues efficiently.
Experience in developing and maintaining ETL/ELT processes to ensure data is accurately and efficiently loaded into data warehouses and data lakes.
Knowledge of data quality frameworks, exception handling and adherence to common standards and compliance.
Experience using CI/CD tools such as CDK, CloudFormation, and Terraform to automate deployments both IaaC and DAGs across environments.