Job Title - Senior Data Engineer (Production Support)
Location - Bangalore
Shift Timings - 4:00 PM - 1:30 PM
Notice - Immediate to 15 Days max

Job Summary:

• This role requires 70% supporting and 30% development activities

Required Skills:

• Python
• Pyspark
• Shell Scripting
• UNIX
• SQL
• Production Support

Desired Skills:

• Databricks
• AWS

Role Expectation:

• We are seeking a skilled Data Engineer with expertise in Pyspark, Shell scripting, and SQL to join our dynamic team. This role will primarily involve providing support for our data infrastructure and processes, with a focus on ensuring smooth operations and resolving issues promptly. Additionally, the role will include implementation tasks related to data pipelines and ETL processes.

Key Responsibilities:

Support Responsibilities:

• Provide day-to-day support for data pipelines, ensuring data availability and reliability.
• Monitor and troubleshoot data ingestion, processing, and output issues.
• Respond to and resolve data-related incidents and service requests in a timely manner.
• Collaborate with cross-functional teams to address and escalate critical issues.

Implementation Responsibilities:

• Develop and maintain data pipelines using Pyspark for data extraction, transformation, and loading.
• Write efficient Shell scripts for automation of data workflows and system monitoring.
• Design and optimize SQL queries for data extraction and reporting purposes.
• Implement improvements to existing data pipelines to enhance performance and scalability.

Thanks.