hero

Companies you'll love to work for

39
companies
544
Jobs

Senior Data Engineer (Production Support)

emids

emids

Customer Service, Data Science
Bengaluru, Karnataka, India
Posted 6+ months ago

Job Title - Senior Data Engineer (Production Support)
Location - Bangalore
Shift Timings - 4:00 PM - 1:30 PM
Notice - Immediate to 15 Days max


Job Summary:

  • This role requires 70% supporting and 30% development activities

Required Skills:

  • Python
  • Pyspark
  • Shell Scripting
  • UNIX
  • SQL
  • Production Support

Desired Skills:

  • Databricks
  • AWS

Role Expectation:

  • We are seeking a skilled Data Engineer with expertise in Pyspark, Shell scripting, and SQL to join our dynamic team. This role will primarily involve providing support for our data infrastructure and processes, with a focus on ensuring smooth operations and resolving issues promptly. Additionally, the role will include implementation tasks related to data pipelines and ETL processes.

Key Responsibilities:

Support Responsibilities:

  • Provide day-to-day support for data pipelines, ensuring data availability and reliability.
  • Monitor and troubleshoot data ingestion, processing, and output issues.
  • Respond to and resolve data-related incidents and service requests in a timely manner.
  • Collaborate with cross-functional teams to address and escalate critical issues.

Implementation Responsibilities:

  • Develop and maintain data pipelines using Pyspark for data extraction, transformation, and loading.
  • Write efficient Shell scripts for automation of data workflows and system monitoring.
  • Design and optimize SQL queries for data extraction and reporting purposes.
  • Implement improvements to existing data pipelines to enhance performance and scalability.

Thanks.