hero

Companies you'll love to work for

40
companies
344
Jobs

Senior Software Engineer (Big Data) - RR/431/2024

emids

emids

Software Engineering
Bengaluru, Karnataka, India
Posted on Friday, April 19, 2024

Job Roles and Responsibilities:

  • Design, develop, and maintain scalable data pipelines using Python and PySpark for data processing and analysis.
  • Strong knowledge of SQL for querying and managing relational databases.
  • Implement and manage ETL processes with Apache Airflow.
  • Create and manage Jupyter Notebooks for data analysis and reporting.
  • Utilize DBT (Data Build Tool) for transforming data in the warehouse.
  • Optimize and manage data storage solutions using Amazon Redshift.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Ensure data quality and integrity through rigorous testing and validation.
  • Monitor, troubleshoot, and improve the performance of data pipelines and workflows.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration skills.
  • Stay updated with the latest industry trends and technologies in big data.

Experience – 4 to 6 Years

Location – Bengaluru

Work Mode - Hybrid

Notice Period – 0 to 30 Days