Senior Software Engineer (Big Data) - RR/431/2024
emids
This job is no longer accepting applications
See open jobs at emids.See open jobs similar to "Senior Software Engineer (Big Data) - RR/431/2024" Blue Venture Fund.Software Engineering
Bengaluru, Karnataka, India
Posted on Friday, April 19, 2024
Job Roles and Responsibilities:
- Design, develop, and maintain scalable data pipelines using Python and PySpark for data processing and analysis.
- Strong knowledge of SQL for querying and managing relational databases.
- Implement and manage ETL processes with Apache Airflow.
- Create and manage Jupyter Notebooks for data analysis and reporting.
- Utilize DBT (Data Build Tool) for transforming data in the warehouse.
- Optimize and manage data storage solutions using Amazon Redshift.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Ensure data quality and integrity through rigorous testing and validation.
- Monitor, troubleshoot, and improve the performance of data pipelines and workflows.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
- Stay updated with the latest industry trends and technologies in big data.
Experience – 4 to 6 Years
Location – Bengaluru
Work Mode - Hybrid
Notice Period – 0 to 30 Days
This job is no longer accepting applications
See open jobs at emids.See open jobs similar to "Senior Software Engineer (Big Data) - RR/431/2024" Blue Venture Fund.