hero

Companies you'll love to work for

40
companies
455
Jobs

Senior Software Engineer (Kafka, Python) RR/870/2024 (4-6 Years)

emids

emids

Software Engineering
Bengaluru, Karnataka, India
Posted on Jul 26, 2024

Job Roles and Responsibilities:

  • Design, develop, and maintain scalable data pipelines using Azure Data services, Python, and PySpark.
  • Integrate data from various sources, ensuring data quality, consistency, and reliability.
  • Manage and optimize data storage solutions on Azure, including data lakes and data warehouses.
  • Implement data processing solutions, including ETL (Extract, Transform, Load) processes, to support business intelligence and analytics.
  • Optimize data processing performance and troubleshoot any data-related issues.
  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Document data architecture, processes, and solutions to ensure maintainability and scalability.
  • Ensure data security and compliance with relevant regulations and best practices.
  • Familiarity with data warehousing concepts and technologies.
  • Understanding of data modeling and database design.
  • Strong problem-solving and analytical skills.
  • Excellent communication and teamwork skills.

Experience – 4 to 6 Years

Location – Bengaluru/Noida/Hyderabad

Work Mode - Hybrid

Notice Period – 0 to 30 Days