Company Name

IBM ( Bangalore )

Job Description

• Job Description:

  We are looking for a passionate and skilled Python Backend Data Engineer to design, develop, and maintain a hybrid data platform across multi-cloud and on-premises environments. You will collaborate with AI engineers, product managers, and software developers to deliver data-driven features and products that scale.

  ---

  Key Responsibilities:

  • Build high-performing, scalable, enterprise-grade backend applications.

  • Develop and manage Big Data applications across the full software development lifecycle.

  • Design and maintain RESTful APIs using FastAPI.

  • Work with streaming and messaging systems like Kafka.

  • Utilize CI/CD pipelines to streamline data engineering workflows.

  • Implement data wrangling and transformation using Pandas, Polaris, NumPy, SQL, etc.

  • Integrate with cloud platforms such as AWS, GCP, and Azure.

  • Leverage NoSQL and SQL databases including PostgreSQL, MySQL, and MongoDB (GridFS).

  • Apply modern authorization methods like OAuth2 and JWT.

  • Contribute to the evolution of data platform architecture using best practices in OOP, DDD, and microservices.

  Required Technical Skills:

  • Proficiency in Python 3, FastAPI, Apache Spark, and Iceberg

  • Experience developing and integrating RESTful web services

  • Solid knowledge of Kafka messaging systems

  • Familiarity with data wrangling and ETL pipelines using Pandas, NumPy, Polaris

  • Expertise in SQL and NoSQL databases

  • Understanding of modern security/auth protocols: JWT, OAuth2

  Preferred Technical Skills & Experience:

  • Knowledge of Domain-Driven Design (DDD) and Microservices Architecture

  • Experience with BI tools and dashboarding platforms

  • Exposure to Gen AI tools and ecosystems

  • Good understanding of multi-cloud architecture (AWS, GCP, Azure)

Job Details

Education Summary

Contact Details