Python Data Engineer Lead
KeySkills
-
Proficiency in Python programming,
Hands-on experience with Apache Spark (Core,
SQL,
Streaming),
Strong knowledge of Pandas (and exposure to Polars preferred),
Solid understanding of distributed data processing within the Hadoop ecosystem,
Strong problem-solving skills and attention to detail,
Ability to work collaboratively in a team environment and lead by exam.,
Company Name
Job Description
Job Overview: Skill Python with Spark Development Exp 8- 15 Yrs Location Chennai (Sholinganallur SEZ)/ Bangalore (RMZ Ecoworld ? Bellandur) Hybrid Mode 12 Days a month as per organization policy Well versed with: Through and hands on knowledge on Python and Spark Programming and writing efficient, reusable, and reliable Python code. Very good proficiency in Python and Spark programming. Pandas: Experience with data manipulation and analysis using Pandas. Implementation experience of Spark Core, Spark SQL and Spark Streaming Working with Spark in combination Hadoop Ecosystem Design and implementation of low-latency, high-availability, and performance applications. Should lead and guide a team of junior Python developers. As Sr Python Developer responsibilities include coding, testing, debugging, and troubleshooting throughout the application development process. Performance tuning, improvement, balancing, usability, and automation. Collaborate with other team members and stakeholders. Required Skill Set Proficiency in Python programming. Experience with Pandas for data manipulation and analysis. Knowledge of Polars for efficient data processing. Strong problem-solving skills and attention to detail. Ability to work collaboratively in a team environment