Python developer
KeySkills
Company Name
Infosys Ltd ( Chennai )
Job Description
Job Description:
Infosys is hiring skilled Python + PySpark Developers with 3+ years of experience to be part of its digital transformation and consulting initiatives. As a developer, you will work on building data pipelines, processing large datasets, and designing efficient data engineering solutions using PySpark on distributed systems.
You will be a key contributor in shaping advanced data platforms and be involved in the entire project lifecycle, from problem definition to deployment. If you are passionate about big data and Python-based data engineering, this is the right opportunity for you.
Key Responsibilities:
Collaborate with teams during all phases of the project lifecycle including requirement gathering, effort estimation, technical diagnosis, solution generation, design, development, and deployment.
Perform research to evaluate alternatives using public domain content, vendor documentation, and literature reviews to recommend optimal solutions.
Develop and validate Proof of Concepts (POCs) using Python and PySpark.
Translate business requirements into technical design and develop robust data processing pipelines on distributed systems.
Configure data transformation workflows and troubleshoot issues using root cause analysis techniques.
Optimize Spark jobs for performance, scalability, and resource usage in large data environments.
Ensure high-quality deliverables and contribute to organizational knowledge-sharing and continuous improvement initiatives.
Mandatory Skills:
Strong programming experience in Python
Proficient in Apache Spark using PySpark
Hands-on experience in building ETL/Data Pipelines in big data environments
Knowledge of Spark transformations, actions, RDDs, and DataFrames
Familiarity with data wrangling, cleansing, and optimization techniques
Understanding of distributed computing principles