Python developer
KeySkills
Company Name
Infosys Ltd ( Bangalore )
Job Description
Job Description:
Infosys is hiring skilled Python + PySpark Developers with 3+ years of experience to be part of its digital transformation and consulting initiatives. As a developer, you will work on building data pipelines, processing large datasets, and designing efficient data engineering solutions using PySpark on distributed systems.
You will be a key contributor in shaping advanced data platforms and be involved in the entire project lifecycle, from problem definition to deployment. If you are passionate about big data and Python-based data engineering, this is the right opportunity for you.
Key Responsibilities:
-
Collaborate with teams during all phases of the project lifecycle including requirement gathering, effort estimation, technical diagnosis, solution generation, design, development, and deployment.
-
Perform research to evaluate alternatives using public domain content, vendor documentation, and literature reviews to recommend optimal solutions.
-
Develop and validate Proof of Concepts (POCs) using Python and PySpark.
-
Translate business requirements into technical design and develop robust data processing pipelines on distributed systems.
-
Configure data transformation workflows and troubleshoot issues using root cause analysis techniques.
-
Optimize Spark jobs for performance, scalability, and resource usage in large data environments.
-
Ensure high-quality deliverables and contribute to organizational knowledge-sharing and continuous improvement initiatives.
Mandatory Skills:
-
Strong programming experience in Python
-
Proficient in Apache Spark using PySpark
-
Hands-on experience in building ETL/Data Pipelines in big data environments
-
Knowledge of Spark transformations, actions, RDDs, and DataFrames
-
Familiarity with data wrangling, cleansing, and optimization techniques
-
Understanding of distributed computing principles
-