Spark Developer
Company Name
Infosys Ltd ( Chennai )
Job Description
Responsibilities:
-
5?8 years of experience in Azure with hands-on expertise in Azure Databricks and Azure Data Factory (ADF).
-
Strong knowledge of SQL and PySpark.
-
Understanding of Medallion Architecture pattern.
-
Experience with Integration Runtime in ADF.
-
Knowledge of different job scheduling methods in ADF (Event-based, Schedule-based, etc.).
-
Experience with Azure Analysis Services (AAS) and Cubes.
-
Ability to create, manage, and optimize Cube processing.
-
Strong communication and collaboration skills.
-
Experience in leading a team.
Additional Responsibilities
-
Proficiency in software configuration management systems.
-
Strong business acumen, strategy, and cross-industry thought leadership.
-
Awareness of latest technologies and industry trends.
-
Excellent logical thinking and problem-solving skills.
-
Knowledge of at least two or three industry domains.
-
Understanding of financial processes for various project types and pricing models.
-
Strong client interfacing and stakeholder management skills.
-
Knowledge of SDLC and agile methodologies.
-
Experience in project and team management.
Preferred Skills
-
Technology → Big Data - Data Processing → Spark
-