Azure Databricks Engineer
KeySkills
Company Name
Job Description
- Job Description
- Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible.
- Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Your Role- Designing and developing end-to-end data pipelines using Azure Data Factory and Databricks, PySpark, SQL, Delta Lake,azure data lake Building and optimizing ETL workflows for ingestion, transformation, and loading of structured and semi-structured data into Azure Synapse Analytics and ADLS.
- Implementing data validation and quality frameworks to ensure data reliability.
- Writing efficient PySpark and SQL code for complex transformations, aggregations, and performance tuning.
- Managing secure access using Azure Key Vault, role-based permissions, and compliance best practices.
- Working in an Agile/Scrum environment, delivering solutions aligned with business needs, currently as part of Cognizant's Data Engineering practice.
- Very good judgement skills and ability to shape compelling solutions.
- Very good collaboration skills and ability to interact with multi-cultural and multi-functional teams spread
Your Profile- Should have 4+ years of experience in Azure Databricks with strong pyspark experience
- Experience with Azure Data Bricks, Data Factory
- Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics
- Experience in Python/Pyspark/Scala/Hive Programming.
- Experience with Azure Databricks/ADB
- Experience with building CI/CD pipelines in Data environments.
Job Details
Experience :
4 To 6
Number Of
Vacancies :
20
Job Type :
Permanent
Industry Type : IT/Software
Salary
:
8 Lac - 12 Lac++
P.A
Education Summary
UG :
Any UG Degree
PG :
Any PG Degree
Contact Details
Contact
Person :
NA
Contact
Number :
8041042084
e-mailId :
vijayanath.siddhareddy@capgemini.com
Address :
Capgemini Technology Services India Limited,
Eco Space, Pritech Park SEZ,Building 6B, Village, Bellandur,
Outer Ring Road, Bellandur, Bangalore.
Office Location
Central Jakarta No 1234, Jakarta, IndonesiaQlik Sense Architect
Experience -
10 to 15
Gen AI Lead
Experience -
0 to 1
Key Skills -
AWS Bedrock,
AWS Bedrock Agent Core SDK,
AWS Strands SDK,
AWS X-Ray,
Application Load Balancer,
OpenSearch,
Amazon Aurora,
S3,
DynamoDB,
EC2,
ECS,
EKS,
AWS Lambda,
API Gateway,
Amazon CloudWatch,
AWS CodePipeline,
AWS CodeBuild,
AWS CodeDeploy,
GitHub Actions,
GitLab CI,
AWS CloudFormation,
CDK,
Terraform,
Parameter Store,
AWS Secrets Manager,
Python.,
Oracle OTM Lead
Experience -
10 to 15
Software Development Engineer
Experience -
2 to 3
Key Skills -
Java / Python / C++,
Data Structures & Algorithms,
System Design,
Distributed Systems,
Microservices Architecture,
Scalable & Fault-Tolerant Systems,
RESTful APIs,
SQL & NoSQL Databases,
Cloud Computing (AWS),
Agile Development,
Unit & Integration Testing,
High-Performance Backend Development,