Azure Databricks Engineer
KeySkills
Company Name
Job Description
- Job Description
- Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible.
- Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Your Role- Designing and developing end-to-end data pipelines using Azure Data Factory and Databricks, PySpark, SQL, Delta Lake,azure data lake Building and optimizing ETL workflows for ingestion, transformation, and loading of structured and semi-structured data into Azure Synapse Analytics and ADLS.
- Implementing data validation and quality frameworks to ensure data reliability.
- Writing efficient PySpark and SQL code for complex transformations, aggregations, and performance tuning.
- Managing secure access using Azure Key Vault, role-based permissions, and compliance best practices.
- Working in an Agile/Scrum environment, delivering solutions aligned with business needs, currently as part of Cognizant's Data Engineering practice.
- Very good judgement skills and ability to shape compelling solutions.
- Very good collaboration skills and ability to interact with multi-cultural and multi-functional teams spread
Your Profile- Should have 4+ years of experience in Azure Databricks with strong pyspark experience
- Experience with Azure Data Bricks, Data Factory
- Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics
- Experience in Python/Pyspark/Scala/Hive Programming.
- Experience with Azure Databricks/ADB
- Experience with building CI/CD pipelines in Data environments.
Job Details
Experience :
4 To 6
Number Of
Vacancies :
20
Job Type :
Permanent
Industry Type : IT/Software
Salary
:
8 Lac - 12 Lac++
P.A
Education Summary
UG :
Any UG Degree
PG :
Any PG Degree
Contact Details
Contact
Person :
NA
Contact
Number :
8041042084
e-mailId :
vijayanath.siddhareddy@capgemini.com
Address :
Capgemini Technology Services India Limited,
Eco Space, Pritech Park SEZ,Building 6B, Village, Bellandur,
Outer Ring Road, Bellandur, Bangalore.
Office Location
Central Jakarta No 1234, Jakarta, IndonesiaApplication Tech Support Practitioner
Experience -
2 to 6
Technical Specialist-App Development
Experience -
3 to 5
Key Skills -
Java,
Java/J2EE,
Spring Boot,
REST APIs,
React JS,
JavaScript,
TypeScript,
HTML5,
CSS3,
Redux,
Flux,
RxJS,
DOM Manipulation,
ES6/ESNext,
Immutable.js,
Isomorphic React,
JSON Web Token (JWT),
Webpack,
Babel,
NPM,
Frontend Optimization,
Git,
SVN,
Mercurial,
MySQL,
Kubernetes,
Software Design,
Debugging,
SDLC,
Agile,
Estimation and Scheduling,
Stakeholder Management,
Problem Solving,
Team Collaboration,
Performance Tuning.,
Python Developer
Experience -
4 to 5
Key Skills -
Python,
Flask,
Django,
FastAPI,
REST API Development,
AI/ML Workflow Support,
Data Processing,
Debugging,
Unit Testing,
Integration Testing,
Code Optimization,
Performance Tuning,
SQL,
NoSQL,
Cloud Deployment (AWS/Azure/GCP),
CI/CD,
Git,
Linux/Unix Commands,
API Integration,
Problem Solving,
Documentation,
Collaboration,
Production Support.,
AWS DEVELOPER
Experience -
5 to 6
Key Skills -
CI/CD pipelines,
Jenkins,
GitHub Actions,
GitLab CI,
AWS CodePipeline,
AWS CodeDeploy,
AWS CodeBuild,
AWS EC2,
AWS S3,
AWS IAM,
AWS Lambda,
AWS CloudWatch,
Kubernetes,
AWS EKS,
Docker,
Terraform,
CloudFormation,
Git,
Branching strategies,
Bash scripting,
Python scripting,
Groovy scripting,
Automation,
Infrastructure as Code (IaC),
Monitoring and logging,
DevOps best practices,
Release management,
Deployment automation,
Security in CI/CD,
Agile development.,