Data Engineer-Data Platforms-AWS
Job Description
- Job Description
- Data Modeling and ETL: Design, build, optimize, and maintain data models and ETL processes to support business requirements.
- Data Pipeline Development: Develop end-to-end data pipelines and workflows from source to target systems.
- Data Infrastructure Management: Build, deploy, and manage scalable data infrastructure to handle large volumes of data efficiently.
- Data Access and Security: Coordinate data access and security to ensure analysts and data scientists can easily access required data.
- Programming and Data Transformation: Develop Python and PySpark programs for data analysis, custom frameworks for rules generation, and business transformation logic using Spark DataFrames/RDDs.
- Integration with Big Data Ecosystem: Work with HBase, Hive, and other big data tools to design and implement efficient data solutions.
- DevOps and Deployment: Implement DevOps best practices for data pipelines and related infrastructure deployment.
Required Technical And Professional Expertise- Understanding of DevOps principles and practices
- Experience in building scalable, end-to-end data ingestion and processing solutions
- Strong knowledge of object-oriented and functional programming with Python, Java, or Scala
Job Details
Experience :
4 To 9
Number Of
Vacancies :
10
Job Type :
Permanent
Industry Type : IT/Software
Salary
:
3 Lac - 6 Lac
P.A
Education Summary
UG :
BE/B.Tech
PG :
Any PG Degree
Contact Details
Contact
Person :
NA
Contact
Number :
8026788990
e-mailId :
response@in.ibm.com
Address :
IBM India Private Limited,
No. 1/124 DLF IT Park Tower 1A,
Ramapuram, Shivaji Garden,
Nandampakkam Post Near L&T,
Chennai.
Office Location
Central Jakarta No 1234, Jakarta, IndonesiaAutomation Testing - SDET
Experience -
0 to 2
Key Skills -
Playwright,
TypeScript,
JavaScript,
Test Automation,
UI Automation,
API Testing,
REST API,
CI/CD,
Git,
Jenkins,
Manual Testing,
Test Case Design,
Exploratory Testing,
Regression Testing,
Defect Reporting,
JIRA,
Agile Methodologies,
Automation Framework Development,
Backend Testing,
Requirement Analysis,
Shift-Left Testing,
Senior Project Manager
Experience -
15 to 17
Key Skills -
Project Management,
Program Management,
Informatica,
CyberArk,
Checkmarx,
Qualys,
Cisco ACI,
Palo Alto Email Security,
AWS Security,
Azure Security Center,
Cloud Security Architecture,
Network Security,
Application Security,
Vulnerability Management,
Identity and Access Management,
Security Compliance,
Risk Management,
DevSecOps,
Infrastructure Security,
Bioinformatics (Nice to have),
PMP Methodologies,
Agile and Waterfall,
Stakeholder Communication,
Leadership,
Team Management,
Security Audits,
Regulatory Standards,
Sr Application Developer
Experience -
3 to 5
Java Angular
Experience -
0 to 2