Data Engineer
KeySkills
-
Python,
PySpark,
Spark DataFrames,
Jupyter Notebook,
PyCharm,
Spark Job Optimization,
Git,
AWS EMR,
Athena,
Glue,
Lambda,
EC2,
S3,
SNS,
Bash/Shell Scripting,
ETL,
CSV,
TSV,
XML,
JSON,
Fixed-width & Multi-record Files,
Data Warehousing,
Star/Snowflake Schemas,
Parquet,
Avro,
ORC,
Snappy,
Gzip,
Aurora,
RDS,
Redshift,
ElastiCache,
DynamoDB,
Jenkins,
DevOps,
Debugging,
US Client Interaction,
Front-end Frameworks,
BFSI Domain,
Company Name
Job Description
- Job Description
- Mandatory - Hands on experience in Python and PySpark.
- Build pySpark applications using Spark Dataframes in Python using Jupyter notebook and PyCharm(IDE).
- Worked on optimizing spark jobs that processes huge volumes of data.
- Hands on experience in version control tools like Git.
- Worked on Amazon?s Analytics services like Amazon EMR, Amazon Athena, AWS Glue.
- Worked on Amazon?s Compute services like Amazon Lambda, Amazon EC2 and Amazon?s Storage service like S3 and few other services like SNS.
- Experience/knowledge of bash/shell scripting will be a plus.
- Has built ETL processes to take data, copy it, structurally transform it etc. involving a wide variety of formats like CSV, TSV, XML and JSON.
- Experience in working with fixed width, delimited , multi record file formats etc.
- Good to have knowledge of datawarehousing concepts ? dimensions, facts, schemas- snowflake, star etc.
- Have worked with columnar storage formats- Parquet,Avro,ORC etc. Well versed with compression techniques ? Snappy, Gzip.
- Good to have knowledge of AWS databases (atleast one) Aurora, RDS, Redshift, ElastiCache, DynamoDB.
- Hands on experience in tools like Jenkins to build, test and deploy the applications
- Awareness of Devops concepts and be able to work in an automated release pipeline environment.
- Excellent debugging skills.
Job Details
Experience :
3 To 5
Number Of
Vacancies :
10
Job Type :
Permanent
Industry Type : IT/Software
Salary
:
4 Lac - 8 Lac
P.A
Education Summary
UG :
Any UG Degree
PG :
Any PG Degree
Contact Details
Contact
Person :
NA
Contact
Number :
2066074000
e-mailId :
careers@zensar.com
Address :
Zensar Technologies Ltd.
Plot #4, MIDC, Off Nagar Road,
Zensar Knowledge Park, Kharadi,
Pune - 411014, Maharashtra, India
Phone: 020-66074000; 020-66057500
Office Location
Central Jakarta No 1234, Jakarta, IndonesiaSAP ABAP Developer
Experience -
1 to 3
IT Consulting
Experience -
1 to 3
Key Skills -
Autotask Ticketing tool ,
Form Design Aid ,
One view Reporting ,
menu creation JD Edwards Enterprise One,
Debugging in JDE,
Menu filtering ,
Business View Design Aid,
Remedy,
Menu promotion,
JDE Debug ,
E1 application troubleshooting,
UDC,
Orchestration Tool,
Named Event Rules,
Financial Reports,
Business Intelligence,
C-Business Functions,
Table Design Aid,
Service Now,
Interfaces,
Reports,
Data Engineer
Experience -
3 to 5
Key Skills -
Python,
PySpark,
Spark DataFrames,
Jupyter Notebook,
PyCharm,
Spark Job Optimization,
Git,
AWS EMR,
Athena,
Glue,
Lambda,
EC2,
S3,
SNS,
Bash/Shell Scripting,
ETL,
CSV,
TSV,
XML,
JSON,
Fixed-width & Multi-record Files,
Data Warehousing,
Star/Snowflake Schemas,
Parquet,
Avro,
ORC,
Snappy,
Gzip,
Aurora,
RDS,
Redshift,
ElastiCache,
DynamoDB,
Jenkins,
DevOps,
Debugging,
US Client Interaction,
Front-end Frameworks,
BFSI Domain,
Test Engineer
Experience -
3 to 5
Key Skills -
Software Testing and Quality Assurance,
Test Case Design and Execution,
Test Planning and Requirement Analysis,
Model-Based Testing Implementation,
Automation Framework Design and Execution,
Test Life Cycle Management and Process Automation,
Defect Identification,
Reporting,
and Tracking,
User Acceptance Testing (UAT) Support,
Test Environment Setup and Maintenance,
Test Status Dashboard and Reporting,
Collaboration with Development and Project Teams,
Root Cause Analysis and Continuous Improvement,
Strong Documentation and Reporting Skills,
Adherence to SLA and Quality Standards,
Customer Communication and Issue Resolution,