Data Engineer
KeySkills
Job Description
- Responsibilities
- Design and build GCP data driven solutions for enterprise data warehouse and data lakes
- Design and implement scalable data architectures on GCP, including data lakes, warehouses, and real-time processing systems.
- Utilize ML Services like Vertex AI.
- Develop and optimize ETL/ELT pipelines using tools like Python, SQL, and streaming technologies (e.g., Kafka, Apache Airflow).
- Architect Historical and Incremental Loads and Refine Architecture on an ongoing basis
- Manage and optimize data storage, partitioning, and clustering strategies for high performance and reliability, utilizing services such as BigQuery, Spark, Pub/Sub, and Object Storage.
- Collaborate with data scientists, Data engineers, and other stakeholders to understand data needs and deliver solutions aligned with business objectives, security, and data governance.
- Automate infrastructure and deployments using Infrastructure as Code (IaC) using tools like Terraform and CI/CD practices (e.g., Tekton) to ensure reliability and scalability.
- Operationalize machine learning models by building data infrastructure and managing structured and unstructured data, supporting AI/ML/LLM workflows, including data labeling, classification, and document parsing.
- Monitor and troubleshoot data pipelines and systems to identify and resolve issues related to performance, reliability, and cost-effectiveness.
- Document data processes, pipeline designs, and architecture, contributing to knowledge transfer and system maintenance.
Job Details
Experience :
2 To 4
Number Of
Vacancies :
1
Job Type :
Permanent
Industry Type : Automobiles/Automotive
Salary
:
3 Lac - 7 Lac
P.A
Education Summary
UG :
Any UG Degree
PG :
Any PG Degree
Contact Details
Contact
Person :
NA
Contact
Number :
9698526000
e-mailId :
karthikeyan.myjobkart@gmail.com
Address :
Ford
Block - 1B,
1st Floor RMZ Millenia Business Park,
143, Dr MGR Road North Veeranam Salai,
Perungudi, Chennai,
Tamil Nadu.
Office Location
Central Jakarta No 1234, Jakarta, IndonesiaQlik Sense Architect
Experience -
10 to 15
Gen AI Lead
Experience -
0 to 1
Key Skills -
AWS Bedrock,
AWS Bedrock Agent Core SDK,
AWS Strands SDK,
AWS X-Ray,
Application Load Balancer,
OpenSearch,
Amazon Aurora,
S3,
DynamoDB,
EC2,
ECS,
EKS,
AWS Lambda,
API Gateway,
Amazon CloudWatch,
AWS CodePipeline,
AWS CodeBuild,
AWS CodeDeploy,
GitHub Actions,
GitLab CI,
AWS CloudFormation,
CDK,
Terraform,
Parameter Store,
AWS Secrets Manager,
Python.,
Oracle OTM Lead
Experience -
10 to 15
Software Development Engineer
Experience -
2 to 3
Key Skills -
Java / Python / C++,
Data Structures & Algorithms,
System Design,
Distributed Systems,
Microservices Architecture,
Scalable & Fault-Tolerant Systems,
RESTful APIs,
SQL & NoSQL Databases,
Cloud Computing (AWS),
Agile Development,
Unit & Integration Testing,
High-Performance Backend Development,