Company Name

IBM ( Kochi )

Job Description

• Job Description
  • Data Modeling and ETL: Design, build, optimize, and maintain data models and ETL processes to support business requirements.
  • Data Pipeline Development: Develop end-to-end data pipelines and workflows from source to target systems.
  • Data Infrastructure Management: Build, deploy, and manage scalable data infrastructure to handle large volumes of data efficiently.
  • Data Access and Security: Coordinate data access and security to ensure analysts and data scientists can easily access required data.
  • Programming and Data Transformation: Develop Python and PySpark programs for data analysis, custom frameworks for rules generation, and business transformation logic using Spark DataFrames/RDDs.
  • Integration with Big Data Ecosystem: Work with HBase, Hive, and other big data tools to design and implement efficient data solutions.
  • DevOps and Deployment: Implement DevOps best practices for data pipelines and related infrastructure deployment.

  Required Technical And Professional Expertise

  1. Understanding of DevOps principles and practices
  2. Experience in building scalable, end-to-end data ingestion and processing solutions
  3. Strong knowledge of object-oriented and functional programming with Python, Java, or Scala

Job Details

Education Summary

Contact Details