Data Engineer-Data Warehouse
KeySkills
Job Description
Job Description:
As a Data Engineer at IBM, you will leverage data to uncover meaningful insights and patterns, playing a vital role in data gathering, storage, and both batch and real-time processing. Working closely with cross-functional teams, you will select appropriate data management systems and identify key data sources for in-depth analytics. You will address challenges around database integration and manage large-scale, complex, and unstructured datasets.
Responsibilities
-
Design, implement, and validate predictive and statistical models with a focus on big data.
-
Apply machine learning and statistical techniques to solve real-world business problems.
-
Develop and maintain enterprise search applications (e.g., Elasticsearch, Splunk) tailored to client requirements.
-
Collaborate in Agile environments with scientists, engineers, and database administrators to bring analytical rigor to behavioral predictions.
-
Develop scalable data pipelines and reusable components for cleansing and integrating diverse data sources.
-
Build predictive or prescriptive models and assess their accuracy and performance.
-
Choose optimal data management systems and tools for business needs.
Required Skills
-
Strong hands-on experience with DBT (Data Build Tool).
-
Knowledge of ETL tools like IBM DataStage and Snowflake.
-
Proficiency in programming languages such as Python, Java, or Scala for data extraction and transformation.
-
Experience using ETL/integration/federation tools to prepare and transform data.
-
Technical expertise with tools such as:
-
Linux
-
SQL
-
Python
-
Apache Spark
-
Hadoop
-
Java
-
Preferred Skills
-
Strong teamwork orientation and excellent communication skills (verbal and written).
-
Ability to interact with both technical and non-technical audiences to translate data into insights.
-
Experience in communicating analytical results clearly and effectively.
-
Proven ability to define and understand business requirements and deliver practical data solutions.
-