Data EngineerSmart OSC _ HCM

Analyze Data Sources:
Thoroughly analyze all data sources and their content to understand the data landscape and requirements.
Identify Data Needs:
Collaborate with stakeholders to identify business and technical data needs, ensuring alignment with project goals.
Data Mapping and Transformation:
Determine the appropriate data mapping and transformation logic to convert raw data into valuable insights.
Conceptual Data Modeling:
Develop the conceptual side of data requirements with a focus on business and application-specific needs.
Database Schema Design:
Create the initial database schema to define the physical structure of the database.
Modify the database schema as needed throughout the development process to accommodate changes.
Data Loading:
Run load scripts for the initial population of the database with test or real data.
Execute scripts for reloading the database with new data as part of data warehouse restocking processes.
Performance Tuning:
Analyze and address response-time issues by tweaking the database structure for optimal performance.
Backup and Restore:
Perform regular backup and restore operations to ensure data integrity and availability.
Pipeline Monitoring and Maintenance:
Monitor and maintain data pipelines to ensure smooth and reliable data flow.