About the role
AI summarisedThe senior data engineering role focuses on building and maintaining AI‑enhanced data pipelines and analytics solutions in a cloud environment. The candidate will design data structures, develop ETL processes, and create CI/CD workflows to support smart manufacturing and AI‑driven workloads.
IDMOnsiteSmart MFG/AI
Key Responsibilities
- Build and maintain data/solution pipelines that ingested and match the new requirements, with AI support to accelerate data onboarding and quality checks
Requirements
- Experience developing, delivering, and/or supporting data engineering, advanced analytics or business intelligence solutions.
- Ability to work with multiple operating systems (e.g., MS Office, Unix, Linux, etc.)
- Experienced in developing ETL/ELT processes using Apache Ni-Fi and Snowflake, GCP Big Query or any Equivalent Data Warehouse.
- Significant experience with big data processing and/or developing applications and data sources via Hadoop, Yarn, Hive, Pig, Sqoop, MapReduce, HBASE, Flume, etc.
