1 University of Arizona, USA.
2 University of Cincinnati, USA.
World Journal of Advanced Research and Reviews, 2025, 26(01), 351-358
Article DOI: 10.30574/wjarr.2025.26.1.1089
Received on 26 February 2025; revised on 03 April 2025; accepted on 05 April 2025
machine learning workflows, examining data processing architectures' evolution and current state. The article explores how organizations are transitioning from traditional ETL to contemporary ELT approaches, driven by the increasing complexity of ML applications and exponential growth in data volumes. The article investigates key aspects including metadata-driven frameworks, quality control mechanisms, performance optimization strategies, and pipeline governance. Through analysis of multiple enterprise implementations, the article demonstrates how modern pipeline architectures have transformed data processing capabilities, improved operational efficiency, and enhanced ML workflow effectiveness. The article also examines emerging challenges in unified processing and schema evolution, providing insights into how organizations are addressing these challenges through advanced architectural patterns and automated management frameworks.
ETL/ELT Pipeline Architecture; Machine Learning Workflows; Metadata-Driven Frameworks; Data Quality Management; Pipeline Governance
Preview Article PDF
Srinivasa Sunil Chippada and Shekhar Agrawal. Modern ETL/ELT pipeline design for ML workflows. World Journal of Advanced Research and Reviews, 2025, 26(01), 351-358. Article DOI: https://doi.org/10.30574/wjarr.2025.26.1.1089.
Copyright © 2025 Author(s) retain the copyright of this article. This article is published under the terms of the Creative Commons Attribution Liscense 4.0