Generative and Autonomous Systems in Data Engineering

Generative and Autonomous Systems in Data Engineering presents an evidence-based, formal analysis of how generative and autonomous components transform data pipelines, emphasizing rigor, validation, and governance. Generative and autonomous systems in data engineering are formally defined before categorizing relevant generative and autonomous components into a comprehensive framework. A data engineering pipeline serves as the keyword for delimiting particular types of data engineering systems. The proposed classification identifies generative models that generate content end-to-end based on prompts or specifications, and autonomous subsystems that carry out decisions and actions with little or no human involvement.