Comment by sleepytree

How are you running the pipeline exactly? I'm new to AI dev and when I hear pipeline I think either CI/CD or something like Apache Airflow or Kestra.