In the past I’ve used task-spooler, but it seems unmaintained now.
I don’t need anything distributed, just: – queue jobs – run one at a time (or manage GPU allocation) – minimal setup / dependencies
I’ve looked at things like Slurm and Kubernetes based setups, but they feel like overkill for this use case.
What are people here using in practice?
Custom scripts? Something like gflow/qup? Or is there a maintained equivalent to task-spooler?
https://github.com/celery/celery
https://github.com/seokjohn/celery_multiprocess_gpu