Yeah I also just ran into that issue a week ago. Had to look for awful hacks to try to get around it, ended up using Ray Serve to offload the processing to a background worker.