FastAPI: How to Process Incoming Requests in Batches
Published in
5 min readNov 17, 2020
Utilizing WebSockets, Queue and APScheduler for batch processing in FastAPI
In this tutorial, I am going to share a simple experiment that I have conducted over the weekend. The basic idea is to queue up all the incoming requests and process them in batches at certain interval each time. To do so, we are going to
- establish two-way connections…