I just saw your article. Great article with lots of information.

Yes I know how you batch hundreds of images in one forward pass, I just got confused because my example (actually TorchServe's example) does not support this. Of course if you want to support it it would make a huge difference to only initialize the pipeline once.

Thanks a lot for taking the time to read and comment! That's what makes us better!