yolov8 速度测试

T4显卡

1，1280 1280 yolov8x6
推理速度
Speed: 7.4ms preprocess, 156.8ms inference, 1.1ms postprocess per image at shape (1, 3, 960, 1280)

2.fp16打开
0: 960x1280 1 bj_bpmh, 159.6ms
Speed: 7.5ms preprocess, 159.6ms inference, 1.2ms postprocess per image at shape (1, 3, 960, 1280)

3.两个模型串联
快乐加倍
Inference time: 0.36016416549682617

4.如果用ThreadPoolExecutor 试试呢
并没啥毛用
Inference time: 0.3802616596221924

5.使用tensorrt加速 fp16 batch size = 1

6.使用tensorrt 的精度变化