Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

yolov5s on TensorRT failed #1235

Open
wfeii1980 opened this issue Dec 20, 2021 · 3 comments
Open

yolov5s on TensorRT failed #1235

wfeii1980 opened this issue Dec 20, 2021 · 3 comments

Comments

@wfeii1980
Copy link

wfeii1980 commented Dec 20, 2021 •
edited
Loading

env

2021-12-20 16-01-16屏幕截图

error

CPU is OK
CUDA GPU Low utilization
TensorRT failed

$ tm_yolov5s -m yolov5s.tmfile -i images/ssd_dog.jpg
tengine-lite library version: 1.5-dev
Tengine Error: 4: [network.cpp::validate::2437] Error Code 4: Internal Error (Repeated tensor name: 203 (tensors must have distinct names))
Tengine: Can not Build engine, please check config.
Tengine Fatal: Pre-run subgraph(20) on TensorRT failed.
Tengine: Scheduler(sync) prerun failed.
Prerun multithread graph failed.
@wfeii1980
Copy link
Author

wfeii1980 commented Dec 21, 2021 •
edited
Loading 

$ /usr/src/tensorrt/bin/trtexec --onnx=model_opt.onnx --verbose
&&&& RUNNING TensorRT.trtexec [TensorRT v8001] # /usr/src/tensorrt/bin/trtexec --onnx=model_opt.onnx --verbose
[12/21/2021-10:09:45] [I] === Model Options ===
[12/21/2021-10:09:45] [I] Format: ONNX
[12/21/2021-10:09:45] [I] Model: model_opt.onnx
[12/21/2021-10:09:45] [I] Output:
[12/21/2021-10:09:45] [I] === Build Options ===
[12/21/2021-10:09:45] [I] Max batch: explicit
[12/21/2021-10:09:45] [I] Workspace: 16 MiB
[12/21/2021-10:09:45] [I] minTiming: 1
[12/21/2021-10:09:45] [I] avgTiming: 8
[12/21/2021-10:09:45] [I] Precision: FP32
[12/21/2021-10:09:45] [I] Calibration: 
[12/21/2021-10:09:45] [I] Refit: Disabled
[12/21/2021-10:09:45] [I] Sparsity: Disabled
[12/21/2021-10:09:45] [I] Safe mode: Disabled
[12/21/2021-10:09:45] [I] Restricted mode: Disabled
[12/21/2021-10:09:45] [I] Save engine: 
[12/21/2021-10:09:45] [I] Load engine: 
[12/21/2021-10:09:45] [I] NVTX verbosity: 0
[12/21/2021-10:09:45] [I] Tactic sources: Using default tactic sources
[12/21/2021-10:09:45] [I] timingCacheMode: local
[12/21/2021-10:09:45] [I] timingCacheFile: 
[12/21/2021-10:09:45] [I] Input(s)s format: fp32:CHW
[12/21/2021-10:09:45] [I] Output(s)s format: fp32:CHW
[12/21/2021-10:09:45] [I] Input build shapes: model
[12/21/2021-10:09:45] [I] Input calibration shapes: model
[12/21/2021-10:09:45] [I] === System Options ===
[12/21/2021-10:09:45] [I] Device: 0
[12/21/2021-10:09:45] [I] DLACore: 
[12/21/2021-10:09:45] [I] Plugins:
[12/21/2021-10:09:45] [I] === Inference Options ===
[12/21/2021-10:09:45] [I] Batch: Explicit
[12/21/2021-10:09:45] [I] Input inference shapes: model
[12/21/2021-10:09:45] [I] Iterations: 10
[12/21/2021-10:09:45] [I] Duration: 3s (+ 200ms warm up)
[12/21/2021-10:09:45] [I] Sleep time: 0ms
[12/21/2021-10:09:45] [I] Streams: 1
[12/21/2021-10:09:45] [I] ExposeDMA: Disabled
[12/21/2021-10:09:45] [I] Data transfers: Enabled
[12/21/2021-10:09:45] [I] Spin-wait: Disabled
[12/21/2021-10:09:45] [I] Multithreading: Disabled
[12/21/2021-10:09:45] [I] CUDA Graph: Disabled
[12/21/2021-10:09:45] [I] Separate profiling: Disabled
[12/21/2021-10:09:45] [I] Time Deserialize: Disabled
[12/21/2021-10:09:45] [I] Time Refit: Disabled
[12/21/2021-10:09:45] [I] Skip inference: Disabled
[12/21/2021-10:09:45] [I] Inputs:
[12/21/2021-10:09:45] [I] === Reporting Options ===
[12/21/2021-10:09:45] [I] Verbose: Enabled
[12/21/2021-10:09:45] [I] Averages: 10 inferences
[12/21/2021-10:09:45] [I] Percentile: 99
[12/21/2021-10:09:45] [I] Dump refittable layers:Disabled
[12/21/2021-10:09:45] [I] Dump output: Disabled
[12/21/2021-10:09:45] [I] Profile: Disabled
[12/21/2021-10:09:45] [I] Export timing to JSON file: 
[12/21/2021-10:09:45] [I] Export output to JSON file: 
[12/21/2021-10:09:45] [I] Export profile to JSON file: 
[12/21/2021-10:09:45] [I] 
[12/21/2021-10:09:45] [I] === Device Information ===
[12/21/2021-10:09:45] [I] Selected Device: Xavier
[12/21/2021-10:09:45] [I] Compute Capability: 7.2
[12/21/2021-10:09:45] [I] SMs: 6
[12/21/2021-10:09:45] [I] Compute Clock Rate: 1.109 GHz
[12/21/2021-10:09:45] [I] Device Global Memory: 7773 MiB
[12/21/2021-10:09:45] [I] Shared Memory per SM: 96 KiB
[12/21/2021-10:09:45] [I] Memory Bus Width: 256 bits (ECC disabled)
[12/21/2021-10:09:45] [I] Memory Clock Rate: 1.109 GHz
[12/21/2021-10:09:45] [I] 
[12/21/2021-10:09:45] [I] TensorRT version: 8001
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::ScatterND version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::Proposal version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::Split version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
[12/21/2021-10:09:47] [I] [TRT] [MemUsageChange] Init CUDA: CPU +353, GPU +0, now: CPU 371, GPU 4842 (MiB)
[12/21/2021-10:09:47] [I] Start parsing network model
[12/21/2021-10:09:47] [I] [TRT] ----------------------------------------------------------------
[12/21/2021-10:09:47] [I] [TRT] Input filename:   model_opt.onnx
[12/21/2021-10:09:47] [I] [TRT] ONNX IR version:  0.0.6
[12/21/2021-10:09:47] [I] [TRT] Opset version:    12
[12/21/2021-10:09:47] [I] [TRT] Producer name:    pytorch
[12/21/2021-10:09:47] [I] [TRT] Producer version: 1.8
[12/21/2021-10:09:47] [I] [TRT] Domain:           
[12/21/2021-10:09:47] [I] [TRT] Model version:    0
[12/21/2021-10:09:47] [I] [TRT] Doc string:       
[12/21/2021-10:09:47] [I] [TRT] ----------------------------------------------------------------
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::ScatterND version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::Split version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Adding network input: 403 with dtype: float32, dimensions: (1, 12, 640, 640)
[12/21/2021-10:09:47] [V] [TRT] Registering tensor: 403 for ONNX tensor: 403
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: model.24.m.0.weight
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: model.24.m.0.bias
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: model.24.m.1.weight
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: model.24.m.1.bias
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: model.24.m.2.weight
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: model.24.m.2.bias
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 734
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 735
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 737
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 738
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 740
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 741
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 743
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 744
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 746
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 747
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 749
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 750
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 752
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 753
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 755
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 756
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 758
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 759
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 761
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 762
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 764
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 765
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 767
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 768
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 770
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 771
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 773
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 774
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 776
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 777
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 779
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 780
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 782
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 783
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 785
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 786
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 788
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 789
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 791
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 792
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 794
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 795
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 797
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 798
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 800
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 801
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 803
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 804
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 806
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 807
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 809
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 810
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 812
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 813
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 815
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 816
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 818
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 819
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 821
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 822
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 824
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 825
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 827
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 828
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 830
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 831
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 833
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 834
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 836
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 837
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 839
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 840
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 842
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 843
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 845
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 846
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 848
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 849
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 851
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 852
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 854
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 855
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 857
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 858
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 860
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 861
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 863
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 864
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 866
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 867
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 869
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 870
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 872
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 873
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 875
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 876
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 878
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 879
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 881
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 882
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 884
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 885
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 887
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 888
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 890
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 891
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 893
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 894
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 896
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 897
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 899
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 900
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 902
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 903
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 905
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 906
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 908
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 909
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 910
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 912
[12/21/2021-10:09:47] [W] [TRT] onnx2trt_utils.cpp:364: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 363
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 364
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 365
[12/21/2021-10:09:47] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647
[12/21/2021-10:09:47] [W] [TRT] onnx2trt_utils.cpp:390: One or more weights outside the range of INT32 was clamped
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 374
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 566
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 690
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 710
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 730
[12/21/2021-10:09:47] [V] [TRT] Parsing node: Conv_41 [Conv]
[12/21/2021-10:09:47] [V] [TRT] Searching for input: 403
[12/21/2021-10:09:47] [V] [TRT] Searching for input: 734
[12/21/2021-10:09:47] [V] [TRT] Searching for input: 735
[12/21/2021-10:09:47] [V] [TRT] Conv_41 [Conv] inputs: [403 -> (1, 12, 640, 640)[FLOAT]], [734 -> (32, 12, 3, 3)[FLOAT]], [735 -> (32)[FLOAT]], 
[12/21/2021-10:09:47] [V] [TRT] Convolution input dimensions: (1, 12, 640, 640)
[12/21/2021-10:09:47] [V] [TRT] Registering layer: Conv_41 for ONNX node: Conv_41
[12/21/2021-10:09:47] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32
[12/21/2021-10:09:47] [V] [TRT] Convolution output dimensions: (1, 32, 640, 640)
[12/21/2021-10:09:47] [V] [TRT] Registering tensor: 733 for ONNX tensor: 733
[12/21/2021-10:09:47] [V] [TRT] Conv_41 [Conv] outputs: [733 -> (1, 32, 640, 640)[FLOAT]], 
[12/21/2021-10:09:47] [V] [TRT] Parsing node: Sigmoid_42 [HardSwish]
[12/21/2021-10:09:47] [V] [TRT] Searching for input: 733
[12/21/2021-10:09:47] [V] [TRT] Sigmoid_42 [HardSwish] inputs: [733 -> (1, 32, 640, 640)[FLOAT]], 
[12/21/2021-10:09:47] [I] [TRT] No importer registered for op: HardSwish. Attempting to import as plugin.
[12/21/2021-10:09:47] [I] [TRT] Searching for plugin: HardSwish, plugin_version: 1, plugin_namespace: 
[12/21/2021-10:09:47] [E] [TRT] 3: getPluginCreator could not find plugin: HardSwish version: 1
[12/21/2021-10:09:47] [E] [TRT] ModelImporter.cpp:720: While parsing node number 1 [HardSwish -> "407"]:
[12/21/2021-10:09:47] [E] [TRT] ModelImporter.cpp:721: --- Begin node ---
[12/21/2021-10:09:47] [E] [TRT] ModelImporter.cpp:722: input: "733"
output: "407"
name: "Sigmoid_42"
op_type: "HardSwish"

[12/21/2021-10:09:47] [E] [TRT] ModelImporter.cpp:723: --- End node ---
[12/21/2021-10:09:47] [E] [TRT] ModelImporter.cpp:726: ERROR: builtin_op_importers.cpp:4643 In function importFallbackPluginImporter:
[8] Assertion failed: creator && "Plugin not found, are the plugin name, version, and namespace correct?"
[12/21/2021-10:09:47] [E] Failed to parse onnx file
[12/21/2021-10:09:47] [I] Finish parsing network model
[12/21/2021-10:09:47] [E] Parsing model failed
[12/21/2021-10:09:47] [E] Engine creation failed
[12/21/2021-10:09:47] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec [TensorRT v8001] # /usr/src/tensorrt/bin/trtexec --onnx=model_opt.onnx --verbose

@wfeii1980
Copy link
Author 

diff --git a/source/device/tensorrt/trt_limit.hpp b/source/device/tensorrt/trt_limit.hpp
index 0a9402e7..396d2834 100644
--- a/source/device/tensorrt/trt_limit.hpp
+++ b/source/device/tensorrt/trt_limit.hpp
@@ -88,7 +88,7 @@ const int trt_supported_ops[] = {
 //        OP_GRU,
 #endif
     //        OP_HARDSIGMOID,
-    //        OP_HARDSWISH,                   // Not supported, last checked version 7.1.3
+    OP_HARDSWISH,                   // Not supported, last checked version 7.1.3
     OP_INPUT,
     OP_INSTANCENORM,
     OP_INTERP, // should be as UpSample

@ringwraith
Copy link 

diff --git a/source/device/tensorrt/trt_limit.hpp b/source/device/tensorrt/trt_limit.hpp
index 0a9402e7..396d2834 100644
--- a/source/device/tensorrt/trt_limit.hpp
+++ b/source/device/tensorrt/trt_limit.hpp
@@ -88,7 +88,7 @@ const int trt_supported_ops[] = {
 //        OP_GRU,
 #endif
     //        OP_HARDSIGMOID,
-    //        OP_HARDSWISH,                   // Not supported, last checked version 7.1.3
+    OP_HARDSWISH,                   // Not supported, last checked version 7.1.3
     OP_INPUT,
     OP_INSTANCENORM,
     OP_INTERP, // should be as UpSample

Thanks for the solution!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ringwraith @wfeii1980