Development Tips & Tricks

Conda

• If there are changes to only .py files, rebuilding ORT doesn't update the .py files correctly in the build dir. In this case, these changed files need to be copied over to the build dir and the wheel must be rebuilt.

Docker

VScode

• Setting up VScode with remote VM
• Debugging within Vscode

Debugging with gdb / pdb

Common debugging Tricks

• Getting the .onnx inference/training graph
• Enable I/O Dump
• Enable execution plan and memory plan dump
• Enable CPU profiling dump
• Enable CUDA memory consumption logs