With reference to BKM for PyTorch CPU Performance (github.com), the vision based models are faster in NHWC than NCHW. Instead of having API level enablement, created PR Enable Optimized Performance Boost for 2D Forward Convolution with Channel Last by akote123 · Pull Request #117845 · pytorch/pytorch (github.com) to make NHWC default for convolution.
Please share view on defaulting NHWC for Convolution Op.