PyTorch 2.x Inference Recommendations

[spiegelball]

Do you have any sources on AOTI inference on mac? I only found this: AOT Inductor and macOS · Issue #119803 · pytorch/pytorch · GitHub

And regarding TorchScript, the latest info I saw is coming from this thread:

What's the difference between torch.export / torchserve / executorch / aotinductor?

We will not deprecate TorchScript without a suitable (and technically superior) replacement. I think the key missing piece, which we are developing but have not yet released, is a generic interpreted runtime that uses libtorch to execute the graph in a target-independent way, optionally calling out to compiled artifacts for acceleration. So the proposed TorchScript replacement flow would be: On the frontend: torch.export → compile subgraphs/whole graph with inductor → packaged model (graph, …

Is it deprecated now?