How do we do mid layer integration after Aten fx graph

compiler
1

Hi all,

How do we do mid-layer integration after the Aten FX graph?

I have a custom backend compiler in cpp that compiles a custom graph data structure. I wanted to convert the final Aten fx graph into my own custom graph data structure and get the binary out and run on the hardware.
Could someone point me to this?

2

Can somebody help me?

3

cc @SherlockNoMad might be able to help?

4

Sounds like you will need

  • A converter that convert from FX-aten graph into your own custom graph
  • A python binding for your cpp backend, if you wish to run your backend in python env.

Also, you can find examples of NvFuser, OnnxRuntime, XLA from this thread [Dynamo] Integrating CapabilityBasedPartitioner in PyTorch/XLA · Issue #4758 · pytorch/xla · GitHub

1 Like
5

Thanks for the pointers. I’ll check it out.