I just worked on an issue addressing mismatched behavior of an operator between compiled and eager modes. While implementing the test to verify the fix I noticed not all operator groupings in common_methods_invocations.py include the ref operators:
These groupings are used in some tests such as test_reductions. When I modified the test to run also for the ref operators there were some failures so this seems like a testing hole that may be allowing for some mismatched behavior between eager and compiled modes but maybe it’s intentional? I’d like to go through and fix some of these unless that’s something that has been looked at before but I couldn’t find any bugs about this but maybe I’m not looking in the right places.
I think we’d definitely appreciate fixes along these lines. There isn’t really anyone captaining the ship here, so you may need to figure out precisely what the right strategy is.
So finally finished going through the first batch of failures when getting some of the tests to run for _ref operators as they do for the eager mode ones. Good news is that it seems most of the failures are just due to inherited attributes in the test definitions that resulted in some tests not being skipped for the _ref versions as they are in the eager version. There is one issue that seems to be a legitimate issue and filed issue Inconsistent behavior for _refs.fft.* operators when input is an empty tensor · Issue #105986 · pytorch/pytorch · GitHub.
Hoping to get some more test results and see what else needs to be addressed.