Implementing OpenCL backend for pytorch

Or I need to modify pytorch source for out-of-tree backend?