Perhaps you’ve seen pages of the following scary error:
../aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [99,0,0], thread: [115,0,0] Assertion `index >= -sizes[i] && index < sizes[i] && "index out of bounds"` failed.
It turns out there is a relatively simple way to figure out what the indexing issue is. The internet suggests prepending
CUDA_LAUNCH_BLOCKING=1
to your command, but this doesn’t seem to help much either. There is a simpler solution: run whatever you’re doing on CPU. It’ll give you much nicer errors.