The reversed SM64 binary was compiled without optim IIRC though.

Of couse you can reverse an optimized binary, just launch IDA and start to have fun to get an idea of the work. Doable, but of course harder.