I honestly don’t know if you have to have your operational transponder on when you are not in controlled airspace or not but in Alaska seeing a transponder being turned off is so common that we called it the “cloaking mode”.

Craig Berland

Might be wrong, but I think the regs say that if you have an operational
transponder you must have it on and operating while flying.

Jim