I've replicated and found the source of the problem. In boss dungeons theres a part of the room where you can climb, noclip through the geometry and get teleported outside with the textures going black. Perhaps they kill the whole map when ur in a dungeon to help save resources?

i dont know