This is exactly how I've approached it. I'm not on the clock? No problem, let me just do these few things real quick while they're on the front of my mind. It happens pretty often, and in some cases is helpful for me the next time I'm working.
Your last line is the kicker, and I couldn't agree more. It fails because of bad management. But I've also worked in studios (that were never remote) where bad management existed in the form of poor communication, production, etc. Bad management just exists in all forms, or management that could certainly be improved for the sake of the entire studio/project.
There's a trend in this thread, if you've worked from home or are actively doing it, you know that it IS very functional and effective. If not more so. Those that haven't and don't, don't see it that way, everyone is lazy, etc. Very "old man" perspectives for sure, lol.
That's what I thought until I started doing it myself. The studio I currently work for is the first one that I've worked for that has always been and will be fully remote, which was a first for me. The structure, communication, and workflow is some of the best I've ever experienced and it's all remote. So, that says a lot.
Meetings are still set and treated no different than they would be in office, video and voice calls are on the regular, and there's an active voice chat where people working through out the day hang out in. Need to share media, review something, etc.? Share the files, stream your screen, etc. I think we're at a point now where WFH has been more feasible than it ever was before. Especially for games and tech.