As an author, I actually like to do it, especially in modern stories. Like, I'll expect the readers to know what the fuck the apartment of a 20-something guy looks like. They've all seen one, probably.
The further a story strays from the reality of our world though, the more I'd step away from...