If there is a good reason (i.e the characters attend a concert or take part in a grand ball), it would be more of a "gimmick" - and a cool one, if not overused.
If just used to set the mood... well, audionovels frequently do this - sometimes it helps, sometimes it distracts.