Harem exclusively describes a situation where one character is the center of 3+ characters' attention (if there's only 2, then it's a love triangle, or possibly just a group of characters). Because of its Arabic root, it usually means one man and many women, though in general it's meant to be...