If they're both over 20, most people won't have a problem. Especially if the younger person is a man.
If the younger one is 18-19, more people will find it iffy, but acceptable. Again if the younger one is male, most will see it as OK.
If the younger one is 17 and under, or worse, under 12...