If he speaks while looking a the person's face then he mean no disrespects. He's probably just uncomfortable with the wardrobe.
Strange, some girls would find it offensive if men ogles them. There's a high chance of getting slapped too.
You humans are complicated lot.