You probably get a lot of funny looks when you employ that adjective.
Some of the looks are from borderline homophobes, who believe that you’d have to be a little too effeminate to be interested in men’s clothing. You can ignore them and their loafer-lightening prejudices.
A large contingent will not know what you mean, or are your fellow-travelers: pseudo intellectuals who falsely believe that ‘sartorial’ has something to do with Jean Paul Satre, and his existential philosophy. The funny look you’re seeing from the them is a simulacrum of understanding, masking their confusion.
The last group will know that many people will not understand the word. They are looking at you strangely because they think you’re a pretentious wanker.
You will find an hirsute, out-of-work intergalactic overlord with questionable tastes in his own clothes among that latter crowd.
Next time: If I use the word simulacrum, does that make me a pretentious wanker?