Short answer, “yes, sort of”.
Generally speaking you can think of crystal energetics like aetheric homeopathics in one a sense and in another sense as adornment for your energy body, auric body, and emotional body.
The resonant frequencies and energetic offputs happen within a range, higher power closer to the gem’s center. But since much of the effects we want are occuring energetically, emotional, etc we are looking to get them close to these bodies.
The energy body has layers ranging up to an inch off the surface of the skin; the auric body is arms length every direction; emotional body exists inside of this space. And these energetics aren’t inhibited by non living material, ie clothes. So if it’s worn on your physical body, skin contact or not, it’s well WITHIN the bodies in question. Plenty close to do it’s work.
That said.
I have noticed quite consistently that some stones, especially those that naturally hold and generate a piezoelectric charge, do better in direct contact with the physical body. So much so that I often set stones on the back sides of pendants, or in such a way as to make contact with the skin.
One caveat I’ll add that goes both ways:
Organic fiber clothes interfere less and in some cases can “pass through” or even enhance charge. Silk for example seems to do this well (crystals in a neck pouch of pure silk, good plan). Wool is good. Cotton is better. Linen actually does best for the bodies’ electromagnetic fields. Interestingly wool+linen is stated as bad in the Bible. Some possibility that it’s because it negates and harms the body field.
On the other hand synthetic fibers in every case make it worse. Add the skin/body reaction to leachable plastics and you actually get a bodily resistance to fields when wearing synthetic fibers. The only exception being the tree fiber options - tenocelle, rayon, etc- are a sort of good/bad neutral result.
So, ultimately if you notice a difference it’s worth it. At minimum there’s an internationality to it that enhances your non ordinary coordination with the gemstone (read my comment elsewhere about manifestation mechanisms).