I have heard this too, stumbled upon an article where some of the performance filters may not filter as well and in turn can lead to extra wear on the engine.
Not something I would do. I think Autostyle sell these filters though if you really want them.