Hi pnegyesi,
I’m afraid it isn’t designed to allow that – the category setting is just that, a setting, but front end users (visitors to your site, in other words) will not be able to do the same thing.
It’s probably possible to implement this as a customization – our Themer’s Guide is a great starting point if you want to investigate that possibility – and we’d also be more than happy to review this as a feature request if you’d like to post one 🙂
Thanks!