You can change the permissions so that only experts, editors, mods and admins can post comments, questions, and answers. Certainly not ideal and gets messy if you have a lot of users in that category. Set viewing to Anybody.
If you needed to lock that down further then you can revoke extended permissions to everyone except you.
Admin --> Permissions