If I enable the encryption, will it be visible to everyone in the domain?

Yes. It will be visible to all the users in your domain. If you want to remove encryption for specific users, click on the drop-down beside the domain name and select users from the list.