In order to view tag settings, go to 'Tags' on the JetBackup Management Console sidebar. Click on your desired tag to view the settings.
Make sure that the tag is not assigned to any corresponiding servers or job optimizers in order to delete it.