I can delete calendar only have my calendar selected.  

As soon as I click on for everyone’s calendar it doesn’t give me the confirmation pop up to delete the record.

PS: I am the only organizer for the record that I want to delete.