Starting from iOS 7.1 Apple offers a built-in Holiday calendar which cannot be deleted.
You can only disable this calendar, it's mentioned in the 'Other' category.
Please see https://weekcalendar.zendesk.com/entries/23257291 how to hide a calendar.