The list of ‘tags’ under the Global Custom Fields is derived from the ‘global Tags’ so if you remove a tag which is used as an associated tag in custom fields then it will change; so that the custom field is then associated to all contacts rather than the tag group it should be associated with.
The example below shows Custom Fields that are associated to 'All Contacts' and not a tag group:
If you have any questions please contact our Support Helpdesk.