If you have data contained in a Custom Field that relates to a specific tag group – if that contact is un-tagged with the associated tag then the custom field data is not lost. 

It is simply hidden until the contact is re-tagged with the tag group associated to the custom field– where the information will then be displayed once again.

Please see below an example of some Custom Fields linked to the tag 'new-lead':