For small frayed areas on a hat, one option is to deal with them in some way or leave them as they are......