No, highlight clear pattern is for removing file-name based highlighting like highlight {*.jpg} .... There are also no negative matches in regexps.
Vim handles this by proving ColorScheme auto-command so that switching between color schemes can re-run highlight for User*, but Vifm doesn't have this event.
You can try extracting highlight User* to a separate file and sourcing it from each colorscheme.