The colored fibers I think are the fibers of the clothing one could be wearing, I've noticed fibers on my skin that happen to be the same color of the clothing I was wearing, specially if it's of organic material such as cotton or wool. I do believe that it could be Demodex mites population going out of control because of a auto inmune deficiency, I'm taking Tyroid medications. We have 2 kind of inmune system, the outerskin inmune system, and the internal organism inmune system, the one we are all familiar with. Demodex mites are out of control because of a weakening inmune system in the outer skin. A good healthy diet, lots of showers and cleaning and mint oil keep them under control.