Why do my panels have little specs of rust on them?

It sounds like your contractor may have improperly cut your panels during installation. Steel shavings or particles from sawing sparks may become embedded in the painted surface if your contractor uses a saw to cut your material and does not brush away the metal shavings.