An ingrown hair on the penile shaft occurs when a hair grows into the skin. Ingrown hairs do not usually require treatment, but some remedies can improve the symptoms. Learn more here.