Could these be aphids? If so, spray with a pyrethrum-based insecticide. Gardens Alive! makes one called Pyola, and Safer, Bayer, Ortho, and many others each market a similar product. It is safe and organic. Check the ingredients list.
If you could send a detailed description of the pest, it would be very helpful.