It is best to do what is called dead heading. Dead heading is removing the withered and wilted flower heads. This discourages the flowers from going to seed.
Dead heading will encourage a better bloom for the next year as seeding uses the plant's energy. It also gives your garden a nice tidy look.