Simply by taste. If you are picking them for eating, when they start turning redish and yellow, it is time to pick them for eating. If you are using them for canning and/or perserves, they should be a little bit greener. Even the green ones will be sweat and eatable. Here in Texas, they are ready to be harvested now. My tree is so loaded down, I can't pick them fast enough.