Could be a leaf fungus such as Botritis. I had about the same thing last year, and nothing I did helped except to take the big shade leaves off. They are not needed anyway and that let the air and light thtough. I got a fine crop of tomatoes anyway.
I found that the Cottonwood and Popular trees had the same thing. Bad fungus year in Western Wa. in 2013.
The Tomato Lady