Hi,
Considering your Zone and where you are, that's pretty much normal for this time of year. Also, annuals tend to go down hill fast if you don't remove spent flowers because making seeds take a great deal of energy from a plant. That's why you want to cut off the flowers before they go into making seed mode so that energy can be put to use making more flowers and leaves. Do leave a few flowers on though to make seeds if you want, but cut the rest off after they've finished blooming. Pansy's are cool weather flowers - we zone 8 people grow them in Winter.
Definitely feed them and try to keep the soil uniformly moist .. not soaking wet though.
