I promise you that they are not apples.
Perhaps someone added pepper seeds to your pots while preparing a salad, salsa, etc.?
If the potting mix was reused, then the seeds could have been in the mix.
Your peppers are already blooming so fruit should set soon. Peppers can self-pollinate if you just give the plant/blooms a bit of a shake. They will produce better outside, of course. As JBarstool mentioned, be sure to put them in shade at first and then acclimate them slowly to the sun since they've been inside.
