Aaron - Don't even think about moving them outdoors just yet. Even as temps rise over the next few days here, they will not stay that way this early. In addition, your plants need time to adapt to their new home. Keep them in those pots and on a sunny windowsill where it stays warm. Water them thoroughly as soon as the surface of the soil feels dry.
When night temps are consistently above 60 degrees (sometime in June), you can consider moving them outside, but into light shade. If they are exposed to direct OUTDOOR sun, they will burn up. And don't try to plant them in the ground outside.
Be patent with your new plants.