Yes, that would be a good idea. Then wait for the soil to dry out most or all of the way at depth before watering again. The surface layer dries out much sooner so it is not reliable as an indicator of moisture deep in the root zone. Strong light will help speed up evaporation, as will warm temps, like near room temperature (high 60s/low 70s) during the day.
