But real compost that has been well composted at high enough temperature should not introduce any worms, although it will attract earthworms, which is a good thing.
Have you had your soil tested to determine the pH (acidity) factor? It's really good to know exactly what you're dealing with, and also after you take steps to improve the soil, you can test again to see your progress.
If you have a good nursery (plant grower/seller) near you, they should have some fertilizer formulated for acid-loving plants. They might even have some acidic soil amendments available too.
