The critters are there because poor quality potting soil was used by the nursery. That said, I don't recommend trying to replace the soil. The critters will not harm the plant and are not the cause of the frond browning.
If you post a photo of the entire plant, we would be better able to identify the type of Palm (I fear it may be a Majesty Palm!) and diagnose the problem.