Actually it was explained. The fleet that was going to travel to the Sol system was around 500 ships strong, but the destruction of the Unyielding Hierophant caused the collateral damage of all but around a dozen Covenant ships, and that is the amount that ends up heading to Earth.

"Perhaps a dozen of their original five hundred craft had come through the explosion." - First Strike: The Definitive Edition, p.399.