Trying to fill gap at mantle

I'm installing a 8x10 7 foot beam on a stone fireplace. Got it in okay on 5 5/8 rods but the stone is uneaven and there's a big gap. Any thoughts on what to fill it with?