Just wondering, since you are significantly lower in rating and it's an easy to miss rule - did you make sure to count each 'large' model (which is all Ogres sans Halfgrowns and Youngbloods) as being worth 20 towards the warband rating?
Per the base rulebook, every large model contributes 20 to the warband rating, not the 5 a normal-sized model counts. If you missed that rule, it may account for the big difference in rating.
That said, I would not put too much stock into warband rating for any warband. It's a very rough indicator of a warband's power level, plus you get the underdog bonuses if you are far enough behind in rating. Underdog bonus XP can help alleviate some of the pain of the Slow-Witted rule.