Blackburn Rovers could've had a man advantage at Fratton Park, according to a former senior official