The investment firm co-founded by The Spectator magazine owner and GB News backer Sir Paul Marshall has seen its yearly profit slide by nearly two-thirds.