A new business is set to open at what was once the Cavalier Inn