The 'hidden gem' is just a short walk from the historic streets of Edinburgh's city centre