It's one of the oldest municipal parks in the city and it's perfect for a springtime stroll