Frost Park on Main Street is one of the best-known parks in Yarmouth County. The area was not always a place for picnics and quiet strolls, rather, it was originally for graves. The first settlers of Yarmouth used this site as a burial ground until 1837. Further graves were placed on the eastern side of the land until 1859 when town officials realized the site was becoming a health hazard given its close proximity to the growing population and expanding downtown. In 1864, the Provincial Legislature declared the cemetery officially closed to any further burials. Among the graves found here were Phineas Durkee (died November 5th, 1801), who was the first English-speaking settler in Yarmouth, as well as Joseph Saunders and his wife Sarah. Mr. Saunders died on November 1st, 1801, and his wife died 27 days later, both at the age of 28.
After the cemetery was closed, the land was unused until 1887 when a group of trustees turned it into a park. At this time, they removed the gravestones, built a fountain, laid a walkway, and added benches, hedges, and trees. Once completed, they named it Victoria Park in honour of the Queen's Silver Jubilee. In 1958, the park's name was changed from to Frost Park in honour of Charles Sydney Frost. Mr. Frost, a Yarmouth County native, was a distinguished businessman who became president of the Bank of Nova Scotia in 1956. He began his career with the financial institution in 1908 at the age of 15. He first had a modest position, but before long, he was the Accountant for the St. John's, Newfoundland, branch. While working in St. John's, World War I broke out, and Mr. Frost enlisted with the Royal Newfoundland Regiment. He had a distinguished service career, rising from Private to Captain, and was awarded a military cross. He returned in 1919, and was appointed manager at the Bank of Nova Scotia branch in Fogo, Newfoundland. In the years that followed, he held positions of Assistant Manager and Manager at various branches across Canada, including Winnipeg, Saskatoon, and Toronto. Mr. Frost was a wonderful example of what perseverance and hard work can do for a person, and Yarmouth wanted to acknowledge that. They did so by dedicating this important park to him. A plaque located prominently in the park reads, "This park named in honour of Charles Sydney Frost, M.C. native son who, through diligence and ability became President of the Bank of Nova Scotia. June 14, 1956."