A railway service between Wellington and Palmerston North began in 1886. The line ran through the Square until after the Milson Deviation was completed in 1959. In 1964 the last passenger train ran through the Square and the tracks were removed.