Phillipsburg's Historic District extends from Union Square to the Black Bridge on South Main Street. In 2009 the district was designated as a Historic District, listed on the State and National Registers of Historic Places. South Main Street was originally called George Street, named for the King George II of England.
The southern portion of this area was largely fashionable residential dwellings with several constructed with a setback allowing for front yards until about 1928. After the Phillipsburg Trust Company construction, the Elks Building, and the Phillipsburg National Bank, South Main Street transformed from a quiet street into a small town commercial district.
Shortly after eighteen hundred, Thomas Bullman built a tavern on Union Square and later sold it to Mr. Albright so that it was known for many years as Albright's tavern. In 1810, John Roseberry built the present Union Square Hotel. Across the street to the north was the Lee House was built in 1811 for a store kept by John Mixsell. Over the years, many of the structures in Union Square have been replaced and repurposed for other businesses, while other properties in the square are available for acquisition and renewal.