Gray lies just outside the junction between Interstate 81 and Interstate 26, the latter of which runs directly through the town. The town was founded as Gray Station, Tennessee, as it mainly served as a railway depot, the town became Gray for preferred usage. The Gray area consists primarily of rural farmland until the 1990s, when some suburban areas became to shape. Since 2000, the Gray area has been gradually growing more and more each year with new chain restaurants and museums like the Gray Fossil Site. Some of Gray has been annexed by Johnson City.