Victoria Barracks was built in 1864 and served as the Queensland headquarters for the Queensland colonial forces and then after Federation (1901) as the Queensland state headquarters for the Australian Military Forces (AMF). Over the next five decades, the barracks site received additional buildings. The major expansion occurred during World War I (1914–18) when 15 buildings were either constructed to or received additions. Blackall Street (now defunct) separated Victoria Barracks from the neighbouring Queensland Police Barracks.

On 3 September 1939, at the outbreak of World War Two, signals were despatched by telephone, radio, telegram and even across cinema screens to mobilise the small permanent forces based in Queensland plus the local AMF (militia) units. The inner-city, Petrie Terrace site had been effectively been built-out so there was no room for the type buildings (e.g. motor garages and workshops) required for the new war effort. Victoria Barracks retained its importance as a command headquarters but was responsible for the less-glamorous tasks associated with army administration or 'red-tape'.