Turning big data into an engine of economic growth - BT Advise team helps explore a new world of information for the betterment of business and society
Big data doesn’t come much bigger than the national census. Taken every ten years, it’s a multi-terabyte treasure trove, yielding astonishingly detailed insights into changing patterns in British life.
Glen Watson, director general of the Office for National Statistics, had his imagination tested after the 2011 census. Starting right there, his challenge was to transform all ONS data and make it available online.
Watching closely were government, business and academia. Working alongside him were BT professional services consultants – whose collaborative way of working was central to Glen’s success.
With 120 BT people working on the project at its height, collaboration was a critical success factor and dedicated BT office space was allocated to house the joint BT/ONS team, just one benefit of working with an organisation having unmatched global resources.
A creative pairing of our organisation with the deep big data expertise brought by BT was an ideal match when we decided to transform public access to our information.
Perfectly suited to that collaborative mind-set the Agile project management methodology was another key to the team’s success, offering an iterative approach that’s tolerant of specification and scope changes.
With 1.6 terabytes of information in just the census alone, the sheer scale of the data configuration and management task was daunting, underlining the wisdom of engaging with industry-recognised experts.