SCALE brought vast amounts of storage space and virtual machines to the Swiss universities. SCALE-UP is now adding tools.
The volume of data stored worldwide is set to reach 40,000 exabytes – 40,000,000,000,000,000,000,000 bytes – by 2020, according to a study by the market research and consulting firm International Data Corporation (IDC). The global data mountain doubles in size every two years. Of course, academia also has to deal with this rapid growth in data. It needs powerful infrastructure to store data and effective tools to analyse them.
This is where the SCALE-UP project comes in. It aims to create a range of efficient data management tools. Nine project partners from the academic community are working together with SWITCH to develop cloud services for use in big data analysis, distributed computing, statistical data analysis, storage of large data volumes and other areas.
SCALE-UP is the successor to SWITCH's SCALE project and runs from August 2015 to the end of 2017. SCALE, which came to an end in the middle of 2015, developed SWITCHengines to offer virtual machines and storage on a scalable, cost-efficient cloud infrastructure. The service is already being actively used by the academic community. The SCALE-UP project is building on the success of its predecessor SCALE and intends to benefit from users' experiences by drawing up best practice documentation. This will promote optimal use of the new services in teaching and research. SCALE-UP will also set up a marketplace for future academic services. The outcome should be a complete package of services to help users navigate the flood of scientific data – byte by byte, exabyte by exabyte.