We take a look at the approach adopted by a research project to deal with Wi-Fi performance problems.
IT departments are used to hearing university members complain about poor wireless performance because the websites they want to look at take ages to load, but why exactly does this happen? Are end-user devices not set up correctly? Are sudden bottlenecks happening because there is not enough bandwidth? Could there be other reasons?
It is really not so easy to find where the problems are and offer a quick solution to them. Hardly any long-term data and histories are available for recording and assessing Wi-Fi performance problems on campus, which makes it very difficult to reconstruct problems after the fact.
With this in mind, SWITCH has taken the lead in a GÉANT task to develop a wireless crowdsourced performance monitoring and verification (WCSPMV) concept that can be used to track performance and the causes of problems affecting it with the aid of end-user feedback. The focus here is on non-invasive bandwidth tests on end-user devices. We gained some initial experience at the TERENA Network Conference 2015, where we presented the concept live. Further implementations and concept improvements are currently under way at a number of universities.
A mobile client (see figure) connects to the nearest access point (AP). It authenticates and authorises itself and receives an IP address from the DHCP server. DHCP, system and/or RADIUS log files are thus created (see "Data Sources"), which allows matching of the client MAC address with the client IP address and of the access point identifier (AP-ID) and time stamp of the successful attempt to connect with the campus wireless network. These data are now entered into a relational database (RDB) and analysed or prepared for visualisation by an analytics engine (AE).
These data can now be called up as needed from the RDB and the AE via a graphical user interface (GUI) to produce reports for the wireless network operator. Attention must be paid here to data protection (see box). These are, after all, personal data that provide information on the end user's behaviour.
We presented the concept described above for the first time at the TERENA Network Conference (TNC2015) in Porto, Portugal and tested it live. We deliberately chose a relatively large conference because the accuracy of measurement depends on the number of Wi-Fi users (crowdsourcing).
During the conference, we were able to carry out initial rough analyses of the network bandwidth and latency data collected and trace the crowding effect that happens when lots of conference participants are in the same place. We took over 1,700 performance measurements at TNC2015, sorted them into complete data sets and correlated them.
The chart shows the download and upload speeds in the large conference hall where the plenary sessions and presentations were held. The hall was equipped with several APs. At a first glance the results showd not clear patterns, but we could separate them by access pionts.The Radius logs told us which IP address was in use at wich access point, and when. We recorded an average download speed of 662.9 KB/s and an average upload speed of 406.5 KB/s. This suggests a high degree of fluctuation. As expected, we saw that the distance to the AP affects the quality of measured data. It also became clear that the image was too small at 1 megabyte and bigger sizes (e.g. 2-5 megabyte) would not compromise the available bandwidth.
The latency chart paints a somewhat clearer picture. Our test showed three things:
Our first test confirmed our assumption that it is possible to collect information on Wi-Fi performance using non-invasive bandwidth tests on end-user devices. The tests supplied relatively good information:
Further test implementations are planned or already running at various locations, including Dublin City University (DCU) and a small Internet service provider.
Improvements and innovations are being incorporated into the concept in terms of measurement data verification, automation of data collection and processing, drawing up a suitable RDB/AE concept with appropriate software and the GUI as a front end for network administrators.