Testing of a wireless communication network is performed by placing test devices in multiple geographic regions. The test devices may be typical consumer wireless devices, such as smartphones, of types that are used with the wireless communication network. Communication channels are established with the devices from a test controller, through a wide-area network such as the Internet and through USB ports or other wired interfaces of the devices. The test controller provides scripts that measure response times of applications that execute on the devices. The response times are used as indicators of network performance in the geographic regions. When the response time for a particular region exceeds a threshold, an operator may be notified or other automated actions may be initiated to address potential network problems in the region.