A system (such as a process control system or communication system) includes one or more sources of configuration data (such as one or more BootP or DHCP servers). A testing mechanism transmits one or more requests for configuration data over a network. One or more sources of configuration data may respond to the requests, such as by providing configuration data (like IP addresses or NTP parameters) to the testing mechanism. The testing mechanism uses the response(s) to identify problems with the sources of configuration data. For example, if responses are received from multiple sources of configuration data, the testing mechanism could generate a notification indicating that a problem exists when the responses contain inconsistent configuration data. Also, if no responses are received, the testing mechanism could generate a notification indicating that a problem exists since no configuration data has been received. Any other or additional problems could also be detected.