An accelerator loading apparatus obtains an acceleration requirement, where the acceleration requirement includes an acceleration function and acceleration performance of a to-be-created virtual machine, determines an image that meets the acceleration function and the acceleration performance, and determines a target host in which an available accelerator that can load the image is located, and then sends an image loading command to the target host. The image loading command includes a descriptor of the image, and is used to enable the target host to load the image for the available accelerator. In the method, a target host that can create the virtual machine may be determined based on the acceleration function and the acceleration performance of the to-be-created virtual machine, and an image used for acceleration is loaded to an available accelerator of the target host, to implement dynamic accelerator loading and deployment.