Techniques are described for using a smart phone or other mobile device to perform automated operations for generating panorama images of building environments and for subsequently using the generated panorama images in further automated manners. In at least some situations, the generation of a panorama image by a mobile device is based at least in part on automatically acquiring multiple constituent images on the mobile device in multiple directions from an acquisition location and on concurrently combining acquired constituent images on the mobile device, such as in a real-time manner relative to the constituent image capture, to generate a panorama image with 360° of horizontal coverage of the view from that acquisition location. Information about such identified building floor plans may be used in various automated manners, including for controlling navigation of devices (e.g., autonomous vehicles), for display on client devices in corresponding graphical user interfaces, etc.