A storage device includes a non-volatile semiconductor storage device including a plurality of physical blocks, and a controller. The controller maintains a mapping of logical addresses to locations within the physical blocks, receives, from a host, a command to start host initiated garbage collection where the controller copies data from an active block into an input block having free pages that is not written after erase operation, receives, from the host, a command to receive data to be written from the host, writes the received data to the same input block, and receives, from a host, another command to start host initiated garbage collection where the controller copies data from an active block into the same input block.