A portable memory device comprises a housing, a circuit board, and a covering member. The portable memory device is convenient to use since the plug of the memory device can be easily exposed or covered simply by a pulling or pushing action. Furthermore, no matter whether the portable memory device is in use or not, its rear end is always closed to prevent foreign objects from entering the housing and causing damage to the circuit board.