A portable microscope apparatus operated with an image capture device includes a sample carrying module, a lens module, a first polarizer and a second polarizer. The sample carrying module includes a transparent carrier and a sample adhesive element including a substrate and a glue layer. The substrate has a concave portion and an extending portion. The concave portion is adjacently connected to the extending portion to form a first surface. The glue layer is at least partially disposed on the first surface and in an integrated form with the substrate. The lens module is detachably connected to the image capture device, and disposed between the sample carrying module and the image capture device. The first polarizer is disposed on an optical path on one side of the sample carrying module. The second polarizer is disposed on the optical path on the other side of the sample carrying module.