Embodiments provide swallowable devices, preparations and methods for delivering viable cells (VC) into the GI tract including GI wall tissue or other tissue site. Particular embodiments provide a swallowable device such as a capsule for delivering VC into an intestinal wall or other site. The VC can be contained within a tissue-penetrating shell disposed in the capsule that protects the VC as they pass through the GI tract until they are inserted into GI tract tissue or other location. The shell desirably has shape, size and material consistency to be contained in a swallowable capsule, delivered from the capsule into solid tissue by the application of force on the shell and biodegrade within the solid tissue to release the VC into the tissue. Within the shell or other structure the VC can be maintained in a viability-sustaining gel that preserves the viability of the VC for selected time periods.