A control rod guide frame comprises a self supporting stack of two or more columnar elements defining a central passage. The columnar elements may include mating features that mate at abutments between adjacent columnar elements of the stack. The control rod guide frame is suitably used in conjunction with a control rod drive mechanism (CRDM) operatively connected with at least one control rod, and a nuclear reactor core, in which the CRDM moves the at least one control rod into and out of the nuclear reactor core under guidance of the control rod guide frame. In another embodiment, a control rod guide frame comprises a stack of two or more columnar elements defining a central passage having a constant cross-section as a function of position along the central passage. In another embodiment, a control rod guide frame comprises an extruded columnar element providing continuous control rod guidance.