A rechargeable alkali metal battery comprising: (a) an anode comprising an alkali metal layer and a dendrite penetration-resistant layer comprising an amorphous carbon or polymeric carbon matrix, an optional carbon or graphite reinforcement phase dispersed in this matrix, and a lithium- or sodium-containing species that are chemically bonded to the matrix and/or the optional carbon or graphite reinforcement to form an integral layer that prevents dendrite penetration, wherein the lithium- or sodium-containing species is selected from Li2CO3, Li2O, Li2C2O4, LiOH, LiX, ROCO2Li, HCOLi, ROLi, (ROCO2Li)2, (CH2OCO2Li)2, Li2S, LixSOy, Na2CO3, Na2O, Na2C2O4, NaOH, NaX, ROCO2Na, HCONa, RONa, (ROCO2Na)2, (CH2OCO2Na)2, Na2S, NaxSOy, or a combination thereof, wherein X═F, Cl, I, or Br, R=a hydrocarbon group, x=0-1, y=1-4; (b) a cathode; and (c) a separator and electrolyte component; wherein the dendrite penetration-resistant layer is disposed between the alkali metal layer and the separator.