A process for preparing aluminum oxide with a low calcium content, in which (1) crude alpha- and/or gamma-aluminum oxide with a total calcium content in the range from 50 to 2000 ppm, based on the crude alpha- and/or gamma-aluminum oxide, is mixed with an aqueous solution or suspension comprising the compounds selected from the group of inorganic acid, organic acid and complexing agent, (2) the mixture from step (1) is admixed with a flocculating aid, (3) in the mixture of step (2), the solids are separated from the liquid, (4) the solids separated are mixed with water in the presence or in the absence of a flocculating aid, (5) in the mixture of step (4), the solids are separated from the liquid, (6) optionally, steps (4) and (5) are repeated once or more than once, (7) optionally, the solids separated optionally after addition of further compounds, are dried.