A method, system, and computer program product for accessible chart navigation using object neighborhood are provided. An input is received to navigate a focus away in a direction from a first object, the first object being a member of a set of objects depicted in a graphical visual chart. A set of inputs is designed to access the chart without using a pointing device or requiring visual inspection of the chart and the set of objects. The set of inputs includes the input and a second input to allow return to a previous step in navigating the chart. A second object is identified to which to navigate responsive to the input, the second object being located within a neighborhood of the first object at a shortest neighborhood distance from the first object. Navigation is performed to the second object to keep the focus within the neighborhood.