A handwritten information management system, which includes a paper sheet document generation section that generates a paper sheet document in which plurality pieces of coded information including coordinate information indicating a position on a paper sheet and document identification information of the paper sheet document formed on the paper sheet are recorded; a paper sheet document registration section that registers the generated paper sheet document and an electronic document corresponding to the paper sheet document correlated with the document identification information; a handwritten information detection section that detects handwritten information handwriting on the generated paper sheet document; a handwritten information registration section that registers handwritten information identification information to identify the handwritten information correlated with the detected handwritten information; and an identification information management section that manages the document identification information and the handwritten information identification information.