Invention Grant
- Patent Title: Graphical systems and methods for human-in-the-loop machine intelligence
-
Application No.: US16221254Application Date: 2018-12-14
-
Publication No.: US11295071B2Publication Date: 2022-04-05
- Inventor: Robert J. Munro , Christopher Walker , Sarah K. Luger , Jason Brenier , Paul A. Tepper , Ross Mechanic , Andrew Gilchrist-Scott , Gary C. King , Brendan D. Callahan , Tyler J. Schnoebelen , Edgar Nunez , Haley Most
- Applicant: 100.co, LLC
- Applicant Address: US FL Miami Beach
- Assignee: 100.co, LLC
- Current Assignee: 100.co, LLC
- Current Assignee Address: US FL Miami Beach
- Agency: Stetina Brunda Garred and Brucker
- Main IPC: G06F40/169
- IPC: G06F40/169 ; G06F16/242 ; G06F16/35 ; G06F16/93 ; G06F16/28 ; G06F16/36 ; G06F16/951 ; G06F16/332 ; G06F16/2453 ; G06Q50/00 ; G06F40/30 ; G06F40/40 ; G06F40/42 ; G06F40/137 ; G06F40/221 ; G06N20/00 ; G06F3/0482

Abstract:
Methods and systems are disclosed for creating and linking a series of interfaces configured to display information and receive confirmation of classifications made by a natural language modeling engine to improve organization of a collection of documents into an hierarchical structure. In some embodiments, the interfaces may display to an annotator a plurality of labels of potential classifications for a document as identified by a natural language modeling engine, collect annotated responses from the annotator, aggregate the annotated responses across other annotators, analyze the accuracy of the natural language modeling engine based on the aggregated annotated responses, and predict accuracies of the natural language modeling engine's classifications of the documents.
Information query