A method includes performing, with at least one processing device, natural language generation using both (i) a semantic word and clause representation generated from syntactically-labeled context and (ii) a syntax generated from common semantic relations between sequential words and clauses. Performing the natural language generation includes pushing words onto a stack based on the semantic word and clause representation and based on words and clauses already on the stack and popping the words and clauses off the stack to be replaced by clauses based on the syntax. Pushing the words onto the stack could be based only on components of the semantic word and clause representation coming from future context.