The present teaching relates to method, system, medium, and implementations for configuring an animatronic device. Information is received about performance of a user exhibited in a dialogue between the user and an animatronic device which conducts the dialogue with the user in accordance with a configuration. The effectiveness of the configuration with respect to the user is assessed based on the information about the performance of the user and is used for machine learning at least one model, which is then used to adjust the configuration to generate an updated configuration for the animatronic device to use to continue the dialogue.