Mapestone wrote:MikeA wrote: For quality tests I've thrown together a file of user inputs called SmallTalk: What did you do yesterday? Have any interesting dreams lately? Are you married? Have any kids? Do you like animals? ... I'm surprised at how poorly many chatbots perform, but I haven't established a benchmark.
Your thoughts MikeA?
That sounds like an excellent idea. Yes, I've noticed small talk shows up a bots weakness. I think a lot of botmasters focus on being clever, knowledgable or funny, rather than being good with small talk.
I've been compiling a list of common questions, along the same lines, but more topic based. I initially started doing this for the setting up of a database bot, but the same questions could be used for this.
I'm also keen to see how, within the confines of Verbot, the conversation can be taken beyound 1 question / 1 answer. This, too me is probably the biggest let-down of some o the more established bots. You often get conversations similar to this:
User:Do you like fruit?
Bot: Yes, I like apples very much.
User: Why?
Bot: Why is a word I am often asked, perhaps you can tell me why?
whereas what would be much better would be something like:
Bot: Because apples are juicy and sweet.
This is leads a bit to your semantic networks thread. Also, I think this can also be done by either keeping within a parent rule or keeping a 'subject' variable, or a combination of all these ideas.