I was recently reading Ben Aaronvitch’s ‘Rivers of London’ and I was struggling to follow the plot. So I engaged in discussions with both ChatGPT and Gemini and both really struggled to not make lots of mistakes. Both AIs would regularly give inaccurate info about major plot points, and when I questioned them about those issues, they would apologize profusely and then try to continue on. I basically had to coach them through to get them to remember important points of the plot! They also struggled to not reveal spoilers past a certain chapter. It was interesting to see the AIs repeatedly fail.

  • XiELEd@piefed.social
    link
    fedilink
    English
    arrow-up
    2
    ·
    12 days ago

    I like to run Local LLMs from time to time. The amount of “effort” they exert is about the same for both simple and hard questions.