A team of researchers who say they are from the University of Zurich ran an “unauthorized,” large-scale experiment in which they secretly deployed AI-powered bots into a popular debate subreddit called r/changemyview in an attempt to research whether AI could be used to change people’s minds about contentious topics.

more than 1,700 comments made by AI bots

The bots made more than a thousand comments over the course of several months and at times pretended to be a “rape victim,” a “Black man” who was opposed to the Black Lives Matter movement, someone who “work[s] at a domestic violence shelter,” and a bot who suggested that specific types of criminals should not be rehabilitated.

The experiment was revealed over the weekend in a post by moderators of the r/changemyview subreddit, which has more than 3.8 million subscribers. In the post, the moderators said they were unaware of the experiment while it was going on and only found out about it after the researchers disclosed it after the experiment had already been run. In the post, moderators told users they “have a right to know about this experiment,” and that posters in the subreddit had been subject to “psychological manipulation” by the bots.

  • dukeofdummies@lemmy.world
    link
    fedilink
    English
    arrow-up
    14
    ·
    11 hours ago

    … well how many deltas did it get?

    I hate it as an experiment on principle but c’mon how well did it do?

  • RightHandOfIkaros@lemmy.world
    link
    fedilink
    English
    arrow-up
    27
    ·
    edit-2
    16 hours ago

    To be fair, I can see how it being “unauthorized” was necessary to collecting genuine data that isn’t poisoned by people intentionally trying to soil the sample data.

  • Grool The Demon@lemmy.world
    link
    fedilink
    English
    arrow-up
    53
    ·
    18 hours ago

    I remember when my front page was nothing but r/changemyview for like a week and I just unsubscribed from the subreddit completely because some of the questions and the amount of hits felt like something fucky was going on. Guess I was right.

    • quid_pro_joe@infosec.pub
      link
      fedilink
      arrow-up
      16
      ·
      12 hours ago

      Same happened to the relationshipsadvice and aita subreddits, the number of posts suddenly skyrocketed with incredibly long, overly-detailed stories that smacked of LLM-generated content.

    • notabot@lemm.ee
      link
      fedilink
      arrow-up
      20
      ·
      15 hours ago

      It’d be pretty trivial to do the same here, 1700 or so comments over ‘several months’, is less than 25 a day. No need even for bot posting, have the LLM ingest the feed, spit out the posts and have the intern make accounts and post them.

      • nectar45@lemmy.zip
        link
        fedilink
        arrow-up
        3
        arrow-down
        1
        ·
        13 hours ago

        Well at least this place is exclusively where people who got banned from reddit end up so they will struggle to find us at least…

  • besselj@lemmy.ca
    link
    fedilink
    arrow-up
    35
    ·
    18 hours ago

    It’ll be interesting to find out if this research got IRB approval prior to the study

  • Ogmios@sh.itjust.works
    link
    fedilink
    arrow-up
    25
    ·
    17 hours ago

    I remember the good old days when the NSA had to physically fly an airplane over the border and spray one of our towns with chemicals if they wanted to run psychological experiments on people!

  • Dr. Bob@lemmy.ca
    link
    fedilink
    English
    arrow-up
    18
    arrow-down
    1
    ·
    edit-2
    18 hours ago

    …posters in the subreddit had been subject to “psychological manipulation…

    There are no users there. It’s just bots talking to other bots.

  • AmidFuror@fedia.io
    link
    fedilink
    arrow-up
    8
    ·
    17 hours ago

    If you think this is shocking, just wait for the big reveal about r/StanfordBasement.

  • BilboBargains@lemmy.world
    link
    fedilink
    arrow-up
    1
    arrow-down
    9
    ·
    11 hours ago

    What difference does it make if you’re talking to a bot? We never meet our interlocutors anyway. Would these people have the same reaction if it were revealed they were talking to a role playing person because I’m pretty sure we’ve already done that many times over.

    • Flagstaff@programming.dev
      link
      fedilink
      English
      arrow-up
      5
      ·
      4 hours ago

      What kind of question is this? A role-playing person talking to others who don’t know they’re role-playing is deceitful, so are you saying there’s absolutely nothing wrong with deception?

      It’s generally expected outside of /r/jokes, /r/twosentencehorror, etc. that the people you’re talking to are telling the truth as they know it, or else why talk at all?

      • BilboBargains@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        39 minutes ago

        I don’t know what your experience is on Reddit but mine came to be that what I was reading couldn’t be trusted. I remember stumbling across a post on some technical subject that I happen to understand very well and couldn’t believe the twaddle that was advanced in the comments with utter conviction and certainty. It got me thinking about all the things I had read and just accepted because I know nothing about them. This is our information landscape, for better or worse.

        Why should it be any different in a role playing scenario? These platforms are motivating engagement and people love an emotional story and so that is presented to us. If we loved true stories more, we would get them instead. I don’t think there’s any malice intended, we’re getting what we want because morons love their feels over their knowledge. It’s the reason the Americans have Trump and Elon and antivax, these people inhabit social media but it is the last thing they should turn to for truth because they are dumb as a sack of rocks and are getting played, shorty.