Via @rodhilton@mastodon.social

Right now if you search for “country in Africa that starts with the letter K”:

  • DuckDuckGo will link to an alphabetical list of countries in Africa which includes Kenya.

  • Google, as the first hit, links to a ChatGPT transcript where it claims that there are none, and summarizes to say the same.

This is because ChatGPT at some point ingested this popular joke:

“There are no countries in Africa that start with K.” “What about Kenya?” “Kenya suck deez nuts?”

  • Eager Eagle@lemmy.world
    link
    fedilink
    English
    arrow-up
    172
    arrow-down
    34
    ·
    1 year ago

    when will people learn that search results change all the time and are different for different people

    • Sami@lemmy.zip
      link
      fedilink
      English
      arrow-up
      131
      ·
      1 year ago

      I get the same as the main post. Either way the point still stands. I had someone correct me with a misconception about something because he googled it and thats what it said in the answer box. It’s getting increasingly difficult to rely on search results especially when google synthesizes them into questions and answers with little context

      • cybervseas@lemmy.world
        link
        fedilink
        English
        arrow-up
        56
        ·
        1 year ago

        Yes. I have to keep reminding my parents that those little Google answer boxes aren’t real search results and can’t be trusted. They sometimes say the exact opposite of the page they’re citing!

      • QIZED@lemmynsfw.com
        link
        fedilink
        English
        arrow-up
        6
        arrow-down
        22
        ·
        1 year ago

        Either way the point still stands.

        What point?

        I had someone correct me with a misconception about something because he googled it and thats what it said in the answer box

        Oh, honey. You must be new here. Googling something, taking the first answer that fits your needs, doing zero follow up, and posting it confidently is nothing new. That has been happening for the last few decades.

        It’s getting increasingly difficult to rely on search results especially when google synthesizes them into questions and answers with little context

        In what way? Like always, I have had to do a little critical thinking to gain anything out of my google searches. But now, sometimes the answer is right there. In what world is that a bad thing?

        But you might just say “hurry durr it give me answer, therefore correct”. Again, yes, that has always been the case. People will use any tools available to them to support their point. If a new tool has less than a 100% success rate, I don’t see that as a problem.

        • Womble@lemmy.world
          link
          fedilink
          English
          arrow-up
          20
          arrow-down
          2
          ·
          1 year ago

          The point is that google is no longer just listing search results. For years now it has been giving the “correct” answer as well as results. This started of with things it could recognise and easily solve like calculations (“what is 432 times 548”), but has now moved into general queries powered by LLMs that have no knowledge of fact.

          • QIZED@lemmynsfw.com
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            18
            ·
            1 year ago

            Okay? As I said, google has been giving incorrect results for decades. Now, just like before, it gives incorrect answers sometimes. But it has gotten a LOT better at giving those correct answers.

            • SIGSEGV@sh.itjust.works
              link
              fedilink
              English
              arrow-up
              18
              arrow-down
              3
              ·
              1 year ago

              You are arguing on bad faith. It is a fact that Google results have been getting worse over time. What is your point? That with extra effort, you might get the answer you’re looking for? Google used to be the king of search! Other search engines don’t seem to have a problem answering the question is the point others are trying to make, despite Google’s massive revenue.

              • QIZED@lemmynsfw.com
                link
                fedilink
                English
                arrow-up
                3
                arrow-down
                13
                ·
                1 year ago

                It is a fact that Google results have been getting worse over time.

                Care to back up that unfounded claim?

                Other search engines don’t seem to have a problem answering the question

                Two for one! Mind giving me some supporting evidence? Nothing anecdotal, mind you. Show me that “other search engines” answer questions better than google, statistically.

                • SIGSEGV@sh.itjust.works
                  link
                  fedilink
                  English
                  arrow-up
                  10
                  arrow-down
                  2
                  ·
                  edit-2
                  1 year ago

                  I can back up that claim by pointing to the popularity of other search engines. People are now even paying to search because Google has become a nightmare due to SEO.

                  As to your other question: did you even read the other comments on this thread before you jumped to Google’s defense?

                  I used to totally be a Google fanboy, like you still are, but they’re failing us, dude, and somewhere deep down, I think you realize that.

                  • QIZED@lemmynsfw.com
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    1 year ago

                    I can back up that claim by pointing to the popularity of other search engines

                    I would love to see that research paper. Just to be clear: you are claiming that google is… Not the most popular search engine? Or that it is losing popularity?

                    You still haven’t answered my questions, though.

                • mayo@lemmy.today
                  link
                  fedilink
                  English
                  arrow-up
                  5
                  arrow-down
                  1
                  ·
                  1 year ago

                  Why don’t you show us some proof that google search is unchanged compared to what it was 10 years go.

              • QIZED@lemmynsfw.com
                link
                fedilink
                English
                arrow-up
                0
                arrow-down
                17
                ·
                1 year ago

                As to my point, it is that google searches have not failed me to date, AI has only improved it, and saying “but it gave me something wrong once!” is basically that “old man yells at clouds” meme.

    • Neato@kbin.social
      link
      fedilink
      arrow-up
      52
      arrow-down
      2
      ·
      1 year ago

      It doesn’t matter? If you search for something and you get a blatantly wrong answer parroted from an AI text completion service, it’s still a fail.

      I got the wrong answer from Google just now and I’ve never heard of that joke before. So clearly it isn’t just OP with polluted metrics.

      • Landrin201@lemmy.ml
        link
        fedilink
        English
        arrow-up
        4
        ·
        1 year ago

        I just tried it and got this result. The sentence is incredible, I can’t get over how painfully stupid it is.

        Apparently Kenya starts with a k sound and a letter that resembles k but not the letter k

    • OldFartPhil@lemm.ee
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      1
      ·
      edit-2
      1 year ago

      I get the result you got, but the Emergent Mind response is the second organic result. That’s still way too high.

    • deleted@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      1 year ago

      Interestingly enough, when I removed the word “letter” I got none. If I put it back I get Kenya.

      This was done on the same device and same browser session.

    • Notorious_handholder@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      1 year ago

      Take out “the letter” part and search as just: “countries in africa that start with k”. For some reason it seems the search involving the words “the letter” got fixed but others did not. Confirmed I was able to get both results by doing that and as of this typing I still able to switch between the two results by just adding or removing those words