…without informed consent.

  • brsrklf@jlai.lu
    link
    fedilink
    English
    arrow-up
    5
    ·
    7 months ago

    Every now and then I see a guy barging in a topic bringing nothing else than “I asked [some AI service] and here’s what it said”, followed by 3 paragraphs of AI-gened gibberish. And then when it’s not well received they just don’t seem to understand.

    It’s baffling to me. Anyone can ask an AI. A lot of people specifically don’t, because they don’t want to battle with its output for an hour trying to sort out from where it got its information, whether it represented it well, or even whether it just hallucinated half of it.

    And those guys come posting a wall of text they may or may not have read themselves, and then they have the gall to go “What’s the problem, is any of that wrong?”… Dude, the problem is you have no fucking idea if it’s wrong yourself, have nothing to back it up, and have only brought automated noise to the conversation.

    • expr@programming.dev
      link
      fedilink
      English
      arrow-up
      3
      ·
      7 months ago

      I was trying to help onboard a new lead engineer and I was working through debugging his caddy config on Slack. I’m clearly putting in effort to help him diagnose his issue and he posts “I asked chatgpt and it said these two lines need to be reversed”, which was completely false (caddy has a system for reordering directives) and honestly just straight up insulting. Fucking pissed me off. People need to stop brining AI slop into conversations. It isn’t welcome and can fuck right off.

      The actual issue? He forgot to restart his development server. 😡

    • tias@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      0
      arrow-down
      1
      ·
      7 months ago

      Dude, the problem is you have no fucking idea if it’s wrong yourself, have nothing to back it up

      That’s not true. For starters you can evaluate it on its own merits to see if it makes logical sense - the AI can help solve a maths equation for you and you can see that it checks out without needing something else to back it up.

      Second, agentic or multiple-step AI:s will dig out the sources for you so you can check them. It’s just a smarter search engine with no ads and better focus on the question asked.

      • Mirodir@discuss.tchncs.de
        link
        fedilink
        English
        arrow-up
        1
        ·
        7 months ago

        On the second part. That is only half true. Yes, there are LLMs out there that search the internet and summarize and reference some websites they find.

        However, it is not rare that they add their own “info” to it, even though it’s not in the given source at all. If you use it to get sources and then read those instead, sure. But the output of the LLM itself should still be taken with a HUGE grain of salt and not be relied on at all if it’s critical, even if it puts a nice citation.

      • tomalley8342@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        7 months ago

        If you have evaluated the statement for its correctness and relevance, then you can just own up to the statement yourself. There is no need to defer responsibility by prefacing it with “I asked [some AI service] and here’s what it said”. That is the point of the article that is being discussed, if you’d like to give it a read sometime.

      • setVeryLoud(true);@lemmy.ca
        link
        fedilink
        English
        arrow-up
        1
        ·
        7 months ago

        Ok, I didn’t need you to act as a middle man to tell me what the LLM just hallucinated, I can do this myself.

        The point is that raw AI output provides absolutely no value to a conversation, and is thus noisy and rude.

        When we ask questions on a public forum, we’re looking to talk to people about their own experience and research through the lens of their own being and expertise. We’re all capable of prompting an AI agent. If we wanted AI answers, we’d prompt an AI agent.

      • brsrklf@jlai.lu
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        7 months ago

        I am speaking from experience.

        The latest example of that I encountered had a blatant logical inconsistency in its summary, a CVE that wasn’t relevant to what was discussed, because it was corrected years before the technology existed. Someone pointed at it.

        The poster hadn’t done the slightest to check what they posted, they just regurgitated it. It’s not the reader’s job to check the crap you’ve posted without the slightest effort.

      • SparroHawc@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        ·
        7 months ago

        with no ads

        For now.

        Eventually it becomes a search engine that replaces the ads on the source material with its own ads, thus choking out the source’s funding and taking it for itself.

      • MousePotatoDoesStuff@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        7 months ago

        “With no ads” Google used to have no ads. And especially with how much it cost to run even today’s LLMs, let alone tomorrow’s ones… enshittification is only a matter of time.