cross-posted from: https://feddit.online/c/tech@feddit.online/p/2125899/chatgpt-helped-sadistic-school-shooter-build-3d-printed-weapons

OpenAI’s chatbot fueled the Tumbler Ridge killer’s plans for making gun accessories and torturing victims, our investigation reveals.

  • lillardfair@lemmy.world
    link
    fedilink
    English
    arrow-up
    15
    ·
    5 hours ago

    Initially I was a little knee jerky to the title and the 1st couple paragraphs. AI sucks, but 3D printing weapons accessories should not be on its face a crime and there’s a lot of unnecessary hand wringing around it. Also, I know the chatbots are always chatbots reporting home, but immediately reporting someone to the authorities for discussing 3d printed accessories and spring strengths is an invasion of privacy in my book.

    However, in this case OpenAI was definitely being negligent. The first account gets banned for “scenarios involving gun violence” they don’t bring it to authorities and then sit on it after they connected it after the fact to the shooter. And that shooter used the 2nd account to both solve the gun accessory improvements while also playing out “hypothetical” shooter scenarios ringing any alarm bells is crazy.

    • grue@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      3 hours ago

      However, in this case OpenAI was definitely being negligent. The first account gets banned for “scenarios involving gun violence” they don’t bring it to authorities and then sit on it after they connected it after the fact to the shooter. And that shooter used the 2nd account to both solve the gun accessory improvements while also playing out “hypothetical” shooter scenarios ringing any alarm bells is crazy.

      What legal responsibilities against “negligence” should the software have had if he had used a local LLM instead?

      If the answer is “none,” why should a cloud-hosted LLM be treated differently?

      If the answer isn’t “none,” why should we accept that infringement of private property rights?

      • lillardfair@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        2 hours ago

        I get your point, but a cloud llm is a service and one that makes no real promise of privacy to begin with. They are always logging your data to improve and identify improper usage. If you make an admission of intended violence to a therapist, let alone a cloud based service, they have an obligation to report it to authorities. I’m not advocating for a nanny state, but if the intent is put put into public or 3rd party space and a conclusion of violence can reasonably be drawn, its the service’s responsibility to report.

        If the answer isn’t “none,” why should we accept that infringement of private property rights?>

        If you are concerned about your privacy, run a home based llm and are using it to plot violence, the records would be evidence in a trial, just like a handwritten journal. There’s not an expectation that it reports you, because internet connection isn’t a required aspect of the system.

        • grue@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          58 minutes ago

          I get your point, but a cloud llm is a service and one that makes no real promise of privacy to begin with. They are always logging your data to improve and identify improper usage. If you make an admission of intended violence to a therapist, let alone a cloud based service, they have an obligation to report it to authorities.

          So because they claim the right to log it, they have an obligation to report it? Would a cloud LLM service that claimed not to log be absolved of that obligation, or should such a service not be allowed to exist?