About 10 — of 310 — contributions to The Wall Street Journal, the Washington Post and the New York Times over the past month appear to have been written by AI models.

Humans are still writing the vast majority of guest columns published in the opinion pages of The Wall Street Journal, The Washington Post, and The New York Times, a Semafor analysis found — but large language models were creeping in well before a high-profile Journal op-ed provoked controversy this week.

Over the past month, 10 out of 310 guest submissions to the three publications were labeled as at least 80% “AI” by AI detector Pangram, suggesting AI is not yet making a meaningful dent in human contributions to the most prestigious publications.

Another 40 articles were partially AI-generated. Pangram uses custom AI models to analyze text and other content for AI and, according to a spokesperson, has a .01% false positive rate. If Pangram finds more than 80% of the text is AI generated, it is labeled as AI. In informal testing by Semafor, Pangram was very accurate in detecting AI-written text, though some complain of false positives.

  • supersquirrel@lemmy.ca
    3·
    6 days ago

    Hey @TootSweet@lemmy.world did you know your house is haunted?

    Let me sell you a 100% effective ghost removal kit composed of a two weeks supply of endangered snakebits in vials, tidepods, and essential deGhost oils!

    We back up our deGhost Kit with a 100 percent success rate in our record at removing ghosts, ghosts have NEVER been found in a house where out kit was used properly!

    Sometimes our system does banish people pretending to be ghosts, but then why were they doing that???.. and certainly we are cataching every ghost that pretends to be a human… we have a special proprietary formula for that you just have to trust us on!

    TL;DR This is literally just someone selling people a machine for detecting bullshit that itself runs on bullshit, they are composed of the same bullshitting tendencies, this is nothing more than lame performance art that actually hurts people.