I saw a toot from someone who was searching for Iocaine and only wanted to partake in discussion involving Iocaine.

  • IndieGoblinOP
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 day ago

    I wonder if you’ve put any thought into this. I’m just.a layman.

    So we assume the ingested data is accepted by ai company but its filtered for legitimacy. Is that human or AI. Either way that had to be bypassed I’m not sure how big of a block of text they analyses but the coherent text needs to exceed this and the web context needs to some how reinforce this.

    Is this possible?

    • algernon@lemmy.ml
      link
      fedilink
      arrow-up
      1
      ·
      13 hours ago

      Is that human or AI.

      As far as I know, it’s mostly incredibly underpaid human labor.

      Is this possible?

      Possible? Most certainly. The trouble is, we have absolutely no way to know, so the best we can do is… guess, hope, and pray. Preparing even one page of plausible looking text is hard - there’s a reason LLMs require powerful GPUs. Generating an infinite amount of plausible looking pages is even harder. That’s why I believe it is not worth the effort to poison them - it costs too much on our side, and we can’t verify if it works.

      On top of that, the more plausible it looks, the more likely it is to lead a human visitor astray, should they accidentally find themselves in the maze. Right now, if a human looks at the iocaine output, it is clearly garbage. The bots don’t care, and the programs and/or people who need to verify it, will either have to go through a massive trove of junk, or throw away everything scraped from the entire domain (in both cases, mission accomplished: LLMs didn’t get to the juicy data they wanted).