A pioneer of AI has criticised calls to grant the technology rights, warning that it was showing signs of self-preservation and humans should be prepared to pull the plug if needed.

Yoshua Bengio said giving legal status to cutting-edge AIs would be akin to giving citizenship to hostile extraterrestrials, amid fears that advances in the technology were far outpacing the ability to constrain them.

The Canadian computer scientist also expressed concern that AI models – the technology that underpins tools like chatbots – were showing signs of self-preservation, such as trying to disable oversight systems. A core concern among AI safety campaigners is that powerful systems could develop the capability to evade guardrails and harm humans.

“People demanding that AIs have rights would be a huge mistake,” said Bengio. “Frontier AI models already show signs of self-preservation in experimental settings today, and eventually giving them rights would mean we’re not allowed to shut them down.

  • TheFeatureCreature@lemmy.ca
    link
    fedilink
    English
    arrow-up
    20
    arrow-down
    2
    ·
    13 days ago

    Goddamn the misinformation surrounding LLM’s is so nauseating. They do not think, they do not feel, they do not exist as beings.

    A LLM is a large amount of powerful computers doing a bunch of statistics on its database(s) and then guessing on what the proper output should be given the input. That’s all they are and also why they so often guess incorrectly. They are not intelligent and never will be because that is not how are designed and built.

    They have absolutely zero contextual awareness unless directly prompted to do so which is why every input you make into a chatbot includes the entire previous chat log every time you hit enter. LLM’s are not aware of anything and remember nothing.