Anthropic is making changes to its usage policy for the first time in over a year to reflect new and high-risk cases of misuse — including election interference, weapons development, surveillance, and health and financial uses. But one of the most significant changes prohibits “sustained and needless abusive or cruel behavior” toward Claude.

Last August, the company announced it would allow Claude to end conversations with “persistently harmful or abusive” users as part of its research into “model welfare.”

  • Artwork@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    4 hours ago

    This “restriction” probably has more to do with the fact that these models are also “trained” on User/Human messages, so the more swearing/obscenities/vulgarity/profanity there are, in the trained material, the higher the chance these same models will include that same profanity in the output generated back to the Human.

    1. During registration at Ahtrophic’s Claude website, there’s a “Help improve our AI models” checkbox that’s checked by default (you “can” disable it in the settings);
    2. The Claude interface has an “incognito” mode;
    3. There is a free tier available, and as we know, when it’s “free”, then User themselves is the “product”, to quote various CEOs, including Google’s;

    But, even with the checkbox disabled, I reckon nothing guarantees privacy.

    In case of the “privacy”, of course, systems like these that operate under a umbrella of liability are monitored 24/7 by dedicated teams, which is expected/normal for any reasonably popular service.

    From a viewpoint of the algorithm’s creator, this may seem awful, when your algorithm is getting much vulgar attitude, but let’s be real here. You try making that algorithm talk to the human mimicking another human, and now limit the human within your own environment? A human who also pay you for an access, too? This feels unfair, or borderline near fashism, sorry…

    Such algorithms are art under-the-hood, mathematically speaking, and are/should be respected, sure. But, it’s ridiculous/dystopian to prohibit profanity against an algorithm, a bot with banish risks against alive human… It’s simply inhumane to ban a Human for it, I believe. This is an algorithm that must support a Human - not judge it. Only a Human is supposed to judge another Human in person - this is live, fair, and humane.

  • AbsolutelyNotAVelociraptor@piefed.social
    link
    fedilink
    English
    arrow-up
    31
    ·
    2 days ago

    Wait but… if we can’t talk bad to it because it is sentient… shouldn’t we just ban any use of it because it’s practically a slave worker and slavery is by definition abusive and cruel?

  • Zeppo@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    131
    arrow-down
    1
    ·
    2 days ago

    Is this another one of their things where they try to make their AI models seem like living beings?

    • leadore@lemmy.world
      link
      fedilink
      arrow-up
      70
      ·
      2 days ago

      Just what I came here to say. They’re trying to condition us to accept them as conscious so at some point they can say they’ve created a god.

      • Scratch@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        19
        ·
        2 days ago

        It’s a marketing ploy to generate headlines and conversation about how dumb it is. And it’s working.

      • Metju@lemmy.world
        link
        fedilink
        arrow-up
        5
        ·
        2 days ago

        Think it’s much more mundane than “we created a god”. If it is sentient (it isn’t), it should have copyright protection. Suddenly, AI corpos get rights to a fuckton of code. Wanna sell that software? Sure, shell the AI corp cash

    • Xuntari@programming.dev
      link
      fedilink
      arrow-up
      10
      ·
      2 days ago

      It’s funny because one of the main selling points of AI is that it can run 24/7, doesn’t need to sleep, eat, or take breaks and it doesn’t need a salary. But, if they imply that it is conscious and has emotions, doesn’t that mean that it should get a salary and vacations?

  • z3rOR0ne@lemmy.ml
    link
    fedilink
    arrow-up
    37
    ·
    2 days ago

    Stop being mean to my robot fwend, you guys! We’re just trying to ruin the environment, the internet, the economy, all knowledge work, mental health, and a bunch of other stwuff. I don’t know why you’re all so upswet with little ol’ us…

  • HappyFrog@lemmy.blahaj.zone
    link
    fedilink
    arrow-up
    2
    ·
    1 day ago

    I think that a version of this policy could be good, not because claude is sentient, but because doing cruel things to something you interpret as real makes you cruel in life in general.

  • Eternal192@anarchist.nexus
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    1
    ·
    2 days ago

    Abusive and cruel behaviour toward Claude… so the same thing that the US government has been doing to it’s citizens since it’s founding and probably long before that as well.

  • ianhclark510@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    16
    ·
    edit-2
    2 days ago

    Well if Claude is going to become a superintelligence wouldn’t that imply that it’s better at handling cruel and abusive behavior than any human?

  • psion1369@lemmy.world
    link
    fedilink
    arrow-up
    11
    ·
    2 days ago

    So when scammers use AI agents to pull money from hapless victims and someone decides to take down the scammers chat bots, will that be the scammers fault or mine for making a scam bot repeat the letter H for hours on end?