A new report from plagiarism detector Copyleaks found that 60% of OpenAI’s GPT-3.5 outputs contained some form of plagiarism.

Why it matters: Content creators from authors and songwriters to The New York Times are arguing in court that generative AI trained on copyrighted material ends up spitting out exact copies.

  • Pennomi@lemmy.world
    link
    fedilink
    English
    arrow-up
    101
    arrow-down
    15
    ·
    8 months ago

    The individual GPT-3.5 output with the highest similarity score was in computer science (100%), followed by physics (92%), and psychology (88%).

    And that’s why this claim is mostly bullshit. These use cases are all sciences, where the correct solution is usually the same or highly similar no matter who writes it. Small snippets of computer code cannot be copyrighted anyway.

    Not surprisingly, softer subjects like “English” and “Theatre” rank extremely low on this scale.

    • FaceDeer@kbin.social
      link
      fedilink
      arrow-up
      38
      arrow-down
      5
      ·
      8 months ago

      Not to mention that a response “containing” plagiarism is a pretty poorly defined criterion. The system being used here is proprietary so we don’t even know how it works.

      I went and looked at how low theater and such were and it’s dramatic:

      The lowest similarity scores appeared in theater (0.9%), humanities (2.8%) and English language (5.4%).

    • LazaroFilm@lemmy.world
      link
      fedilink
      English
      arrow-up
      28
      arrow-down
      2
      ·
      8 months ago

      So, if the Ai gives you a correct answer to a science question, it’s “infringing copyright” and if it spits out a bullshit answer, it’s giving you wrong, and unsupported claims.

    • themoonisacheese@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      1
      ·
      8 months ago

      Right? Nod doubt that output can be similar to training data, and I would believe that some of it is plagiarism, but plagiarism detectors are infamous among uni students for being completely unreliable and flagging pronouns, dates and citations. Until someone can go “here’s an example of actual plagiarism” (which is obvious when pointed out), these claims make no sense.

      • linearchaos@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        2
        ·
        8 months ago

        If it’s plagiarizing, so are Google search results summaries.

        It’s not like it doesn’t cite where it found the data.

    • Ghostalmedia@lemmy.world
      link
      fedilink
      English
      arrow-up
      12
      arrow-down
      1
      ·
      8 months ago

      Eh, kinda. It’s not like a science paper is just going to be an equation and nothing else. An author’s synthesis of the results is always going to have unique language. And that is even more true for a social science paper.

      • Jojo@lemm.ee
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        1
        ·
        8 months ago

        Are those “best matches” paper-sized, or snippet-sized?

    • OpenStars@startrek.website
      link
      fedilink
      English
      arrow-up
      10
      ·
      8 months ago

      But also, there is far less training data to mix and match responses from, so naively I would expect a higher plagiarism rate, by its very nature.

      Less than 2% of the world’s population has a doctorate. According to the US Census Bureau, only 1.2% of the US population has a PhD.

      source

        • OpenStars@startrek.website
          link
          fedilink
          English
          arrow-up
          3
          ·
          8 months ago

          Surely many who have them received them from elsewhere before immigration to America, and likewise the proportion of immigrants who have them I would expect to be oversized. Americans tend to be more greedy than anything else and don’t put in the effort required for such small (financial) rewards.

          Also, those with PhDs tend to congregate into certain areas that support those jobs, i.e. cities but not even a goodly number of those so much; plus smaller college towns too ofc. As such, many in the general populace might rarely if ever run into one for the largest majority of their lives, unless traveling specifically to those areas for some reason?

          And ofc rural areas are far larger, geographically speaking, than places where a person with a PhD would (likely) go. So you could randomly pick a spot on a map 100 times and never manage to find someone with a PhD anywhere within tens of miles, I would expect - although that line of thinking reveals my own biases: do most educated farmers stop at like an MS and just follow up with their own (possibly even extensive) self studies, or go all the way to PhDs while working their actual farms? (I doubt it bc it does not sound practical, and that is a hallmark of farmers afaik, but I could be wrong…) Anyway, I expect the unequal distribution is a contributing / exasperating factor to the general rarity.

      • ShittyBeatlesFCPres@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        edit-2
        8 months ago

        Ironically, in the article, the link to the original Census source of the 1.2% datum is now dead.

        Also, it’s 2.1% now (for people over 25), according to the Wikipedia article’s source: https://www.census.gov/data/tables/2018/demo/education-attainment/cps-detailed-tables.html

        Edit: the Wikipedia citation is from 2018 data. The 2023 tables are here: https://www.census.gov/data/tables/2022/demo/educational-attainment/cps-detailed-tables.html

        Citation party!

    • pulaskiwasright@lemmy.ml
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      2
      ·
      edit-2
      8 months ago

      You can’t write a paper covering scientific topics without plagiarism. A human would be required to. Generative AI should be held to at least as high of a standard.

      • Pennomi@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        arrow-down
        2
        ·
        8 months ago

        Turns out ChatGPT isn’t writing a scientific paper though, it’s conversing with the user.

    • pewter@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      ·
      edit-2
      8 months ago

      They should show a small, but representative sample of questions they gave it.

      Also they should compare the scores to similarity scores for a flesh and blood smart human that answers the questions.

    • General_Effort@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      8 months ago

      Well, I tried it. So here’s an example.

      this may soon be a thing of the past as

      This fragment was flagged as plagiarism.

  • kromem@lemmy.world
    link
    fedilink
    English
    arrow-up
    44
    arrow-down
    1
    ·
    8 months ago

    “Plagiarism detection company claims LLM conditions plagiarism according to their detector.”

    I wonder how many student written essays also contain ‘plagiarism’ according to their tool.

    • Anamnesis@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      1
      ·
      8 months ago

      Probably very few. The bias for these companies is in false negatives, not false positives, since false positives create controversy when students appeal a ruling.

      • General_Effort@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        8 months ago

        The bias here was certainly to come up with a lot of false positives for advertising; kinda like anti-virus companies do it.

    • CheeseNoodle@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      2
      ·
      8 months ago

      100% iirc, there are only so many ways to write about how the blue curtains indicate the character is feeling depressed or something.

  • Voyajer@lemmy.world
    link
    fedilink
    English
    arrow-up
    20
    arrow-down
    1
    ·
    edit-2
    8 months ago

    Ai outs ai. Also, haven’t these ai anti-plagiarism tools shown to have very high false positive rates?

    • Madis@lemm.ee
      link
      fedilink
      English
      arrow-up
      18
      ·
      edit-2
      8 months ago

      ChatGPT itself doesn’t know where it got the info from, so it makes up links and names - it’s a language model, not a search engine.

      On the other hand, if you manage to find a reputable source and give it relevant metadata, it can format a nice citation for you, saving you time on that instead.

    • Anamnesis@lemmy.world
      link
      fedilink
      English
      arrow-up
      10
      ·
      8 months ago

      Badly. This burns my laziest students every semester. Chatgpt just adds nonsense citations.

      • TheChurn@kbin.social
        link
        fedilink
        arrow-up
        3
        ·
        8 months ago

        Copilot is GPT under the hood, it just starts with a search step that finds (hopefully) relevant content and then passes that to GPT for summarization.

    • jacksilver@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      8 months ago

      It depends on how they’re using it behind the scenes. Chatbots like ChatGPT can’t cite sources, because they are just generating text on the fly. However, some approaches (if links/sources are provided) use an approach called Rag (Retrevial Augmented Generation). This approach uses similarity in search terms to find sources first, then uses the sources to augment/generate its answer.

      That being said there are pros and cons to both approaches.

  • dan1101@lemm.ee
    link
    fedilink
    English
    arrow-up
    9
    arrow-down
    1
    ·
    8 months ago

    Isn’t that basically what the current LLM AI fundamentally does? Just digests a bunch of text and gives a summary back in response to queries?

    • General_Effort@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      8 months ago

      No. It’s not really clear what LLMs do, but it certainly depends on context.

      What they fundamentally do is continue a text. That’s what they were originally trained to do. Then they were fine-tuned to continue a chat log or respond to an instruction. To be able to do that, they have learned a lot. Unfortunately, we do not know what.

      If you ask for a summary of some text, it will give you one; regardless of whether the text even exists.

      The summary could be one written by a human that it has memorized. Or it could be complete nonsense, that it is making up on the fly. You never know.

  • BreakDecks@lemmy.ml
    link
    fedilink
    English
    arrow-up
    7
    ·
    8 months ago

    One AI company throwing accusations at another AI company, and the evidence on both sides is to point their fingers at their own black-box LLMs like they’re magic…

  • _number8_@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    11
    ·
    edit-2
    8 months ago

    ok, so? plagiarism is a meaningless, tenuous call that can be avoided simply with some quotation marks and a link. isn’t this supposed to unite humanity’s knowledge rather than nitter and ditter around about meaningless technicalities? it’s not writing a fucking paper (and if you copy and paste it for a paper that’s already plagiarism anyway)

    if it had to remember a citation for everything it knew, it’d only be able to remember half as much information because its memory would be cluttered with useless citations that you could easily find by googling if you really cared to know. most people just want quick facts