Previous posts: https://programming.dev/post/3974121 and https://programming.dev/post/3974080

Original survey link: https://forms.gle/7Bu3Tyi5fufmY8Vc8

Thanks for all the answers, here are the results for the survey in case you were wondering how you did!

Edit: People working in CS or a related field have a 9.59 avg score while the people that aren’t have a 9.61 avg.

People that have used AI image generators before got a 9.70 avg, while people that haven’t have a 9.39 avg score.

Edit 2: The data has changed slightly! Over 1,000 people have submitted results since posting this image, check the dataset to see live results. Be aware that many people saw the image and comments before submitting, so they’ve gotten spoiled on some results, which may be leading to a higher average recently: https://docs.google.com/spreadsheets/d/1MkuZG2MiGj-77PGkuCAM3Btb1_Lb4TFEx8tTZKiOoYI

  • ApeNo1@lemm.ee
    link
    fedilink
    English
    arrow-up
    11
    ·
    1 year ago

    Would be good to see tests against only images of real life scenarios or things. Limited to photorealistic people, places, events like say floods etc. I think cartoons or non photorealistic drawings will always be hard to pick as there is not an obvious image of reference you would have in your mind as there is no limit to different artists styles.

    • themusicman@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      Yeah. These examples were cherry picked to mislead. Pick a set of random images, and the result will be totally different.

  • Dandroid@dandroid.app
    link
    fedilink
    arrow-up
    10
    ·
    1 year ago

    This is what I was suspecting. People are just guessing. I have had people adamantly claim pictures that I took were AI generated and that I was lying when I said they weren’t. I see people on the internet constantly pull reasons out of their ass of why something is AI generated, saying “a real artist wouldn’t make this mistake,” but my wife has made those exact mistakes before.

    • popcar2@programming.devOP
      link
      fedilink
      English
      arrow-up
      12
      ·
      1 year ago

      I feel for you. A few people said the human art I put in the survey were lackluster but I thought they were pretty good, not everyone is an S-tier artist.

      77% of people guessed this was AI generated, and a friend of mine kept saying it was weird and inconsistent so “I doubt a real artist would put random food in the back”

      It’s actually a cropped image of https://www.deviantart.com/tsaoshin/art/Strawberry-Taiyaki-Cat-905271835 . I wouldn’t want to be an artist right now.

        • rockerface 🇺🇦@lemm.ee
          link
          fedilink
          arrow-up
          2
          ·
          1 year ago

          Anyone who says “a real X wouldn’t…” where X is any profession, is really clueless about anything that X do. Though it is particularly true for artists, I’ll admit

          • Helix 🧬@feddit.de
            link
            fedilink
            arrow-up
            1
            ·
            1 year ago

            I feel like most professionals in a discipline say ‘a real X would absolutely be so stupid as to…’ instead. They have seen every mistake the profession can offer.

            Yes, developers would absolutely delete production databases even after you told them to triple check. Yes, artists absolutely would start a world war over racism. Yerp, archers would absolutely try to off themselves with a bow. And oh dear would car drivers absolutely drive into oncoming traffic and honk because everyone seems to drive on the wrong side.

            People make mistakes and do stupid shit all the time. Maybe we should treat them like we treat AIs, just throw them away when they fucked up? 🙃

      • Dandroid@dandroid.app
        link
        fedilink
        arrow-up
        7
        ·
        1 year ago

        That or even every image being human generated. See all the reasons people come up with to explain why they thought human generated art was AI generated.

  • Euphoma@lemmy.ml
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 year ago

    I got the cartoon with text wrong because I didn’t know dalle-3 could do text. I got 12 from vibes of more detail? This assumption that AI does more detail gets a lot of actual humans. AI image generation is really crazy. The simpler stuff is pretty much indistinguishable from real human stuff at this point.

  • peanuts4life@beehaw.org
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    1
    ·
    1 year ago

    Awesome job! Here is the first image dalle-3 generated of you.

    Not overly convincing, but look at those hands!

  • apotheotic (she/her)@beehaw.org
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    I was quite disappointed that I “only” got 14, originally, but these results make me feel a lot better about that score. Any chance you could share some more involved results of this survey? I’m curious about percentiles for each score, and standard deviations for those averages - is 9.70 vs 9.39 statistically relevant or within expected variance?

    I was, of course, fooled by the cartoon and the lineart sketch, those two are stupendously convincing.