Basically what the title says. I know online providers like GPTzero exist, but when dealing with sensitive documents, I would prefer to keep it in-house. A lot of people like to talk big about open source models for generating stuff, but the detection side is not as discussed I feel.

I wonder if this kind of local capability can be stitched into a browser plugin. Hell, doesn’t even need to be a locally hosted service on my home network. Local app on-machine should be fine. But being able to host it as a service to use from other machines would be interesting.

I’m currently not able to give it a proper search but the first glance results are either for people trying to evade these detectors or people trying to locally host language models.

  • MartianSands@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    47
    ·
    11 hours ago

    Be cautious about trusting the AI-detection tools, they’re not much better than the AI they’re trying to detect, because they’re just as prone to false positives and false negatives as the agents they claim to detect.

    It’s also inherently an arms race, because if a tool exists which can easily and reliably detect AI generated content then they’d just be using that tool for their training instead of what they already use, and the AI would quickly learn to defeat it. They also wouldn’t be worrying about their training data being contaminated by the output of existing AI, Which is becoming a genuine problem right now

    • iii@mander.xyz
      link
      fedilink
      English
      arrow-up
      14
      ·
      10 hours ago

      if a tool exists which can easily and reliably detect AI generated content then they’d just be using that tool for their training

      Generative Adversarial Networks are an example of that idea in action.

  • null_dot@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    22
    ·
    10 hours ago

    There are no decent GPT-detection tools.

    If there were they would be locally hosted language models, and you’d need a reasonable GPU.

  • Eheran@lemmy.world
    link
    fedilink
    English
    arrow-up
    15
    arrow-down
    1
    ·
    edit-2
    11 hours ago

    What do you want to achieve with it? They were still (super) unreliable last time I checked. Unreliable as in “you might as well roll a dice”. Oh and they all say they are world leading, best etc.

  • splendoruranium@infosec.pub
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    1
    ·
    edit-2
    10 hours ago

    Basically what the title says. I know online providers like GPTzero exist, but when dealing with sensitive documents, I would prefer to keep it in-house. A lot of people like to talk big about open source models for generating stuff, but the detection side is not as discussed I feel.
    I wonder if this kind of local capability can be stitched into a browser plugin. Hell, doesn’t even need to be a locally hosted service on my home network. Local app on-machine should be fine. But being able to host it as a service to use from other machines would be interesting.
    I’m currently not able to give it a proper search but the first glance results are either for people trying to evade these detectors or people trying to locally host language models.

    In general it’s a fool’s errand, I’m afraid. What’s the specific context in which you’re trying to apply this?

  • falseWhite@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    9 hours ago

    I would guess you’d need a model that’s at least just as powerful and smart as the original model that created the content. Otherwise it’s like asking a 10 year old to proof read an article written by an adult.

  • Melvin_Ferd@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    arrow-down
    9
    ·
    7 hours ago

    Guys I need something that can check if someone is using autocorrect. Stoopid clankers.