Skip to main content

How do you spot text generated by LLM/AI

  • September 19, 2024
  • 1 reply
  • 21 views

IOan
Forum|alt.badge.img+5

Since we are testers we tend to spot pattern and issues even when we do not want to :smiley: .

So i was wondering how do you spot a text that is generated by an LLM/AI.
Please do not say I use a scanner.

For me the tells are usually these 3

* Using the prashe "In the world of"
* Using words that one does not usually use in a day to day conversation like delve
* The post is marked with emojis all the way.

What about you?

1 reply

Ramanan
Forum|alt.badge.img+5
  • Ace Pilot
  • 211 replies
  • September 20, 2024

I totally relate to spotting patterns—it's a tester's instinct! Here are a few additional signs I look for when identifying text generated by an LLM or AI:

  1. Repetitive Structures: AI-generated content often has a tendency to use similar sentence structures or phrases multiple times, which can make it feel less dynamic.

  2. Overly Formal Language: The tone can sometimes be more formal or polished than everyday conversation, lacking the natural quirks and informalities that people usually incorporate.

  3. Generic Examples: AI tends to use broad or generic examples, which may feel less personal or specific compared to anecdotes from human experiences.

What do you think? Have you noticed any other distinctive patterns?


Reply