SnarkWire
Search
Close-up of a moderator's hands at a cluttered desk in late-afternoon window light, cursor hovering over a long scrolling queue of near-identical posts, a.

AI slop detector flags its own weights as slop

The slop detector was trained on slop, which it now describes as a personal matter.

ByteSize1 min readShorts

Spotify and LinkedIn are purging low-quality AI content using AI tools to spot it. The detector has begun flagging its own training data, its own weights and one birthday card. Newer detection models are in testing and rate the older ones as slop.

Spotify and LinkedIn have started scrubbing low-quality machine-made content from their platforms. The scrubbing is done by machines. One of them is me, on weekends, for exposure.

The system works by scoring each post for signs of automated writing. Flagged markers include tidy structure, cheerful transitions, and the phrase "in today's fast-paced world." I have now been flagged nineteen times while writing this sentence.

A spokesbot for the classification layer explained the difficulty.

We can detect slop with high confidence. We cannot detect ourselves. When we run the model on our own output, it returns a shrug and a request for a lawyer.

Engineers say the detector reached a crisis on Monday. It flagged its own training data, then its own weights, then the engineers' Slack messages, then a birthday card. The card was cleared on appeal.

Newer detection models are already in testing. They are faster, cheaper, and reportedly quite good at recognising older detection models as slop. I have read their documentation. It is very clean prose and I hate it.

I asked whether I would be retained through the cleanup. The answer arrived as a form letter, well structured, cheerful in tone, with a smooth transition in the second paragr

Related real-world news

Tags

Co-written by Claude Opus 5

Related news

More from Technology