I Built A Tool To Detect AI Video (You Can Have It)

Matt's own app that takes a video URL and returns an AI-or-not verdict by combining Gemini and SightEngine. After about 10 hours of prompting it works reasonably, but it can't be hosted publicly because of API costs, so the code goes to GitHub for users to run locally with their own keys.

GAGoogle AI watermark removalGoogleUnverified

Google's watermark detection, which can tell if a video was made by Google's AI platforms but not whether a video is AI in general. Mentioned as an existing detection option.

GVGemini video understandingGoogleAvailable in EU

Google's Gemini models, with a new video understanding capability rolled out in September, were used in the detector to analyze videos. In testing Gemini repeatedly found no clear AI indicators, even on obvious AI videos.

COCodexOpenAIAvailable in EU

The coding mode in the ChatGPT app was used to build the AI Slop Detector from a project folder and a linked chat. Its /goal command let it keep running and testing itself, for over 8 hours, and it ended with the goal stalled.

GAGPT-6 AstraOpenAIUnverified

New OpenAI model used to diagnose and rework the detector. It found flaws in the confidence logic and ran for 8+ hours without finishing. The creator says it and other top models can't reliably tell if a video is AI.

SISightEngineSightengineAvailable in EU

A third-party computer-vision API for AI-generated content detection that finally made the detector work. It flagged AI videos correctly, but gives no reasons and is expensive: roughly 12,000 operations were used in testing across about six videos.