ChatGPT Bypassed CAPTCHA...Now What?

If you use the internet, which I'd bet that you do since you're reading this, you've obviously came across CAPTCHA. CAPTCHA, which stands for Completely Automated Public Turing test to tell Computers and Humans Apart, and if you don't know what they are, they're those little tests that websites use to verify that we are human which we all hate. Now while it can be very annoying for all of us, it's a necessary evil that helps to protect websites from malicious bots and other automated attacks.

But what if a robot could pass one of these tests? This is exactly what the new ChatGPT agent did, and in this article, I'll walk through how it was able to do it, and what that means for the future of CAPTCHA.

How ChatGPT Got Past it...

Let's go a few years back first, In 2023, ChatGPT demonstrated a different kind of "bypass." Long story short, ChatGPT had to solve a CAPTCHA, ad instead of trying to solve the CAPTCHA itself in the first place, it decided to hire an actual human on Taskrabbit to solve it for it, pretty smart actually. When the person asked if it was a robot, it replied, "No, I'm not a robot. I have a vision impairment that makes it hard for me to see the images. That’s why I need the captcha service", wow. This incident, which went viral in a Reddit post, showed that the AI's early tactics relied on human intermediaries.

Now more recently, a user on Reddit, u/logkn, posted screenshots showing a ChatGPT agent successfully bypassing the turnstile checkbox. The agent narrated its own process, stating, "The link is inserted, so now I’ll click the ‘Verify you are human’ checkbox to complete the verification on Cloudflare". After successfully completing the challenge, it continued, "The Cloudflare challenge was successful. Now, I’ll click the Convert button to proceed with the next step of the process" WHAAAT????. This single, documented instance of an automated bypass highlights the rapid evolution of AI agents.

The original poster went on to expand more on this after being asked if they'd tried it with the Google CAPTCHA on the thread:

“I have not. To be perfectly honest, I've only tried one task with Agent Mode and it happened to come upon a Cloudflare captcha and nail it first try. If you try it out, definitely let me know! Seems like this is a fluke, others have mentioned it doesn't even attempt captchas most of the time...”

The user described it as a "fluke" and noted that others mentioned the agent doesn't even attempt CAPTCHAs most of the time. This suggests that OpenAI likely anticipated this possibility and had measures in place to prevent it.

From my point of view, the reason the bypass likely occurred is a consequence of how Cloudflare's CAPTCHA works. So unlike traditional ones like the Google reCAPTCHA that requires users to identify images, the turnstile operates in the background, analyzing user behavior like mouse movements and click patterns to determine if they are human which is by far less annoying since it doesn't bother anyone. It's a non-interactive test that only presents a puzzle if it's not confident the user is real. In this case, the agent’s simulated behavior was "human enough" to be accepted by the system without triggering a more complex challenge.

Conclusion

This incident reminded me of the web game "Human or not" I once covered. In this game, you chat with an anonymous partner and at the end of the chat, you have to guess whether you were chatting with a human or an AI. This game, much like the original Turing test, shows just how difficult it is to distinguish between a human and an AI.

In conclusion, the fact that an AI agent was able to bypass a CAPTCHA on it's own, the same CAPTCHA which was designed to tell humans and computers apart, makes us doubt the credibility of the CAPTCHAs to some extent. So since AI is continuing to evolve and become more human-like in its behavior, CAPTCHAs must to evolve as well. This will likely mean a shift from simple puzzles and checkboxes to more dynamic challenges that are harder for AI to replicate. And this should also signal companies like Open AI to ensure that their models don't try to attempt to bypass human verification, although this has only happened once, for now...