I Challenged My AI Clone to Replace Me for 24 Hours | WSJ
News & Politics
Introduction
In today's technologically advanced world, AI tools that generate text and images are already blurring the lines between what is real and what is fake. With the emergence of AI-generated voice and video, these distinctions become even more uncertain. I decided to explore this further by challenging my AI clone to see if it could effectively replace me for an entire day.
Creating My AI Avatar
I began this intriguing experiment by creating an avatar that looks and moves like me using a startup called Synthesia. To develop the avatar, I first smiled into the camera—something I genuinely enjoy—and took a moment to breathe gently. I recorded a series of head movements and read through a slightly odd pre-written script, which was all part of the process. In the next step, I headed to an audio studio to record my voice for about an hour. As a result of this setup, Synthesia used my recordings to develop my AI likeness.
To enhance the voice with a more natural sound, I also utilized a tool called 11 Labs, which processed two hours of my previous recordings to create a better voice clone. Each AI tool operates similarly, allowing me to type in anything, and my AI avatar would replicate it.
The Challenges
I laid out four challenges to test if AI me could successfully substitute real me, granting me more leisure time.
Challenge 1: Phone Calls
Coincidentally, I had a call scheduled with Evan Spiegel, the CEO of Snap. During our conversation, we discussed the implications of chatting with AI all day. Surprisingly, even my sister was fooled when I called her about her deceased fish. She initially believed it was genuinely me but soon noticed the lack of natural conversation pauses, revealing our reliance on human interaction. Result: Pass
Challenge 2: Create a TikTok
For this task, I asked ChatGPT to write a TikTok script in my voice about an obscure iOS 16 tip. However, the AI struggled to maintain accuracy and often fabricated details. The final TikTok produced lacked the authentic touch that defines my content. TikTok users noticed that my avatar didn't move its arms, and the mouth movements didn’t sync with the audio. Result: Fail
Challenge 3: Bank Biometrics
Some banks use voice recognition to validate identity. I tested this by calling my bank with the AI voice. To my surprise, the system accepted the AI-generated voice, confirming my identity without further checks. However, a test with an intern who mimicked my voice failed to authenticate him, indicating that biometric security is not foolproof. Result: Pass
Challenge 4: Video Calls
For this final challenge, I generated generic meeting phrases through AI and streamed the video of my avatar into Google Meet calls. Although the avatar's initial appearance was convincing, it quickly became apparent to my colleagues that something was amiss. Result: Fail
Conclusion
Through these challenges, we learned that AI-generated video clones are not yet compelling enough to fool people, while AI voices have improved dramatically. While these tools could potentially save time, they also raise concerns about misuse. Companies like Synthesia and 11 Labs require consent for creating avatars and voice clones, yet the risk of scams using deepfake technology remains. This means we must remain vigilant in distinguishing between real and AI-generated content.
Ultimately, as we navigate this increasingly digital landscape, it’s essential to prioritize our humanity and communication with others.
Keywords
- AI clone
- Synthesia
- Voice cloning
- Mimicry
- Video calls
- TikTok
- Voice biometrics
- Deepfake
FAQ
Q: What is an AI clone?
A: An AI clone is a digital representation of a person created using artificial intelligence tools, which can mimic their appearance, voice, and mannerisms.
Q: How do I create an AI avatar?
A: You can create an AI avatar by recording your likeness and voice, which can then be transformed into an animated digital representation. Tools like Synthesia and 11 Labs facilitate this process.
Q: Can AI voices effectively replace real voices in communications?
A: Yes, AI voices have become quite convincing; they can pass voice biometric checks but may still lack the natural rhythm of human conversation.
Q: What risks are associated with using AI clones?
A: Risks include potential misuse for scams and identity theft, as individuals may use cloned voices or avatars to deceive others.
Q: Are AI-generated videos currently effective for professional use?
A: Not yet; while they show promise, AI-generated videos often lack the subtle movements and expressions necessary for genuine human interaction, leading to suspicion in professional environments.
