‘I Really Worry’: Deepfake Surge Raises Concerns as AI Videos of Jacinta Allan Circulate

Why It Matters

Deepfake attacks on a sitting premier threaten electoral integrity and the credibility of evidence in courts, compelling legislators and tech firms to develop safeguards.

Key Takeaways

• AI-generated deepfakes of Victoria's premier flood online platforms
• Fake video shows Allan discussing character references in sentencing
• Fabricated image places Allan before multiple political flags, sparking outrage
• Experts warn deepfakes could influence elections and undermine public trust
• Lack of Australian legislation leaves political deepfakes largely unregulated

Summary

The video highlights a rapid surge in AI‑generated deepfakes targeting Victorian Premier Jacinta Allan, circulating on social media platforms. A fabricated clip shows her allegedly commenting on character references in sentencing, while a doctored photo places her before a row of Pride, Trans and Palestinian flags.

Analysts note that the deepfakes are indistinguishable to many viewers, especially older audiences less familiar with synthetic media. Experts warn that such manipulations could sway public opinion ahead of the next state election and even be weaponized in courtrooms, where forged evidence may be presented as genuine.

The discussion references other high‑profile fakes, including a recent Tom Cruise‑Brad Pitt mash‑up and a dismissed California law aimed at curbing political deepfakes after a Kamala Harris hoax. A politician’s retweet of the fake flag image, later deleted, underscores how quickly misinformation spreads before verification.

Without specific Australian regulations, the threat remains largely unchecked, prompting calls for digital‑forensic capabilities and heightened media literacy. The episode illustrates how deepfake technology could erode trust in political figures, distort legal proceedings, and force policymakers to confront new forms of digital deception.

Original Description

Sky News host Caleb Bond warns of the implications AI could have on influencing voters following deepfake videos posted on social media of Victorian Premier Jacinta Allan.

“It will get better, this AI, deepfake technology and I really worry that it will get to a point where, yes, you can completely fabricate things in a political sense,” Mr Bond said.

“This will become so common now, I worry about what it will do for the justice system.”