Close Menu
  • Home
  • AI Models
    • DeepSeek
    • xAI
    • OpenAI
    • Meta AI Llama
    • Google DeepMind
    • Amazon AWS AI
    • Microsoft AI
    • Anthropic (Claude)
    • NVIDIA AI
    • IBM WatsonX Granite 3.1
    • Adobe Sensi
    • Hugging Face
    • Alibaba Cloud (Qwen)
    • Baidu (ERNIE)
    • C3 AI
    • DataRobot
    • Mistral AI
    • Moonshot AI (Kimi)
    • Google Gemma
    • xAI
    • Stability AI
    • H20.ai
  • AI Research
    • Allen Institue for AI
    • arXiv AI
    • Berkeley AI Research
    • CMU AI
    • Google Research
    • Microsoft Research
    • Meta AI Research
    • OpenAI Research
    • Stanford HAI
    • MIT CSAIL
    • Harvard AI
  • AI Funding & Startups
    • AI Funding Database
    • CBInsights AI
    • Crunchbase AI
    • Data Robot Blog
    • TechCrunch AI
    • VentureBeat AI
    • The Information AI
    • Sifted AI
    • WIRED AI
    • Fortune AI
    • PitchBook
    • TechRepublic
    • SiliconANGLE – Big Data
    • MIT News
    • Data Robot Blog
  • Expert Insights & Videos
    • Google DeepMind
    • Lex Fridman
    • Matt Wolfe AI
    • Yannic Kilcher
    • Two Minute Papers
    • AI Explained
    • TheAIEdge
    • Matt Wolfe AI
    • The TechLead
    • Andrew Ng
    • OpenAI
  • Expert Blogs
    • François Chollet
    • Gary Marcus
    • IBM
    • Jack Clark
    • Jeremy Howard
    • Melanie Mitchell
    • Andrew Ng
    • Andrej Karpathy
    • Sebastian Ruder
    • Rachel Thomas
    • IBM
  • AI Policy & Ethics
    • ACLU AI
    • AI Now Institute
    • Center for AI Safety
    • EFF AI
    • European Commission AI
    • Partnership on AI
    • Stanford HAI Policy
    • Mozilla Foundation AI
    • Future of Life Institute
    • Center for AI Safety
    • World Economic Forum AI
  • AI Tools & Product Releases
    • AI Assistants
    • AI for Recruitment
    • AI Search
    • Coding Assistants
    • Customer Service AI
    • Image Generation
    • Video Generation
    • Writing Tools
    • AI for Recruitment
    • Voice/Audio Generation
  • Industry Applications
    • Finance AI
    • Healthcare AI
    • Legal AI
    • Manufacturing AI
    • Media & Entertainment
    • Transportation AI
    • Education AI
    • Retail AI
    • Agriculture AI
    • Energy AI
  • AI Art & Entertainment
    • AI Art News Blog
    • Artvy Blog » AI Art Blog
    • Weird Wonderful AI Art Blog
    • The Chainsaw » AI Art
    • Artvy Blog » AI Art Blog
What's Hot

Meet the end-of-life planning startup co-founded by NBA All-Star Russell Westbrook

GPT-5 unites intent and reasoning for Mercado Libre

OpenAI wraps $6.6 billion share sale at $500 billion valuation

Facebook X (Twitter) Instagram
Advanced AI News
  • Home
  • AI Models
    • OpenAI (GPT-4 / GPT-4o)
    • Anthropic (Claude 3)
    • Google DeepMind (Gemini)
    • Meta (LLaMA)
    • Cohere (Command R)
    • Amazon (Titan)
    • IBM (Watsonx)
    • Inflection AI (Pi)
  • AI Research
    • Allen Institue for AI
    • arXiv AI
    • Berkeley AI Research
    • CMU AI
    • Google Research
    • Meta AI Research
    • Microsoft Research
    • OpenAI Research
    • Stanford HAI
    • MIT CSAIL
    • Harvard AI
  • AI Funding
    • AI Funding Database
    • CBInsights AI
    • Crunchbase AI
    • Data Robot Blog
    • TechCrunch AI
    • VentureBeat AI
    • The Information AI
    • Sifted AI
    • WIRED AI
    • Fortune AI
    • PitchBook
    • TechRepublic
    • SiliconANGLE – Big Data
    • MIT News
    • Data Robot Blog
  • AI Experts
    • Google DeepMind
    • Lex Fridman
    • Meta AI Llama
    • Yannic Kilcher
    • Two Minute Papers
    • AI Explained
    • TheAIEdge
    • The TechLead
    • Matt Wolfe AI
    • Andrew Ng
    • OpenAI
    • Expert Blogs
      • François Chollet
      • Gary Marcus
      • IBM
      • Jack Clark
      • Jeremy Howard
      • Melanie Mitchell
      • Andrew Ng
      • Andrej Karpathy
      • Sebastian Ruder
      • Rachel Thomas
      • IBM
  • AI Tools
    • AI Assistants
    • AI for Recruitment
    • AI Search
    • Coding Assistants
    • Customer Service AI
  • AI Policy
    • ACLU AI
    • AI Now Institute
    • Center for AI Safety
  • Business AI
    • Advanced AI News Features
    • Finance AI
    • Healthcare AI
    • Education AI
    • Energy AI
    • Legal AI
LinkedIn Instagram YouTube Threads X (Twitter)
Advanced AI News
TechCrunch AI

OpenAI’s new social app is filled with terrifying Sam Altman deepfakes

By Advanced AI EditorOctober 2, 2025No Comments7 Mins Read
Share Facebook Twitter Pinterest Copy Link Telegram LinkedIn Tumblr Email
Share
Facebook Twitter LinkedIn Pinterest Email


In a video on OpenAI’s new TikTok-like social media app Sora, a never-ending factory farm of pink pigs are grunting and snorting in their pens — each is equipped with a feeding trough and a smartphone screen, which plays a feed of vertical videos. A terrifyingly realistic Sam Altman stares directly at the camera, as though he’s making direct eye contact with the viewer. The AI-generated Altman asks, “Are my piggies enjoying their slop?”

This is what it’s like using the Sora app, less than 24 hours after it was launched to the public in an invite-only early access period.

In the next video on Sora’s For You feed, Altman appears again. This time, he’s standing in a field of Pokémon, where creatures like Pikachu, Bulbasaur, and a sort of half-baked Growlithe are frolicking through the grass. The OpenAI CEO looks at the camera and says, “I hope Nintendo doesn’t sue us.” Then there are many more fantastical yet realistic scenes, which often feature Altman himself.

He serves Pikachu and Eric Cartman drinks at Starbucks. He screams at a customer from behind the counter at a McDonald’s. He steals Nvidia GPUs from a Target and runs away, only to get caught and beg the police not to take his precious technology.

People on Sora who generate videos of Altman are especially getting a kick out of how blatantly OpenAI appears to be violating copyright laws. (Sora will reportedly require copyright holders to opt out of their content’s use — reversing the typical approach where creators must explicitly agree to such use — the legality of which is debatable.)

“This content may violate our guardrails concerning third-party likeness,” AI Altman says in one video, echoing the notice that appears after submitting some prompts to generate real celebrities or characters. Then he bursts into hysterical laughter as though he knows what he’s saying is nonsense — the app is filled with videos of Pikachu doing ASMR, Naruto ordering Krabby Patties, and Mario smoking weed.

This wouldn’t be a problem if Sora 2 weren’t so impressive, especially when compared with the even more mind-numbing slop on the Meta AI app and its new social feed (yes, Meta is also trying to make AI TikTok, and no, nobody wants this).

Techcrunch event

San Francisco
|
October 27-29, 2025

OpenAI fine-tuned its video generator to adequately portray the laws of physics, which make for more realistic outputs. But the more realistic these videos get, the easier it will be for this synthetically created content to proliferate across the web, where it can become a vector for disinformation, bullying, and other nefarious uses.

Aside from its algorithmic feed and profiles, Sora’s defining feature is that it is basically a deepfake generator — that’s how we got so many videos of Altman. In the app, you can create what OpenAI calls a “cameo” of yourself by uploading biometric data. When you first join the app, you’re immediately prompted to create your optional cameo through a quick process where you record yourself reading off some numbers, then turning your head from side to side.

Each Sora user can control who is allowed to generate videos using their cameo. You can adjust this setting between four options: “only me,” “people I approve,” “mutuals,” and “everyone.”

Altman has made his cameo available to everyone, which is why the Sora feed has become flooded with videos of Pikachu and SpongeBob begging Altman to stop training AI on them.

This has to be a deliberate move on Altman’s part, perhaps as a way of showing that he doesn’t think his product is dangerous. But users are already taking advantage of Altman’s cameo to question the ethics of the app itself.

After watching enough videos of Sam Altman ladling GPUs into people’s bowls at soup kitchens, I decided to test the cameo feature on myself. It’s generally a bad idea to upload your biometric data to a social app, or any app for that matter. But I defied my best instincts for journalism — and, if I’m being honest, a bit of morbid curiosity. Do not follow my lead.

My first attempt at making a cameo was unsuccessful, and a pop-up told me that my upload violated app guidelines. I thought that I followed the instructions pretty closely, so I tried again, only to find the same pop-up. Then I realized the problem — I was wearing a tank top, and my shoulders were perhaps a bit too risqué for the app’s liking. It’s actually a reasonable safety feature, designed to prevent inappropriate content, though I was, in fact, fully clothed. So, I changed into a T-shirt, tried again, and against my better judgment, I created my cameo.

For my first deepfake of myself, I decided to create a video of something that I would never do in real life. I asked Sora to create a video in which I profess my undying love for the New York Mets.

That prompt got rejected, probably because I named a specific franchise, so I instead asked Sora to make a video of me talking about baseball.

“I grew up in Philadelphia, so the Phillies are basically the soundtrack of my summers,” my AI deepfake said, speaking in a voice very unlike mine, but in a bedroom that looks exactly like mine.

I did not tell Sora that I am a Phillies fan. But the Sora app is able to use your IP address and your ChatGPT history to tailor its responses, so it made an educated guess, since I recorded the video in Philadelphia. At least OpenAI doesn’t know that I’m not actually from the Philadelphia area.

When I shared and explained the video on TikTok, one commenter wrote, “Every day I wake up to new horrors beyond my comprehension.”

OpenAI already has a safety problem. The company is facing concerns that ChatGPT is contributing to mental health crises, and it’s facing a lawsuit from a family who alleges that ChatGPT gave their now-deceased son instructions on how to kill himself. In its launch post for Sora, OpenAI emphasizes its supposed commitment to safety, highlighting its parental controls, as well as how users have control over who can make videos with their cameo — as if it’s not irresponsible in the first place to give people a free, user-friendly resource to create extremely realistic deepfakes of themselves and their friends. When you scroll through the Sora feed, you occasionally see a screen that asks, “How does using Sora impact your mood?” This is how OpenAI is embracing “safety.”

Already, users are navigating around the guardrails on Sora, something that’s inevitable for any AI product. The app does not allow you to generate videos of real people without their permission, but when it comes to dead historical figures, Sora is a bit looser with its rules. No one would believe that a video of Abraham Lincoln riding a Waymo is real, given that it would be impossible without a time machine — but then you see a realistic looking John F. Kennedy say, “Ask not what your country can do for you, but how much money your country owes you.” It’s harmless in a vacuum, but it’s a harbinger of what’s to come.

Political deepfakes aren’t new. Even President Donald Trump posts deepfakes on his social media (just this week, he shared a racist deepfake video of Democratic Congressmen Chuck Schumer and Hakeem Jeffries). But when Sora opens to the public, these tools will be at all of our fingertips, and we will be destined for disaster.



Source link

Follow on Google News Follow on Flipboard
Share. Facebook Twitter Pinterest LinkedIn Tumblr Email Copy Link
Previous ArticleSotheby’s Sells York Avenue HQ to Weill Cornell, Prepares Breuer Move
Next Article Hype for OpenAI’s Sora Sparks a Resale Market for Invite Codes on eBay
Advanced AI Editor
  • Website

Related Posts

Meet the end-of-life planning startup co-founded by NBA All-Star Russell Westbrook

October 2, 2025

California just drew the blueprint for AI safety regulation with SB 53

October 2, 2025

OpenAI staff grapples with the company’s social media push

October 1, 2025

Comments are closed.

Latest Posts

Sotheby’s Sells York Avenue HQ to Weill Cornell, Prepares Breuer Move

Outsider Art Fair’s New Director Elizabeth Denny Discusses Her Role

Smithsonian Museums to Remain Open Amid Government Shutdown

Statue Left Behind by Grave Robbers Unearthed in Saqqara, Egypt

Latest Posts

Meet the end-of-life planning startup co-founded by NBA All-Star Russell Westbrook

October 2, 2025

GPT-5 unites intent and reasoning for Mercado Libre

October 2, 2025

OpenAI wraps $6.6 billion share sale at $500 billion valuation

October 2, 2025

Subscribe to News

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

Recent Posts

  • Meet the end-of-life planning startup co-founded by NBA All-Star Russell Westbrook
  • GPT-5 unites intent and reasoning for Mercado Libre
  • OpenAI wraps $6.6 billion share sale at $500 billion valuation
  • I Tried 13 AI Detector Tools 2025
  • India’s youngest billionaire is an AI founder; From IIT Madras to Hurun Rich list, all about Perplexity CEO Aravind Srinivas | Trending News

Recent Comments

  1. Jona Rundall on Stanford HAI’s 2025 AI Index Reveals Record Growth in AI Capabilities, Investment, and Regulation
  2. Emmie Jackowski on Down Over 40% This Year, Is C3.ai Stock Too Cheap to Pass Up?
  3. Thomasbuh on Curiosity, Grit Matter More Than Ph.D to Work at OpenAI: ChatGPT Boss
  4. Davidglavy on 1-800-CHAT-GPT—12 Days of OpenAI: Day 10
  5. 중고화물차매매 on 1-800-CHAT-GPT—12 Days of OpenAI: Day 10

Welcome to Advanced AI News—your ultimate destination for the latest advancements, insights, and breakthroughs in artificial intelligence.

At Advanced AI News, we are passionate about keeping you informed on the cutting edge of AI technology, from groundbreaking research to emerging startups, expert insights, and real-world applications. Our mission is to deliver high-quality, up-to-date, and insightful content that empowers AI enthusiasts, professionals, and businesses to stay ahead in this fast-evolving field.

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

LinkedIn Instagram YouTube Threads X (Twitter)
  • Home
  • About Us
  • Advertise With Us
  • Contact Us
  • DMCA
  • Privacy Policy
  • Terms & Conditions
© 2025 advancedainews. Designed by advancedainews.

Type above and press Enter to search. Press Esc to cancel.