- The Neuron
- Posts
- šŗ Scammers are going WILD with AI...
šŗ Scammers are going WILD with AI...
PLUS: OpenAI watermarks text now?!

Welcome, humans.
Big news: we are re-launching our podcast The Neuron: AI Explained with the first new episode set to come out this Friday! If youāre an advertiser looking to sponsor this type of content, reach out to [email protected] and let us know.
Hereās what you need to know about AI today:
Cyber crimes are escalating at a rapid clip thanks to AI.
OpenAI's o3 model set industry records on ARC-AGI at a fraction of competitors' cost.
AI coding agent capabilities now basically double every four months.
AI systems surpassed 94% of human experts in practical virology knowledge.

Cyber criminals are going WILD with AI (because duh?)
By now youāve probably seen the viral trend of everyone generating action figures and dolls out of their own likeness (itās SO viral, people are already sick of it).
Well, as it turns out, giving AI info about your personal interests, hobbies, and even your likeness can be used in social engineering and scamsāESPECIALLY if you share the pics on social media, where bad actors can scoop those identifiers up to use against you.
A recent report out of the UK found that AI-enabled crime, such as phishing and romance scams, have seen a āsubstantial accelerationā thanks to AI making cybercrime easier and more effective than ever. Wow, who ever could have predicted this?!
But how? AI lowers the bar for criminals, letting themā¦
Automate attacks at scale.
Generate hyper-realistic fake content (websites, reviews, emails).
Use deepfakes or voice cloning to impersonate trusted people.
For example, remember the exec who was tricked by a deepfake CFO into sending someone Ā£20M? Thatās the power AI gives scammers.
Microsoft just reported thwarting $4B in such fraud attempts last year alone.
It's not just phishing and fake websites either. AI fuels convincing job scams with fake AI interviews and automates the manipulation in romance fraud (like pig-butchering scams).
Thereās even a new threat for developers: āPackage Hallucinations,ā where code-generating AI recommends non-existent software packages. Attackers then publish malicious code under those fake names, tricking unwitting vibe-coders into installing malware (one study found 200K unique fake packages generated by popular AI models!)
While companies like Microsoft are deploying defensive AI and building safer products (āFraud-resistant by Designā), and researchers are testing mitigations (though often with trade-offs, like reduced code quality), vigilance is key.
Our take: Assume AI is amplifying threats. Verify any job offers, ignore urgent payment requests, be skeptical of DMs, and think carefully about the data you feed AI tools or share online. Staying informed and cautious is your best defense in the age of AI-powered scams. Hereās our full explainer with more findings and tips.
Weāve also read itās probably a good idea to have a safe phrase with your significant other and/or family members to confirm youāre actually talking to them on the phone when sharing personal details. Why? Check out todayās Treats to Tryā¦cloning voices just got INSANELY easy (as if it wasnāt easy enough as it is).

FROM OUR PARTNERS
Do real work with agentic AI
Sanaās all-in-one AI platform lets you build and deploy powerful agents that automate complex workflows for every team.
With Sana Agents, you can:
Conduct 9 hours of deep research in seconds across every app.
Analyze complex datasets 10x faster.
Accelerate your sales cycle by cutting prep time 90%.
Capture perfect meeting notes with instant action items
LLM-agnostic. Extensible APIs. Enterprise-grade security.
Trusted by top teams, loved by end users.

Prompt Tip of the Day
Apparently OpenAI is now secretly watermarking text from their newest models with invisible characters that look identical to regular spaces, but canāt be detected by typical tools. This sneaky feature seems to target longer outputs like essays that students might copy-paste.
Want to check if your AI text is watermarked? Paste it into this online character viewer or open it in a code editor like Sublime Text or VS Codeāthe watermarks create a distinctive pattern that clearly identifies direct copies from newer ChatGPT models.
Removing them is super easy, tooājust find and replace these special characters with regular spaces in any text editor that displays special characters.
Btw, Hacker News isnāt convinced this was intentional on OpenAIās part, but itās an interesting discovery either way.

Treats To Try.
*Data brokers selling your personal info? Yikes. Incogni Unlimited not only scrubs your data from our extensive 250+ broker network, but lets you point them at ANY sketchy site sharing your details. Protect your personal data for 55% off with code NEURON
Instagram Edits is the companyās new competitor to CapCut, and comes with AI tools that Instagram doesnāt have.
Sand AI released MAGI-1, an open-source video model that generates high-quality videos chunk-by-chunk with precise timeline control and infinite extension capabilities (demo on X)ātry it here.
Nari Labs released Dia 1.6B, a new open AI model that converts your text into natural-sounding conversations with emotional tones, speaker variations, and non-verbal sounds like laughter and coughsādemo, try it here.
Assort Health answers patient calls with specialty-specific voice AI, freeing your medical staff from routine scheduling tasks (raised $22M)
Descript now has an agent to help you āvibecodeā videos (so like, āvibe editingā?); itāll remove awkward silences, translate content, and condense long recordings into concise final productsāwatch this demo or apply here.
Superpower analyzes your blood twice yearly to catch health problems before symptoms appear and creates personalized action plans to improve your wellbeingāpaid only rn ($499/year).
Manychat automates messaging and responses across Instagram, WhatsApp, TikTok, and Messengerāfree to try (raised $140M).
*This is sponsored content. Advertise in The Neuron here.

Around the Horn.
OpenAI would apparently buy Google Chrome if given the chance, and may be partnering with Shopify to let you buy Shopify products directly in chat.
Grok now has vision, allowing it to see the world around you like ChatGPT can.
Physical Intelligence's Ļ0.5 robot can now clean up in brand new homes it's never seen before by understanding both what to do and how to do it.
This video is a WILD demo of what AI gaming will be like when NPCs in games can respond to what you actually sayāits from the game Whispers from the Star (yet to be released).
OpenAIās o3 model now scores 57% on the ARC-AGI v1 test (a tough benchmark for AI intelligence):
Mike Knoop shared on X that o3 (medium) is now the industry's leading AI reasoning system with double the score at 1/20th the cost compared to competitors, scoring $1.5/task (o3 high kept timing out).
As Ethan Mollick says, thatās more evidence that o3 represents āa big move forwardā for AI.
That said, it only achieved 3% on ARC v2, at $2.5/taskātalk about a challenge!
Related: Because of o3/o4, the time horizon of coding agents (tasks measured by how long they would take humans to do) is now doubling every 4 months (up from 7 months reported back in March)āread our full story on the original report here.

Midweek Wisdom
Anthropic discovered that Claude expresses five main value categories (Practical, Epistemic, Social, Protective, and Personal) in real-world conversations, with the AI sometimes mirroring user values but also standing firm on core principles when users request unethical content (paper)
Check out this startling analysis showing frontier AI systems have already surpassed 94% of human experts in practical virology knowledge (paper).
This LLM Roadmap blog is a fun way to learn about all the technical stuff related to AIābut itās still VERY technical.
Check out the top AI papers from last week (according to NLP newsletter).
This is a great piece on how there are two OpenAIs⦠the one promising superintelligence, and the one thatās just a business.
Pretty cool: AI is being used to protect endangered wildlife through thermal cameras that alert ships to nearby whales, text message systems warning villagers of snow leopards near livestock, drones counting waterbirds in seconds instead of thousands of hours, and monitoring tools that have detected thousands of illegal wildlife sales across social media platforms.

A Cat's Commentary.


![]() | Thatās all for today, for more AI treats, check out our website. NEW: Our podcast is making a comeback! Check it out on Spotify. |

| ![]() |