Dark navy and orange illustration of a cracked digital vault leaking data streams

Fireworks AI Breach Hit Notion Chats: Rotate Your Keys Today

In short

  • Fireworks AI, a host for AI models, says attackers got into customer data and parts of unfinished models over the past month. Notion confirmed its chats were hit.
  • Fireworks serves about 10,000 enterprise customers. Notion says fewer than 1% of its workspaces had AI chat transcripts exposed.
  • The money angle: stolen AI access gets resold and the bill lands on the owner. Rotate keys and set spending caps today.

You do not have to use Fireworks to be affected. If a tool you use runs its AI on Fireworks, your chats can end up in the leak. That is what happened to Notion. Do you paste keys into AI chats? Stop, and read on.

What happened

On Monday, November 9, Fireworks disclosed that hackers had accessed some customers’ datasets and models over the previous month, according to Forbes. The company now calls it LLMjacking: attackers steal access to AI models and resell it, and the victim pays the bill. Fireworks is working with Unit 42, the security team at Palo Alto Networks. Its CEO, Lin Qiao, said on X that the attackers’ behavior suggested AI agents were involved.

The timeline: a first incident in early October, a separate attack on October 24 on machines holding research and development data, and the latest update on November 9. Exposed items include billing and account information, addresses, payment history and parts of unfinished AI models. Forbes reports two customers have already moved a large part of their business away.

Notion used Fireworks to serve open-weight models and for its Insights feature. Fireworks told Notion on November 6 and confirmed a new dataset on November 8. Notion cut the connection. The exposed data is Notion AI chat transcripts from fewer than 1% of workspaces, with no author or workspace label and no page content.

How to use it

  1. Notion workspace owner? Open the sidebar, click the question mark and choose Security incident review. It works on desktop and web only.
  2. Treat any exposed chat as compromised. If someone pasted a password or API key into Notion AI, rotate it now.
  3. Set a hard monthly spending cap on every AI API key you own. This one is my advice, not Notion’s.
  4. Use a separate key per tool, so one leak does not open everything.

Do the math: rotating 5 keys takes about 15 minutes. At €30 an hour that is €7.50. A cap of €50 a month on each key limits the worst case on that key to €50. Without a cap there is no limit. The numbers are my example, not from the incident.

What it means

Your AI vendor has vendors. Every layer holds your prompts. The hosts that grow fastest, Fireworks is valued at $17.5 billion according to Forbes, are the biggest targets. Expect more tools to name their AI subprocessors, and more customers to ask.

Read also: Stop Your AI Coding Agent Leaking API Keys for €0 With Gitleaks · Trigger.dev Breach: Attacker Read Customers’ Environment Variables · Notion Agents Now Work 24+ Hours on One Task – Up From 5 Minutes

Ivan’s Take

Not a reason to drop AI tools. A reason to stop pasting secrets into chats. I would rotate every key that ever touched a chat window this week and put a spending cap on the rest. Ten minutes of boring work.

Sources: Notion · Forbes

II
About the author
Ivan Ivanov
Founder ofAI Rush XGiantPartsSupreme CommerceHawkValueBabyVitaAvtoGear

If it doesn’t save you time or money, you won’t see it here

  • Facts, not hypeEvery price and number is checked against the official source
  • Always the real priceYou see what it costs before you click
  • I say when it’s weakEven when it’s OpenAI or Google
All articles by Ivan →

Similar Posts