The link should probably be: https://www.schneier.com/blog/archives/2025/06/what-llms-kno...

Or the post it quotes https://simonwillison.net/2025/May/21/chatgpt-new-memory/

  "6": "User is active 2 days in the last 1 day, 8 days in the last 7 days, and 11 days in the last 30 days."

lol

I suppose the last 24 hours contains today and yesterday.

Is that how you work 200%?

I applied this query with 4o and yes, quite a thorough historical recounting. Really weaves together all those "random" questions one asks an LLM into a surprisingly (and somewhat scary) encompassing of one's self.

All: There's no valid use cases for local LLM, unless you're doing something illegal or unethical, you creepy pervert and/or criminal

Also all: How come LLM (and the company that runs it and provides a way for me to access and use it) knows so much about me? That's creepy. And there's just no way anybody could predict that would happen

People's privacy expactations are miscalculated in a world with LLMs. Before LLMs there was little reason to care if you were leaving breadcrumbs, because no one with access was going to investigate them and draw conclusions from them.

The fact that the LLMs are prone to hallucinations and fanciful conclusion jumping probably make things worse, because the only way to be safe from it wrongfully concluding things about you is to just be invisible to it.

When I speak to ChatGPT and other LLMs, I am mindful of the profile they build on me and what I ask about. And even how I ask it.

It is the same as I have been doing for 15 years on public social media.

I really dislike the new memory, find myself using temp chats on ChatGPT a lot these days, they claim it adds nothing to mine or the collective knowledge, although to be honest at this point my trust in OpenAI is incredibly low.

Isn’t this just outputting the same information that you can find on my “administre memories” section of ChatGPT settings?

No. That's the old memory feature, where you could view and delete individual memories.

This is the new memory feature where it automatically summarizes notes from your previous conversations.

I wrote more about the difference between the two here: https://simonwillison.net/2025/May/21/chatgpt-new-memory/#we...

> User’s account is 237 weeks old.

ChatGPT was released to the public on November 30, 2022.

Otherwise, this reads like an FBI file:

https://digitalcommons.unl.edu/usjusticematls/10/

I created an account with OpenAI back in 2020 to try out GPT-3, which would explain that account age.

(I just confirmed that by searching my email for anything mentioning OpenAI in 2020 and found an invite to create an account in October 2020.)

The solution is to use www.duck.ai.

Full privacy, no data collection, no User profiling, no surveillance, no training with your data.

Plus, you can chose your preferred AI model: Claude, GPT, etc.

And it's even free of charge.

I find this is an extraordinary tool for 90% of needs, and I love that it can interact with multiple models. It is a great example of how to productize the ecosystem in a user-loyal way.

Doesn’t offer access to the usual paid models, which is why it’s free of charge.

I know someone else who uses Grok and has the "learn from my responses" feature turned on, he claims it generates memories (like chatgpt did for a while) although he might just not understand how the dialog engine works.

This is like the prompts which ask the LLM to act as a spy / FBI agent, to expose what it knows about the user, right?

I still don't know what integrous means.

"Integrous" is a rarely used adjective meaning "having or characterized by integrity". It's derived from the Latin word "integer," meaning whole or complete, and the suffix "-ous" indicating fullness or possession. While technically correct, it's more common to use synonyms like "honest," "decent," or "virtuous" to convey the concept of integrity.

Now, take a guess where this comes from..

You might as well have asked the pen on your desk how much it knows about you. Whether your personal data is in the current LLM context window or not has nothing to do with whether it was collected from you by Mistral.

Of course that doesn't prove much. Perhaps the information is only available to administrators.

Not to complain, but that test would be more interesting if you ran it with an account.

where is the nearest McDonald's? 18:51

I'm sorry, but I don't have the capability to access real-time location data to find the nearest McDonald's for you. However, you can easily find this information by using a maps application on your phone or computer.

Same old but there has been surprisingly little attention paid to it in the present context.

I don’t care what chatGPT knows about me. But I do care what OpenAI knows about me and how it will use that knowledge.

The alternative is transparency and verification of who has that data.

for a start, the ability to partition that knowledge?

e.g. what is being researched or worked on for project A, might be vastly different or require different domain of knowledge for project B.

Or worse still, you ended up reusing code across different projects for different clients, and one day client O(#1) decides to sue client G(#2) and finds code similarities?

[1] as example, perhaps client O has a name that rhymes with "Horrible"

[2] and potentially client G's name rhymes with "Flugel"

The alternative is that LLMs don’t know anything about us, of course. That’s what Kagi’s Assistants do.

That the LLM is in control of us.

Plainspoken and unnerving. Schneier nails it: LLMs become mirrors that reflect, amplify, and exploit our own signals.

What resonated with me: every prompt, every correction, every hesitation feeds a profile the model refines over time. It’s not just personalization—it’s psychoanalysis-by-proxy.

This matter needs more than opt-out buttons. We need transparency and circuit breakers. Give me AI that explains why it suggests a certain answer—not just adapts forever without oversight.