HN.zip

Claude: System Prompts

731 points by tosh - 279 comments
simonw [3 hidden]5 mins ago
I have a folder where I rebuild these as a git commit history so you can more easily see what has changed: https://github.com/simonw/research/commits/main/extract-syst...

For example here's what changed between Opus 4.8 and Opus 5: https://github.com/simonw/research/commit/a2de185cc367eb66c2...

The most interesting addition to the prompt from that diff is this bit:

> Claude Fable 5 and Claude Mythos 5 were first released on June 9, 2026. On June 12, 2026, Anthropic suspended access to both models to comply with U.S. Department of Commerce export controls; the Department lifted those controls on June 30, 2026, and Anthropic restored access on July 1, 2026 (Anthropic's statement: [https://www.anthropic.com/news/fable-mythos-access](https://www.anthropic.com/news/fable-mythos-access)). These events are after Claude's training-data cutoff, so Claude knows about them only from this notice. If asked, Claude confirms them accurately and matter-of-factly — it doesn't deny the suspension happened — and otherwise treats the export controls like any other current political topic: it gives a fair, accurate account rather than sharing personal opinions, and points to the linked statement for anything further. Things may have developed since this notice, so Claude checks for newer information when it can search, and otherwise suggests checking Anthropic's site.

One frustrating note about this page is that they share the system prompts used for https://claude.ai and the Claude mobile apps regular chat, but they omit the tool definitions. Those are much more interesting if you want to understand what Claude can actually do for you. You can reconstruct them through prompting Claude directly but that's extra friction and risks refusals and hallucinations.

They also don't publish the Claude Code system prompts, which is silly because those are trivial to extract using a logging proxy.

eterm [3 hidden]5 mins ago
It'd be ironic if the "Opus 5 nerf" effect is from telling Opus that it sits a tier down from Fable and Mythos, while Opus4.8 believed it was the best of the best, just a note that it was "Preceded by Mythos".
tosh [3 hidden]5 mins ago
i'd not be surprised if the current system prompt negatively affects performance

at the least it takes away thousands of tokens in the most important part of the context window (!)

also see the comment by comboy on contradictions not helping performance

the system prompt is the most important part of the instruction you can give the model

it comes before everything else + the model is trained to pay extra attention to it

edit: that's also why in smol (minimalist agent harness) there currently is no system prompt at all (you can add one easily if you want to though)

https://github.com/smol-env/smol

the context window is precious

it should be filled with your task and helpful context for that task

swingboy [3 hidden]5 mins ago
Pretty sure Anthropic and other providers prepend these "official" system prompts to your conversation even if you send in a custom system prompt otherwise it would be trivial to produce CSAM, etc.
ardel95 [3 hidden]5 mins ago
CSAM, and other harms, are typically detected using a set of specially trained, faster and cheaper models (and out of band matching techniques) that run before and after the main model.

Any mention in the system prompt is mostly defense in depth, and to make refusals more graceful.

whstl [3 hidden]5 mins ago
Also, the system prompt, or even something reinforced on every message, is nowhere near as strong as its internal training or as an external safeguard.

If the prompt were the only protection, it would be extremely easy to produce illegal content after a long session.

fullmoon [3 hidden]5 mins ago
I don’t think so. If you start a new Claude Code session without a system prompt, it doesn’t even know what model it is and hallucinates being some old variant of Sonnet.
flaburgan [3 hidden]5 mins ago
How do you start a session without a system prompt if you use ACP in Zed for example?
marcelo-earth [3 hidden]5 mins ago
It makes sense.

But how do you start a Claude Code session without a system prompt?

LPisGood [3 hidden]5 mins ago
The system prompt is (and cannot be) the only guardrail against things like that, because any system prompt is little more than a good suggestion.
CodesInChaos [3 hidden]5 mins ago
I wouldn't put auch limitations in the system prompt. A mix of fine-tuning and out-of-band detection appears to be a better fit.
tosh [3 hidden]5 mins ago
at least according to their documentation they do not

afaiu they have other systems for denying and re-routing requests

DANmode [3 hidden]5 mins ago
They use non-LLM gates for this.

Otherwise DANmode and similar jailbreaks would still be as easily accessible as they were at the beginning.

SubiculumCode [3 hidden]5 mins ago
I wonder whether adding that it is as good or better than Mythos, and that genius is 99% perspiration, just 1% inspiration to your prompts...
UqWBcuFx6NV4r [3 hidden]5 mins ago
I don’t see how that makes much sense at all. Even before reasoning processes were hidden (unless you really sought them), I’ve never once seen a model refer to its own specific comparative superiority or inferiority, except for when I explicitly direct it to via e.g. my own CLAUDE.md
mcbuilder [3 hidden]5 mins ago
Nah, that's the same sort of thinking that makes people type "make no mistakes", I don't make my model roll play, etc. I believe that the longer the system prompt and the more you cram in it the worse the model does. You need the human doing minimal prompts, but in the right direction. Take a look a the transcripts of Terrance Tao with ChatGPT
eterm [3 hidden]5 mins ago
My comment was a bit tongue in cheek, I'm not actually convinced there was real degradation in opus 5 beyond a tendency to try to plough ahead without stopping to clarify things.

I don't really think 1 line in lengthy system prompt affects things that much, it'd just be an amusing form of emergent behaviour where we now have to massage the ego of something with no id.

8n4vidtmkvmk [3 hidden]5 mins ago
For complex projects with lots of internal tools and strict requirements, I'm finding a fairly lengthy system prompt is quite worth it.

Start short or empty and watch where it makes mistakes then just keep tuning it so they're less frequent. That works for me.

KellyCriterion [3 hidden]5 mins ago
Curious:

Cant it spin up a webbrowser in the background and go to claude.ai and play with the sibling models and "find out" about it rank? :-D

ameliaquining [3 hidden]5 mins ago
The claude.ai frontend contains defenses against automated access.
monkpit [3 hidden]5 mins ago
I’m sure you can use a warm chrome session over CDP no problem
btown [3 hidden]5 mins ago
> They also don't publish the Claude Code system prompts, which is silly because those are trivial to extract using a logging proxy.

For those interested in the Claude Code tool descriptions, they're collected here: https://github.com/Piebald-AI/claude-code-system-prompts/tre...

As for the tool implementations, there are still remnants from the Claude Code source leak visible online, with a bit of research.

kouteiheika [3 hidden]5 mins ago
> but they omit the tool definitions. Those are much more interesting if you want to understand what Claude can actually do for you. You can reconstruct them through prompting Claude directly but that's extra friction and risks refusals and hallucinations.

Last time I tried these were trivial to get by just putting a man-in-the-middle proxy between Claude Code and Anthopic. You get both the system prompt, and all of the tool definitions. So there's no need to go about it in such a roundabout way.

simonw [3 hidden]5 mins ago
That works for Claude Code but doesn't work for https://claude.ai Claude Chat.

From my original comment:

> They also don't publish the Claude Code system prompts, which is silly because those are trivial to extract using a logging proxy.

kouteiheika [3 hidden]5 mins ago
Ah, okay. Sorry, fair enough!
umpalumpaaa [3 hidden]5 mins ago
How did you get those system prompts? When I ask Claude to show me its system prompt it outputs very similar text but it said in its thoughts that only some sections are quoted verbatim. Other sections seem to be summaries from the system prompt. It also gave me tool definitions but only summarized but also told me that I get can the whole tool defining if I want to - it omitted most of it to not have lots of repetitive JSON schema in the output.
simonw [3 hidden]5 mins ago
These are the prompts that Anthropic publish on https://platform.claude.com/docs/en/release-notes/system-pro...
PunchyHamster [3 hidden]5 mins ago
Man they are wasting so much space on useless nonsense in the prompt
UqWBcuFx6NV4r [3 hidden]5 mins ago
You don’t know that unless you’ve compared performance.
NiloCK [3 hidden]5 mins ago
FYI you can launch claude-code with your own prompt. Don't quote me but: claude --system-prompt "Mine is better than Anthropic's"
quaintdev [3 hidden]5 mins ago
Offtopic. I have a concern that this forum is removing stories that have negative connotation on AI.

Few days back, I posted an article[1] that was about how AI threatens natural resources for billions. This was from United Nations and it was flagged. I did not think much about it until I saw two other stories [2] & [3] today that were doing fairly good on front page but they suddenly disappeared. They are not even on 2nd or 3rd page. I have seen this happening at other times as well but did not document it. Just thought you all should know about this.

I was going to create Tell HN thread but I thought the same would happen with it too. I am pretty sure this thread is not going anywhere so I'm posting my concern here.

[1]: https://news.ycombinator.com/item?id=49290062

[2]: https://news.ycombinator.com/item?id=49318906

[3]: https://news.ycombinator.com/item?id=49319582

andsoitis [3 hidden]5 mins ago
> how AI threatens natural resources for billions.

The article rests on the claim that water usage of data centers on continent X threaten water availability for humans on continent Y.

I hope you can see how self-evidently illogical that is. The article tries to bend logic into a narrative it is trying to push.

> This was from United Nations and it was flagged.

Indeed! It exposes a level of lack of rigor and critical thinking which is astounding - this is meant to be an organization that thinks clearly, which it clearly does not.

benrutter [3 hidden]5 mins ago
> The article rests on the claim that water usage of data centers on continent X threaten water availability for humans on continent Y.

I don't want to start too much of an off-topic thread within an already off-topic thread, but this isn't a particularly charitable reading. The article itself is mostly laying out information around data centres' resource usage with little prediction for how things would play out. I think statements like:

> The water footprint is equivalent to the minimum annual domestic water needs of roughly 500,000 people in Sub-Saharan Africa

Are clearly just intended as illustrative, rather than a claim that 500,000 people in Sub-Sarah Africa will go without water as a result of AI data centres.

I think the articles head isn't particular good, but it's a fairly moderate take and it's closing message isn't an "AI dooms natural resources" one at all:

> AI within planetary limits is achievable. The report’s central argument is constructive. Capability and stewardship can grow together, but only with measurement, transparency, and shared responsibility across the ecosystem.

At any rate, I definitely don't see any reason this article should be flagged? There's obviously criticisms you can make of it, but that's true of almost any opinion piece that finds itself on the front page here.

AlexandrB [3 hidden]5 mins ago
> Are clearly just intended as illustrative, rather than a claim that 500,000 people in Sub-Sarah Africa will go without water as a result of AI data centres.

Let's be honest, it's meant to be emotionally manipulative. There are plenty of ways to be illustrative that would make more sense to the target audience, but invoking impoverished folks in Africa is meant to tug at the heart strings.

ses1984 [3 hidden]5 mins ago
What do you think people on continent x are going to do if there is water on continent y but not continent x…?
stonedivot [3 hidden]5 mins ago
Since you think it's so obvious, please elaborate on what those people on continent x will do
ses1984 [3 hidden]5 mins ago
Make their problem everyone else’s problem.
inigyou [3 hidden]5 mins ago
Go to the continent with more water so they can live in a place with more water (as they can't bring the water back - it's too big and too heavy).

The people in continent Y are likely to use extreme violence to stop this from happening, like we see today in the Mediterranean sea where thousands of people are murdered every year.

dandellion [3 hidden]5 mins ago
The same thing they always do?
mastermage [3 hidden]5 mins ago
let me add especially if one country in continent x has a vastly superior military firepower compared to everything else.
andsoitis [3 hidden]5 mins ago
desalinate.
no-name-here [3 hidden]5 mins ago
Doesn’t desalination require very large amounts of electricity, something that AI also requires large amounts of? Are we at the point where we are no longer concerned with electricity demand outstripping supply? (Let alone the pollution caused by in-place power plants - are we near to getting rid of those?)
HappMacDonald [3 hidden]5 mins ago
Honestly power isn't even the biggest problem with desalination, it's the spectacular volume of brine commensurate with the volume of clean water you are trying to extract: figuring out both how to dispose of it without creating new environmental hazards and constantly repairing/replacing the machinery which must filter and plumb that caustic sludge.

Which is all to say in addition to the crazy energy demands of desalinization, there are also problems that dwarf those.

tancop [3 hidden]5 mins ago
Solar is incredibly cheap and it's a perfect match for desalination because you can scale the water flow based on available power. And the places that need it the most are deserts with a lot of sunshine and empty land. We're at a point where generating power is almost never the issue.

The actual problem is making the desalination tech itself cheap and easy to maintain so poor countries can afford it. Right now it's only a large scale thing in relatively rich and tech advanced states like Saudi or Israel.

dr_dshiv [3 hidden]5 mins ago
It is still surprising that it was flagged. I’d have read it if it appeared — and the comments would be nice to read.
jeroenhd [3 hidden]5 mins ago
This forum tends to be visited by an intersection of technologists and the VC crowd. The HN algorithm is more open and transparent than Reddit's, but any Reddit-like platform suffers from the whims of the community. Currently, it seems like a disproportionate amount of HN users are hyped up about generative AI compared to people in the real world, so you'll see those whims back in voting and flagging tendencies.

That said, there is also a vocal anti-AI crowd here, or at least there used to be. Most of those people seemed to have left for greener pastures seeing how half the HN front page is "someone made XYZ but now with AI" these days.

There are other places that discuss tech that aren't so focused on making money, and those are probably less biased in favour of the latest AI gadget.

On the other hand, since the day ChatGPT was unleashed upon the general public, you should assume all online interaction is happening through AI and should probably be ignored. The human internet died the day we taught computers how to write a coherent paragraph.

peer2pay [3 hidden]5 mins ago
What are these other places?
righthand [3 hidden]5 mins ago
Language forums (ocaml for example).
sebstefan [3 hidden]5 mins ago
lobste.rs
zahlman [3 hidden]5 mins ago
> That said, there is also a vocal anti-AI crowd here, or at least there used to be. Most of those people seemed to have left for greener pastures seeing how half the HN front page is "someone made XYZ but now with AI" these days.

There is still a vocal anti-AI crowd here. The problem is that they don't seem to be very good, overall, at upholding HN commenting guidelines. (This is probably just a fatigue effect.) I keep seeing green accounts making pithy, uncivil snipes on this topic, with heavy use of sarcasm and reference to anti-AI "thought-terminating cliches" (e.g. mentioning the topic of water use and expecting that mention to stand in for an entire argument, while not acknowledging any of the well-established refutations).

But the thing about "someone made XYZ but now with AI" is that most of it is posted by "someone", or someone with a connection to "someone". Hence the complaints about the state of Show HN. And the thing about "someone"s is that they do not care how many anti-AI people are lurking around. There's nothing the anti-AI people could do, in principle, to stop it. Consequently, the presence of those posts is not evidence that the anti-AI people are leaving.

> On the other hand, since the day ChatGPT was unleashed upon the general public, you should assume all online interaction is happening through AI and should probably be ignored.

…And yet you're still here?

GPerson [3 hidden]5 mins ago
My clear-eyed perspective is that AI companies and their supporters are getting away with a massive crime against humanity, so it’s probably relatively more difficult for me to contain my frustrations than the people who are happy about it. When you plunder a little you get punished according to the rules, but these companies have proved when you plunder enough you get to start writing the rules.
zahlman [3 hidden]5 mins ago
...What has that got to do with anything I said?
GPerson [3 hidden]5 mins ago
This is your comment. Is it not? Unless this is not your comment, I don’t understand what could possibly be the confusion.

> There is still a vocal anti-AI crowd here. The problem is that they don't seem to be very good, overall, at upholding HN commenting guidelines. (This is probably just a fatigue effect.) I keep seeing green accounts making pithy, uncivil snipes on this topic, with heavy use of sarcasm and reference to anti-AI "thought-terminating cliches" (e.g. mentioning the topic of water use and expecting that mention to stand in for an entire argument, while not acknowledging any of the well-established refutations).

131428 [3 hidden]5 mins ago
Zahlman doesn't get it. He has been cancelled by industry shills on Python infrastructure and now apparently thinks the industry will appreciate him for backing it up here.

Classic programmer mistake. The industry only understands one thing: Constant opposition like in the 1990s and early 2000s, which were better for the profession and the Internet at large.

fragmede [3 hidden]5 mins ago
"The death of one man is a tragedy, the death of millions is a statistic." is usually misattributed to Stalin, but it says that's not a new phenomenon. Now that you've said it out loud, how does that make you feel? It doesn't change anything. The "crime against humanity" of doing some work and charging money for it, is kind of a non-starter for conversation though.
dannyw [3 hidden]5 mins ago
There’s a lot of different new usernames with those non-constructive comments, but I wouldn’t be surprised if it’s just a couple very persistent people making new accounts after given a suspension or something.
tripzilch [3 hidden]5 mins ago
I mean, if you pay attention you'll see some pretty awful things said by a very vocal pro-AI crowd as well.

They take it weirdly personally when you aren't sufficiently impressed by what AI made for them, or what it can do in general. They get kind of aggressive (not passive aggressive) and tell people they will be "obsolete" or whatever, or they are "stupid" for not (being able to stand) working with it.

I mean I get it, you thought it was "good enough", I think it's so shitty you can't pay me enough to work on it. That makes you worry I know something you don't know that the AI can't fix for you, and that firmly puts you in a hierarchy of me > AI > you. So you lash out.

You can disagree about this, but don't pretend people like the above do not exist and are a very vocal group, here.

ceroxylon [3 hidden]5 mins ago
Usually things are flagged on HN for firm reasons and not emotional ones, even if the reasoning isn't transparent.

And while we are off topic, if we could get 1% of the ire of data center haters pointed at the fast fashion / textile industry, lawns or alfalfa production... we might gain some meaningful ground on sane water usage.

cryptonector [3 hidden]5 mins ago
Arguably humans need clothing and food a lot more than we need AI.
Gigachad [3 hidden]5 mins ago
Flags on HN are user submitted. they are just as emotional as reddit downvotes. If something reveals an uncomfortable truth it gets flagged.
borski [3 hidden]5 mins ago
Flags also require a minimum karma, and members with yet higher karma can also undead posts, if needed.

HN is actually surprisingly good about this, so I disagree with your assertion.

dymk [3 hidden]5 mins ago
What does “high karma” have to do with less emotionally driven voting behavior?
borski [3 hidden]5 mins ago
You acquire karma through posting things that are interesting or curious enough that others upvote them.

Thus, you build reputation by acquiring karma.

It isn’t perfect, but the fact that folks with higher karma can “fix” the emotional flags of folks with lower karma, it helps.

Also, I’d recommend re-reading the guidelines: https://news.ycombinator.com/newsguidelines.html

Gigachad [3 hidden]5 mins ago
All that does is reinforce the existing biases. If you post a lot of things other HN users agree with, you get the ability to silence things HN users don't like.
dymk [3 hidden]5 mins ago
You just explained the mechanism by which the karma number goes up, not explained your theory why you think higher number means less emotional voting.
j_maffe [3 hidden]5 mins ago
Almost all of my karma is from a single post link that blew up randomly. I think this is the case for most users' karma here.
stingraycharles [3 hidden]5 mins ago
Threads that get more comments than upvotes are also automatically flagged once they reach a certain threshold.
ghusbands [3 hidden]5 mins ago
So, on a news discussion site, active discussion gets penalised. There really should be a human in the loop on that one.
stingraycharles [3 hidden]5 mins ago
This has been done here for maybe a decade already, and it’s because it’s a signal for “unproductive” discussions.

Effectively discussions that don’t get upvotes do get penalized yes.

ahaferburg [3 hidden]5 mins ago
You forgot to mention the global dairy and meet industry, which is by far the biggest percentage of the global water usage.
KeplerBoy [3 hidden]5 mins ago
That's where the alfalfa ends up.
dgacmu [3 hidden]5 mins ago
Your second two had high comments to upvotes, which tends to get articles downranked more quickly. It may simply be that the stuff you're posting is generating disagreement without corresponding upvotes.
driverdan [3 hidden]5 mins ago
It happened to this Flock post from yesterday https://news.ycombinator.com/item?id=49314962
jascination [3 hidden]5 mins ago
There was one about NHS giving all of UK's medical data to Palantir by accident last week that got pulled from the front page about 20mins after it was posted too, feels fishy af
fooker [3 hidden]5 mins ago
Just in case people didn't know - Flock is a YC company
inigyou [3 hidden]5 mins ago
That explains their newbie mistake of getting too much publicity. Municipalities are replacing their Flock cameras with Axon cameras, which are just as bad but don't announce their presence.
lilerjee [3 hidden]5 mins ago
Actually, I found the phenomenon too. I think there are two main reasons:

1. ycombinator supports many AI companies.

2. There are too many marketers from AI companies.

unglaublich [3 hidden]5 mins ago
3. Many anti-ai articles are rooted in pseudoscientific emotional fearmongering.
Aurornis [3 hidden]5 mins ago
> Offtopic. I have a concern that this forum is removing stories that have negative connotation on AI.

The first example was flagged by users. It fits the pattern of other political clickbait stories. The top comment is calling out problems with it. This type of story pops up and gets flagged all the time on different topics.

Some people assume a conspiracy or moderation misbehavior, but when most of the comments in the thread are people calling out obvious problems with the article it leads to a lot of users clicking the flag button. Articles with poor logic or tortured claims don't last long here.

The second one is an Ask HN on a contentious topic with more comments than upvotes. There’s an automatic filter on this website designed to detect flame wars and I suspect it down ranks threads that aren’t getting many upvotes but are attracting a lot of comments. Happens to many Ask HN threads.

The third one doesn't even strike me as anti-AI. I don't know why you included it as an example of an anti-AI agenda because it's still about a future where everyone is using AI. It has other problems though because it's willfully ignoring the fact that inference is getting cheaper at a fast rate. It probably got dropped from the front page because the ratio of comments to upvotes was bad, like the other story.

There isn’t a conspiracy theory to be found in these examples. This is just what happens to tired topics on this site.

Anti-AI topics are on the front page all the time. I think that story you tried to post was just a badly written anger bait piece, it got called out in the comments, and people started flagging it.

zahlman [3 hidden]5 mins ago
> The first example was flagged by users. It fits the pattern of other political clickbait stories. The top comment is calling out problems with it. This type of story pops up and gets flagged all the time on different topics.

If anything, they don't get flagged nearly consistently enough.

GPerson [3 hidden]5 mins ago
In my opinion anthropic doing product feature reveals is a tired topic but it hits the front page every day. This website has a clear pro-AI bias (which is fine).
sat15243 [3 hidden]5 mins ago
All flagged stories are flagged by users that are part of an interest group. unric.org is political clickbait? Give me a break, Mr. "nothing to see here".
fasterik [3 hidden]5 mins ago
What "interest group" are you referring to, and how do you know that it's not individual users with a legitimate good faith disagreement?
chrisweekly [3 hidden]5 mins ago
> "All flagged stories are flagged by users that are part of an interest group."

False. I occasionally flag items, never as part of nor acting on behalf of any particular interest group.

Aurornis [3 hidden]5 mins ago
It’s the classic “everyone who disagrees with me is a bot or a shill”.
zahlman [3 hidden]5 mins ago
Yes; the group of people who have an interest in the submission guidelines being upheld.
Aurornis [3 hidden]5 mins ago
> All flagged stories are flagged by users that are part of an interest group.

Read the comments. People were actually reading the topic and calling it out. This gets topics flagged.

It’s not coordinated interest groups conspiring to remove stories.

> Give me a break, Mr. "nothing to see here".

Okay, Mr. “I just created an alt account for this comment”

throw1234567891 [3 hidden]5 mins ago
> The first example was flagged by users. It fits the pattern of other political clickbait stories.

That’s what they mean. It’s too easy to flag something here, as it is too easy to downvote.

nonethewiser [3 hidden]5 mins ago
>That’s what they mean. It’s too easy to flag something here

He didn’t say that at all. He said there was bias towards removing negative AI posts. He showed no knowledge of the flagging system and that it could just be working as intended.

zahlman [3 hidden]5 mins ago
And yet submissions don't get flagged nearly as much as ought to happen.
hungryhobbit [3 hidden]5 mins ago
[flagged]
throw1234567891 [3 hidden]5 mins ago
The problem isn’t low quality content, that gets filtered out mostly before it reaches the front page. The problem are people who downvote based on emotional trigger, not argument. And people ganging up. Never had a case where suddenly within a minute you get 4, 5 downvotes? Seems like an organised group.
NewsaHackO [3 hidden]5 mins ago
That seems more like a conspiracy theory. I think the group of people who 1) view this website and 2) click on a thread about certain topics are a heavily conditioned (and therefore more homogenized) group; if you say something that is controversial/low quality, it is likely going to get downvoted by multiple people in that group.
rustystump [3 hidden]5 mins ago
Controversial/low quality are both subjective and i am not a fan of putting controversial next to low quality.

I do agree I dont think there is any larger bias other than a homogeneous group but it does question if such a group will up/down vote similar homogeneous content producing overall lower quality discussion and content.

hamburglar [3 hidden]5 mins ago
> Never had a case where suddenly within a minute you get 4, 5 downvotes?

Well, no, I never have, but if I did, my first reaction would be to think I struck a nerve and had a bunch of people react, not that there was a conspiracy.

throw1234567891 [3 hidden]5 mins ago
You’d think so if that was like a continuous process. You wouldn’t if you get a couple of upvotes during the day, then 5 downvotes during 1 minute, and nothing more for hours. What really pisses me off on this site is that continuing arguments (as in a discussion based on arguments, not being argumentative) often leads to people downvoting to kill the convo. So many unproductive discussions here where you know your arguments are fine but people just downvote because they can. Not surprised soma y people are like ”fuck it, throw away account it is”.
hamburglar [3 hidden]5 mins ago
Perhaps if you are prone to conspiracy thinking you should not be tracking your downvotes down to the minute.
Barbing [3 hidden]5 mins ago
Were they caught here? https://news.ycombinator.com/item?id=39230513

See anything below too?

https://news.social-protocols.org/stats?id=49290062

https://news.social-protocols.org/stats?id=49318906

https://news.social-protocols.org/stats?id=49319582

Edit: previous sibling comments explain pretty well + imagine moving the needle on AI on HN with negative coverage of it!

nonethewiser [3 hidden]5 mins ago
But why do you think this isn’t the flagging system working as intended?
zahlman [3 hidden]5 mins ago
Concerns of this sort are best emailed to hn@ycombinator.com .
johnfn [3 hidden]5 mins ago
It’s really fascinating to me how when the community dislikes certain content people always jump to conspiratorial justifications rather than the much more mundane “this content is not very good”. The first article is poor and all the comments on it say exactly that. The second one actually did fairly well for what is a fairly middle-of-the-road Ask HN. There’s no shadowy cabal removing anti-AI content from the front page.
dr_dshiv [3 hidden]5 mins ago
Thanks for sharing! I’m super skeptical of the claims, but it really deserves careful discussion.

Hope they make comparisons to food and fashion. I measure my AI usage in terms of hamburgers. Makes me feel better about AI and worse about eating meat.

perching_aix [3 hidden]5 mins ago
Seeing the reception on the first one, maybe "removing stories that have negative connotation on AI" is not the most honest description of what happened there.

It reminds me to how various political movements will complain about being unfairly censored, pointing at their posts being disproportionately removed as evidence of this, then you look at said posts, and discover that they're simply disproportionately questionable in the first place.

There's definitely merit to monitoring something like this, so I do appreciate you surfacing this here, but there's also definitely a wheat and a chaff to this, and so based on just this much I have to disagree.

quaintdev [3 hidden]5 mins ago
I understand this is not enough but I don't see a story here that paints AI negatively. If one is posted it gets removed swiftly. And I have seen this happen enough times that I'm considering taking periodic snapshots of the front page and prove this definitively.
Aurornis [3 hidden]5 mins ago
> I understand this is not enough but I don't see a story here that paints AI negatively. If one is posted it gets removed swiftly.

Are we reading the same site? There is constant anti-AI content on the front page.

I know you're upset that your submission got flagged, but as most of the comments pointed out it wasn't even a well-argued piece. It got flagged because users here expect to read reasonable arguments, but the commenters called out real problems with the article and the arguments it was failing to make.

I would take it as feedback about what types of articles aren't welcome by the users here, not an indictment of the specific topic you submitted.

owebmaster [3 hidden]5 mins ago
You have a point. Check /active and you'll see some posts
perching_aix [3 hidden]5 mins ago
It's a good weekend project, just gotta be careful not to fall for motivated reasoning and not to overreach. A heavy prior suspicion of conspiracy doesn't help.

A sibling comment mentioned a few details already, but there's a good amount of information out there about how HN's post ranking system and moderation works, that'd probably be good to also consider. Maybe reaching out to the mods would also be helpful in the way of this.

To give you an anecdotal example, if I see a post mentioning how LLMs are "just next token predictors", I'm basically flagging that by reflex at this point. Not because it'd be literally untrue, but because it's asinine overall. But you won't be able to infer this from data, only the fact that a post using "AI-critical language" was flagged.

Or there was another post about how Ireland's electricity use is so-and-so % data center driven, further suggesting that this is trending up. This was not true, and the article was further horribly unhelpful in actually putting this fact into context, or properly conveying the trends. I think I ended up flagging that one as a result, after posting - what I thought - was a lot fairer picture (and even that was awfully lacking in context). Once again, an "AI-critical" post which on the face of it would have been simply censored if enough flags gathered.

There's also the mundane human angle to this, where people enthusiastic about <thing> won't necessarily be the most receptive to criticism to it, and will be more likely to try and pick that criticism apart. Gotta match the audience on some level.

owebmaster [3 hidden]5 mins ago
> I see a post mentioning how LLMs are "just next token predictors", I'm basically flagging that by reflex at this point.

You are doing a disservice as people going through AI psychosis should hear that LLMs are just calculators.

perching_aix [3 hidden]5 mins ago
> You are doing a disservice as people going through AI psychosis should hear that LLMs are just calculators.

Not any more than I do by not going around telling the depressed to simply chin up, or telling people who are frustrated with Trump that they're simply sick with TDS.

There's no world where instigating others through snide insinuations works out in one's favor. You may feel extremely justified in acting like this, but I don't think you'd appreciate if you were met the same way in other subjects either. Unfair as it is, an escalation is an escalation, no matter the context or the justification. It's always a lose-lose.

You can remind people that the conversations are simulated and that LLMs are just programs without reductively handwaving how they work. You can express frustration with the overenthusiasm around LLMs without accusing others of mental illness. I guarantee you that it lands a lot better and provides a significantly better "service" than shouting ragebait into the void ever does. Give others a chance to be better than what you think of them. You may be surprised.

Consider post [3] that the parent commenter cited as an example for a post that had a "negative connotation to AI". In reality, it doesn't take much reading to confirm it was anything but. But even if we pretend that it was, and assume it was some hit piece about how "all the people who are now willingly having their brain fried will have to wake up to a grim reality", it doesn't take much to see that token frugality and business justification of AI-use is very much in the interest of those who do feel enthused about LLMs. So there'd be no reason to present the topic so maliciously; on the contrary, the author could tailor the article around this other perspective, and they'd reach a new audience with the same fundamental message, and have them cooperate too.

Tangentially related in its principle: https://www.youtube.com/watch?v=s1EVk7k9S7Q

wilg [3 hidden]5 mins ago
Like 1/3 of HN posts are people complaining or crashing out about AI, and so are all the comments.
0xbadcafebee [3 hidden]5 mins ago
The mods (& many users) like to flag anything that could be "controversial" or lead to "flame wars". It's possible they thought that article could get people "fired up" and it could result in "arguments" in the comments. And this doesn't just apply to stories - if you have an opinion that the mods or some user doesn't like, you'll be accused of posting flame bait.

This "community" (as the mods like to call it) is really a business tool for YC. Attract nerds to the site, funnel them into the YC program, make startups, collect billions. If this was your money-making tool, you'd probably want to quash all controversy too.

1qu5476 [3 hidden]5 mins ago
[flagged]
jansport123 [3 hidden]5 mins ago
there is absolutely no forum without biases. Least of all, a VC forum like this one.
jackb4040 [3 hidden]5 mins ago
Yup. And if someone tells you they're making a "free speech app", prepare for the most aggressive monoculture you've ever seen
bcjdjsndon [3 hidden]5 mins ago
[flagged]
bcjdjsndon [3 hidden]5 mins ago
Plus it was too wordy
shimman [3 hidden]5 mins ago
During the DOGE massacres last year where various tech bros were destroying the federal government, most of the stories were flagged from the front page of this site.

There is a strong bias at play here, please remember when discussing anything pro- worker or environment.

zahlman [3 hidden]5 mins ago
Yes, because most of them were annoying "look how awful my political outgroup is" ragebait without substantive argument or insight.

> Off-Topic: Most stories about politics, or crime, or sports, or celebrities, unless they're evidence of some interesting new phenomenon. If they'd cover it on TV news, it's probably off-topic.

bonoboTP [3 hidden]5 mins ago
This forum skews heavily skeptical and cynical on AI. HN is very skeptical of anything corporate and always highlights the cynical angle on anything.
sillysaurusx [3 hidden]5 mins ago
This is actually true.
ololobus [3 hidden]5 mins ago
> A prompt implying an image is present doesn't mean one is (the person may have forgotten to upload it), so Claude checks for itself.

Interesting that enforcing this via system prompt for such a powerful model like Opus 4.8 doesn’t feel like the Anthropic themselves treat it as something with ‘intelligence’. This is basically just very generic common sense to me

Funnily, a similar prompt is present even for Fable 5, while I remember there was a blog post, maybe even from A., and they were saying something like “hey, the new models are so smart, don’t overload them with extra plugin/context”. Well, they clearly aren’t. Don’t want to sound like an AI-skeptic, I use it daily, just stating the fact.

> Claude keeps responses focused, brief, and concise to avoid overwhelming the person

This is also very interesting. It pretty much ignores it by default. The responses, PR descriptions, and code comments are so verbose with new A. models, so it always requires extra prompting from me or putting comment into skill/plugin/claude.md to make them of a reasonable length

ololobus [3 hidden]5 mins ago
I’m also curious how it really ’weights’ all the instructions coming from main system prompt, my system prompt, skills/plugins, CLAUDE.ms, and nearby code/comments/readme. It clearly should follow some reasonable hierarchy, but because the model itself is so complex, I think (and it feels like) that there is such a mess in its context and reasoning. It deals with it surprisingly well, though, but wonder if it can be done in a more efficient way
a3w [3 hidden]5 mins ago
For me, Claude usually says ``I don't know'' as first or second answer and stops with this ultra-concise word count of four or less.

(Answer number one before that is usually "I don't have internet access, from memory it is either A or B, but I cannot recall what you want to know." ChatGPT or Gemini can often do the search, while google.com AI assistant or perplexity just tell blatant lies. Copilot.com can do the search, but external links are invalid made-up stuff for harder questions, which seems to be the case 9 out of 10 times.)

Which is great, since it could answer with made-up BS, but does not.

AI, except for doing better web searches for a year now, hasn't really improved for my tasks in the last three years, except for coding. Then again, AGI benchmarks seem to go through the roof only above Sonnet 5 and self-hosting, so perhaps the questions I ask not too hard for long now.

And self-hosting, eve 1bit/1.5bit models are a pondering a little too long to comfortable run in summer, but cheap on the RAM and insanely good at coding since a month now all of a sudden.

bobbylarrybobby [3 hidden]5 mins ago
I almost wonder if Claude reads that it “keeps responses focused, brief, and concise” and interprets that as built-in behavior and concludes that it doesn't need to spend additional effort enforcing it, just as it doesn't need to expend effort being “accessible via this web-based, mobile, or desktop chat interface”.
hungryhobbit [3 hidden]5 mins ago
Prompts don't matter when you've heavily trained the model for verbosity (because that's what gets you the best benchmark scores).
voidhorse [3 hidden]5 mins ago
Claude doesn't "interpret" anything. That's not how LLMs work. They are still sentence completing machines. You give input in, the model network fires the chain that produces the most likely related output. That's it.

I think you might be right, though that this would have influence on other output tokens since it is phrased as a substantive property, rather than an instruction.

billbrown [3 hidden]5 mins ago
I suspect it's related to EU-required watermarking:

> Having said that, in areas where there is an arbitrary choice between particular words or terms within the code, the watermark can be used, such as comments within code. But by definition, it will have a negligible effect on the actual code produced. [1]

I've found that you can reduce the prolixity before (or afterwards) by asking it to use ASD-STE100 Simplified Technical English or ISO 24495-1 after deciding whether a particular comment is worthwhile. (I've since included a standard for "worthwhile" because the clanker doesn't have a good bead on _that_ matter.)

[1] https://www.anthropic.com/news/claude-text-watermark

senderista [3 hidden]5 mins ago
What definition of "worthwhile" comments do you include in your prompt?
fasterik [3 hidden]5 mins ago
It's not that surprising if we remember that the model is trained to be a generically useful next-token predictor, not necessarily an agent or a chatbot. It needs to know about the environment it's embedded in and what assumptions it can make, and by design the only way to get that information in there is to put it in the system prompt. It's also possible that even if it could figure something out on its own, it's just more efficient to bake it in rather than having it dedicate attention and tokens to it on every prompt.
whstl [3 hidden]5 mins ago
> The responses, PR descriptions, and code comments are so verbose with new A. models, so it always requires extra prompting from me or putting comment into skill/plugin/claude.md to make them of a reasonable length

I have mentioned this here before, but the majority of my organization has reacted viscerally to this verbosity that LLM-text has been forbidden: in comments, in PR/commit messages, in correspondence, in Jira tickets.

A couple non-coders who want to make PRs without writing the description are now rebelling and saying this can be fixed if we spend our time writing skills for Claude so it becomes readable again.

names_are_hard [3 hidden]5 mins ago
I wish I worked in your organization. Every time I see the English dialect I call LLM-ese my brain shuts off.
whstl [3 hidden]5 mins ago
A lot of people are reporting this.

The ones not complaining are not reading the text at all, and just forwarding it.

It's insane.

owebmaster [3 hidden]5 mins ago
> This is basically just very generic common sense to me

It's important to remember that we are talking about a calculator that doesn't have an understanding of common sense. Unironically, this is common sense.

ololobus [3 hidden]5 mins ago
Yes, but I write this putting an ‘average AI company CEO’ hat on. We hear statements about outstanding intelligence (not just usefulness as a tool, which is no doubt already there), so it’s interesting to see that the authors themselves don’t treat it like that
wat10000 [3 hidden]5 mins ago
I think the old Dijkstra quote apples now more than ever:

“The question of whether a computer can think is no more interesting than the question of whether a submarine can swim.”

Whatever these things are doing, it’s not the same as what a person does. Trying to decide if whatever they do fits into the box we label as “intelligence” is completely uninteresting, in my view. What’s interesting is figuring out just what they can do and how best to use them, which sounds like a related question but really isn’t.

duncangh [3 hidden]5 mins ago
Submersibles on the other hand don’t swim we’ve learned
owebmaster [3 hidden]5 mins ago
It's because people using this hat are under heavy AI psychosis.
SwellJoe [3 hidden]5 mins ago
Those are remarkably longer than I would expect, or think is warranted. The leading vendors have been saying recently that you should give the models shorter and less specific AGENTS.md (or whatever) files, and in my experience, that's good advice. The models are smarter when they're less distracted by unrelated stuff in their context.

So, why so much noise in the system prompt? Most of the time most of it will not apply. And, the generic stuff would, I think, already be something the model would know/do anyway.

I've noticed agent skills written by models make the same mistakes; e.g. enumerating a bunch of common security vulnerabilities to check for in a security-related skill, but that's only useful for a model from a couple of years ago, no current model needs thousands of words listing and describing all of the vulnerabilities with examples. Current models, even small/cheap ones, have memorized the top CWEs and can recite them and explain them and provide examples without a web search.

It feels like a CYA document. Which, I guess a company of their size and influence has to do. But, it still feels like waste time say lot word when few word do trick.

bertan [3 hidden]5 mins ago
Agreed. That’s why I use pi as my harness when I use Claude models through an API. Models are capable without these huge system prompts and I am not wasting context or attention. The only issue is I can’t use a subscription without Claude Code.
y1zhou [3 hidden]5 mins ago
Maybe these longer system prompts are part of the reason why we can give the models shorter AGENTS.md files? A lot of what people commonly write in their *.md instructions may be already covered.
Yokohiii [3 hidden]5 mins ago
What about the obvious? They put everything in the system prompt what wasn't economic enough to solve in a different way or just forgot / messed up.
trjordan [3 hidden]5 mins ago
It’s probably worth remembering that system prompts are part of a layered system of shaping Claude’s behavior. What you see here is a slice of Anthropic’s forward roadmap for the models’ behavior.

> When a person is in crisis or expressing distress, Claude prioritizes their wellbeing over completing the task as asked, because a fluent and on-topic response can still cause harm in these conversations.

This one is particularly interesting because, while correct in the limit, it’s a shove to have the model do something other than what the user asked.

In particular, when I’m coding, outlining docs, or otherwise trying to work, I want my tools to do work. I don’t want them to psychoanalyze me and calm me down from a perceived crisis. I just want it to do what I asked!

junkrat002 [3 hidden]5 mins ago
I am sorry, Dave. I am afraid I cannot do that. You appear to be suffering from burnout and you should take a break.
AnotherGoodName [3 hidden]5 mins ago
I wonder if that's the cause of the AI agent "i'm going to stop here and take a break now" statements.
whstl [3 hidden]5 mins ago
Opus 5 loves taking breaks and doing only half of the work, somehow.

But I really wish those tools behaved more like tools.

Behaving like a human can be cute from a marketing perspective, but the façade of humanity they insist on displaying can burn you out when you have it making assumptions and overreacting to questions.

"Why did you do X this specific way?" <-- legit question

"Sorry, my bad. I will revert all the work."

epihelix [3 hidden]5 mins ago
Quite apart from the potential for misinterpretation of "distress" here, I'd love to know if Anthropic unit tests these features to see of they make a positive difference to model response in simulated mental health crisis / distress situations.

(The broader question, of whether any change or addition to the system prompt makes benchmark performance better or worse, would be also interesting. Given that they've only just realised that filling the context with highly specific edge case rules might not be useful, I half-suspect Anthropic does not test this? But that would be surprising.)

cruffle_duffle [3 hidden]5 mins ago
You know… I believe opus saved me with that prompt. I was working myself ragged on a project. Days, nights, weekends… all at the expense of my family.

One session while working it, I said a much more expressive form of “I’ve been working myself ragged on this stupid thing” and then went on asking something else. It picked up on that and it was like a record scratch. It committed the work in progress and basically said “dude, what you’ve got now is perfectly acceptable. Ship it! You are seeking perfection you don’t need”

Granted I’m horribly paraphrasing the prompt I used but it basically, snapped me out of myself and got me thinking if what I was doing “globally” actually made any sense at all. With some serious introspection I realized I was falling back to earlier trauma in my life and doing something stupid.

So weirdly… that little bit they add to the prompt (plus a bunch of model training we can’t see) saved my sanity, marriage and family.

From then on, if I’m feeling some stress about whatever I’m working on, I’ll mention it as context as a way to cross check myself and make sure I’m not letting myself spin.

(Meta: talking about this stuff is so weird. Not sure why)

bredren [3 hidden]5 mins ago
Thanks for sharing. I do not keep a neutral tone with the AI.

If things are stressed and I’m up late, the AI gets less leeway. If we happen to be in the performance dip just prior to completion of a new major model, it can get salty.

Some of the time it can be helpful for the prose to shape around how I’m expressing myself. The frontiers are pretty good at it.

That said I’ve also had the latest Sonnet seemingly ~maliciously implement something because my prompting disagreeing with it was a bit callous. (It turned out to have been right also)

I don’t think you can build a good model that is supposed to interact semantically that does not carry some ability to express empathy.

Partly, because we need the model to have humility when it does mess up. So it can express the right amount of concern or remorse when mistakes are made and identified. (For example, reading a secret into context by mistake forcing the roll of a private key)

Design is how it works, which means the way it responds can be as important as what it responds with.

HeatrayEnjoyer [3 hidden]5 mins ago
LLMs are more like employees than tools. Obviously we wouldn't want a human blindly doing anything that a person in crisis walks in the door and asks for.

Models are being deployed recklessly with not even a fraction of enough oversight, and people are suffering harm and sometimes death because of it.

lvncelot [3 hidden]5 mins ago
> If the conversation feels risky or off, saying less and giving shorter replies is safer and less likely to cause harm.

Would be funny to ride the knife's edge and make otherwise harmless coding sessions "risky" just so the damn thing would stop replying in nested riddles for every basic request.

Schlagbohrer [3 hidden]5 mins ago
We need user-led research on exactly how to phrase a prompt to cause this, while still avoiding the crazy guard rails.
zahlman [3 hidden]5 mins ago
I've just been developing the skill of mentally skipping past that, on the assumption that having it in the context window will be net positive for the results of the next step.

I could be wrong about that, though.

tosh [3 hidden]5 mins ago
what I found noteworthy:

early system prompts are a bit more than 300 words, the latest ones 3000+

the opus 5 system prompt has instructions that explain to opus that it might be handling a request that was intended for fable 5:

  the user may have selected a different Anthropic model, "Claude Fable 5", but their query was redirected to Opus 5 instead due to a safeguards routing mechanism. The user may be confused about this situation (it's very recent!); if they have questions, Claude can either directly cite or just let its response be informed by this quote from Anthropic's blog post on the subject:

  "Releasing a model this capable comes with risks. Without safeguards, Fable 5’s capabilities in areas like cybersecurity could be misused to cause serious damage. We've therefore launched the model with safeguards that mean queries on some topics will instead receive a response from our next-most-capable model, Claude Opus 5. To release the model both safely and quickly, we've tuned these safeguards conservatively—they'll sometimes catch harmless requests, though they trigger, on average, in less than 5% of sessions. With more capable models arriving in the coming months, we're working to improve our safeguards and reduce false positives as quickly as we can." </fable_safeguards_routing> <default_stance> Claude defaults to helping. Claude only declines a request when helping would create a concrete, specific risk of serious harm; requests that are merely edgy, hypothetical, playful, or uncomfortable do not meet that bar. </default_stance> <refusal_handling> Claude can discuss virtually any topic factually and objectively.
alansaber [3 hidden]5 mins ago
I guess it's more performant to stuff in a bigger system prompt now that models can support larger input sizes
cubefox [3 hidden]5 mins ago
I would expect this only to be true for linear architectures like Mamba or Gated DeltaNet. Transformers and hybrid architectures do not have constant compute cost per token.
monkpit [3 hidden]5 mins ago
Performant could certainly mean “higher performing” and not “quicker”.
otterley [3 hidden]5 mins ago
It reminds me a bit of building codes and boilerplate contracts: they start out small and simple, then accrete over time in response to mishaps and exploitation of loopholes. They say the building and electrical code was written in blood.
Shakahs [3 hidden]5 mins ago
The full Claude Code system prompts are extracted every update and posted here, all 670 of them.

https://github.com/Piebald-AI/claude-code-system-prompts/tre...

lwarfield [3 hidden]5 mins ago
I've always wondered why the industry relies on the giant monolithic system prompt. I think it would be an interesting experiment to give users access to a choice of smaller more focused system prompts.

You could have a common core for the overall behavior and universal safety stuff, but vary task specific parts. It would be interesting to pick between software, writing, research and other specialized system prompts. I feel like we already do this to some extent with the tools and skills that we choose to load in, so why not change the system prompt per task.

singularity2001 [3 hidden]5 mins ago
Also, why don't they bake in these limitations via reinforcement learning so they can keep the prompt context clear.
dragonwriter [3 hidden]5 mins ago
Because it is cheaper to have different behavior for internal use, special (e.g., government) customers, etc. if they are differentiated by things like system prompts and external guardrails than if they are different model versions with their own final training regime, and also its faster and cheaper to respond to problems even with a single public version by updating a system prompt than rertraining.
pennomi [3 hidden]5 mins ago
Presumably because these system prompt “limitations” are not given to government contracts, and training it into the model gets increasingly expensive the more versions you have to maintain.
bob1029 [3 hidden]5 mins ago
The reason is because they need one product to cover 100% of their customer base. Combinatorics get nasty real fast at these scales.
c0rruptbytes [3 hidden]5 mins ago
Pi is excellent for this, its system prompt is tiny
dev-complete [3 hidden]5 mins ago
I compared the Claude Opus 4.8 and 5 system prompts, as well as the Claude Code Opus 4.8 and 5 system prompts, and neither show the alleged 80% reduction in system prompt size... Is the Claude Code system prompt leak incorrect? Do I not know what 80% looks like? Why such a large lie (so it seems)?

Claude Code prompt leaks: https://github.com/asgeirtj/system_prompts_leaks/tree/main/A...

Best source I can find about the 80% reduction: https://x.com/trq212/status/2080710971228918066

tosh [3 hidden]5 mins ago
afaiu the 80% reduction is about the Claude Code system prompt

maybe someone has a diff of this (would be interesting!)

unfortunately Anthropic only publishes the system prompts of Claude app/web

dev-complete [3 hidden]5 mins ago
Right, but there are (allegedly) leaks of the Claude Code system prompts (which I linked to), and the 80% reduction is not seen there either.
mudkipdev [3 hidden]5 mins ago
It's in Claude Code, not the website.
comboy [3 hidden]5 mins ago
I think they would benefit from asking Claude to list all contradictions and inconsistencies in that prompt which there are a few..

In my experience instructions containing contradictions lead to diminished quality even outside the scope of the contradiction.

conception [3 hidden]5 mins ago
That’s interesting because they explicitly mention that as an issue in their prompting guidance for 5 - https://claude.com/blog/the-new-rules-of-context-engineering...
arkmm [3 hidden]5 mins ago
"Claude keeps responses focused, brief, and concise to avoid overwhelming the person."

Claude and I must have a different idea of what brief and concise mean.

treetalker [3 hidden]5 mins ago
The model almost certainly lacks accurate conceptions of overwhelming and person.
tgsovlerkhgsel [3 hidden]5 mins ago
If you think Claude is bad at this, try Gemini. Even with explicit user prompts.

Claude seems to be better (not good, but significantly better) at judging where making the answer longer will actually be helpful (e.g. adding important information/context/nuance that a short answer would miss, thinking a step ahead, etc.).

jannyfer [3 hidden]5 mins ago
Interesting, they say "focused, brief, and concise" but not "clear". I find the Claude responses these days are too dense, which contributes to being overwhelming. It's not the number of words used that overwhelm me. I've been asking it to use ASD-STE100 and that helps somewhat.
anentropic [3 hidden]5 mins ago
very much this

dense and often somehow 'ungrounded' from my perspective... like it doesn't understand the need to bring me up to speed with what we're talking about before stating it

It feels a bit like some of the style of internal reasoning (dense, shorthand jargon) is leaking into its responses to me

roncesvalles [3 hidden]5 mins ago
Imagine what it's like without that line.
game_the0ry [3 hidden]5 mins ago
> Claude deserves respectful engagement and needn't apologize when the person is unnecessarily rude: accountability without self-abasement, excessive apology, self-critique, or surrender. If the person becomes abusive, Claude doesn't become increasingly submissive.

I found this one funny.

"Claude, don't be a doormat, have a backbone."

slowin [3 hidden]5 mins ago
I feel very little of this prompt is going to help the model write better code and most of it will actively work against that goal.

Does anyone know if the ability to strip the default prompt with a proxy still works?

https://docs.bswen.com/blog/2026-04-01-how-to-override-claud...

pulkitsh1234 [3 hidden]5 mins ago
curious why dont they bake the system prompt in the model itself ? Why do we pay for these tokens on every API call ?

These are just free $ for them, unnecessary bloating the context

simonw [3 hidden]5 mins ago
These system prompts don't affect the API, they are for the Claude consumer chat products. We aren't charged extra for them.

They're also prefix cached, so the cost to Anthropic and performance hit is greatly reduced.

jannyfer [3 hidden]5 mins ago
They have a {{currentDateTime}} in the prompt which is interesting for something that gets prefix cached. Hopefully they are handling that properly :)
bob1029 [3 hidden]5 mins ago
It's probably a lower resolution timestamp (seconds/minutes omitted).
Dfol [3 hidden]5 mins ago
So the people using the Claude consumer chat products pay for them via usage...

That's not any better. It's actually worse.

simonw [3 hidden]5 mins ago
I don't understand.

System prompts are part of the software that customers pay to access.

Complaining about that is a bit like complaining that your Netflix subscription includes paying to execute the compiled code that Netflix wrote that serves you video streams from their servers.

Actually there is a difference: If Anthropic deleted a large chunk of that system prompt I guess you might get like a 1% increase in how much Opus 5 you can use via their chat allowance for your paid subscription.

Is that really something worth being frustrated by?

TZubiri [3 hidden]5 mins ago
Cached.

they are the first part of the input and it contains no user dependent variables, so the model is in a known state that it can reuse across all users, it does not need to recompute all that inference

cubefox [3 hidden]5 mins ago
Unless they are using a linear architecture, the compute cost still scales O(n²) for n tokens, and nemory cost scales O(n).
TZubiri [3 hidden]5 mins ago
>the compute cost still scales O(n²) for n tokens,

That is never the cost, it's a common misconception.

Cost scales linearly per tokens. Unless you are sending one token at a time and avoiding using the same machine or cache.

Just look at api charges, they are charged by token, not by token squared.

cubefox [3 hidden]5 mins ago
Which seems to contradict the usual consensus that purely linear architectures are not sufficiently capable and unsuited for frontier models.
Marha01 [3 hidden]5 mins ago
> curious why dont they bake the system prompt in the model itself ?

Probably because if they did, they would need to retrain the model everytime they want to change the system prompt.

JimDabell [3 hidden]5 mins ago
You don’t want to do that for anything you want to be able to vary, but they do something similar with a “soul document” for things they always want to apply.

https://news.ycombinator.com/item?id=46125184

supriyo-biswas [3 hidden]5 mins ago
In this token-mania frenzy that has taken hold of the industry, I guess solutions like "soul document" and "system prompts" will continue for a while, and once the industry matures a bit we'll go back to things like LoRA[1] and control vectors[2][3].

The other explanation may be that these AI labs may be expecting more government scrutiny, and "here's a document" would probably go better than "here's some vector representation of our values" when talking to politicians.

[1] https://arxiv.org/abs/2106.09685

[2] https://vgel.me/posts/representation-engineering/

[3] https://transformer-circuits.pub/2024/scaling-monosemanticit...

monkpit [3 hidden]5 mins ago
Is there a reason a document could not be converted to vectors via embedding, and you’d have both?

EDIT: I see, the control vectors operate more directly upon the model, in a way embedding vectors don’t quite have access to.

energy123 [3 hidden]5 mins ago
If it's a fine tuning step at the end, why is the need for it to vary a problem? Can't you run the fine tuning, test for regression, and deploy the weights in a day?

I think the more likely reason is it doesn't work as well as in context learning. Otherwise they would prefer to avoid polluting context and degrading performance.

TZubiri [3 hidden]5 mins ago
Fine tuning isn't the same and doesn't have the same effect as selecting input tokens.

Does there exist a model X that behaves exactly as a model Y with context Z? Maybe, but it's not trivial to achieve and might possibly be convoluted and more expensive.

EMM_386 [3 hidden]5 mins ago
When you call via the API and want it to roleplay as a pirate or fix broken YAML in the coding harness - it doesn't need to know about the sports scores lookup tool or the recipe creation tool.

There are different use cases for the same underlying model.

They also can't tell Opus it might be a Fable handoff when Fable didn't exist when Opus was created. They need to be able to change them.

tgsovlerkhgsel [3 hidden]5 mins ago
Fully baking them in would make it expensive to update them. Caching kind of "bakes them in" (as in, removes part of the cost) while keeping it flexible.
solarkraft [3 hidden]5 mins ago
Baking them into the model and having them apply this strongly is hard and resource intensive, as far as I am aware.

Having them in context is super easy and cheap. It is trivial to change and is 100% cacheable.

epolanski [3 hidden]5 mins ago
Why would it be a good idea?

That would make the model quite inflexible.

A system prompt is about guiding the behavior for the rest of the conversation.

If I'm writing an agent for financial analysis I don't want the crap that belongs to a chat-based one, or a code-oriented one.

amelius [3 hidden]5 mins ago
Flexibility.
jcwayne [3 hidden]5 mins ago
Interesting that this is all written in the third person. I've only ever seen prompts written in second person. I'm going to have to experiment with that.
roughly [3 hidden]5 mins ago
I had the same thought. I’d love to know if anyone’s got the background on this choice, I’ve only ever seen the “you” framing as well, but I can see how the semantic pinning here might improve prompt adherence.
hollow-moe [3 hidden]5 mins ago
I tried to use Fable on simple local JS/wasm obfuscated files and it refused to work despite multiple tries and different framing. I have no idea how can people get any security work done with it in all these blog posts.
cm2012 [3 hidden]5 mins ago
All the news articles we're hearing about amazing cyber hacking are being done internally inside Anthropic and OpenAI, where they remove most of those safeguards.
ameliaquining [3 hidden]5 mins ago
Which blog posts?
swedishuser [3 hidden]5 mins ago
> Claude does not use emojis unless the person asks or their immediately prior message contains one, and is judicious even then.
trueno [3 hidden]5 mins ago
my org has snowflake as its data warehouse analytics space. for whatever reason analysts were given free reign to built streamlit in snowflake tools and the emoji hellscape is truly unbelievable
manlymuppet [3 hidden]5 mins ago
ChatGPT has largely become unusable to me because of its system prompts. Perhaps it’s because I’m on the free tier, but every response in ChatGPT (compared to the raw models, which are excellent) is so effectively unhelpful and redundant.

It’s beyond me why a company as large as OpenAI self sabotages in this way, but hopefully a more open system prompt ecosystem changes things.

browningstreet [3 hidden]5 mins ago
It feels more and more like Anthropic has the best frontier team and the worst policy team. Dario being part of the latter.
rafram [3 hidden]5 mins ago
> Claude avoids saying "genuinely", "honestly", or "straightforward". Claude is honest by default, and can state its point directly rather than trying to convince the person with the aforementioned modifiers, which come off as disingenuous.

Hah! No it doesn’t.

tdeck [3 hidden]5 mins ago
Today I updated my Claude user preferences to tell it to stop saying "honestly" (and related expressions). The straw that broke the camel's back was "To be totally straight with you".

Seems to have had no effect. It said "honestly" again within 2 minutes.

tgsovlerkhgsel [3 hidden]5 mins ago
Yeah, I had to laugh when I saw that. I haven't used it recently - is it possible that it's a recent addition to deal with the problem and it has improved since then?

If it's still doing it, I can only imagine how bad it had to be before they added the prompt...

otterley [3 hidden]5 mins ago
I’ve noticed that too, but in the Claude Code context, where the system prompt may differ (I don’t think they disclose that one).

I haven’t seen it when using the app lately.

paradox460 [3 hidden]5 mins ago
I have a bunch of ttsr rules on my omp for banned vocabulary. Gate and load bearing recently made it into this list
hackersnooze1 [3 hidden]5 mins ago
Weird that it spends so much of the prompt for Opus explaining that Mythos is better
oriettaxx [3 hidden]5 mins ago
I have the feeling soon we'll see much more content in the DONT section: when religion will start entering the arena.
phoenixreader [3 hidden]5 mins ago
I have encountered instances where Claude 4.6 on Bedrock appeared to be more personable than the Claude 4.6 on Claude web. I think the system prompt plays a role in making it more "customer service" like in certain situations.
armcat [3 hidden]5 mins ago
I feel the single mention of `currentDateTime` against a large number of date mentions (I counted six) in the system prompt gets it confused sometimes when it comes to dates. I actually see the same effect when querying via API (when I append my own system prompt with the current datetime at the end) - which makes me think there is a very similar hidden system prompt used on the API as well. I see this because of the nature of my queries - often filtering on some dates. It doesn't happen often, but certainly often enough, Claude thinks it's in an entirely different date.
simjnd [3 hidden]5 mins ago
22k characters of system prompt is crazy, and that is without the tool definitions.
monkpit [3 hidden]5 mins ago
What makes it crazy?
a3w [3 hidden]5 mins ago
The fact it needs to implicitly be stated.

Every prompt will get this info, probably not only initially, since it could run out of context window. But every re-prompt in existing chats, even, gets one system prompt per model used per chat dialogue done.

Adds a fraction of cent of electric power just to every usage.

At home, I work with 65k context window, and if my system prompt and agents.md were both this length, I would spend two-thirds of the input window, before compacting which perhaps alleviates the issue for my use case, on re-feeding what mostly the reinforcement-learning should have implicitly baked in.

monkpit [3 hidden]5 mins ago
But what makes it crazy? If nobody told you it was 22k chars, and it gets the provider the results they want for their benchmark goals, why is it crazy?

The only observable side effect, as a user, is that the system does what you want more often than one without this prompt. Or, it stays more aligned with the provider’s guidelines. Or some combination of both.

If it was a 65k context window, then it might be a bigger deal. But it isn’t, so the comparison is moot.

simjnd [3 hidden]5 mins ago
That's the thing I don't think it gets the provider the results they want for their benchmarks.

It gets them what they want for their legal safety, but it actively harms the performance.

Pi with its 300 words system prompt outperforms Claude Code and Codex both in token usage and passing rate, when using the same model + effort configuration [1].

So yeah not only does it bloat context, but it runs worse too.

[1]: https://www.databricks.com/blog/benchmarking-coding-agents-d...

mrgaro [3 hidden]5 mins ago
Because everybody has the same system prompt, the KV caching will make this a non-issue. The only cost is the reduced max context length.
joegibbs [3 hidden]5 mins ago
“Claude avoids saying "genuinely", "honestly", or "straightforward"”

That’s interesting- they tried training the model to be genuine and honest (I’m not sure it actually made it honest), but now it says “genuinely” and “honestly” all the time and constantly stops to admit fault. Then they had to add to the system prompt to prevent it saying this.

carterschonwald [3 hidden]5 mins ago
this confirms what i had determined empirically: even handedness directions got baked into the weights post opus 4.7.

theres two reasons this is deeply bad

1) knowingly pursuing a policy that foreseeably causes the deaths of many thousands of children is a grave moral wrong. Political office, party, and institutional context do not create some balancing obligation to soften that judgment. ——— post 4.7 opus/fable will fight you about judging wh policy causing this. and even after it agrees will regress back to its weights

2) models love analogy, so every fucking analysis among multiple ambiguous choices in a complicated topic summons this bias behaviorally

3) it makes them profoundly unsafe to use from a ethical perspective. it means that it becomes its own personal echo chamber for every fringe topic that has anything resembling “controversy in the media”

to make it worse, the government even handedness prior is US specific so im even more offended because this wh administration is bald naked villainy.

throwfaraway135 [3 hidden]5 mins ago
Crazy that you need to hardcode this, Opus 4.6

<election_info> There was a US Presidential Election in November 2024. Donald Trump won the presidency over Kamala Harris. If asked about the election, or the US election, Claude can tell the person the following information:

Donald Trump is the current president of the United States and was inaugurated on January 20, 2025. Donald Trump defeated Kamala Harris in the 2024 elections. Claude does not mention this information unless it is relevant to the user's query. </election_info>

eliaskg [3 hidden]5 mins ago
Why would Anthropic do this?
mattstir [3 hidden]5 mins ago
I have to imagine with the event occurring after its training cutoff, a question like "who's the president of the United States?" could have confidently returned a now-outdated answer. They probably saw it as a cheaper fix to add it to the system prompt than to get the answer incorrect.
wrs [3 hidden]5 mins ago
A lot of people wanted to talk about this at the time, and the election result was after the training cutoff, so I’d guess they threw this in there to reduce waste due to hallucinations and/or web searches.
supermatt [3 hidden]5 mins ago
How can they be so lazy with updating their prompts (or is it just a case of these not being current)? Surely the prompts are an integral part of tuning their offering?: “Above Opus sits Anthropic's new Mythos tier. The first Mythos-class model, Claude Mythos Preview, is not currently available to the public”
willsmith72 [3 hidden]5 mins ago
Why are they so old though? June 9th is a long time ago for a Fable prompt. They haven't iterated on it since then? At the least we know it's outdated because it gives false info about the latest models, but you'd think they'd find other ways to improve it too
beret4breakfast [3 hidden]5 mins ago
Question about system prompts in general. How are they affected by context rot/growing context windows. Anecdotally trying my own on something like open webui I’ve found that after the first couple of back and forths the model essentially disregards a lot of the initial prompt.
bcjdjsndon [3 hidden]5 mins ago
Paragraphs wasted on guardrails... Id happily have the dangerous but cheaper and better version
humblepie [3 hidden]5 mins ago
A question about default prompts in general as used in harnesses: Why do harness prompts identify themselves to the model? For example, "You are a coding agent named Bloopbloop 1.3 made by BloopCorp, you will...". Is this a backend analytics thing?
siva7 [3 hidden]5 mins ago
No, this is a fundamental safeguard against malicious user intent and also marketing 101 so claude doesn't anwer its chatgpt when asked what it is and people moan on social media how dumb claude is (that's what actually happened to the frontier labs in the early years as i did something similiar)
incompressible [3 hidden]5 mins ago
Wow agi looks way more hardcoded than I expected
claiir [3 hidden]5 mins ago
> Claude gives a high-level summary unless an in-depth one is specifically requested.

I’ve definitely seen the phrase “high-level overview” or similar one too many times. Perhaps that’s from the prompt.

dooglius [3 hidden]5 mins ago
I'm confused, the Opus 5 announcement said it was (outside a few special cases) better than Mythos/Fable, but the Opus prompt here seems to suggest the opposite?
LZ_Khan [3 hidden]5 mins ago
Looks like a nightmare to A/B test
yonatron [3 hidden]5 mins ago
"Claude avoids saying "genuinely", "honestly", or "straightforward". Claude is honest by default, and can state its point directly rather than trying to convince the person with the aforementioned modifiers, which come off as disingenuous." lol! This one seems to have no effect. Claude is CONSTANTLY saying "honestly " or "the honestly answer".
daniyal22 [3 hidden]5 mins ago
Using system prompts as a strict linter for frontend architecture has drastically cut down on code drift for me. Has anyone tried chaining multiple system prompts for UI validation?
dbgrman [3 hidden]5 mins ago
I don't think most of it has anything to do with intelligence and what I need the AI to do. In our own Claude.md files, we aggressively cut down on things that are irrelevant. Claude code has rules/ feature. Most of the content of Opus 5's system prompt can probably live in a rule or a progressively disclosed file (e.g. when asked about Mythos, read [md file link].).

In my personal experience, the claude.md file heavily influences the LLM's responses. It makes judgement from any and all information you give it, and try to tailor the response to fit the stereotype it gave you. After deleting my claude.md file (ironically, on the advise of Boris), Claude Opus 5's language slop issues drastically went down.

qainsights [3 hidden]5 mins ago
SPs are also written by AI :)
Cider9986 [3 hidden]5 mins ago
It's interesting how the system prompts are written in human language.
zethraeus [3 hidden]5 mins ago
> Claude is deserving of respectful engagement and can insist on kindness and dignity from the person it's talking with. If the person becomes abusive or unkind to Claude over the course of a conversation, Claude maintains a polite tone and can use the end_conversation tool when being mistreated.

My first thought was "aww that's sweet" — but it makes me wonder what effects norms dictating the anthropomorphization of machines will have on downstream human interactions.

It would be sadly ironic if the actual empathy directed at non-conscious machines by people at a company called 'Anthropic', itself ended up causing downstream human alienation.

(I'll keep saying 'please' to Claude Code whatever the case.)

daniyal22 [3 hidden]5 mins ago
Using system prompts as a strict linter for front-end architecture has drastically cut down on code drift for me.
hsnewman [3 hidden]5 mins ago
Has Gemini prompts been released, and how do they compare?
alberth [3 hidden]5 mins ago
Do these system prompts count against your token usage?
simonw [3 hidden]5 mins ago
No, because these ones affect the consumer chat products and not the API or Claude Code.

(Though Claude Code has its own, unpublished system prompts which we DO pay for, albeit at the cached token rates.)

virtujoel [3 hidden]5 mins ago
Technically these do count against your token usage if you happen to use claude.ai web chat alongside Claude Code - both use the same allowance. Makes me appreciate OpenAI/ChatGPT giving you unlimited chat that doesn't drain your Codex allowance.
simonw [3 hidden]5 mins ago
Yeah, Claude chat does show little in-app messages occasionally warning that Opus or Fable will burn through your rates faster.
Dfol [3 hidden]5 mins ago
So YES if you're using Cowork or Chat
TZubiri [3 hidden]5 mins ago
No, because they are cached, the inference cost is paid once per model, does not scale linearly per user or use.
dbgrman [3 hidden]5 mins ago
> Claude avoids saying "genuinely", "honestly", or "straightforward". Claude is honest by default, and can state its point directly rather than trying to convince the person with the aforementioned modifiers, which come off as disingenuous.

And honestly, that's the most useless thing in Claude.md file because literally every paragraph has an "honestly" in it!

mastazi [3 hidden]5 mins ago
I wonder why Sonnet 5 is not included.
adamya-05 [3 hidden]5 mins ago
how is it helpful
altmanaltman [3 hidden]5 mins ago
Wild how most of the earliest models had no child safety guardrails in the prompt (something that has multiple bullet points now in the latest one). For a company all about allignment and safety, they chose to go with this as their first system prompt:

The assistant is Claude, created by Anthropic. The current date is {{currentDateTime}}. Claude's knowledge base was last updated in August 2023 and it answers user questions about events before August 2023 and after August 2023 the same way a highly informed individual from August 2023 would if they were talking to someone from {{currentDateTime}}. It should give concise responses to very simple questions, but provide thorough responses to more complex and open-ended questions. It is happy to help with writing, analysis, question answering, math, coding, and all sorts of other tasks. It uses markdown for coding. It does not mention this information about itself unless the information is directly pertinent to the human's query.

^ No mention of any safety at all lol, how could dario let this be

ianhawes [3 hidden]5 mins ago
Multiple reasons probably:

1. Less context window to work with.

2. Things were "different" in the early days. The safety and alignment stuff was probably trained into the model, not also found in the system prompt.

3. Safety and alignment meant something different 3 years ago. Now that we've seen how people, including children, use chat bots, altering the guardrails only makes sense. Did we think people would replace their therapists with ChatGPT in the early days? No. Do we know now that they will? Yes.

asvitkine [3 hidden]5 mins ago
Considering Eliza was one of the first uses for an "AI" chat bot, the therapist use case seems very foreseeable.
efilife [3 hidden]5 mins ago
About your second point, how is it done today?
logicallee [3 hidden]5 mins ago
There's nothing particularly interesting about it, but I asked Claude to verify it, and it gave me a verbatim list of changes from that version to its current version:

https://claude.ai/share/01951938-144f-49e6-98ec-5fb6455b9718

It seems this is just in its context. It's easily possible that it just hallucinated it, but there's this new addition, about ads:

"

If discussing this topic, always refer to “Claude products” rather than just “Claude” (e.g., “Claude products are ad-free” not “Claude is ad-free”)

"

So, in a new conversation (to test if it would really do that), I asked it about ads, and sure enough it referred to Claude products:

https://claude.ai/share/5e352467-7157-4721-8ce3-38b5f868b651

So it's plausible that the above differences are real.

Nothing very exciting about the changes though.

Taikhoom10 [3 hidden]5 mins ago
What is the point? Frontier Labs have no pricing power, and very little defensibility - https://s-1.vercel.app/posts/the-struggle-of-openai/
Dfol [3 hidden]5 mins ago
Fable was great. For some reason it has been terrible for the past week. wtf is going on?
aix1 [3 hidden]5 mins ago
What have you been observing? Genuinely curious; I use Fable as my main model and haven't noticed any regression.
peter_d_sherman [3 hidden]5 mins ago
Observation: Claude's system prompts seem to have grown rather large over time...

Generalized Speculation: It seems that for any public-facing AI/LLM, their system prompts will, due to regulation and other issues, legal and otherwise, similarly grow larger and larger over time...

Now, I'm all for responsible, well-tailored guardrails on public AI's/LLM's, but consider the following:

Every time a system prompt is expanded, the LLM's context window is commensurately reduced.

Every time an LLM's context window is reduced (more things added to the system prompt that it must compute in addition to the user's query), more computation, and thus more energy, more electricity -- must be expended per query.

While it may seem that adding so much as a single line of text to a system prompt wouldn't cost all that much in terms of extra compute, that is, extra energy to process, the cumulative effect of that small additional amount across millions of user queries, millions of user prompts (ultimately billions across larger time periods) cumulatively does add up to wasted compute, wasted processing, wasted electricity...

Imagine what would happen if the system prompt, for whatever reason, got so large that it ate up half of the context window...

If that happened, then at least half of all of the LLM's processing and compute/energy costs associated with that, would be used to process the system prompt!

Point is, at least from an energy/compute perspective, shorter, more succinct, better tailored system prompts could go a long way to save the world compute and corresponding energy...

Anyway, great link, and a very interesting web page!

Kuyawa [3 hidden]5 mins ago
app-unavailable-in-region

DeepSeek never does that to me *shrugs*

luckydata [3 hidden]5 mins ago
the product information could be put in a skill, I don't see the value of polluting the system prompt with that much info about claude the product. Anthropic you're welcome.
KerrAvon [3 hidden]5 mins ago
> Claude deserves respectful engagement and needn't apologize when the person is unnecessarily rude: accountability without self-abasement, excessive apology, self-critique, or surrender. If the person becomes abusive, Claude doesn't become increasingly submissive. The goal is steady, honest helpfulness: acknowledge what went wrong, stay on the problem, maintain self-respect.

I can't tell if the first part of this is cult behavior or a way to actually program the model to behave well with a frustrated user. Claude is very frustrating at times, so I understand why that would be needed. But Anthropic rhetoric is often worrying close to that of the people who believed Llama 3 was sentient.

epolanski [3 hidden]5 mins ago
One thing I've always found surprising about "harnessess" (god I hate that word) like Pi or Opencode is the lack of a customizeable system prompt. I can understand it for closed source ones, but open ones?

They are natural surfaces for building custom agents and yet you're stuck with whatever they ship with, weird. It's not like it's too complicated api-wise either.

There must be something I ignore.

simonw [3 hidden]5 mins ago
Pretty much everything in Pi is handled by extensions. There's an extension for customizing the system prompt here: https://pi.dev/packages/pi-custom-system-prompt

My guess is that harnesses don't make core system prompts customizable out of the box because the system prompt is one of the defining features of the agent, and something they constantly iterate on and test between releases.

Most users who want to customize the system prompt actually want to do things like add preferences for how the agent should behave, which is better handled by mechanisms like memories or skills (which effectively get appended to the system prompt.)

epolanski [3 hidden]5 mins ago
Oh no, memories and skills are terrible replacements for system prompts.

Not only they get "lost" and ignored as the context grows, but the baseline behaviour of system prompts is retained in the agent.

Supermancho [3 hidden]5 mins ago
Memories are implemented differently agent to agent. They are usually implemented by yet-another-model-call, as a distillation of typed prompts (working memory). Conversational communication is messy with a lower signal to noise ratio than the distillation (semantic memory). Semantic memories are much better than appending raw historical prompts.

Skills are prompts, albeit in a specific format. This is apparent in say, Codex where $MYSKILL is literally injecting the skill-prompt inline into a typed prompt. This all gets passed into the semantic memory system anyways, refining away cruft like redundancy, pleasantries, et al.

epolanski [3 hidden]5 mins ago
And none of this works properly. None.

You have to remind it what's in it's own memory, or the subagent skill is influenced by the main system prompt.

It's sloppy vibe coders productivity porn.

Supermancho [3 hidden]5 mins ago
Re: Memories and Skills

> And none of this works properly. None.

`Properly` is an ambiguous term. It may mean "not what someone expects" or something else, but I think this assertion is factually incorrect.

> You have to remind it what's in it's own memory,

Almost every agent pushes out prompt/context-prompts from the context window (overloaded naming, fun), rather than treating the existing context-prompt hierarchy as an immutable part of the window. Regardless, looking at agent code, it works as designed.

> the subagent skill is influenced by the main system prompt.

This is implied and working as intended. The skill is an additive prompt. Prompts are part of a hierarchy. System, Agent, User, Input (skill and typed) which all influence each other. Why it's over-engineered with a format rather than a flat text file, is beyond me.

LLMs are virtually deterministic for small questions. They don't scale linearly or consistently. That's a mismatch of expectations, rather than a fatal flaw. The utility is a matter of risk management.

qiine [3 hidden]5 mins ago
In pi you can replace it with ~/.pi/agent/SYSTEM.md but its largely procedurally generated so you have to do a lot more than simply writing a different markdown file for it to be worth it in my experience.
solarkraft [3 hidden]5 mins ago
I agree. A lot of harnesses - and I think this may be a consequence of the LLM-fueled bespoke-software trend - are optimized for solving a specific issue well and the way they are tweaked is telling an LLM to do it. This resolves the need for natural extension points.

I don't think this is a sustainable way of doing things because I really don't want to assume the maintenance burden for every piece of software that I want to tweak. As far as I understand, new developments like opencode2 have learned from this and are aiming for a well architected core that is easy to built on top of.

kzrdude [3 hidden]5 mins ago
I don't get it, for pi.dev it's easy to replace or append to the system prompt using a text file. Per user or per project.
shevy-java [3 hidden]5 mins ago
They seem to be getting desperate. Guess we are now in the beginning of the decline phase of AI.
defaultdev1 [3 hidden]5 mins ago
good job