> It found the U.S. “failed in its obligation to do everything feasible to verify” that the school was a military objective and that the failure “went beyond mere negligence.” The report said the United States “directed the strikes at the building of the school while being aware of a substantial risk of striking a civilian object and acting recklessly as regards the possibility that this would happen.”
Reading the details, "AI" doesn't really seem like the culprit -it's a scapegoat.
The intelligence that it was no longer a military target never entered the target database, the team that was responsible for vetting the target list was gutted, and said team was never even consulted.
The White House wanted 1000 targets and pulled from their database without any due diligence. Whether it was an AI call or an SQL query - this was from pure human maliciousness and incompetence.
seizethecheese [3 hidden]5 mins ago
Important context is that the context wasn’t even in a connected system. Unclear if the human analysts would have even caught this, or if they would have known to check this unconnected system.
> Some US intelligence analysts took notice, the officials said. Bloomberg reported in June that one analyst detected changes to the site as early as 2019, and logged remarks about the modifications in a system that wasn’t connected to the primary military intelligence database, which informs targeting
xlayn [3 hidden]5 mins ago
Now, ask yourself if you want AI taking decisions around your life... it will pull numbers... someone will have a "goal" of 1000 "hits" and there you go, 2-3 months in jail working to check what went wrong...
But don't worry, the other P AI system will ensure that the first one doesn't do mistakes...
beloch [3 hidden]5 mins ago
"In the final days of February, the Trump administration demanded an overwhelming aerial assault. More than 1,000 Iranian targets were hit within the first 24 hours alone. That order compressed the time frame for finalizing targets, the officials said, instilling an urgency that — combined with gaps in underlying information about the site, cuts in civilian-protection personnel and an overreliance on artificial-intelligence technology — set the stage for the deadly error."
-------------------
Maven is an untested tool for rapidly selecting targets under time pressure during a war. It's reason for existing is speed. If you're in a shooting war, the ability to select good military targets faster than your enemy, but not necessarily with zero error, is an advantage.
Planning a first strike is a different situation. Time pressure should not be a significant factor. Humans should have been doing their due diligence on every single target. If an untested tool for rapid mid-battle target selection was relied upon completely because of a hasty executive order, then the responsibility falls entirely on the executive.
jmathai [3 hidden]5 mins ago
Seems like a scenario where two completely avoidable wrongs....killed 120 children. AI being one of the wrongs.
> “No more politically correct and overbearing rules of engagement,” - Hegseth
...
> Hegseth and the commander in charge of the Iran operation, Adm. Brad Cooper, were questioned about the strike before Congress. Hegseth said the U.S. does not target civilians and would investigate
So the administration does not intentionally target civilians, they have just stopped caring about who a civilian is.
andrepd [3 hidden]5 mins ago
Well Israel has defined "combatant" as "male between 14 and 55", and the Western world more or less shrugged and moved on without missing a bit. I'm not optimistic.
ceejayoz [3 hidden]5 mins ago
That, unfortunately, originates more from the US than Israel.
Not sure wtf “politically correct” in the context of rules of engagement even means.
What a fucking moron
cogman10 [3 hidden]5 mins ago
Instead of worrying about woke things like "is this person actually a combatant actively fighting" they want the much simpler rule of "everyone we kill was actually a terrorist that deserves to die".
Basically they stopped caring those woke UN rules about war crimes.
colingauvin [3 hidden]5 mins ago
While I think that it's important to do root cause analysis, we need to be very careful not to absolve blame from the people that decided to shift a significant weight of decision-making authority to an AI. An AI can be tried in a court. There has to be a responsible human for everyone one of its actions, especially when it's killing (-people-) children.
> The Pentagon chief last year slashed offices that didn’t contribute to his goal of “lethality,” including the group that assists in limiting risk to civilians, known as the Civilian Protection Center of Excellence. Around 200 employees who worked on the issue, including at that office, have been reduced by about 90 percent, according to two current and former officials and a person familiar with the effort. The team that handles civilian casualties at Central Command, which oversees the Middle East, has dropped from 10 to one.
Negligent homicide in pursuit of their DEI goals, basically.
stuaxo [3 hidden]5 mins ago
Do you just chuck that on the end of any sentence, because this makes less sense than an LLM.
> Officials said some users expected Maven to flag stale records or contradictions in the intelligence assembled for potential targets, though it is not clear why they thought the system would do that
This is what happens when people who don't understand AI and its limitations embrace it wholeheartedly, thinking it's going to behave like The ultimate analyst. Except it's not. Its got blind spots in more places than anyone knows. And not to mention the system itself has multiple areas of failure.
pants2 [3 hidden]5 mins ago
Chatbots in general can be quite opaque in how they operate, the biggest issue with agent products is communicating it's capabilities and limitations to users. If you have a bank app it's pretty clear whether or not it can send wire transfers, but a if that's a chatbot, users will have to think to ask it (and even then it could hallucinate)
shimman [3 hidden]5 mins ago
No, this is what happens when software developers don't understand how users actually use their products.
This was a totally expected outcome, similar to how CV cameras arrest the wrong minorities in neighboring states 100s of miles away because it told the officer it was them; or how health insurance companies use ML algorithms to deny Americans care.
It's going to happen in other sectors of life and it will continue killing innocent civilians.
banubis [3 hidden]5 mins ago
The pentagon says it was Palantir software’s fault, Palantir says it was the fault of bad data input to their software. Where’s the accountability by both organizations? How did we get to a world where military decisions leading to innocent deaths are responded to as if it was just another miscommunication implementing a B2B SaaS platform.
hyperhello [3 hidden]5 mins ago
Small children often develop coping mechanisms for their lack of agency. It may be part of these people’s worldview since early childhood that anyone who opposes them should magically die.
gambiting [3 hidden]5 mins ago
To me it's extremely obvious that this is the desired outcome - no accountability for anyone with this setup.
augment_me [3 hidden]5 mins ago
The new world is complex and AI technology has outpaced the regulation cycle, so it's inevitable that we come to a place where you don't have accountability and can never have it because 0) the courts can't handle the case, they don't have the frameworks for it, so it takes longer time 1) you can overload the courts with slop, 2) by the time there is a decision the world has moved on and technology has moved on
Really good time to do various crime.
croon [3 hidden]5 mins ago
I disagree with this framing. Nothing in accountability has really changed other than our willingness to enforce it.
Replace "AI" with any other tool or software in your scenario, and the outcome is the same. The same people and organizations are accountable, it's just that we currently live in a world without accountability in the highest places where it's most needed, and that's unrelated to AI.
macintux [3 hidden]5 mins ago
Related: the U.S. nearly boarded a Chinese boat that AI incorrectly flagged as carrying nuclear weapons materiel.
This is actually a much bigger close call than the hugging face incident. A hallucination almost triggered a possible precursor to WWIII.
jmathai [3 hidden]5 mins ago
> The Minab site, which was cataloged as an Islamic Revolutionary Guard Corps facility due to outdated data, was fed into Maven with other candidates and came out as a recommended day-one target. Target-list work that once took hours was condensed into minutes.
I feel like we're optimizing the wrong metric here.
seizethecheese [3 hidden]5 mins ago
Even ignoring the risk of civilian casualties (which to be clear should be weighed heavily) it’s just bad ROI. Like each missile probably costs more than the extra targeting work they should have done.
ambicapter [3 hidden]5 mins ago
probably -> definitely
These missiles cost a couple million each.
seizethecheese [3 hidden]5 mins ago
Yeah, totally, I’m being cautious because I don’t know how large the team is that would spend a few more hours, but under most assumptions you’re right.
jacquesm [3 hidden]5 mins ago
I'm going to bet that absolutely nobody higher up will end up going to jail for this.
FireBeyond [3 hidden]5 mins ago
Jail? I'm going to bet that absolutely nobody higher up will face any consequences for this. The outcome will be "we will review our processes".
> Yup. Brown Muslims from another country are barely considered human. It's like killing an ant.
Or even from the same country: let me remind you that the islamist guards in Iran slaughtered 30 000 unarmed protesters in January 2026.
I understand 123 children is catastrophic. But 123 vs 30 000: maybe we should reflect on what allowed an islamist regime to slaughter 30 000 of its own people.
verdverm [3 hidden]5 mins ago
The current regime came to power, in part, because of US/UK interference in the country going back to before WW2. There's a pattern of deposing existing leaders for those that are friendly to Western oil extraction. Our poor historical judgements led to much of our consternation today, and... we... keep... doing... it... #AmericanAmnesia
Once a bad regime is in power, there is less we can do about their internal affairs without sending in the troops again.
It's easy to blame the military and the higher-ups, after all they made this choice. But more relevant to HN, this couldn't have happened without technology professionals working for Palantir.
> A Palantir spokesperson told Bloomberg the company “is not responsible for the underlying data nor identifying intelligence deficiencies” and that there is no evidence its software was at fault.
If you work for Palantir, you are writing software that kills people. Software that, in this case, killed 123 children. What salary is worth that?
I encourage others who work in the public sector, whether directly or through a contractor, to read and internalize Don't Get Distracted by Caleb Hearth [0]. I think about it nearly every day.
Of course it could have happened. You don't even need targeting for this to happen. You can drop bombs at random and kill whoever is unlucky enough to be in the wrong place. The US has a long history of doing it (Japan, Vietnam, ...).
So yeah, the military and whoever decided that a war was a good idea are to blame.
People working at Palantir are as much responsible for the killing of these 123 children than seatbelt manufacturers are responsible for the people who died because their product failed. That is, because they didn't do their job correctly, people died, definitely worth feeling bad about. However, should people stop working in seatbelt manufacturing because of it? Absolutely not, we need seatbelts, because without them, things would be worse.
Palantir, or whoever does target identification, is like the seatbelt of the reckless drivers of the militaries, who, for the lack of precise information, would just carpet bomb the place. It is not a hypothetical, it is how the US has worked before they had precision ammunition.
This is essentially a trolley problem. The war is the trolley, people who work for Palantir are the ones pulling levers. And if there is no one to pull the lever, the trolley is gong on a track with a lot of people on it.
PorciiVorbesc [3 hidden]5 mins ago
>It's easy to blame the military and the higher-ups
My brother in Cthulu, they're the ones making the life or death decision that killed people, who else should be to blame?
>But more relevant to HN, this couldn't have happened without technology professionals working for Palantir.
If you wanna go the historical tech-tree scapegoat route then none of this would have happened if DARPA wouldn't have invented the internet, or if Thomas Edison wouldn't have invented the lightbulb, or if the fish haven't ventured onto land and evolve into us land mammal apes who invented sharpened sticks as murder objects.
cogman10 [3 hidden]5 mins ago
Look, if Palantir had any redeeming qualities then I might agree with you. Unlike electricity which runs our computers, homes, cars, etc. What does Palantir do? It spies on people and helps governments to create "people we don't like" lists. In the absolute best case it's a "minority report" engine, but it's still just there to try and stop pre-crime (not crime).
This isn't the case where we are talking about a company doing anything socially good. It's simply there to help authoritarian governments.
PorciiVorbesc [3 hidden]5 mins ago
Palantir only exists because government wants and funds these types of tools. If it Palantir wouldn't exist then another dozen companies with different names would exist that would create the same Torment Nexus for the government due to inexhaustible demand for such tools.
>It's simply there to help authoritarian governments.
The fact that you're so close yet so far away to figuring out who's to blame still boggles my mind.
whatshisface [3 hidden]5 mins ago
I know, right? I'm not even sure if this is the biggest installation on Earth. If it's possible for us, it's possible for any number of private military contractors. I bet there's a similar capability in the hands of every advanced county on Earth. Anyway, shaddup, the focusing crystal's not calibrating right, and tomorrow I have present the targeting parameters to Dr. Evil.
augment_me [3 hidden]5 mins ago
The govt is investing in the military whether you like it or not, there is a set amount of GDP going into the sector regardless of your moral choice.
Would you rather not have someone make good software that does not misidentify schools at sites? Or should we outsource this to worse engineers who don't care about morals and don't find this metric meaningful?
gameshot911 [3 hidden]5 mins ago
If I write healthcare software, and a doctor orders the wrong drug that kills the patient, am I responsible?
ekzy [3 hidden]5 mins ago
Legally, probably not...?
Whether you may/should feel responsible depends on how the software works, I guess. Did it automatically recommend some drug, somewhat confidently, with gray text on gray background saying "AI sometimes makes mistakes"?
So I think we should behave responsibly when making software, even more now with AI
petre [3 hidden]5 mins ago
Let's not forget the shareholders who invested in this company knowing what they do. That includes some of my colleagues. I told them that whoever created and named this company is clearly a psycho.
impossiblefork [3 hidden]5 mins ago
Personally I'm more interested in the justification for the second and third strikes.
There needs to be some protection for first responders and others helping the injured.
FireBeyond [3 hidden]5 mins ago
Israel likes to argue that Hamas embeds fighters with first responders, which even if so, they're still responding to injured. But Israel considers this not even collateral damage but justified.
Mind you Israel is currently funding a lobbyist organization in the UK to flag Médecins Sans Frontières (Doctors Without Borders) as a terrorist group (because many years ago a couple of people who had affiliations with other anti-Israel groups were found to be also affiliated with MSF).
WarmWash [3 hidden]5 mins ago
Hamas doesn't issue uniforms to it's fighters besides select units for show.
Every Hamas fighter is in a superposition that collapses based on the perspective of the observer.
Also, in Afghanistan the Taliban routinely used ambulances for troop transport. I have no idea why people think terrorist organizations hold some kind of moral compass that keeps them playing fair. They are awful morally unhinged zealots. If you don't think terrorists will punch below the belt because "god" just wants the "enemy" dead, you are hopelessly lost in the sauce.
impossiblefork [3 hidden]5 mins ago
Yeah, I've heard about it, but presumable Americans soldiers still care about IHL at least to some degree, even though they've historically not bothered with the Geneva convention and have tortured people.
aliasxneo [3 hidden]5 mins ago
Meanwhile, the Houthi's are trying to build missile technology with AI. We're only seeing the beginning of the consequences of an over-reliance on AI for military purposes.
sedan_baklazhan [3 hidden]5 mins ago
That is absolutely irrelevant. USA will never take responsibility. Nobody will be prosecuted. No compensations will be paid.
blikdak [3 hidden]5 mins ago
A poor craftsman blames his tools.
jtrn [3 hidden]5 mins ago
Things that jumped out at me.
If true, there was no verification of the targets selected by AI, meaning AI is the final arbiter of the deadly use of force. Another Rubicon passed.
Trump pretends like it didn’t happen: “We might never know what really happened there” is a frustrating lack of responsibility.
Still missing, as it always is from all of these kinds of articles, is: How common is this error rate compared to pure human evaluation and decision-making? I’m not saying I support AI-assisted killing, but why is nobody comparing it to human failure rates? If the article is true, then there were 1,000 targets hit in the first 24 hours. If the majority of the legwork and selection was done by AI, how many schools, or equivalents, would one expect to be wrongly hit if all the targeting work were done by humans only?
vikas123456789 [3 hidden]5 mins ago
Whole world is turning into an unlivable place and people who are doing it are not taking responsibility.
jacquesm [3 hidden]5 mins ago
They never have. Their money insulates them from the consequences of their actions.
andsoitis [3 hidden]5 mins ago
There’s a threshold where the money won’t insulate anymore.
They'll probably be dead by then. It's nihilistic. After us, the deluge...
Dansvidania [3 hidden]5 mins ago
a random musing:
I often see the argument "humans make mistakes too" when talking about AI, self driving cars, autonomous drones and such...
yes, they do, but most of the time they go to trial, there are consequences, there might even be justice.
when AI/self driving cars/drones make mistakes, which might very well be more rare in absolute [citation needed], there is (seems to me) a tendency to shrug it off, almost as if it were force majeure.
is it just me?
eeem [3 hidden]5 mins ago
Can't wait to read "Karp in Al-Quds: A Report on the Banality of Evil" in 2030.
conn10mfan [3 hidden]5 mins ago
ultimately someone or a group of people need to be held criminally accountable for this crime. it is on the magnitude of the my lai massacre and there should be justice for the victims
petre [3 hidden]5 mins ago
There is no justice. And Iran will probably blow up some innocent civillians in response the opportunity arrives, instead of targeting the actual culprits.
mhh__ [3 hidden]5 mins ago
Blowing up a school is proven route to diplomatic triumph and regime change!
igleria [3 hidden]5 mins ago
so who is paying for this? "humans must always remain accountable for artificial intelligence (AI) decisions"
1239971 [3 hidden]5 mins ago
An Maven AI used Claude, which was denied here multiple times. Maybe call the next model after Fable Minab!
RIMR [3 hidden]5 mins ago
I don't want to see the Pentagon try to pass the blame here, but I am all for giving half the blame to Palantir.
sys32768 [3 hidden]5 mins ago
Tragically this won't be the last time AI kills a lot of innocent people.
elAhmo [3 hidden]5 mins ago
This is not AI killing poeole, this is US government killing poeole.
angoragoats [3 hidden]5 mins ago
AI didn’t kill innocent people here, the Department of Defense and its decision-makers did.
underlipton [3 hidden]5 mins ago
Never so happy to see such an obvious scapegoat get thrown under the bus. I don't buy it for a second, but no tears will be shed if the stock market does.
ck2 [3 hidden]5 mins ago
first, closer to 250 people were murdered by the $4 Million tomahawk
second, imagine if Iran even accidentally took out an elementary school in the US filled with 250 people
third, there was a human group that was supposed to review targets regardless of whomever picked them, the group was purposely disbanded, that's negligent homicide at best but more clearly a war crime on purpose
fourth, let's say it was 250 soldiers somehow among a civilian setting, IT CHANGED NOTHING, this war will change nothing, they cannot destroy pickaxe mountain, they will abandon the war in 2029 like the US abandoned Iraq, Afghanistan, Vietnam and Korea, WAR CHANGES NOTHING, you cannot "War to Peace"
verdverm [3 hidden]5 mins ago
time to make Palantir the next Flock
France gave them the boot, you can too
chews [3 hidden]5 mins ago
nice, Karp really reeled in a nice big fish, and ofcourse he is going to blame OpenAI/Anthropic for giving the targets, this explains his CNBC rants about the frontiers, his tool was the trigger in a killchain of hallucination.
vfclists [3 hidden]5 mins ago
The one that pulls the trigger bears the responsibility.
jacquesm [3 hidden]5 mins ago
No. That's too easy on the higher ups, they never pull triggers.
derektank [3 hidden]5 mins ago
Completely disagree. When we’re talking about something like air, missile, or artillery strikes, the operator of the weapon system may literally never even see the target, on a screen or otherwise. They may simply be entering targeting information provided to them by an operations center. These decisions are social and group decisions, with distributed responsibility, which is why it’s so important to have institutions like the Civilian Protection Center of Excellence which historically has identified and helped implement the policies which prevent these kinds of disasters, but which unfortunately the current administration decided to shut down without a replacement.
Sometimes, the difference between a successful strike on a lawful combatant and disaster is one analyst pointing out that the building the enemy is hiding in is next to a square that’s used for a market on Tuesdays and wouldn’t you know it, it’s Tuesday. That’s not something the person “pulling the trigger,” can always be expected to know, which is why every ops center needs to be designed to elevate those voices, when the time comes
mito88 [3 hidden]5 mins ago
the operator was following orders...
esseph [3 hidden]5 mins ago
The one that pulls the trigger is often not the one doing any targeting, especially on a strategic strike weapon like a tomahawk. They are receiving a target data package with preprogrammed instructions. Their role is far more... mechanical. They're not seeing the targets at all.
verdverm [3 hidden]5 mins ago
I would argue `s/pulls the trigger/gives the go ahead/` is intuitively more appropriate. The sailor on the boat that fired off the tomahawk (iirc) was likely not in a position to make an in-the-moment determination
allears [3 hidden]5 mins ago
Given that everything emanating from this administration has a political agenda, does this mean that Thiel is on the outs?
ambicapter [3 hidden]5 mins ago
> unreleased Pentagon probe
From TFA.
esseph [3 hidden]5 mins ago
He's rich and connected, of course not.
cpursley [3 hidden]5 mins ago
They are also openly and proudly using this system along with Starlink to assist Ukraine, who a couple months ago killed a bunch of teens in a college in East Ukraine under very similar circumstances that a simple Google or Yandex maps search would have red-flagged plus on the ground real human intel. Unless the point was actually to kill kids.
I think your source is undermining your claim. That Wikipedia article strongly suggests that the whole event was fabricated by Russia.
cpursley [3 hidden]5 mins ago
Okay, that one is fake because Russia bad. Iran one is real because Orange man bad. Same ISR and targeting systems. Mental gymnastics is a hell of thing.
FireBeyond [3 hidden]5 mins ago
Says the Russian Emergency Situations Ministry, which then immediately refused to allow the UN access to verify the claim.
ceejayoz [3 hidden]5 mins ago
The account in question has a history of being… deeply credulous of Russian claims.
Thank you for reminding me about these posts, time has proved my statements true. Especially after the Iran war exposed these outdated systems via direct hits on US bases, which can't be narrative'd away like in Ukraine.
ceejayoz [3 hidden]5 mins ago
> time has proved my statements true
The S-400 is fairing well? F-35s apparently walked all over Iran's air defense network without much challenge.
> Especially after the Iran war exposed these outdated systems via direct hits on US bases…
Interception rates have been extremely high. The problem, of course, is the ammo shortage and drone cost asymmetry. Which has been widely documented, and presents an issue for the S-400s too.
sublinear [3 hidden]5 mins ago
Is that really the case? Stories like this always have all sides muddying waters.
The terrorists are well known to use children and the rest of the public as hostage meatshields, and the US military is always looking for something/someone else to blame for the dirty work they have to do.
The broader public is so polarized by performative politics and botspam that they eat these stories up, but nothing I'm saying is secret. It's been this way since forever. Slow news today?
I'm not even defending AI at all and think these are crappy choices, but compared to humans gathering intelligence who can go rogue, what alternative does anyone really have?
23j423j423hj [3 hidden]5 mins ago
It was a school. No one on either side is denying this.
ceejayoz [3 hidden]5 mins ago
> Stories like this always have all sides muddying waters.
Which makes the administration's near complete silence on the strike rather suspicious, no?
What fucking terrorists? We're talking about a country bombing another country's school. A country with a population of 93 million. Are you trying to insinuate that all 93 million Iranians are terrorists?
Maybe you meant the American terrorists?
> Stories like this always have all sides muddying waters.
All sides agree that the US bombed a school full of children, actually.
This looks as much, if not more, like terrorism to me than other incidents the media endlessly portrays.
The US has done so much evil around the world. Enough is enough.
And yeah, Alex Karp is a complete idiot. I cannot imagine how vile one has to be to make a profit off this.
angoragoats [3 hidden]5 mins ago
In a just world, Pete Hegseth and the entire board of Palantir would be in prison for this.
bix6 [3 hidden]5 mins ago
DOGE strikes again. Edit actually looks like it was Hegseth himself, king Testosterone.
> Staffing on civilian harm mitigation teams across the U.S. Department of Defense had also fallen by roughly 90% over recent years, shrinking to fewer than 20 people overall. Centcom’s group shrank from 10 people to one.
Reading the details, "AI" doesn't really seem like the culprit -it's a scapegoat.
The intelligence that it was no longer a military target never entered the target database, the team that was responsible for vetting the target list was gutted, and said team was never even consulted.
The White House wanted 1000 targets and pulled from their database without any due diligence. Whether it was an AI call or an SQL query - this was from pure human maliciousness and incompetence.
> Some US intelligence analysts took notice, the officials said. Bloomberg reported in June that one analyst detected changes to the site as early as 2019, and logged remarks about the modifications in a system that wasn’t connected to the primary military intelligence database, which informs targeting
But don't worry, the other P AI system will ensure that the first one doesn't do mistakes...
-------------------
Maven is an untested tool for rapidly selecting targets under time pressure during a war. It's reason for existing is speed. If you're in a shooting war, the ability to select good military targets faster than your enemy, but not necessarily with zero error, is an advantage.
Planning a first strike is a different situation. Time pressure should not be a significant factor. Humans should have been doing their due diligence on every single target. If an untested tool for rapid mid-battle target selection was relied upon completely because of a hasty executive order, then the responsibility falls entirely on the executive.
...
> Hegseth and the commander in charge of the Iran operation, Adm. Brad Cooper, were questioned about the strike before Congress. Hegseth said the U.S. does not target civilians and would investigate
So the administration does not intentionally target civilians, they have just stopped caring about who a civilian is.
https://en.wikipedia.org/wiki/Military-age_male
What a fucking moron
Basically they stopped caring those woke UN rules about war crimes.
I cannot believe this has come to pass.
> The Pentagon chief last year slashed offices that didn’t contribute to his goal of “lethality,” including the group that assists in limiting risk to civilians, known as the Civilian Protection Center of Excellence. Around 200 employees who worked on the issue, including at that office, have been reduced by about 90 percent, according to two current and former officials and a person familiar with the effort. The team that handles civilian casualties at Central Command, which oversees the Middle East, has dropped from 10 to one.
Negligent homicide in pursuit of their DEI goals, basically.
Negligence was involved.
DEI for drunk white men who look good on TV got us Hegseth, who's now rather hilariously requiring gender-affirming treatment for the troops. (https://www.pbs.org/newshour/world/pentagon-moves-forward-wi...)
> An AI can be tried in a court.
An AI can't be tried in a court.
This is what happens when people who don't understand AI and its limitations embrace it wholeheartedly, thinking it's going to behave like The ultimate analyst. Except it's not. Its got blind spots in more places than anyone knows. And not to mention the system itself has multiple areas of failure.
This was a totally expected outcome, similar to how CV cameras arrest the wrong minorities in neighboring states 100s of miles away because it told the officer it was them; or how health insurance companies use ML algorithms to deny Americans care.
It's going to happen in other sectors of life and it will continue killing innocent civilians.
Really good time to do various crime.
Replace "AI" with any other tool or software in your scenario, and the outcome is the same. The same people and organizations are accountable, it's just that we currently live in a world without accountability in the highest places where it's most needed, and that's unrelated to AI.
https://gizmodo.com/almost-started-a-war-us-military-nearly-...
I feel like we're optimizing the wrong metric here.
These missiles cost a couple million each.
https://www.propublica.org/article/hegseth-civilian-harm-mit...
Or even from the same country: let me remind you that the islamist guards in Iran slaughtered 30 000 unarmed protesters in January 2026.
I understand 123 children is catastrophic. But 123 vs 30 000: maybe we should reflect on what allowed an islamist regime to slaughter 30 000 of its own people.
Once a bad regime is in power, there is less we can do about their internal affairs without sending in the troops again.
https://en.wikipedia.org/wiki/Background_and_causes_of_the_I...
> That didn't happen.
> And if it did, it wasn't that bad.
> And if it was, it was AI's fault, not mine.
It's gonna say something like "they were all military-aged males". https://en.wikipedia.org/wiki/Military-age_male
> A Palantir spokesperson told Bloomberg the company “is not responsible for the underlying data nor identifying intelligence deficiencies” and that there is no evidence its software was at fault.
If you work for Palantir, you are writing software that kills people. Software that, in this case, killed 123 children. What salary is worth that?
I encourage others who work in the public sector, whether directly or through a contractor, to read and internalize Don't Get Distracted by Caleb Hearth [0]. I think about it nearly every day.
[0] https://calebhearth.com/dont-get-distracted
So yeah, the military and whoever decided that a war was a good idea are to blame.
People working at Palantir are as much responsible for the killing of these 123 children than seatbelt manufacturers are responsible for the people who died because their product failed. That is, because they didn't do their job correctly, people died, definitely worth feeling bad about. However, should people stop working in seatbelt manufacturing because of it? Absolutely not, we need seatbelts, because without them, things would be worse.
Palantir, or whoever does target identification, is like the seatbelt of the reckless drivers of the militaries, who, for the lack of precise information, would just carpet bomb the place. It is not a hypothetical, it is how the US has worked before they had precision ammunition.
This is essentially a trolley problem. The war is the trolley, people who work for Palantir are the ones pulling levers. And if there is no one to pull the lever, the trolley is gong on a track with a lot of people on it.
My brother in Cthulu, they're the ones making the life or death decision that killed people, who else should be to blame?
>But more relevant to HN, this couldn't have happened without technology professionals working for Palantir.
If you wanna go the historical tech-tree scapegoat route then none of this would have happened if DARPA wouldn't have invented the internet, or if Thomas Edison wouldn't have invented the lightbulb, or if the fish haven't ventured onto land and evolve into us land mammal apes who invented sharpened sticks as murder objects.
This isn't the case where we are talking about a company doing anything socially good. It's simply there to help authoritarian governments.
>It's simply there to help authoritarian governments.
The fact that you're so close yet so far away to figuring out who's to blame still boggles my mind.
Would you rather not have someone make good software that does not misidentify schools at sites? Or should we outsource this to worse engineers who don't care about morals and don't find this metric meaningful?
Whether you may/should feel responsible depends on how the software works, I guess. Did it automatically recommend some drug, somewhat confidently, with gray text on gray background saying "AI sometimes makes mistakes"?
So I think we should behave responsibly when making software, even more now with AI
There needs to be some protection for first responders and others helping the injured.
Mind you Israel is currently funding a lobbyist organization in the UK to flag Médecins Sans Frontières (Doctors Without Borders) as a terrorist group (because many years ago a couple of people who had affiliations with other anti-Israel groups were found to be also affiliated with MSF).
Also, in Afghanistan the Taliban routinely used ambulances for troop transport. I have no idea why people think terrorist organizations hold some kind of moral compass that keeps them playing fair. They are awful morally unhinged zealots. If you don't think terrorists will punch below the belt because "god" just wants the "enemy" dead, you are hopelessly lost in the sauce.
If true, there was no verification of the targets selected by AI, meaning AI is the final arbiter of the deadly use of force. Another Rubicon passed.
Trump pretends like it didn’t happen: “We might never know what really happened there” is a frustrating lack of responsibility.
Still missing, as it always is from all of these kinds of articles, is: How common is this error rate compared to pure human evaluation and decision-making? I’m not saying I support AI-assisted killing, but why is nobody comparing it to human failure rates? If the article is true, then there were 1,000 targets hit in the first 24 hours. If the majority of the legwork and selection was done by AI, how many schools, or equivalents, would one expect to be wrongly hit if all the targeting work were done by humans only?
I often see the argument "humans make mistakes too" when talking about AI, self driving cars, autonomous drones and such...
yes, they do, but most of the time they go to trial, there are consequences, there might even be justice.
when AI/self driving cars/drones make mistakes, which might very well be more rare in absolute [citation needed], there is (seems to me) a tendency to shrug it off, almost as if it were force majeure.
is it just me?
second, imagine if Iran even accidentally took out an elementary school in the US filled with 250 people
third, there was a human group that was supposed to review targets regardless of whomever picked them, the group was purposely disbanded, that's negligent homicide at best but more clearly a war crime on purpose
fourth, let's say it was 250 soldiers somehow among a civilian setting, IT CHANGED NOTHING, this war will change nothing, they cannot destroy pickaxe mountain, they will abandon the war in 2029 like the US abandoned Iraq, Afghanistan, Vietnam and Korea, WAR CHANGES NOTHING, you cannot "War to Peace"
France gave them the boot, you can too
Sometimes, the difference between a successful strike on a lawful combatant and disaster is one analyst pointing out that the building the enemy is hiding in is next to a square that’s used for a market on Tuesdays and wouldn’t you know it, it’s Tuesday. That’s not something the person “pulling the trigger,” can always be expected to know, which is why every ops center needs to be designed to elevate those voices, when the time comes
From TFA.
https://en.wikipedia.org/wiki/2026_Starobilsk_strike
https://news.ycombinator.com/item?id=47441817
https://news.ycombinator.com/item?id=36559017
etc.
The S-400 is fairing well? F-35s apparently walked all over Iran's air defense network without much challenge.
> Especially after the Iran war exposed these outdated systems via direct hits on US bases…
Interception rates have been extremely high. The problem, of course, is the ammo shortage and drone cost asymmetry. Which has been widely documented, and presents an issue for the S-400s too.
The terrorists are well known to use children and the rest of the public as hostage meatshields, and the US military is always looking for something/someone else to blame for the dirty work they have to do.
The broader public is so polarized by performative politics and botspam that they eat these stories up, but nothing I'm saying is secret. It's been this way since forever. Slow news today?
I'm not even defending AI at all and think these are crappy choices, but compared to humans gathering intelligence who can go rogue, what alternative does anyone really have?
Which makes the administration's near complete silence on the strike rather suspicious, no?
Yes it is really the case here.
What fucking terrorists? We're talking about a country bombing another country's school. A country with a population of 93 million. Are you trying to insinuate that all 93 million Iranians are terrorists?
Maybe you meant the American terrorists?
> Stories like this always have all sides muddying waters.
All sides agree that the US bombed a school full of children, actually.
https://en.wikipedia.org/wiki/2026_Minab_school_attack
This looks as much, if not more, like terrorism to me than other incidents the media endlessly portrays.
The US has done so much evil around the world. Enough is enough.
And yeah, Alex Karp is a complete idiot. I cannot imagine how vile one has to be to make a profit off this.
> Staffing on civilian harm mitigation teams across the U.S. Department of Defense had also fallen by roughly 90% over recent years, shrinking to fewer than 20 people overall. Centcom’s group shrank from 10 people to one.
https://www.propublica.org/article/hegseth-civilian-harm-mit...
Edit: hilarious downvotes. Does DOGE get Elon Stan bots or something?
https://en.wikipedia.org/wiki/Franz_Conrad_von_H%C3%B6tzendo...
I would like to know how you know this