> It found the U.S. “failed in its obligation to do everything feasible to verify” that the school was a military objective and that the failure “went beyond mere negligence.” The report said the United States “directed the strikes at the building of the school while being aware of a substantial risk of striking a civilian object and acting recklessly as regards the possibility that this would happen.”
Reading the details, "AI" doesn't really seem like the culprit -it's a scapegoat.
The intelligence that it was no longer a military target never entered the target database, the team that was responsible for vetting the target list was gutted, and said team was never even consulted.
The White House wanted 1000 targets and pulled from their database without any due diligence. Whether it was an AI call or an SQL query - this was from pure human maliciousness and incompetence.
show comments
colingauvin
While I think that it's important to do root cause analysis, we need to be very careful not to absolve blame from the people that decided to shift a significant weight of decision-making authority to an AI. An AI can't be tried in a court. There has to be a responsible human for everyone one of its actions, especially when it's killing (-people-) children.
I cannot believe this has come to pass.
show comments
imranq
> Officials said some users expected Maven to flag stale records or contradictions in the intelligence assembled for potential targets, though it is not clear why they thought the system would do that
This is what happens when people who don't understand AI and its limitations embrace it wholeheartedly, thinking it's going to behave like The ultimate analyst. Except it's not. Its got blind spots in more places than anyone knows. And not to mention the system itself has multiple areas of failure.
show comments
banubis
The pentagon says it was Palantir software’s fault, Palantir says it was the fault of bad data input to their software. Where’s the accountability by both organizations? How did we get to a world where military decisions leading to innocent deaths are responded to as if it was just another miscommunication implementing a B2B SaaS platform.
show comments
jmathai
> The Minab site, which was cataloged as an Islamic Revolutionary Guard Corps facility due to outdated data, was fed into Maven with other candidates and came out as a recommended day-one target. Target-list work that once took hours was condensed into minutes.
I feel like we're optimizing the wrong metric here.
show comments
macintux
Related: the U.S. nearly boarded a Chinese boat that AI incorrectly flagged as carrying nuclear weapons materiel.
You're absolutely right, those were innocent children. I apologize for the error. Would you like to know more about war crimes?
show comments
feurio
"Proteus! You just killed 123 schoolgirls, you sick mofo!"
"You're absolutely right."
impossiblefork
Personally I'm more interested in the justification for the second and third strikes.
There needs to be some protection for first responders and others helping the injured.
show comments
63
It's easy to blame the military and the higher-ups, after all they made this choice. But more relevant to HN, this couldn't have happened without technology professionals working for Palantir.
> A Palantir spokesperson told Bloomberg the company “is not responsible for the underlying data nor identifying intelligence deficiencies” and that there is no evidence its software was at fault.
If you work for Palantir, you are writing software that kills people. Software that, in this case, killed 123 children. What salary is worth that?
I encourage others who work in the public sector, whether directly or through a contractor, to read and internalize Don't Get Distracted by Caleb Hearth [0]. I think about it nearly every day.
Our targeting cycle is broken. 'Find me more targets' is something that you will hear a JTF commander say. Not 'what do we need to accomplish this objective'. Or, crazy idea here, how is this objective -that I handed off to someone that I properly resourced and empowered to achieve it- progressing. I can only imagine that AI is not to blame here but also not necessarily helping either. It is yet another shiny object that is distracting from the core problem: we have lost our ability to manage the operational level of war. Everything is sucked up to a centralized decision making structure and spit out on a fake 72 hour cycle that pretends that it is responsive. Our observe, orient, decide and act loops are days, or weeks, long while an enemy can see a dust cloud on the horizon and decide to walk out and put an IED in front of a convoy in 5 minutes.
When Russia made its current play at taking over Ukraine it failed miserably. The dumbest plans executed with no ability to react to the real state on the ground were all on display. They had the capability and they had the resources but their ability to execute at the operational level was terrible and for all the same reasons we are terrible. Centralized command, no ability to package up a problem with resources and a commander and hand it off, no ability to react. Their operational level was broken fundamentally, just like ours is. The scariest thing about the Ukraine war right now is that they have learned the operational level of war. They can plan and react. They are now a force to be reckoned with because they know how to use their tools, including AI, to be effective.
We went through this same learning curve in WWII. We were terrible initially. Russia sent a huge column of resources on a major road and let it stall, we put a bunch of battleships right next to each other. But then we learned and by the end of it we could pull off d-day. Those planners then left the military and got us to the moon with slide rules. We still haven't gone back and it isn't because our technology is worse, it is because we started loosing that operational knowledge again.
The end result of the school bombing will likely be even more oversight at the highest level, more centralized decision making and review, which is exactly the wrong direction needed to fix the problem. We need to rediscover the operational level of war. We need to learn to be responsive. We need to stop trying to create a 72 hour steady state cycle that serves nobody but manual writers and embrace that war is chaotic and if you build a process that makes it feel steady state you have really built a cycle that looses wars and bombs kids.
sedan_baklazhan
That is absolutely irrelevant. USA will never take responsibility. Nobody will be prosecuted. No compensations will be paid.
vikas123456789
Whole world is turning into an unlivable place and people who are doing it are not taking responsibility.
show comments
conn10mfan
ultimately someone or a group of people need to be held criminally accountable for this crime. it is on the magnitude of the my lai massacre and there should be justice for the victims
show comments
jtrn
Things that jumped out at me.
If true, there was no verification of the targets selected by AI, meaning AI is the final arbiter of the deadly use of force. Another Rubicon passed.
Trump pretends like it didn’t happen: “We might never know what really happened there” is a frustrating lack of responsibility.
Still missing, as it always is from all of these kinds of articles, is: How common is this error rate compared to pure human evaluation and decision-making? I’m not saying I support AI-assisted killing, but why is nobody comparing it to human failure rates? If the article is true, then there were 1,000 targets hit in the first 24 hours. If the majority of the legwork and selection was done by AI, how many schools, or equivalents, would one expect to be wrongly hit if all the targeting work were done by humans only?
aliasxneo
Meanwhile, the Houthi's are trying to build missile technology with AI. We're only seeing the beginning of the consequences of an over-reliance on AI for military purposes.
blikdak
A poor craftsman blames his tools.
show comments
eeem
Can't wait to read "Karp in Al-Quds: A Report on the Banality of Evil" in 2030.
ck2
first, closer to 250 people were murdered by the $4 Million tomahawk
second, imagine if Iran even accidentally took out an elementary school in the US filled with 250 people
third, there was a human group that was supposed to review targets regardless of whomever picked them, the group was purposely disbanded, that's negligent homicide at best but more clearly a war crime on purpose
fourth, let's say it was 250 soldiers somehow among a civilian setting, IT CHANGED NOTHING, this war will change nothing, they cannot destroy pickaxe mountain, they will abandon the war in 2029 like the US abandoned Iraq, Afghanistan, Vietnam and Korea, WAR CHANGES NOTHING, you cannot "War to Peace"
sashank_1509
Depressing, why should my tax dollars fund this incompetence and insanity. We need more accountability for such military decisions
jacquesm
I'm going to bet that absolutely nobody higher up will end up going to jail for this.
show comments
Dansvidania
a random musing:
I often see the argument "humans make mistakes too" when talking about AI, self driving cars, autonomous drones and such...
yes, they do, but most of the time they go to trial, there are consequences, there might even be justice.
when AI/self driving cars/drones make mistakes, which might very well be more rare in absolute [citation needed], there is (seems to me) a tendency to shrug it off, almost as if it were force majeure.
is it just me?
igleria
so who is paying for this? "humans must always remain accountable for artificial intelligence (AI) decisions"
1239971
An Maven AI used Claude, which was denied here multiple times. Maybe call the next model after Fable Minab!
chrisjj
A great example of the primary use case for this so-called AI tech: substitute for competence.
underlipton
Never so happy to see such an obvious scapegoat get thrown under the bus. I don't buy it for a second, but no tears will be shed if the stock market does.
RIMR
I don't want to see the Pentagon try to pass the blame here, but I am all for giving half the blame to Palantir.
ChrisArchitect
Related
Iran school bombing: grounds to believe US was behind atrocity, UN finds
Tragically this won't be the last time AI kills a lot of innocent people.
show comments
cpursley
They are also openly and proudly using this system along with Starlink to assist Ukraine, who a couple months ago killed a bunch of teens in a college in East Ukraine under very similar circumstances that a simple Google or Yandex maps search would have red-flagged plus on the ground real human intel. Unless the point was actually to kill kids.
nice, Karp really reeled in a nice big fish, and ofcourse he is going to blame OpenAI/Anthropic for giving the targets, this explains his CNBC rants about the frontiers, his tool was the trigger in a killchain of hallucination.
vfclists
The one that pulls the trigger bears the responsibility.
show comments
LightBug1
FFS ...
Either this is true, and it's fucking bullshit.
Or it's an exaggeration/ false, and it's still fucking bullshit.
So, either way, something coming out of the Pentagon is fucking bullshit.
allears
Given that everything emanating from this administration has a political agenda, does this mean that Thiel is on the outs?
show comments
bix6
DOGE strikes again. Edit actually looks like it was Hegseth himself, king Testosterone.
> Staffing on civilian harm mitigation teams across the U.S. Department of Defense had also fallen by roughly 90% over recent years, shrinking to fewer than 20 people overall. Centcom’s group shrank from 10 people to one.
This looks as much, if not more, like terrorism to me than other incidents the media endlessly portrays.
The US has done so much evil around the world. Enough is enough.
And yeah, Alex Karp is a complete idiot. I cannot imagine how vile one has to be to make a profit off this.
1832764323
No this is BS, they murdered these children on purpose to reenact Purim (when they started the war). Purim is a celebration of the murder of Persian civilians, including children by Jewish forces. Several Zionist venture capitalists such as Sam Lessin were literally celebrating this.
Despite what AI told them, they knew it was a school full of kids. They still chose to kill them all with bomb. Only maniac would do such thing.
show comments
johnsmith1840
Did nobody here actually look at the school in question? The Iranians built a little kids school INSIDE a military base, a really important one at that. Same paint, style, literally ~20ft away.
A tragedy but it's hard to argue that it wasn't the intention of the Iranians for this exact senario to happen.
> It found the U.S. “failed in its obligation to do everything feasible to verify” that the school was a military objective and that the failure “went beyond mere negligence.” The report said the United States “directed the strikes at the building of the school while being aware of a substantial risk of striking a civilian object and acting recklessly as regards the possibility that this would happen.”
Reading the details, "AI" doesn't really seem like the culprit -it's a scapegoat.
The intelligence that it was no longer a military target never entered the target database, the team that was responsible for vetting the target list was gutted, and said team was never even consulted.
The White House wanted 1000 targets and pulled from their database without any due diligence. Whether it was an AI call or an SQL query - this was from pure human maliciousness and incompetence.
While I think that it's important to do root cause analysis, we need to be very careful not to absolve blame from the people that decided to shift a significant weight of decision-making authority to an AI. An AI can't be tried in a court. There has to be a responsible human for everyone one of its actions, especially when it's killing (-people-) children.
I cannot believe this has come to pass.
> Officials said some users expected Maven to flag stale records or contradictions in the intelligence assembled for potential targets, though it is not clear why they thought the system would do that
This is what happens when people who don't understand AI and its limitations embrace it wholeheartedly, thinking it's going to behave like The ultimate analyst. Except it's not. Its got blind spots in more places than anyone knows. And not to mention the system itself has multiple areas of failure.
The pentagon says it was Palantir software’s fault, Palantir says it was the fault of bad data input to their software. Where’s the accountability by both organizations? How did we get to a world where military decisions leading to innocent deaths are responded to as if it was just another miscommunication implementing a B2B SaaS platform.
> The Minab site, which was cataloged as an Islamic Revolutionary Guard Corps facility due to outdated data, was fed into Maven with other candidates and came out as a recommended day-one target. Target-list work that once took hours was condensed into minutes.
I feel like we're optimizing the wrong metric here.
Related: the U.S. nearly boarded a Chinese boat that AI incorrectly flagged as carrying nuclear weapons materiel.
https://gizmodo.com/almost-started-a-war-us-military-nearly-...
You're absolutely right, those were innocent children. I apologize for the error. Would you like to know more about war crimes?
"Proteus! You just killed 123 schoolgirls, you sick mofo!"
"You're absolutely right."
Personally I'm more interested in the justification for the second and third strikes.
There needs to be some protection for first responders and others helping the injured.
It's easy to blame the military and the higher-ups, after all they made this choice. But more relevant to HN, this couldn't have happened without technology professionals working for Palantir.
> A Palantir spokesperson told Bloomberg the company “is not responsible for the underlying data nor identifying intelligence deficiencies” and that there is no evidence its software was at fault.
If you work for Palantir, you are writing software that kills people. Software that, in this case, killed 123 children. What salary is worth that?
I encourage others who work in the public sector, whether directly or through a contractor, to read and internalize Don't Get Distracted by Caleb Hearth [0]. I think about it nearly every day.
[0] https://calebhearth.com/dont-get-distracted
Blaming AI for your own prompts is wild.
Our targeting cycle is broken. 'Find me more targets' is something that you will hear a JTF commander say. Not 'what do we need to accomplish this objective'. Or, crazy idea here, how is this objective -that I handed off to someone that I properly resourced and empowered to achieve it- progressing. I can only imagine that AI is not to blame here but also not necessarily helping either. It is yet another shiny object that is distracting from the core problem: we have lost our ability to manage the operational level of war. Everything is sucked up to a centralized decision making structure and spit out on a fake 72 hour cycle that pretends that it is responsive. Our observe, orient, decide and act loops are days, or weeks, long while an enemy can see a dust cloud on the horizon and decide to walk out and put an IED in front of a convoy in 5 minutes.
When Russia made its current play at taking over Ukraine it failed miserably. The dumbest plans executed with no ability to react to the real state on the ground were all on display. They had the capability and they had the resources but their ability to execute at the operational level was terrible and for all the same reasons we are terrible. Centralized command, no ability to package up a problem with resources and a commander and hand it off, no ability to react. Their operational level was broken fundamentally, just like ours is. The scariest thing about the Ukraine war right now is that they have learned the operational level of war. They can plan and react. They are now a force to be reckoned with because they know how to use their tools, including AI, to be effective.
We went through this same learning curve in WWII. We were terrible initially. Russia sent a huge column of resources on a major road and let it stall, we put a bunch of battleships right next to each other. But then we learned and by the end of it we could pull off d-day. Those planners then left the military and got us to the moon with slide rules. We still haven't gone back and it isn't because our technology is worse, it is because we started loosing that operational knowledge again.
The end result of the school bombing will likely be even more oversight at the highest level, more centralized decision making and review, which is exactly the wrong direction needed to fix the problem. We need to rediscover the operational level of war. We need to learn to be responsive. We need to stop trying to create a 72 hour steady state cycle that serves nobody but manual writers and embrace that war is chaotic and if you build a process that makes it feel steady state you have really built a cycle that looses wars and bombs kids.
That is absolutely irrelevant. USA will never take responsibility. Nobody will be prosecuted. No compensations will be paid.
Whole world is turning into an unlivable place and people who are doing it are not taking responsibility.
ultimately someone or a group of people need to be held criminally accountable for this crime. it is on the magnitude of the my lai massacre and there should be justice for the victims
Things that jumped out at me.
If true, there was no verification of the targets selected by AI, meaning AI is the final arbiter of the deadly use of force. Another Rubicon passed.
Trump pretends like it didn’t happen: “We might never know what really happened there” is a frustrating lack of responsibility.
Still missing, as it always is from all of these kinds of articles, is: How common is this error rate compared to pure human evaluation and decision-making? I’m not saying I support AI-assisted killing, but why is nobody comparing it to human failure rates? If the article is true, then there were 1,000 targets hit in the first 24 hours. If the majority of the legwork and selection was done by AI, how many schools, or equivalents, would one expect to be wrongly hit if all the targeting work were done by humans only?
Meanwhile, the Houthi's are trying to build missile technology with AI. We're only seeing the beginning of the consequences of an over-reliance on AI for military purposes.
A poor craftsman blames his tools.
Can't wait to read "Karp in Al-Quds: A Report on the Banality of Evil" in 2030.
first, closer to 250 people were murdered by the $4 Million tomahawk
second, imagine if Iran even accidentally took out an elementary school in the US filled with 250 people
third, there was a human group that was supposed to review targets regardless of whomever picked them, the group was purposely disbanded, that's negligent homicide at best but more clearly a war crime on purpose
fourth, let's say it was 250 soldiers somehow among a civilian setting, IT CHANGED NOTHING, this war will change nothing, they cannot destroy pickaxe mountain, they will abandon the war in 2029 like the US abandoned Iraq, Afghanistan, Vietnam and Korea, WAR CHANGES NOTHING, you cannot "War to Peace"
Depressing, why should my tax dollars fund this incompetence and insanity. We need more accountability for such military decisions
I'm going to bet that absolutely nobody higher up will end up going to jail for this.
a random musing:
I often see the argument "humans make mistakes too" when talking about AI, self driving cars, autonomous drones and such...
yes, they do, but most of the time they go to trial, there are consequences, there might even be justice.
when AI/self driving cars/drones make mistakes, which might very well be more rare in absolute [citation needed], there is (seems to me) a tendency to shrug it off, almost as if it were force majeure.
is it just me?
so who is paying for this? "humans must always remain accountable for artificial intelligence (AI) decisions"
An Maven AI used Claude, which was denied here multiple times. Maybe call the next model after Fable Minab!
A great example of the primary use case for this so-called AI tech: substitute for competence.
Never so happy to see such an obvious scapegoat get thrown under the bus. I don't buy it for a second, but no tears will be shed if the stock market does.
I don't want to see the Pentagon try to pass the blame here, but I am all for giving half the blame to Palantir.
Related
Iran school bombing: grounds to believe US was behind atrocity, UN finds
https://news.ycombinator.com/item?id=49739018
Title: Inside the AI "Kill Chain" That Destroyed an Iranian School
(https://news.ycombinator.com/item?id=49763739 https://news.ycombinator.com/item?id=49761106)
https://archive.ph/0V37g
time to make Palantir the next Flock
France gave them the boot, you can too
Tragically this won't be the last time AI kills a lot of innocent people.
They are also openly and proudly using this system along with Starlink to assist Ukraine, who a couple months ago killed a bunch of teens in a college in East Ukraine under very similar circumstances that a simple Google or Yandex maps search would have red-flagged plus on the ground real human intel. Unless the point was actually to kill kids.
https://en.wikipedia.org/wiki/2026_Starobilsk_strike
nice, Karp really reeled in a nice big fish, and ofcourse he is going to blame OpenAI/Anthropic for giving the targets, this explains his CNBC rants about the frontiers, his tool was the trigger in a killchain of hallucination.
The one that pulls the trigger bears the responsibility.
FFS ...
Either this is true, and it's fucking bullshit.
Or it's an exaggeration/ false, and it's still fucking bullshit.
So, either way, something coming out of the Pentagon is fucking bullshit.
Given that everything emanating from this administration has a political agenda, does this mean that Thiel is on the outs?
DOGE strikes again. Edit actually looks like it was Hegseth himself, king Testosterone.
> Staffing on civilian harm mitigation teams across the U.S. Department of Defense had also fallen by roughly 90% over recent years, shrinking to fewer than 20 people overall. Centcom’s group shrank from 10 people to one.
https://www.propublica.org/article/hegseth-civilian-harm-mit...
Edit: hilarious downvotes. Does DOGE get Elon Stan bots or something?
In a just world, Pete Hegseth and the entire board of Palantir would be in prison for this.
TIL about this attack.
https://en.wikipedia.org/wiki/2026_Minab_school_attack
This looks as much, if not more, like terrorism to me than other incidents the media endlessly portrays.
The US has done so much evil around the world. Enough is enough.
And yeah, Alex Karp is a complete idiot. I cannot imagine how vile one has to be to make a profit off this.
No this is BS, they murdered these children on purpose to reenact Purim (when they started the war). Purim is a celebration of the murder of Persian civilians, including children by Jewish forces. Several Zionist venture capitalists such as Sam Lessin were literally celebrating this.
https://x.com/lessin/status/2029663841181979097
https://en.wikipedia.org/wiki/Purim
Despite what AI told them, they knew it was a school full of kids. They still chose to kill them all with bomb. Only maniac would do such thing.
Did nobody here actually look at the school in question? The Iranians built a little kids school INSIDE a military base, a really important one at that. Same paint, style, literally ~20ft away.
A tragedy but it's hard to argue that it wasn't the intention of the Iranians for this exact senario to happen.