Google Should Not Help the U.S. Military Build Unaccountable AI Systems
By Peter Eckersley and Cindy Cohn | EFF | April 5, 2018
Thousands of Google staff have been speaking out against the company’s work for “Project Maven,” according to a New York Times report this week. The program is a U.S. Department of Defense (DoD) initiative to deploy machine learning for military purposes. There was a small amount of public reporting last month that Google had become a contractor for that project, but those stories had not captured how extensive Google’s involvement was, nor how controversial it has become within the company.
Outcry from Google’s own staff is reportedly ongoing, and the letter signed by employees asks Google to commit publicly to not assisting with warfare technology. We are sure this is a difficult decision for Google’s leadership; we hope they weigh it carefully.
This post outlines some of the questions that people inside and outside of the company should be mulling about whether it’s a good idea for companies with deep machine learning expertise to be assisting with military deployments of artificial intelligence (AI).
What we don’t know about Google’s work on Project Maven
According to Google’s statement last month, the company provided “open source TensorFlow APIs” to the DoD. But it appears that this controversy was not just about the company giving the DoD a regular Google cloud account on which to train TensorFlow models. A letter signed by Google employees implies that the company also provided access to its state-of-the-art machine learning expertise, as well as engineering staff to assist or work directly on the DoD’s efforts. The company has said that it is doing object recognition “for non-offensive uses only,” though reading some of the published documents and discussions about the project suggest that the situation is murkier. The New York Times says that “the Pentagon’s video analysis is routinely used in counterinsurgency and counterterrorism operations, and Defense Department publications make clear that the project supports those operations.”
If our reading of the public record is correct, systems that Google is supporting or building would flag people or objects seen by drones for human review, and in some cases this would lead to subsequent missile strikes on those people or objects. Those are hefty ethical stakes, even with humans in the loop further along the “kill chain”.
We’re glad that Google is now debating the project internally. While there aren’t enough published details for us to comment definitively, we share many of the concerns we’ve heard from colleagues within Google, and we have a few suggestions for any AI company that’s considering becoming a defense contractor.
What should AI companies ask themselves before accepting military contracts?
We’ll start with the obvious: it’s incredibly risky to be using AI systems in military situations where even seemingly small problems can result in fatalities, in the escalation of conflicts, or in wider instability. AI systems can often be difficult to control and may fail in surprising ways. In military situations, failure of AI could be grave, subtle, and hard to address. The boundaries of what is and isn’t dangerous can be difficult to see. More importantly, society has not yet agreed upon necessary rules and standards for transparency, risk, and accountability for non-military uses of AI, much less for military uses.
Companies, and the individuals who work inside them, should be extremely cautious about working with any military agency where the application involves potential harm to humans or could contribute to arms races or geopolitical instability. Those risks are substantial and difficult to predict, let alone mitigate.
If a company nevertheless is determined to use its AI expertise to aid some nation’s military, it must start by recognizing that there are no settled public standards for safety and ethics in this sector yet. It cannot just assume that the contracting military agency has fully assessed the risks or that it doesn’t have a responsibility to do so independently.
At a minimum, any company, or any worker, considering whether to work with the military on a project with potentially dangerous or risky AI applications should be asking:
- Is it possible to create strong and binding international institutions or agreements that define acceptable military uses and limitations in the use of AI? While this is not an easy task, the current lack of such structures is troubling. There are serious and potentially destabilizing impacts from deploying AI in any military setting not clearly governed by settled rules of war. The use of AI in potential target identification processes is one clear category of uses that must be governed by law.
- Is there a robust process for studying and mitigating the safety and geopolitical stability problems that could result from the deployment of military AI? Does this process apply before work commences, along the development pathway and after deployment? Could it incorporate the sufficient expertise to address subtle and complex technical problems? And would those leading the process have sufficient independence and authority to ensure that it can check companies’ and military agencies’ decisions?
- Are the contracting agencies willing to commit to not using AI for autonomous offensive weapons? Or to ensuring that any defensive autonomous systems are carefully engineered to avoid risks of accidental harm or conflict escalation? Are present testing and formal verification methods adequate for that task?
- Can there be transparent, accountable oversight from an independently constituted ethics board or similar entity with both the power to veto aspects of the program and the power to bring public transparency to issues where necessary or appropriate? For example, while Alphabet’s AI-focused subsidiary DeepMind has committed to independent ethics review, we are not aware of similar commitments from Google itself. Given this letter, we are concerned that the internal transparency, review, and discussion of Project Maven inside Google was inadequate. Any project review process must be transparent, informed, and independent. While it remains difficult to ensure that that is the case, without such independent oversight, a project runs real risk of harm.
These are just starting points. Other specific questions will surely need answering, both for future proposals and even this one, since many details of the Project Maven collaboration are not public. Nevertheless, even with the limited information available, EFF is deeply worried that Google’s collaboration with the Department of Defense does not have these kinds of safeguards. It certainly does not have them in a public, transparent, or accountable way.
The use of AI in weapons systems is a crucially important topic and one that deserves an international public discussion and likely some international agreements to ensure global safety. Companies like Google, as well as their counterparts around the world, must consider the consequences and demand real accountability and standards of behavior from the military agencies that seek their expertise—and from themselves.
Share this:
Related
April 6, 2018 - Posted by aletho | Militarism, Timeless or most popular, War Crimes | Google, United States
No comments yet.
This site uses Akismet to reduce spam. Learn how your comment data is processed.
Featured Video
Utah Mom Sues ASTRAZENECA In Major COVID Vaccine Injury Lawsuit
or go to
Aletho News Archives – Video-Images
From the Archives
Why vaccines for children are Big Pharma’s holy grail – Part 1
By Serena Wylde | TCW Defending Freedom | October 18, 2023
James A Shannon, director of the US National Institutes of Health 1955-68, said: ‘No vaccination can be proven safe before it is given to children.’
When he made that statement, it was still possible in the US to sue vaccine manufacturers under tort law for vaccine-induced deaths and injuries, which is no longer the case.
Today the US has the world’s most aggressive vaccine schedule and ranks as the sickest country, with the highest infant mortality, in the developed world. The UK does not lag far behind.
Vaccines carry three separate areas of potential risk. Firstly, they artificially stimulate the immune system to produce antibodies, which temporarily inhibits another part of the body’s defence mechanism. In an infant, whose immune system is just developing, this high demand of energy can in some cases overwhelm its metabolic reserves, and cause brain inflammation. The brain is the highest energy-consuming tissue in the body, followed by the gastro-intestinal tract and the immune system.
Secondly, vaccines contain chemicals, metals and drugs. Thirdly, according to the former pharmaceutical R&D executive Sasha Latypova, traditional vaccines are consistently contaminated with plant and animal proteins which hyper-sensitise the body, especially in children, giving rise to allergies.
In the US in the 1970s there were three inoculations recommended for children… continue
Blog Roll
-
Join 2,755 other subscribers
Visits Since December 2009
- 6,739,129 hits
Looking for something?
Archives
Calendar
Categories
Aletho News Civil Liberties Corruption Deception Economics Environmentalism Ethnic Cleansing, Racism, Zionism Fake News False Flag Terrorism Full Spectrum Dominance Illegal Occupation Mainstream Media, Warmongering Malthusian Ideology, Phony Scarcity Militarism Progressive Hypocrite Russophobia Science and Pseudo-Science Solidarity and Activism Subjugation - Torture Supremacism, Social Darwinism Timeless or most popular Video War Crimes Wars for IsraelTags
9/11 Afghanistan Africa al-Qaeda Australia BBC Benjamin Netanyahu Brazil Canada CDC Central Intelligence Agency China CIA CNN Colombia Covid-19 COVID-19 Vaccine Da’esh Donald Trump Egypt European Union Facebook FBI FDA France Gaza Germany Google Hamas Hebron Hezbollah Hillary Clinton Human rights India Iran Iraq ISIS Israel Israeli settlement Japan Jerusalem Joe Biden Korea Latin America Lebanon Libya Middle East National Security Agency NATO New York Times North Korea NSA Obama Pakistan Palestine Qatar Russia Sanctions against Iran Saudi Arabia Syria The Guardian Turkey Twitter UAE UK Ukraine United Nations United States USA Venezuela Washington Post West Bank WHO Yemen ZionismRecent Comments
roberthstiver on Israeli officials’ jaws… papasha408 on Georgian President Vetoes Fore… poisonedwater on Washington is essentially defy… poisonedwater on Houthis Take Down Another US R… poisonedwater on Israeli officials’ jaws… Dennis Wilson on Labor strike in 10 California… roberthstiver on US university president placed… roberthstiver on Israeli officials’ jaws… 5 dancing shlomos on US: Ilan Pappe interrogated by… Tollef Ås/秋涛乐/טלפ וש on UK media outlet accused of ‘ju… Dennis Wilson on EU Big Brother is Watching New… roberthstiver on US: Ilan Pappe interrogated by…
Aletho News
- Zionists cry wolf endlessly
- HOW DTAP VACCINE SPREADS WHOOPING COUGH
- Fatal Post COVID-19 mRNA-Vaccine Associated Cerebral Ischemia
- Brussels should remember that Europeans are sovereign, not the EU treaties or the Eurocrats
- Georgian President Vetoes Foreign Agents Bill
- Moscow responds to latest EU ban on Russian media
- West ‘playing with fire’ – Moscow
- Labor strike in 10 California universities demands the right to protest for Palestine
- Over 600 mosques destroyed in Israeli onslaught on Gaza since Oct. 7
- ASTRAZENECA FALLOUT AMIDST VACCINE WITHDRAWAL
If Americans Knew
- Israeli lawyers at Int’l Court of Justice out of touch with reality – Day 224
- The Israel-Affiliated Organization Leading the Backlash Against Student Protests
- The writing was on the wall for Israel’s torture of prisoners
- Not even the US government knows the US government line on Rafah
- Israeli anti-Zionist academic Ilan Pappe interrogated by FBI in Detroit
- Jewish billionaires secretly worked to shape U.S. public opinion on Israel’s war against Gaza
- As it defends its planned genocidal Rafah invasion before ICJ, Israel vows to “intensify” raids – Day 223
- New report shows Biden is going to extraordinary lengths to continue arming Israel
- Palestinians rally at historic villages in northern Israel
- Blinken Says Israeli Units Accused of Serious Violations Have Done Enough to Avoid Sanctions. Experts and Insiders Disagree.
Richie Allen
- The Richie Allen Show Returns Tomorrow Wednesday April 24th
- Call Richie Today Monday March 11th From 4.30pm
- Connect To The Richie Allen Show WhatsApp Today
- NHS Asks Patients To Choose From 12 Genders, 10 sexual Preferences & 159 Religions
- The Richie Allen Show Moves To A New Time Slot From Monday Nov 20th
- Starmer Will Sack Shadow Ministers Who Vote For Gaza Ceasefire
- AI Tool Can Predict Heart Attacks Years In Advance
- Nepal Bans TikTok To Preserve Social Harmony
- Bloke Appointed Boss Of Womb Health Charity
- WHO – “Gaza’s Biggest Hospital Becoming A Cemetery”
No Tricks Zone
- Data Reveal That US Heat Wave Index, Japan Drought Coincide With Solar Activity
- New Study Finds An Extremely Low CO2 Climate Sensitivity For The Arctic And Antarctic
- U.N. Contributing Scientist: ‘Culling’ Human Population Could Avert Climate Catastrophe
- Using Nets On The Seafloor To Retrieve Seafood ‘Roughly The Same As Running 100 Coal-Fired Plants’
- New Paper: Global Warming Leading To HIMALAYAN COOLING, Preventing Glacial Melt!
- DNA Evidence Reveals Domestic Cats, Dogs, African Wildcats, Frogs Lived In The Arctic 9000 Years Ago
- -80°C: Antarctic Vostok Station Records “Extreme Winter Cold”…Not Even Winter Yet!
- The German E-Vehicle Nightmare, 2024 Q1 Sales Plummet 14%… “Graveyard” For Unsold Cars
- Newly Discovered 90,000-Year-Old Human Footprints Reveal How Much Higher Sea Levels Used To Be
- Germany’s Economic Bloodbath Worsens As Green Revolution Causes Economy To Bleed To Death
More Links
Contact:
atheonews (at) gmail.com
Disclaimer
This site is provided as a research and reference tool. Although we make every reasonable effort to ensure that the information and data provided at this site are useful, accurate, and current, we cannot guarantee that the information and data provided here will be error-free. By using this site, you assume all responsibility for and risk arising from your use of and reliance upon the contents of this site.
This site and the information available through it do not, and are not intended to constitute legal advice. Should you require legal advice, you should consult your own attorney.
Nothing within this site or linked to by this site constitutes investment advice or medical advice.
Materials accessible from or added to this site by third parties, such as comments posted, are strictly the responsibility of the third party who added such materials or made them accessible and we neither endorse nor undertake to control, monitor, edit or assume responsibility for any such third-party material.
The posting of stories, commentaries, reports, documents and links (embedded or otherwise) on this site does not in any way, shape or form, implied or otherwise, necessarily express or suggest endorsement or support of any of such posted material or parts therein.
The word “alleged” is deemed to occur before the word “fraud.” Since the rule of law still applies. To peasants, at least.
Fair Use
This site contains copyrighted material the use of which has not always been specifically authorized by the copyright owner. We are making such material available in our efforts to advance understanding of environmental, political, human rights, economic, democracy, scientific, and social justice issues, etc. We believe this constitutes a ‘fair use’ of any such copyrighted material as provided for in section 107 of the US Copyright Law. In accordance with Title 17 U.S.C. Section 107, the material on this site is distributed without profit to those who have expressed a prior interest in receiving the included information for research and educational purposes. For more info go to: http://www.law.cornell.edu/uscode/17/107.shtml. If you wish to use copyrighted material from this site for purposes of your own that go beyond ‘fair use’, you must obtain permission from the copyright owner.
DMCA Contact
This is information for anyone that wishes to challenge our “fair use” of copyrighted material.
If you are a legal copyright holder or a designated agent for such and you believe that content residing on or accessible through our website infringes a copyright and falls outside the boundaries of “Fair Use”, please send a notice of infringement by contacting atheonews@gmail.com.
We will respond and take necessary action immediately.
If notice is given of an alleged copyright violation we will act expeditiously to remove or disable access to the material(s) in question.
All 3rd party material posted on this website is copyright the respective owners / authors. Aletho News makes no claim of copyright on such material.
Leave a comment