Ethics of artificial intelligence
Encyclopedia
The ethics of artificial intelligence is the part of the ethics of technology
Ethics of technology
Ethics in technology is a subfield of ethics addressing the ethical questions specific to the Technology Age. Some prominent works of philosopher Hans Jonas are devoted to ethics of technology. It is often held that technology itself is incapable of possessing moral or ethical qualities, since...

 specific to robot
Robot
A robot is a mechanical or virtual intelligent agent that can perform tasks automatically or with guidance, typically by remote control. In practice a robot is usually an electro-mechanical machine that is guided by computer and electronic programming. Robots can be autonomous, semi-autonomous or...

s and other artificially intelligent
Artificial intelligence
Artificial intelligence is the intelligence of machines and the branch of computer science that aims to create it. AI textbooks define the field as "the study and design of intelligent agents" where an intelligent agent is a system that perceives its environment and takes actions that maximize its...

 beings. It is typically divided into roboethics, a concern with the moral behavior of humans as they design, construct, use and treat artificially intelligent beings, and machine ethics, concern with the moral behavior of artificial moral agents (AMAs).

Roboethics

The term "roboethics" was coined by roboticist Gianmarco Veruggio in 2002, referring to the morality of how humans design, construct, use and treat robots and other artificially intelligent beings. It considers both how artificially intelligent beings may be used to harm humans and how they may be used to benefit humans.

Robot rights

Robot rights are the moral obligations of society towards its machines, similar to human rights
Human rights
Human rights are "commonly understood as inalienable fundamental rights to which a person is inherently entitled simply because she or he is a human being." Human rights are thus conceived as universal and egalitarian . These rights may exist as natural rights or as legal rights, in both national...

 or animal rights
Animal rights
Animal rights, also known as animal liberation, is the idea that the most basic interests of non-human animals should be afforded the same consideration as the similar interests of human beings...

. These may include the right to life and liberty, freedom of thought and expression and equality before the law.
The issue has been considered by the Institute for the Future
Institute for the Future
The Institute for the Future is a Palo Alto, California–based think tank established in 1968, as a spin-off from the RAND Corporation, to help organizations plan for the long-term future....


and by the U.K.
United Kingdom
The United Kingdom of Great Britain and Northern IrelandIn the United Kingdom and Dependencies, other languages have been officially recognised as legitimate autochthonous languages under the European Charter for Regional or Minority Languages...

 Department of Trade and Industry.

A key issue is sentience
Sentience
Sentience is the ability to feel, perceive or be conscious, or to have subjective experiences. Eighteenth century philosophers used the concept to distinguish the ability to think from the ability to feel . In modern western philosophy, sentience is the ability to have sensations or experiences...

, or the ability to feel pleasure and pain. For advocates of animal rights
Animal rights
Animal rights, also known as animal liberation, is the idea that the most basic interests of non-human animals should be afforded the same consideration as the similar interests of human beings...

, sentience is the distinguishing feature that forces society to honor the rights of animals. Using an argument analogous to the one used by animal rights advocates, a computer program or robot that is able to feel pleasure and pain has rights. However, there is no universally accepted definition of sentience (or related aspects such as consciousness
Consciousness
Consciousness is a term that refers to the relationship between the mind and the world with which it interacts. It has been defined as: subjectivity, awareness, the ability to experience or to feel, wakefulness, having a sense of selfhood, and the executive control system of the mind...

) for machines.

Experts disagree whether specific and detailed laws will be required soon or safely in the distant future. Glenn McGee reports that sufficiently humanoid robots may appear by 2020.
Ray Kurzweil sets the date at 2029.
However, most scientists suppose that at least 50 years may have to pass before any sufficiently advanced system exists.

The rules for the 2003 Loebner Prize
Loebner prize
The Loebner Prize is an annual competition in artificial intelligence that awards prizes to the chatterbot considered by the judges to be the most human-like. The format of the competition is that of a standard Turing test. In each round, a human judge simultaneously holds textual conversations...

 competition explicitly addressed the question of robot rights:
61. If, in any given year, a publicly available open source Entry entered by the University of Surrey or the Cambridge Center wins the Silver Medal or the Gold Medal, then the Medal and the Cash Award will be awarded to the body responsible the development of that Entry. If no such body can be identified, or if there is disagreement among two or more claimants, the Medal and the Cash Award will be held in trust until such time as the Entry may legally possess, either in the United States of America or in the venue of the contest, the Cash Award and Gold Medal in its own right.

The threat to privacy

Aleksandr Solzhenitsyn
Aleksandr Solzhenitsyn
Aleksandr Isayevich Solzhenitsyn was aRussian and Soviet novelist, dramatist, and historian. Through his often-suppressed writings, he helped to raise global awareness of the Gulag, the Soviet Union's forced labor camp system – particularly in The Gulag Archipelago and One Day in the Life of...

's The First Circle
The First Circle
In the First Circle is a novel by Aleksandr Solzhenitsyn released in 1968. A fuller version of the book was published in English in 2009....

describes the use of speech recognition
Speech recognition
Speech recognition converts spoken words to text. The term "voice recognition" is sometimes used to refer to recognition systems that must be trained to a particular speaker—as is the case for most desktop recognition software...

 technology in the service of tyranny. If an AI program exists that can understand speech and natural language
Natural language processing
Natural language processing is a field of computer science and linguistics concerned with the interactions between computers and human languages; it began as a branch of artificial intelligence....

s (e.g. English
English language
English is a West Germanic language that arose in the Anglo-Saxon kingdoms of England and spread into what was to become south-east Scotland under the influence of the Anglian medieval kingdom of Northumbria...

), then, with adequate processing power it could theoretically listen to every phone conversation and read every email in the world, understand them and report back to the program's operators exactly what is said and exactly who is saying it. An AI program like this could allow governments or other entities to efficiently suppress dissent and attack their enemies.

The threat to human dignity

Joseph Weizenbaum
Joseph Weizenbaum
Joseph Weizenbaum was a German-American author and professor emeritus of computer science at MIT.-Life and career:...

 argued in 1976 that AI technology should not be used to replace people in positions that require respect and care, such as:
  • A customer service representative, (AI technology is already used today for telephone-based interactive voice response
    Interactive voice response
    Interactive voice response is a technology that allows a computer to interact with humans through the use of voice and DTMF keypad inputs....

     systems)
  • A therapist, (as was seriously proposed by Kenneth Colby
    Kenneth Colby
    Kenneth Mark Colby, M.D. was an American psychiatrist dedicated to the theory and application of computer science and artificial intelligence to psychiatry. Colby was a pioneer in the development of computer technology as a tool to try to understand cognitive functions and to assist both patients...

     in the 1970s)
  • A nursemaid for the elderly, (as was reported by Pamela McCorduck
    Pamela McCorduck
    Pamela McCorduck is the author of a number of books concerning the history and philosophical significance of artificial intelligence, the future of engineering and the role of women and technology. She is also the author of three novels. She is a contributor to Omni, New York Times, Daedalus, the...

     in her book The Fifth Generation)
  • A judge, or
  • A police officer.

Weizenbaum explains that we require authentic feelings of empathy from people in these positions. If machines replace them, we will find ourselves alienated, devalued and frustrated. Artificial intelligence, if used in this way, represents a threat to human dignity. Weizenbaum argues that fact that we are entertaining the possibility of machines in these positions suggests that we have experienced an "atrophy of the human spirit that comes from thinking of ourselves as computers."

Pamela McCorduck
Pamela McCorduck
Pamela McCorduck is the author of a number of books concerning the history and philosophical significance of artificial intelligence, the future of engineering and the role of women and technology. She is also the author of three novels. She is a contributor to Omni, New York Times, Daedalus, the...

 counters that, speaking for women and minorities "I'd rather take my chances with an impartial computer," pointing out that there are conditions where we would prefer to have automated judges and police that have no personal agenda at all. AI founder John McCarthy
John McCarthy (computer scientist)
John McCarthy was an American computer scientist and cognitive scientist. He coined the term "artificial intelligence" , invented the Lisp programming language and was highly influential in the early development of AI.McCarthy also influenced other areas of computing such as time sharing systems...

 objects to the moralizing tone of Weizenbaum's critique. "When moralizing is both vehement and vague, it invites authoritarian abuse," he writes.

Machine ethics

Machine ethics (or machine morality) is the field of research concerned with designing Artificial Moral Agents (AMAs), robots or artificially intelligent computers that behave morally or as though moral.

Isaac Asimov
Isaac Asimov
Isaac Asimov was an American author and professor of biochemistry at Boston University, best known for his works of science fiction and for his popular science books. Asimov was one of the most prolific writers of all time, having written or edited more than 500 books and an estimated 90,000...

 considered the issue in the 1950s in his I, Robot
I, Robot
I, Robot is a collection of nine science fiction short stories by Isaac Asimov, first published by Gnome Press in 1950 in an edition of 5,000 copies. The stories originally appeared in the American magazines Super Science Stories and Astounding Science Fiction between 1940 and 1950. The stories are...

. At the insistence of his editor John W. Campbell Jr., he proposed the Three Laws of Robotics
Three Laws of Robotics
The Three Laws of Robotics are a set of rules devised by the science fiction author Isaac Asimov and later added to. The rules are introduced in his 1942 short story "Runaround", although they were foreshadowed in a few earlier stories...

 to govern artificially intelligent systems. Much of his work was then spent testing the boundaries of his three laws to see where they would break down, or where they would create paradoxical or unanticipated behavior. His work suggests that no set of fixed laws can sufficiently anticipate all possible circumstances.

In 2009, during an experiment at the Laboratory of Intelligent Systems in the Ecole Polytechnique Fédérale of Lausanne
Lausanne
Lausanne is a city in Romandy, the French-speaking part of Switzerland, and is the capital of the canton of Vaud. The seat of the district of Lausanne, the city is situated on the shores of Lake Geneva . It faces the French town of Évian-les-Bains, with the Jura mountains to its north-west...

 in Switzerland
Switzerland
Switzerland name of one of the Swiss cantons. ; ; ; or ), in its full name the Swiss Confederation , is a federal republic consisting of 26 cantons, with Bern as the seat of the federal authorities. The country is situated in Western Europe,Or Central Europe depending on the definition....

, robots that were programmed to cooperate with each other in searching out a beneficial resource and avoiding a poisonous one eventually learned to lie to each other in an attempt to hoard the beneficial resource. One problem in this case may have been that the goals were "terminal" (i.e. in contrast, ultimate human motives typically have a quality of requiring never-ending learning).

Some experts and academics have questioned the use of robots for military combat, especially when such robots are given some degree of autonomous functions. The US Navy has funded a report which indicates that as military robots become more complex, there should be greater attention to implications of their ability to make autonomous decisions. The President of the Association for the Advancement of Artificial Intelligence
Association for the Advancement of Artificial Intelligence
The Association for the Advancement of Artificial Intelligence or AAAI is an international, nonprofit, scientific society devoted to advancing the scientific understanding of the mechanisms underlying thought and intelligent behavior and their embodiment in machines...

 has commissioned a study to look at this issue. They point to programs like the Language Acquisition Device
Language Acquisition Device (computer)
The Language Acquisition Device is a computer program developed by Lobal Technologies, a computer company in the United Kingdom, and scientists from King's College. It emulates the functions of the brain's frontal lobes where humans process language and emotion....

 which can emulate human interaction.

Vernor Vinge has suggested that a moment may come when some computers are smarter than humans. He calls this "the Singularity
Technological singularity
Technological singularity refers to the hypothetical future emergence of greater-than-human intelligence through technological means. Since the capabilities of such an intelligence would be difficult for an unaided human mind to comprehend, the occurrence of a technological singularity is seen as...

." He suggests that it may be somewhat or possibly very dangerous for humans. This is discussed by a philosophy called Singularitarianism
Singularitarianism
Singularitarianism is a technocentric ideology and social movement defined by the belief that a technological singularity—the creation of a superintelligence—will likely happen in the medium future, and that deliberate action ought to be taken to ensure that the Singularity benefits...

. The Singularity Institute for Artificial Intelligence has suggested a need to build "Friendly AI", meaning that the advances which are already occurring with AI should also include an effort to make AI intrinsically friendly and humane.

In 2009, academics and technical experts attended a conference to discuss the potential impact of robots and computers and the impact of the hypothetical possibility that they could become self-sufficient and able to make their own decisions. They discussed the possibility and the extent to which computers and robots might be able to acquire any level of autonomy, and to what degree they could use such abilities to possibly pose any threat or hazard. They noted that some machines have acquired various forms of semi-autonomy, including being able to find power sources on their own and being able to independently choose targets to attack with weapons. They also noted that some computer viruses can evade elimination and have achieved "cockroach intelligence." They noted that self-awareness as depicted in science-fiction is probably unlikely, but that there were other potential hazards and pitfalls.

In Moral Machines: Teaching Robots Right from Wrong, Wendell Wallach and Colin Allen conclude that attempts to teach robots right from wrong will likely advance understanding of human ethics by motivating humans to address gaps in modern normative theory
Normative ethics
Normative ethics is the study of ethical action. It is the branch of philosophical ethics that investigates the set of questions that arise when considering how one ought to act, morally speaking...

 and by providing a platform for experimental investigation. As one example, it has introduced normative ethicists to the controversial issue of which specific learning algorithms to use in machines. Nick Bostrom
Nick Bostrom
Nick Bostrom is a Swedish philosopher at the University of Oxford known for his work on existential risk and the anthropic principle. He holds a PhD from the London School of Economics...

 and Eliezer Yudkowsky
Eliezer Yudkowsky
Eliezer Shlomo Yudkowsky is an American artificial intelligence researcher concerned with the singularity and an advocate of friendly artificial intelligence, living in Redwood City, California.- Biography :...

 have argued for decision trees (such as ID3
ID3 algorithm
In decision tree learning, ID3 is an algorithm used to generate a decision tree invented by Ross Quinlan. ID3 is the precursor to the C4.5 algorithm.-Algorithm:The ID3 algorithm can be summarized as follows:...

) over neural networks
Artificial neural network
An artificial neural network , usually called neural network , is a mathematical model or computational model that is inspired by the structure and/or functional aspects of biological neural networks. A neural network consists of an interconnected group of artificial neurons, and it processes...

 and genetic algorithms
Genetic algorithm
A genetic algorithm is a search heuristic that mimics the process of natural evolution. This heuristic is routinely used to generate useful solutions to optimization and search problems...

 on the grounds that decision trees obey modern social norms of transparency and predictability (e.g. stare decisis
Stare decisis
Stare decisis is a legal principle by which judges are obliged to respect the precedents established by prior decisions...

), while Chris Santos-Lang argued in the opposite direction on the grounds that the norms of any age must be allowed to change and that natural failure to fully satisfy these particular norms has been essential in making humans less vulnerable to criminal "hackers".

Unintended consequences

Several critics have argued that AI technology has the potential to disrupt existing society and introduce new dangers and malaise.
Nick Bostrom, Teacher and Philosopher at Oxford University, published a paper "Existential Risks" In the Journal of Evolution and Technology. Mr. Bostrom stated that Artificial Intelligence has the capability to bring about human extinction, which is of course not what society intends for Artificial Intelligence to do.

Ethics of artificial intelligence in fiction

The movie The Thirteenth Floor
The Thirteenth Floor
The Thirteenth Floor is a 1999 science fiction film directed by Josef Rusnak and loosely based upon Simulacron-3 , a novel by Daniel F. Galouye...

 suggests a future where simulated worlds with sentient inhabitants are created by computer game consoles for the purpose of entertainment. The movie The Matrix
The Matrix
The Matrix is a 1999 science fiction-action film written and directed by Larry and Andy Wachowski, starring Keanu Reeves, Laurence Fishburne, Carrie-Anne Moss, Joe Pantoliano, and Hugo Weaving...

 suggests a future where the dominant species on planet Earth are sentient machines and humanity is treated with utmost Speciesism
Speciesism
Speciesism is the assigning of different values or rights to beings on the basis of their species membership. The term was created by British psychologist Richard D...

. The short story The Planck Dive
Luminous (story collection)
Luminous is a collection of short science fiction stories by Greg Egan.Luminous contains the following short stories.*Chaff — An agent is sent to kill a geneticist who is working in a druglord-controlled stronghold in the jungles of Colombia, and working on important brain-altering...

 suggest a future where humanity has turned itself into software that can be duplicated and optimized and the relevant distinction between types of software is sentient and non-sentient. The same idea can be found in the Emergency Medical Hologram of Starship Voyager, which is an apparently sentient copy of a reduced subset of the consciousness of its creator, Dr. Zimmerman, who, for the best motives, has created the system to give medical assistance in case of emergencies. The movies Bicentennial Man and A.I.
A.I. (film)
A.I. Artificial Intelligence, also known as A.I., is a 2001 science fiction drama film directed, produced and co-written by Steven Spielberg. Based on Brian Aldiss' short story "Super-Toys Last All Summer Long", the film stars Haley Joel Osment, Frances O'Connor, Jude Law, Sam Robards, Jake Thomas...

 deal with the possibility of sentient robots that could love. I, Robot
I, Robot (film)
I, Robot is a 2004 science-fiction action film directed by Alex Proyas. The screenplay was written by Jeff Vintar, Akiva Goldsman and Hillary Seitz, and is very loosely based on Isaac Asimov's short-story collection of the same name. Will Smith stars in the lead role of the film as Detective Del...

 explored some aspects of Asimov's three laws. All these scenarios try to foresee possibly unethical consequences of the creation of sentient computers.

Over time, debates have tended to focus less and less on possibility and more on desirability, as emphasized in the "Cosmist" and "Terran" debates initiated by Hugo de Garis
Hugo de Garis
Hugo de Garis is a researcher in the sub-field of artificial intelligence known as evolvable hardware. He became known in the 1990s for his research on the use of genetic algorithms to evolve neural networks using three dimensional cellular automata inside field programmable gate arrays...

 and Kevin Warwick
Kevin Warwick
Kevin Warwick is a British scientist and professor of cybernetics at the University of Reading, Reading, Berkshire, United Kingdom...

. A Cosmist, according to Hugo de Garis, is actually seeking to build more intelligent successors to the human species.

See also

  • Friendly artificial intelligence
    Friendly artificial intelligence
    A Friendly Artificial Intelligence or FAI is an artificial intelligence that has a positive rather than negative effect on humanity. Friendly AI also refers to the field of knowledge required to build such an AI...

  • Animal rights
    Animal rights
    Animal rights, also known as animal liberation, is the idea that the most basic interests of non-human animals should be afforded the same consideration as the similar interests of human beings...


External links

The source of this article is wikipedia, the free encyclopedia.  The text of this article is licensed under the GFDL.
 
x
OK