Toronto Declaration

Last updated

The Toronto Declaration: Protecting the Rights to Equality and Non-Discrimination in Machine Learning Systems is a declaration that advocates responsible practices for machine learning practitioners and governing bodies. It is a joint statement issued by groups including Amnesty International and Access Now, with other notable signatories including Human Rights Watch and The Wikimedia Foundation. [1] It was published at RightsCon on May 16, 2018. [2] [3]

Contents

The Declaration focuses on concerns of algorithmic bias and the potential for discrimination that arises from the use of machine learning and artificial intelligence in applications that may affect people's lives, "from policing, to welfare systems, to healthcare provision, to platforms for online discourse." [4] A secondary concern of the document is the potential for violations of information privacy.

The goal of the Declaration is to outline "tangible and actionable standards for states and the private sector." [5] The Declaration calls for tangible solutions, such as reparations for the victims of algorithmic discrimination. [6]

Contents

The Toronto Declaration consists of 59 articles, broken into six sections, concerning international human rights law, duties of states, responsibilities of private sector actors, and the right to an effective remedy.

Preamble

The document begins by asking the question, "In a world of machine learning systems, who will bear accountability for harming human rights?" [4] It argues that all practitioners, whether in the public or private sector, should be aware of the risks to human rights and approach their work with human rights in mind – conscious of the existing international laws, standards, and principles. The document defines human rights to include "the right to privacy and data protection, the right to freedom of expression and association, to participation in cultural life, equality before the law, and access to effective remedy"; [4] but it states that the Declaration is most concerned with equality and non-discrimination.

Using the framework of international human rights law

The framework of international human rights law enumerates various rights, provides mechanisms to hold violators to account, and ensures remedy for the violated. The document cites the United Nations Human Rights Committee's definition of discrimination as "any distinction, exclusion, restriction or preference which is based on any ground [including but not limited to] race, colour, sex, language, religion, political or other opinion, national or social origin, property, birth or other status, and which has the purpose or effect of nullifying or impairing the recognition, enjoyment or exercise by all persons, on an equal footing, of all rights and freedoms." [7]

Governments should proactively create binding measures, and private entities should create internal policies, to protect against discrimination. Measures may include protections for sensitive data, especially for vulnerable populations. Systems should be designed in collaboration with a diverse community in order to prevent discrimination in design.

Duties of states: human rights obligations

Governments today are deploying machine learning systems, often in collaboration with private entities. Even when development is contracted to such third parties, governments retain their obligation to protect human rights. Before implementation, and on an ongoing basis thereafter, they should identify risks and conduct regular audits, then take all necessary measures to mitigate these risks. They should be transparent about how machine learning is implemented and used, avoiding black box systems whose logic cannot be easily explained. Systems should be subject to strict oversight from diverse internal committees and independent judicial authorities.

Governments must also protect citizens from discrimination by private entities. In addition to oversight, they should pass binding laws against discrimination, as well as for data protection and privacy, and they should provide effective means to remedy for affected individuals. It is important for national and regional governments to expand on and contextualize international law.

Responsibilities of private sector actors: human rights due diligence

Private entities are responsible for conducting "human rights due diligence." Just like governments, private entities should identify risks before development by considering common risks and consulting stakeholders, "including affected groups, organizations that work on human rights, equality and discrimination, as well as independent human rights and machine learning experts." [4] They should design systems that mitigate risks, subject systems to regular audits, and forego projects that carry too high of risks. They should be transparent about assumed risks, including details of the technical implementation where necessary, and should provide a mechanism for affected individuals to dispute any decisions that affect them.

The right to an effective remedy

"The right to justice is a vital element of international human rights law." [4] Private entities should create processes for affected individuals to seek remedy, and they should designate roles for who will oversee these processes. Governments must be especially cautious when deploying machine learning systems in the justice sector. Transparency, accountability, and remedy can help.

Related Research Articles

Civil and political rights are a class of rights that protect individuals' freedom from infringement by governments, social organizations, and private individuals. They ensure one's entitlement to participate in the civil and political life of society and the state.

Civil liberties are guarantees and freedoms that governments commit not to abridge, either by constitution, legislation, or judicial interpretation, without due process. Though the scope of the term differs between countries, civil liberties may include the freedom of conscience, freedom of press, freedom of religion, freedom of expression, freedom of assembly, the right to security and liberty, freedom of speech, the right to privacy, the right to equal treatment under the law and due process, the right to a fair trial, and the right to life. Other civil liberties include the right to own property, the right to defend oneself, and the right to bodily integrity. Within the distinctions between civil liberties and other types of liberty, distinctions exist between positive liberty/positive rights and negative liberty/negative rights.

Rights are legal, social, or ethical principles of freedom or entitlement; that is, rights are the fundamental normative rules about what is allowed of people or owed to people according to some legal system, social convention, or ethical theory. Rights are of essential importance in such disciplines as law and ethics, especially theories of justice and deontology.

<i>Canadian Charter of Rights and Freedoms</i> 1982 Canadian constitutional legislation

The Canadian Charter of Rights and Freedoms, often simply referred to as the Charter in Canada, is a bill of rights entrenched in the Constitution of Canada, forming the first part of the Constitution Act, 1982. The Charter guarantees certain political rights to Canadian citizens and civil rights of everyone in Canada from the policies and actions of all governments in Canada. It is designed to unify Canadians around a set of principles that embody those rights. The Charter was proclaimed in force by Queen Elizabeth II of Canada on April 17, 1982, as part of the Constitution Act, 1982.

The right to privacy is an element of various legal traditions that intends to restrain governmental and private actions that threaten the privacy of individuals. Over 185 national constitutions mention the right to privacy. On December 10, 1948, the United Nations General Assembly adopted the Universal Declaration of Human Rights (UDHR), originally written to guarantee individual rights of everyone everywhere; while the right to privacy does not appear in the document, many interpret this through Article 12, which states: "No one shall be subjected to arbitrary interference with their privacy, family, home or correspondence, nor to attacks upon his honor and reputation. Everyone has the right to the protection of the law against such interference or attacks."

The Charter of Human Rights and Freedoms, also known as the "Quebec Charter", is a statutory bill of rights and human rights code passed by the National Assembly of Quebec on June 27, 1975. It received Royal Assent from Lieutenant Governor Hugues Lapointe, coming into effect on June 28, 1976. Introduced by the Liberal government of Robert Bourassa, the Charter followed extensive preparatory work that began under the Union Nationale government of Daniel Johnson.

<span class="mw-page-title-main">Freedom of information</span> Freedom of a person or people to publish and consume information

Freedom of information is freedom of a person or people to publish and consume information. Access to information is the ability for an individual to seek, receive and impart information effectively. This sometimes includes "scientific, indigenous, and traditional knowledge; freedom of information, building of open knowledge resources, including open Internet and open standards, and open access and availability of data; preservation of digital heritage; respect for cultural and linguistic diversity, such as fostering access to local content in accessible languages; quality education for all, including lifelong and e-learning; diffusion of new media and information literacy and skills, and social inclusion online, including addressing inequalities based on skills, education, gender, age, race, ethnicity, and accessibility by those with disabilities; and the development of connectivity and affordable ICTs, including mobile, the Internet, and broadband infrastructures".

The Vienna Declaration and Programme of Action (VDPA) is a human rights declaration adopted by consensus at the World Conference on Human Rights on 25 June 1993 in Vienna, Austria. The position of United Nations High Commissioner for Human Rights was recommended by this Declaration and subsequently created by General Assembly Resolution 48/141.

The Cairo Declaration on Human Rights in Islam (CDHRI) is a declaration of the member states of the Organisation of Islamic Cooperation (OIC) first adopted in Cairo, Egypt, on 5 August 1990,, and later revised in 2020 and adopted on 28 November 2020. It provides an overview on the Islamic perspective on human rights. The 1990 version affirms Islamic sharia as its sole source, whereas the 2020 version doesn't specifically invoke sharia. The focus of this article is the 1990 version of the CDHRI.

<span class="mw-page-title-main">Human rights in Switzerland</span> Overview of the observance of human rights in Switzerland

Human rights are largely respected in Switzerland, one of Europe's oldest democracies. Switzerland is often at or near the top in international rankings of civil liberties and political rights observance. Switzerland places human rights at the core of the nation's value system, as represented in its Federal Constitution. As described in its FDFA's Foreign Policy Strategy 2016-2019, the promotion of peace, mutual respect, equality and non-discrimination are central to the country's foreign relations.

<span class="mw-page-title-main">Right to education</span> Human right

The right to education has been recognized as a human right in a number of international conventions, including the International Covenant on Economic, Social and Cultural Rights which recognizes a right to free, primary education for all, an obligation to develop secondary education accessible to all with the progressive introduction of free secondary education, as well as an obligation to develop equitable access to higher education, ideally by the progressive introduction of free higher education. In 2021, 171 states were parties to the Covenant.

Privacy law is a set of regulations that govern the collection, storage, and utilization of personal information from healthcare, governments, companies, public or private entities, or individuals.

<i>Toonen v. Australia</i> Court case

Toonen v. Australia was a landmark human rights complaint brought before the United Nations Human Rights Committee (UNHRC) by Tasmanian resident Nicholas Toonen in 1994. The case resulted in the repeal of Australia's last sodomy laws when the Committee held that sexual orientation was included in the antidiscrimination provisions as a protected status under the International Covenant on Civil and Political Rights (ICCPR).

The Declaration of Human Duties and Responsibilities (DHDR) was written for reinforcing the implementation of human rights under the auspices of the UNESCO and the interest of the Office of the United Nations High Commissioner for Human Rights and was proclaimed in 1998 "to commemorate the 50th anniversary of the Universal Declaration of Human Rights (UDHR)" in the city of Valencia. Therefore, it is also known as the Valencia Declaration.

Bodily integrity is the inviolability of the physical body and emphasizes the importance of personal autonomy, self-ownership, and self-determination of human beings over their own bodies. In the field of human rights, violation of the bodily integrity of another is regarded as an unethical infringement, intrusive, and possibly criminal.

The Office of the Privacy Commissioner administers the Privacy Act 2020. The Privacy Commissioner is entrusted to protect personal information of New Zealanders in accordance with the Privacy Act. Current Privacy Commissioner, Michael Webster, began his role in July 2022.

In the regulation of algorithms, particularly artificial intelligence and its subfield of machine learning, a right to explanation is a right to be given an explanation for an output of the algorithm. Such rights primarily refer to individual rights to be given an explanation for decisions that significantly affect an individual, particularly legally or financially. For example, a person who applies for a loan and is denied may ask for an explanation, which could be "Credit bureau X reports that you declared bankruptcy last year; this is the main factor in considering you too likely to default, and thus we will not give you the loan you applied for."

<span class="mw-page-title-main">Algorithmic bias</span> Technological phenomenon with social implications

Algorithmic bias describes systematic and repeatable errors in a computer system that create "unfair" outcomes, such as "privileging" one category over another in ways different from the intended function of the algorithm.

Digital self-determination is a multidisciplinary concept derived from the legal concept of self-determination and applied to the digital sphere, to address the unique challenges to individual and collective agency and autonomy arising with increasing digitalization of many aspects of society and daily life.

Automated decision-making (ADM) involves the use of data, machines and algorithms to make decisions in a range of contexts, including public administration, business, health, education, law, employment, transport, media and entertainment, with varying degrees of human oversight or intervention. ADM involves large-scale data from a range of sources, such as databases, text, social media, sensors, images or speech, that is processed using various technologies including computer software, algorithms, machine learning, natural language processing, artificial intelligence, augmented intelligence and robotics. The increasing use of automated decision-making systems (ADMS) across a range of contexts presents many benefits and challenges to human society requiring consideration of the technical, legal, ethical, societal, educational, economic and health consequences.

References

  1. ↑ Brandom, Russell (2018-05-16). "New Toronto Declaration calls on algorithms to respect human rights". The Verge. Retrieved 2021-09-03.
  2. ↑ "The Toronto Declaration • Toronto Declaration". Toronto Declaration. Retrieved 2021-09-08.
  3. ↑ "BBC World Service - Digital Planet, The Toronto Declaration". BBC. Retrieved 2021-09-08.
  4. 1 2 3 4 5 "The Toronto Declaration: Protecting the right to equality and non-discrimination in machine learning systems". The Toronto Declaration. Amnesty International and Access Now. May 16, 2018. Archived from the original on August 12, 2021. Retrieved September 3, 2021.
  5. ↑ May 17; Burt, 2018 | Chris (2018-05-17). "Toronto Declaration calls for application of human rights frameworks to machine learning | Biometric Update". www.biometricupdate.com. Retrieved 2021-09-03.{{cite web}}: CS1 maint: numeric names: authors list (link)
  6. ↑ "The Toronto Declaration on Machine Learning calls for AI that protects human rights". Futurism. 16 May 2018. Retrieved 2021-09-03.
  7. ↑ General Comment No. 18: Non-discrimination. Geneva: United Nations Human Rights Committee. 1989.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.