Internet manipulation is the co-optation of online digital technologies, including algorithms, social bots, and automated scripts, for commercial, social, military, or political purposes. [1] Internet and social media manipulation are the prime vehicles for spreading disinformation due to the importance of digital platforms for media consumption and everyday communication. [2] When employed for political purposes, internet manipulation may be used to steer public opinion, [3] polarise citizens, [4] circulate conspiracy theories, [5] and silence political dissidents. Internet manipulation can also be done for profit, for instance, to harm corporate or political adversaries and improve brand reputation. [6] Internet manipulation is sometimes also used to describe the selective enforcement of Internet censorship [7] [8] or selective violations of net neutrality. [9]
Internet manipulation for propaganda purposes with the help of data analysis and internet bots in social media is called computational propaganda.
Behavior Manipulation: Internet manipulation often aims to change user perceptions and their corresponding behaviors. [5] Since the early 2000s, this notion of cognitive hacking meant a cyberattack aiming to change human behavior. [10] [11] Today, fake news, disinformation attacks, and deepfakes can secretly affect behavior in ways that are difficult to detect. [12]
High-arousal emotion virality: It has been found that content that evokes high-arousal emotions (e.g. awe, anger, anxiety or with hidden sexual meaning) is more viral and that content that holds one or many of these elements: surprising, interesting, or useful is taken into consideration. [13]
Simplicity over complexity: Providing and perpetuating simple explanations for complex circumstances may be used for online manipulation. Often such are easier to believe, come in advance of any adequate investigations and have a higher virality than any complex, nuanced explanations and information. [14] (See also: Low-information rationality)
Peer-influence: Prior collective ratings of an web content influences ones own perception of it. In 2015 it was shown that the perceived beauty of a piece of artwork in an online context varies with external influence as confederate ratings were manipulated by opinion and credibility for participants of an experiment who were asked to evaluate a piece of artwork. [15] Furthermore, on Reddit, it has been found that content that initially gets a few down- or upvotes often continues going negative, or vice versa. This is referred to as "bandwagon/snowball voting" by reddit users and administrators. [16]
Filter bubbles: Echo chambers and filter bubbles might be created by Website administrators or moderators locking out people with altering viewpoints or by establishing certain rules or by the typical member viewpoints of online sub/communities or Internet "tribes"
Confirmation bias & manipulated prevalence: Fake news does not need to be read but has an effect in quantity and emotional effect by its headlines and sound bites alone.[ citation needed ] Specific points, views, issues and people's apparent prevalence can be amplified, [17] stimulated or simulated. (See also: Mere-exposure effect
Information timeliness and uncorrectability: Clarifications, conspiracy busting and fake news exposure often come late when the damage is already done and/or do not reach the bulk of the audience of the associated misinformation [18] [ better source needed ]
Psychological targeting: Social media activities and other data can be used to analyze the personality of people and predict their behaviour and preferences. [19] [20] Michal Kosinski developed such a procedure. [19] Such can be used for media or information tailored to a person's psyche e.g. via Facebook. According to reports such may have played an integral part in Donald Trump's 2016 election win. [19] [21] (See also: Targeted advertising, Personalized marketing)
Due to overabundance of online content, social networking platforms and search engines have leveraged algorithms to tailor and personalize users' feeds based on their individual preferences. However, algorithms also restrict exposure to different viewpoints and content, leading to the creation of echo chambers or filter bubbles. [5] [22]
With the help of algorithms, filter bubbles influence users' choices and perception of reality by giving the impression that a particular point of view or representation is widely shared. Following the 2016 referendum of membership of the European Union in the United Kingdom and the United States presidential elections, this gained attention as many individuals confessed their surprise at results that seemed very distant from their expectations. The range of pluralism is influenced by the personalized individualization of the services and the way it diminishes choice. [23] Five manipulative verbal influences were found in media texts. There are self-expression, semantic speech strategies, persuasive strategies, swipe films and information manipulation. The vocabulary toolkit for speech manipulation includes euphemism, mood vocabulary, situational adjectives, slogans, verbal metaphors, etc. [24]
Research on echo chambers from Flaxman, Goel, and Rao, [25] Pariser, [26] and Grömping [27] suggest that use of social media and search engines tends to increase ideological distance among individuals.
Comparisons between online and off-line segregation have indicated how segregation tends to be higher in face-to-face interactions with neighbors, co-workers, or family members, [28] and reviews of existing research have indicated how available empirical evidence does not support the most pessimistic views about polarization. [29] A 2015 study suggested that individuals' own choices drive algorithmic filtering, limiting exposure to a range of content. [30] While algorithms may not be causing polarization, they could amplify it, representing a significant component of the new information landscape. [31]
The Joint Threat Research Intelligence Group unit of the Government Communications Headquarters (GCHQ), the British intelligence agency [32] was revealed as part of the global surveillance disclosures in documents leaked by the former National Security Agency contractor Edward Snowden [33] and its mission scope includes using "dirty tricks" to "destroy, deny, degrade [and] disrupt" enemies. [33] [34] Core-tactics include injecting false material onto the Internet in order to destroy the reputation of targets and manipulating online discourse and activism for which methods such as posting material to the Internet and falsely attributing it to someone else, pretending to be a victim of the target individual whose reputation is intended to be destroyed and posting "negative information" on various forums may be used. [35]
Known as "Effects" operations, the work of JTRIG had become a "major part" of GCHQ's operations by 2010. [33] The unit's online propaganda efforts (named "Online Covert Action"[ citation needed ]) utilize "mass messaging" and the "pushing [of] stories" via the medium of Twitter, Flickr, Facebook and YouTube. [33] Online "false flag" operations are also used by JTRIG against targets. [33] JTRIG have also changed photographs on social media sites, as well as emailing and texting colleagues and neighbours with "unsavory information" about the targeted individual. [33] In June 2015, NSA files published by Glenn Greenwald revealed new details about JTRIG's work at covertly manipulating online communities. [36] The disclosures also revealed the technique of "credential harvesting", in which journalists could be used to disseminate information and identify non-British journalists who, once manipulated, could give information to the intended target of a secret campaign, perhaps providing access during an interview. [33] It is unknown whether the journalists would be aware that they were being manipulated. [33]
Furthermore, Russia is frequently accused of financing "trolls" to post pro-Russian opinions across the Internet. [37] The Internet Research Agency has become known for employing hundreds of Russians to post propaganda online under fake identities in order to create the illusion of massive support. [38] In 2016 Russia was accused of sophisticated propaganda campaigns to spread fake news with the goal of punishing Democrat Hillary Clinton and helping Republican Donald Trump during the 2016 presidential election as well as undermining faith in American democracy. [39] [40] [41]
In a 2017 report [42] Facebook publicly stated that its site has been exploited by governments for the manipulation of public opinion in other countries – including during the presidential elections in the US and France. [17] [43] [44] It identified three main components involved in an information operations campaign: targeted data collection, content creation and false amplification and includes stealing and exposing information that is not public; spreading stories, false or real, to third parties through fake accounts; and fake accounts being coordinated to manipulate political discussion, such as amplifying some voices while repressing others. [45] [46]
This section needs expansion. You can help by adding to it. (February 2017) |
In 2016 Andrés Sepúlveda disclosed that he manipulated public opinion to rig elections in Latin America. According to him with a budget of $600,000 he led a team of hackers that stole campaign strategies, manipulated social media to create false waves of enthusiasm and derision, and installed spyware in opposition offices to help Enrique Peña Nieto, a right-of-center candidate, win the election. [47] [48]
In the run up to India's 2014 elections, both the Bharatiya Janata party (BJP) and the Congress party were accused of hiring "political trolls" to talk favourably about them on blogs and social media. [37]
The Chinese government is also believed to run a so-called "50-cent army" (a reference to how much they are said to be paid) and the "Internet Water Army" to reinforce favourable opinion towards it and the Chinese Communist Party (CCP) as well as to suppress dissent. [37] [49]
In December 2014 the Ukrainian information ministry was launched to counter Russian propaganda with one of its first tasks being the creation of social media accounts (also known as the i-Army) and amassing friends posing as residents of eastern Ukraine. [37] [50]
Twitter suspended a number of bot accounts that appeared to be spreading pro-Saudi Arabian tweets about the disappearance of Saudi dissident journalist Jamal Khashoggi. [51]
A report by Mediapart claimed that the UAE, through a secret services agent named Mohammed, was using a Switzerland-based firm Alp Services to run manipulation campaigns against Emirati opponents. Alp Services head, Mario Brero used fictitious accounts that were publishing fake articles under pseudonyms to attack Qatar and the Muslim Brotherhood networks in Europe. The UAE assigned Alp to publish at least 100 articles per year that were critical of Qatar. [52]
This section is empty. You can help by adding to it. (February 2017) |
Internet manipulation may be seen being used within business and marketing as a way to influence consumers. Forbes, discusses how disinformation online can be spread rapidly across social platforms. Legitimate and fake news are blurring together and both are being weaponized on large-scale campaigns to influence the general population. [53]
We may be influenced by a company but is it manipulation? Learning what to look out for is crucial to avoid internet manipulation. Businesses and marketing may provide misleading images, non-relevant context, or not delivering on their intent. [54]
A business should be providing ethical marketing practices to ensure the most trust and reliability to consumers. To avoid such manipulation online, it's important to understand your target audience. Being able to directly communicate to your audience is key. By collectively showing and discussing the product efficiently by not being misleading to try to influence your audience.
This section needs expansion. You can help by adding to it. (February 2017) |
Hackers, hired professionals and private citizens have all been reported to engage in internet manipulation using software, including Internet bots such as social bots, votebots and clickbots. [55] In April 2009, Internet trolls of 4chan voted Christopher Poole, founder of the site, as the world's most influential person of 2008 with 16,794,368 votes by an open Internet poll conducted by Time magazine. [56] The results were questioned even before the poll completed, as automated voting programs and manual ballot stuffing were used to influence the vote. [57] [58] [59] 4chan's interference with the vote seemed increasingly likely, when it was found that reading the first letter of the first 21 candidates in the poll spelled out a phrase containing two 4chan memes: "Marblecake. Also, The Game". [60]
Jokesters and politically oriented hacktivists may share sophisticated knowledge of how to manipulate the Web and social media. [61]
This section needs expansion. You can help by adding to it. (February 2017) |
In Wired it was noted that nation-state rules such as compulsory registration and threats of punishment are not adequate measures to combat the problem of online bots. [62]
To guard against the issue of prior ratings influencing perception several websites such as Reddit have taken steps such as hiding the vote-count for a specified time. [16]
Some other potential measures under discussion are flagging posts for being likely satire or false. [63] For instance in December 2016 Facebook announced that disputed articles will be marked with the help of users and outside fact checkers. [64] The company seeks ways to identify 'information operations' and fake accounts and suspended 30,000 accounts before the presidential election in France in a strike against information operations. [17]
Inventor of the World Wide Web Tim Berners-Lee considers putting few companies in charge of deciding what is or is not true a risky proposition and states that openness can make the web more truthful. As an example he points to Wikipedia which, while not being perfect, allows anyone to edit with the key to its success being not just the technology but also the governance of the site. Namely, it has an army of countless volunteers and ways of determining what is or is not true. [65]
Furthermore, various kinds of software may be used to combat this problem such as fake checking software or voluntary browser extensions that store every website one reads or use the browsing history to deliver fake revelations to those who read a fake story after some kind of consensus was found on the falsehood of a story.[ original research? ]
Furthermore, Daniel Suarez asks society to value critical analytic thinking and suggests education reforms such as the introduction of 'formal logic' as a discipline in schools and training in media literacy and objective evaluation. [63]
According to a study of the Oxford Internet Institute, at least 43 countries around the globe have proposed or implemented regulations specifically designed to tackle different aspects of influence campaigns, including fake news, social media abuse, and election interference. [66]
In Germany, during the period preceding the elections in September 2017, all major political parties save AfD publicly announced that they would not use social bots in their campaigns. Additionally, they committed to strongly condemning such usage of online bots.
Moves towards regulation on social media have been made: three German states Hessen, Bavaria, and Saxony-Anhalt proposed in early 2017 a law that would mean social media users could face prosecution if they violate the terms and conditions of a platform. For example, the use of a pseudonym on Facebook, or the creation of fake account, would be punishable by up to one year's imprisonment. [67]
In early 2018, the Italian Communications Agency AGCOM published a set of guidelines on its website, targeting the elections in March that same year. The six main topics are: [68]
In November 2018, a law against the manipulation of information was passed in France. The law stipulates that during campaign periods: [69]
In April 2018, the Malaysian parliament passed the Anti-Fake News Act. It defined fake news as 'news, information, data and reports which is or are wholly or partly false.' [70] This applied to citizens or those working at a digital publication, and imprisonment of up to 6 years was possible. However, the law was repealed after heavy criticism in August 2018. [71]
In May 2018, President Uhuru Kenyatta signed into law the Computer and Cybercrimes bill, that criminalised cybercrimes including cyberbullying and cyberespionage. If a person "intentionally publishes false, misleading or fictitious data or misinforms with intent that the data shall be considered or acted upon as authentic," they are subject to fines and up to two years imprisonment. [72]
German chancellor Angela Merkel has issued the Bundestag to deal with the possibilities of political manipulation by social bots or fake news. [73]
This article incorporates text from a free content work.Licensed under CC BY SA 3.0 IGO( license statement/permission ).Text taken from World Trends in Freedom of Expression and Media Development Global Report 2017/2018 ,202,University of Oxford,UNESCO.
Disinformation is misleading content deliberately spread to deceive people, or to secure economic or political gain and which may cause public harm. Disinformation is an orchestrated adversarial activity in which actors employ strategic deceptions and media manipulation tactics to advance political, military, or commercial goals. Disinformation is implemented through attacks that "weaponize multiple rhetorical strategies and forms of knowing—including not only falsehoods but also truths, half-truths, and value judgements—to exploit and amplify culture wars and other identity-driven controversies."
Media manipulation refers to orchestrated campaigns in which actors exploit the distinctive features of broadcasting mass communications or digital media platforms to mislead, misinform, or create a narrative that advance their interests and agendas.
An Internet bot, web robot, robot or simply bot, is a software application that runs automated tasks (scripts) on the Internet, usually with the intent to imitate human activity, such as messaging, on a large scale. An Internet bot plays the client role in a client–server model whereas the server role is usually played by web servers. Internet bots are able to perform simple and repetitive tasks much faster than a person could ever do. The most extensive use of bots is for web crawling, in which an automated script fetches, analyzes and files information from web servers. More than half of all web traffic is generated by bots.
Russian web brigades, also called Russian trolls, Russian bots, RUbots, Kremlinbots, or Kremlin trolls are state-sponsored anonymous Internet political commentators and trolls linked to the Russian government. Participants report that they are organized into teams and groups of commentators that participate in Russian and international political blogs and Internet forums using sockpuppets, social bots, and large-scale orchestrated trolling and disinformation campaigns to promote pro-Putin and pro-Russian propaganda.
A filter bubble or ideological frame is a state of intellectual isolation that can result from personalized searches, recommendation systems, and algorithmic curation. The search results are based on information about the user, such as their location, past click-behavior, and search history. Consequently, users become separated from information that disagrees with their viewpoints, effectively isolating them in their own cultural or ideological bubbles, resulting in a limited and customized view of the world. The choices made by these algorithms are only sometimes transparent. Prime examples include Google Personalized Search results and Facebook's personalized news-stream.
Philip N. Howard is a sociologist and communication researcher who studies the impact of information technologies on democracy and social inequality. He studies how new information technologies are used in both civic engagement and social control in countries around the world. He is Professor of Internet Studies at the Oxford Internet Institute and Balliol College at the University of Oxford. He was Director of the Oxford Internet Institute from March 2018 to March 26, 2021. He is the author of ten books, including New Media Campaigns and The Managed Citizen, The Digital Origins of Dictatorship and Democracy, and Pax Technica: How the Internet of Things May Set Us Free or Lock Us Up. His latest book is Lie Machines: How to Save Democracy from Troll Armies, Deceitful Robots, Junk News Operations, and Political Operatives.
State-sponsored Internet propaganda is Internet manipulation and propaganda that is sponsored by a state. States have used the Internet, particularly social media to influence elections, sow distrust in institutions, spread rumors, spread disinformation, typically using bots to create and spread contact. Propaganda is used internally to control populations, and externally to influence other societies.
Peñabots is the nickname for automated social media accounts allegedly used by the Mexican government of Enrique Peña Nieto and the PRI political party to keep unfavorable news from reaching the Mexican public. Peñabot accusations are related to the broader issue of fake news in the 21st century.
Fake news websites are websites on the Internet that deliberately publish fake news—hoaxes, propaganda, and disinformation purporting to be real news—often using social media to drive web traffic and amplify their effect. Unlike news satire, these websites deliberately seek to be perceived as legitimate and taken at face value, often for financial or political gain. Fake news websites monetize their content by exploiting the vulnerabilities of programmatic ad trading, which is a type of online advertising in which ads are traded through machine-to-machine auction in a real-time bidding system.
A troll farm or troll factory is an institutionalised group of internet trolls that seeks to interfere in political opinions and decision-making.
Fake news websites target United States audiences by using disinformation to create or inflame controversial topics such as the 2016 election. Most fake news websites target readers by impersonating or pretending to be real news organizations, which can lead to legitimate news organizations further spreading their message. Most notable in the media are the many websites that made completely false claims about political candidates such as Hillary Clinton and Donald Trump, as part of a larger campaign to gain viewers and ad revenue or spread disinformation. Additionally, satire websites have received criticism for not properly notifying readers that they are publishing false or satirical content, since many readers have been duped by seemingly legitimate articles.
A social bot, also described as a social AI or social algorithm, is a software agent that communicates autonomously on social media. The messages it distributes can be simple and operate in groups and various configurations with partial human control (hybrid) via algorithm. Social bots can also use artificial intelligence and machine learning to express messages in more natural human dialogue.
Fake news or information disorder is false or misleading information claiming the aesthetics and legitimacy of news. Fake news often has the aim of damaging the reputation of a person or entity, or making money through advertising revenue. Although false news has always been spread throughout history, the term fake news was first used in the 1890s when sensational reports in newspapers were common. Nevertheless, the term does not have a fixed definition and has been applied broadly to any type of false information presented as news. It has also been used by high-profile people to apply to any news unfavorable to them. Further, disinformation involves spreading false information with harmful intent and is sometimes generated and propagated by hostile foreign actors, particularly during elections. In some definitions, fake news includes satirical articles misinterpreted as genuine, and articles that employ sensationalist or clickbait headlines that are not supported in the text. Because of this diversity of types of false news, researchers are beginning to favour information disorder as a more neutral and informative term.
Propaganda is a form of persuasion that is often used in media to further some sort of agenda, such as a personal, political, or business agenda, by evoking an emotional or obligable response from the audience. It includes the deliberate sharing of realities, views, and philosophies intended to alter behavior and stimulate people to act.
Social media use in politics refers to the use of online social media platforms in political processes and activities. Political processes and activities include all activities that pertain to the governance of a country or area. This includes political organization, global politics, political corruption, political parties, and political values. The media's primary duty is to present us with information and alert us when events occur. This information may affect what we think and the actions we take. The media can also place pressure on the government to act by signaling a need for intervention or showing that citizens want change
Fake news in the Philippines refers to the general and widespread misinformation or disinformation in the country by various actors. It has been problematic in the Philippines where social media and alike plays a key role in influencing topics and information ranging from politics, health, belief, religion, current events, aid, lifestyle, elections and others. Recently, it has evolved to be a rampant issue against the COVID-19 pandemic in the Philippines and the 2022 Philippine general election.
Disinformation attacks are strategic deception campaigns involving media manipulation and internet manipulation, to disseminate misleading information, aiming to confuse, paralyze, and polarize an audience. Disinformation can be considered an attack when it occurs as an adversarial narrative campaign that weaponizes multiple rhetorical strategies and forms of knowing—including not only falsehoods but also truths, half-truths, and value-laden judgements—to exploit and amplify identity-driven controversies. Disinformation attacks use media manipulation to target broadcast media like state-sponsored TV channels and radios. Due to the increasing use of internet manipulation on social media, they can be considered a cyber threat. Digital tools such as bots, algorithms, and AI technology, along with human agents including influencers, spread and amplify disinformation to micro-target populations on online platforms like Instagram, Twitter, Google, Facebook, and YouTube.
Russian disinformation campaigns have occurred in many countries. For example, disinformation campaigns led by Yevgeny Prigozhin have been reported in several African countries. Russia, however, denies that it uses disinformation to influence public opinion.
In internet slang, rage-baiting is the manipulative tactic of eliciting outrage with the goal of increasing internet traffic, online engagement, revenue and support. Rage baiting or farming can be used as a tool to increase engagement, attract subscribers, followers, and supporters, which can be financially lucrative. Rage baiting and rage farming manipulates users to respond in kind to offensive, inflammatory headlines, memes, tropes, or comments.
Team Jorge is the name given to an outfit of Israeli contractors specialized in the use of malign cyber activities including hacking, sabotage, and bot farm-run social media disinformation campaigns to manipulate the outcomes of elections. One of the organization's primary tools is a software package called Advanced Impact Media Solutions, or Aims.