The economy of attention in the age of (mis)information

Abstract

In this work we present a thorough quantitative analysis of information consumption patterns of qualitatively different information on Facebook. Pages are categorized, according to their topics and the communities of interests they pertain to, in a) alternative information sources (diffusing topics that are neglected by science and main stream media); b) online political activism; and c) main stream media. We find similar information consumption patterns despite the very different nature of contents. Then, we classify users according to their interaction patterns among the different topics and measure how they responded to the injection of 2788 false information (parodistic imitations of alternative stories). We find that users prominently interacting with alternative information sources – i.e. more exposed to unsubstantiated claims – are more prone to interact with intentional and parodistic false claims.

Introduction

People can populate their informational domain – i.e. the amount of information available to a society member. The functioning of socio-technical systems, as any socio-cognitive system, requires individuals to interact in order to acquire information to cope with uncertainty. In particular, when dealing with content selection, the efficacy of such systems rely on the accuracy and the completeness of information. In order to have complete information, individuals need perspectives, where all the relevant angles of looking are presented as squarely and objectively as possible. However, the unprecedented diffusion of online social media allowed the massive and proactive production of different perspectives and narratives. Along this path, research on trust needs to account for the relation between information available and its role in the public opinion.

In fact, each decision needs cognitive strategies to reduce the level of uncertainty in the process of beliefs’ formation and revision with respect to the decision’s consequences. Reputation systems are used to collect and analyze information about the performance of service entities with the purpose of computing reputation scores for service objects and service entities. A fundamental assumption of reputation systems is that reputation scores can help predict the future performance of the respective entities and thereby reduce uncertainty of relying parties during the decision making processes [1]-[6].

However, the World Economic Forum, in its 2013 report [7], has listed the “massive digital misinformation” as one of the main risks for the modern society. People perceptions, knowledge, beliefs, and opinions about the world and its evolution get (in)formed and modulated through the information they can access, most of which coming from newspapers, television [8], and, more recently, the Internet. The world wide web has changed the way we can pursue intellectual growth or shape ideas. In particular, large social networks, with their user-provided content, are facilitating the study of how the economy of attention leads to specific patterns for the emergence, production, and consumption of information [9]-[13].

Despite the enthusiastic rhetoric about the ways in which new technologies have burst the interest in debating political or social relevant issues [14]-[19], the role of the socio-technical system in enforcing informed debates still remains unclear. Indeed, the emergence of knowledge from this process has been dubbed collective intelligence or even more rhetorically wisdom of crowds[20]-[23], although we have become increasingly aware of the presence of unsubstantiated or untruthful rumors.

In this paper we show a genuine example of how false information is particularly pervasive on social media, fostering sometimes a sort of collective credulity. We perform a thorough quantitative analysis of information consumption patterns of qualitatively different information on Facebook over a set of 50 pages on which interacted 2.3 million of users. In order to study attention and consumption patterns of different contents we divide pages in categories according to the kind of narrative supported. More precisely, pages are categorized, according to their topics and the communities of interests they pertain to, in a) alternative information sources (diffusing topics that are neglected by science and main stream media); b) online political activism; and c) main stream media.

Then, we classify users according to their interaction patterns among the different topics and measure how they responded to the injection of 2788 false information (parodistic imitations of alternative stories). Our findings show a) similar information consumption patterns despite the very different nature of contents and b) that users prominently interacting with alternative information sources – i.e. more exposed to unsubstantiated claims – are more prone to interact with intentional and parodistic false claims.

Narratives on online social media

On the Web several cultures coexist, and conspiracy thinking is one of the most prolific. The vast majority of unsubstantiated rumors on the web is related to conspiracy stories and find on the Web a natural medium for their dissemination. Narratives grounded on conspiracy theories tend to reduce the complexity of reality and are able to contain the uncertainty they generate [24]-[26]. They are able to create a climate of disengagement from mainstream society and from officially recommended practices [27] – e.g. vaccinations, diet, etc. Conspiracy thinking exposes individuals to unsubstantiated (difficult to verify) hypotheses providing alternative explanations to reality [28]-[32]. In particular, conspiracists are prone to explain significant social or political aspects as plots conceived by powerful individuals or organizations [33]. As these kinds of arguments can sometimes involve the rejection of science, alternative explanations are invoked to replace the scientific evidence. For instance, people who reject the link between HIV and AIDS generally believe that AIDS was created by the U.S. Government to control the African American population [34],[35]. Since unsubstantiated claims are proliferating over the Internet, what could happen if they were used as the basis for policy making? Nonetheless, several tools have been recently designed to help users disambiguate misinformation and false news [36],[37]. On the other hand, basic questions remain on how the quality of (mis)information affects the economy of attention processes, concerning, for example, the virality of information, its lifespan and the consumption patterns.

A large body of literature addresses the study of social dynamics on socio-technical systems [12],[38]-[44].

In this work we address the relationship between information sources and collective debates. In particular, our focus is on how alternative and mainstream news are used when people discuss and organize political actions online – i.e. political activism. More precisely, pages are categorized, according to their topics and the communities of interests they pertain to, in a) alternative information sources (diffusing topics that are neglected by science and main stream media); b) online political activism; and c) main stream media.

Moreover, recently it has been noticed the emergence of very distinct groups, namely trolls, building Facebook pages as a parodistic imitation of both alternative information sources and online political activism. Their activities range from controversial comments, and posting satirical content mimicking alternative news sources, to the fabrication of purely fictitious statements, heavily unrealistic and sarcastic. This pervasiveness of unreliable contents might lead to mix up unsubstantiated stories with their satirical counterparts – e.g. the presence of sildenafil-citratum (the active ingredient of Viagra™) [45] in chem-trails or the anti hypnotic effects of lemons (more than 45000 shares) [46],[47]. Not rarely, these memes became viral and were used as evidence in online debates from political activists [48].

Inspired by these lively and controversial social dynamics at the edge between virality and credulity, we addressed the quantitative analysis of the interlink between information sources and political discussion on the web by focusing on different profile of users (according to the kind of content they are mostly exposed to) and how they are biased in selecting contents. In particular we first characterize information consumption patterns in the various categories (alternative news, mainstream news and political activism) and then we measure how the most polarized users are responsive to intentional false claims diffused by a troll page.

Experiment setup and data collection

The impressive pervasiveness of unsubstantiated rumors online has been listed as one of the main risk for our society for its effect on the public opinion. Our experiment aims at understanding the effect of the exposure to unsubstantiated claims on the content selection criteria and, in particular, if such an exposure might lead to interact with information that are intentionally false.

Firstly, we show users attention patterns with respect to different kind of contents, and then we look at who are the users more prone to interact with intentional false information according to the content they are usually exposed to. To do this, we focus on the Italian Facebook ecosystem and we define three categories of pages according to the kind of information they promote. The categorization of the pages is based on their different social functions together with the type of information they disseminate. The first category includes all pages of main stream newspapers; the second category consists of alternative information sources – pages which disseminate controversial information, often lacking supporting evidence and sometimes contradictory of the official news (e.g. conspiracy theories, link between vaccines and autism, etc); the third category is that of self-organized online political movements – with the role of gathering users to publicly convey discontent against the current political and socio-economic situation (e.g. one major political party in Italy has most of its activity online). The criteria to define pages categories are based on pages’ self-description and the kind of content they disseminate. All national newspapers active of Facebook belongs to mainstream news. Pages of political activism and alternative news have been identified with the help of Facebook groups very active in the debunking unsubstantiated rumors. However, all pages of alternative news in their mission declare to have the role to disseminate information neglected by “manipulated main stream media”.

The resulting dataset is composed of 50 public pages for which we download all the posts (and the relative users’ interactions) in a timespan of six months (from September 1st, 2012 to February 28th, 2013). The data are publicly available as they come from a public online social site (Facebook). However, any information has been analyzed anonymously and in aggregated form. The entire data collection process has been performed exclusively with the Facebook Graph API [49], which is publicly available, and for the analysis (according to the specification settings of the API) we used only public available data (users with privacy restrictions are not included in the dataset). The pages from which we download data are public Facebook entities (can be accessed anyone). User content contributing to such pages is also public unless the user’s privacy settings specify otherwise. The exact breakdown of the data is presented in Table 1. For all categories the focus of our analysis is on the interaction of users with the public posts – i.e. likes, shares, and comments. Finally, we got access to 2788 post from a troll page [50]. All of these posts are caricatural version of political activism and alternative news stories, with the peculiarity to include always false information and demential claims. Despite the small dimension (7430 unique users, 18212 likes, 11337 comments and 9549 likes to comments), the page was able to trigger several viral phenomena, one of which reached 100K shares. We use these troll memes to measure how the social ecosystem under investigation is responsive to the injection of intentional false information. On Facebook, users have three main actions to interact with posts: likes (intended as positive feedbacks to the post), comments (a measure of the activity of online collective debates), and shares (intended as the attitude to share a given information). Since comments and shares are more controversial [51]-[53], to measure the responsitivity with respect to the injection of intentional false claims, we account only for likes as a good approximation for users’ engagement.

Table 1 Breakdown of Facebook dataset

Results and discussion

The information space

Our dataset has two main entities: users and pages. In order to characterize information consumption patterns we represent the dataset as a bipartite network. As shown in Figure 1, a bipartite graph is a triple \mathcal{G}=(A,B,E), where A={a _i | i=1…n _A } and B={b _j | j=1…n _B } are two disjoint sets of vertices, and E⊆A×B is the set of edges, i.e. edges exist only between vertices of the two different sets A and B.

Figure 1

Bipartite network and projections. Pages in red and users in blue. Users are linked to a page if they give a comment or a like to a page post. From the bipartite network it is possible to define the users and pages projection.

The bipartite graph is described by the matrix M defined as

M_{\mathit{\text{ij}}}=\left\{\begin{array}{ll}1& \mathit{\text{if}}\mathit{\text{an}}\mathit{\text{edge}}\mathit{\text{exists}}\mathit{\text{between}}{a}_i\mathit{\text{and}}{b}_j\\ 0& \mathit{\text{otherwise}}\end{array}\right.

According to the bipartite transformation, in Figure 2 we show the projection on the pages side for comments and likes – i.e. nodes are pages and the links stands for having users that commented and liked two pages. The connectivity pattern in the two networks is similar and really densely interconnected. Thus, alternative news, main stream news and political discussion have several common users. As a like stands for a positive feedback to the post and a comments might be either negative of positive (discussion on the information), from this transformation we can notice that online discussions and positive feedbacks on information belonging to different topics and contexts are similar. Such a first result suggests that different contents (mainstream news, alternative news and political discussion) are consumed in a comparable way.

Figure 2

Page network. Projection of the bipartite network on pages for users’ likes (left) and users’ comments (right). Two pages are connected if a user commented on both. Alternative news (green), mainstream news (violet) and political activism pages have several users in common.

To further detail such a similarity, in Figure 3 we show the empirical complementary cumulative distribution function of edge weights – i.e. the number of comments or likes the pages have in common – of the two bipartite projections on pages of users’ likes and comments. Reminding that edge weights stand for the number of posts in which two users commented or liked together, we can see that the distributions are similarly shaped. The information space we are exploring is densely interconnected and presents similar connectivity patterns in terms of likes (positive feedback) and comments (discussion), meaning that unsubstantiated claims (information difficult to verify and often related to conspiracy theories), main stream news and political discussion are consumed and reverberate in a similar way on Facebook.

Figure 3

Page network. Empirical complementary cumulative distribution function (CCDF) of the edge weights on the page projection. Link weights stand for the number of common users between pages that commented (blue) and liked (red). The distribution are similar.

Information consumption patterns

To provide a better picture of fruition patterns with respect to different information, we continue our analysis by zooming in at the level of posts. Recalling that the division of pages in categories accounts for the very distinctive nature between political discussion and kind of information used (mainstream or alternative), we focus on the coexistence in the political discussion of mainstream news and conspiracy-like information. Firstly, we analyze general fruition patterns in terms of number of comments, likes and shares for posts grouped by page category. Then, to characterize the online discussion around qualitatively different information, we measure the duration of collective debates for each post diffused by the different pages.

In Figure 4 we show the empirical complementary cumulative distribution function of the actions (like, comments and shares) on each post for different categories of pages – i.e. alternative news, mainstream news and political activism. Such a plot clearly shows that the fruition patterns of qualitatively different contents are similar.

Figure 4

Attention patterns. Empirical complementary cumulative distribution function (CCDF) of users’ actions (likes and comments) on posts grouped by page category. The distributions are indicating similar consumption patterns on the various page categories. Qualitatively different information are consumed in a similar way.

Finally, in order to quantify the level of engagement produced by an information, we measure the lifetime of each post – i.e. the temporal distance between the first and the last comment – as a good approximation of the attention received by an information. In Figure 5 we show the lifetime’s probability distribution function for each post in each category.

Figure 5

Posts lifetime. Distribution of posts’ lifetime – i.e. the temporal distance between the first and last comment – grouped by page category. The life time of posts in both categories is similar.

Information-based communities are aggregated around shared narratives and the debates among them contribute to the proliferation of political pages and alternative information sources with the aim to organize and convey the public discontent (with respect to the crisis and the decisions of the national government) by exploiting the Internet peculiarities. According to our results, collective debates grounded of different information persist similarly, independently of whether the topic is the product of conspiracist or mainstream source. In this portion of the Italian Facebook ecosystem, untruthful rumors spread and trigger viral debate, representing an important part of the information flow animating the political scenario and shaping the public opinion.

Interaction with false information

The goal of our study is to detect potential bias induced by the exposure to untruthful rumors on users’ content selection criteria in an information environment where mainstream and alternative news reverberate in a similar way. Now we want to measure the attitude of a user to interact with intentional parodistic false information.

For better discriminating the users’ behavior, we focus on the users’ activity rates on the various categories. In Figure 6 we show how the number of actions for each user is distributed within the various categories. We rank users by their activity and each curve stands for the fraction of a given bin – i.e. data values falling in a given small interval (bin) are replaced by the average value of the interval. As we can see, users are really more active on political activism and alternative news rather than main stream news. User activity is dominated by alternative news and political discussion.

Figure 6

User activity on caterories of pages. Fraction of user activity (likes and comments) on each category per user ranked by activity rate (total number of action of a user). How each user has the total activity distributed among the different pages categories. The most of the activity is on political discussion (red) and alternative news (green).

Continuing our investigation, we want to understand if this information context might affect the users’ selection criteria. Therefore, we measure the reaction of users to a set of 2788 false information injected by a troll page – i.e. a page promoting caricatural version of alternative news and political activism stories (see Section Narratives on online social media for further details).

For better discriminating users’ behavior, we focus on the users’ activity rates on the various categories looking for the polarized ones – i.e. users that are mostly exposed to one type of content among mainstream news, political activism and alternative news.

We apply a classification strategy in order to discriminate typical users for each page category. In particular, we are interested in distinguishing users on the base of their behavior. Having access to the 6 months historical likes, comments, and likes to comments on all posts within the timespan (and within the privacy restrictions), we quantify the interaction of each user with the posts in each category. As we do this, the following assumptions are in place:

• the topic of the post is coherent with the theme of the page on which it was published;

• a user is interested in the topic of the post if he/she likes the post. A comment – although it reflects interest – is more ambiguous, thus it is not considered to express a positive preference of the topic;

• we neither have access to nor try to guess the page subscription list of the users, regardless of their privacy settings. Every step of the analysis involves only the active (participating) users on each page.

According to these assumptions, we use solely the likes to the posts. For instance, if a user likes 10 different posts on one or multiple pages of the same political movement, but that user never liked posts of any other topic, we will label that user to be associated with the political movement. Given the outline of users distribution within the various categories, we want to see which users are more responsive to the injection of false information in terms of interaction. As before, we cannot use the comments as discriminators, since they can represent either positive or negative feedbacks with respect to the published topic. Therefore, we focus only on the users liking 2788 troll posts. As previously mentioned, troll posts are related to arguments debated by political activists or on alternative information sources but with a clear parodistic flavor. For instance, one of the most popular memes that explicitly spread a false rumor (in text form) reads: Italian Senate voted and accepted (257 in favor and 165 abstentions) a law proposed by Senator Cirenga aimed at funding with 134 billion Euros the policy-makers to find a job in case of defeat in the political competition. We were able to easily verify that this meme contains at least four false statements: the name of the senator, the total number of votes is higher than possible, the amount of money (more than 10% of Italian GDP) as well as the law itself. This meme was created by a troll page and, on the wave of public discontent against italian policy-makers, quickly became viral, obtaining about 35,000 shares in less than one month. Shortly thereafter, the image was downloaded and reposted (with the addition of a commentary) by a page describing itself as being focused on political debate. Nowadays, this meme is among the arguments used by protesters manifesting in several Italian cities. This is a striking example of the large scale effect of misinformation diffusion on the opinion formation process. To characterize the spreading pattern of this outstanding example, in Figure 7 we show the total number of actions (likes and comments) made on the troll post about Senator Cirenga grouped by users classified in different categories.

Figure 7

Cirenga fruition. Cumulative number of comments per day of one of the most viral post within the false information for classified users. Users more active on commenting are usual consumer of alternative news.

Such a post received a lot of attention initially from alternative news and political activists which through their volume made it viral to an extent that it is still used as argumentation in the political discussion. There are two spikes in the diffusion, however the higher number of comments is made by those users who are usual consumer of alternative information sources. As shown in Figure 8, by counting the polarized users that liked the posts, we find that the users most susceptible to interact with false information are those that are mostly exposed and interacting with unsubstantiated claims (i.e. posts on alternative information pages).

Figure 8

Users interacting with false information. Fraction of labeled users on the different categories – i.e., user usually exposed to one type of content among the tree (alternative, mainstream a political) – which interacted with 2788 intentional false information. Users more prone to interact with false claims are consumer of alternative information sources.

According to our results, users with strong preferences for alternative information sources, perhaps motivated by the will to avoid the manipulation played by mainstream media controlled by the government, are more susceptible to false information. Our result suggests that those who took a less systematic (more heuristic) approach in evaluating any evidence were more likely to end up with an account that was more consistent with their previous beliefs even if these are parodistic posts.

The free circulation of contents is facilitating users attention to critical matter such as the financial crisis as well as any political argument. However, in this work we show that unsubstantiated rumors are pervasive in online social media and they might affect users belief formation and revision.

Information based on conspiracy are able to create a climate of disengagement from mainstream society and from officially recommended practices [27] – e.g. vaccinations, diet, etc. Conspiracy thinking exposes individuals to unsubstantiated (difficult to verify) hypotheses providing alternative explanations to reality [28]-[32]. In particular, conspiracists are prone to explain significant social or political aspects as plots conceived by powerful individuals or organizations [33]. Furthermore our results suggests that exposure to unsubstantiated rumors might facilitate the interaction with intentional false claims such as the case of Senator Cirenga.