A blog or weblog is a specialized web site that allows an individual or a group of individuals to express their thoughts, voice their opinions, and share their experiences and ideas. The entries are called blog posts, while the individuals who authored the blog posts are referred to as bloggers. A blog site could contain a single blogger, and is referred as a personal blog, while a blog site containing a group of bloggers is known as a multi-author blog as shown in Figure 1. Multi-author blogs have certain characteristics amongst their bloggers such as common shared goals and guidelines, and the editor would guide and organize the activities of the blog. The reasons for having multiple authors on a blog are the wider variety of opinions and ideas that could cater to more readers. Nevertheless, the greater variety of opinion expressions could lead to differences in the bloggers’ influence styles. Influence style refers to the manner in which the blogger exert influence through the blog postings. For example, a blogger could be subjective in persuasion influence style as seen in the expression “
Previous studies had attempted to analyze the personality of bloggers (Guadagno, Okdie, & Eno, 2008; Yarkoni, 2010). However, the studies measured the personality of bloggers manually in relation to their propensity to blog, and had not considered the influence styles of bloggers. Other studies had proposed using blog features (Adar & Adamic, 2005; Agarwal & Liu, 2008), similarity comparison (Matsumura, Yamamoto, & Tomozawa, 2008; Song, Chi, Hino, & Tseng, 2007), and community detection (Agarwal, Liu, Tang, & Yu, 2008; Ghosh & Lerman, 2008) to detect blog influence. However, the studies did not consider the subject matter of the blog post, and thus, would not measure influence accurately. This is because influence is subjective in nature and is often dependent on the contextual details. Recent studies further considered the context of blog posts by analyzing the sentiments between linked blog posts (Leskovec, Huttenlocher, & Kleinberg, 2010; Cai, Bao, Yang, Tang, Ma, Zhang, & Su, 2011; Li, Bhowmick, & Sun, 2011). These studies focused on a single notion that influence exists between blogs with hypertext links, but ignored the details in the other aspects of influence. Influence is a complex concept that consists of various components such as the different influence styles, and could not be described using a single detached feature. Influential bloggers are not restricted to a monolithic description of influence and may differ in influence style. By identifying each blogger’s influence style we provide more in-depth profiles of the bloggers. For example, bloggers’ influence could be better described through identifying the bloggers as active participants or just passive sharers, whether they focus on specific topics or products, as seen in Figure 2, or they are broad in their scope, whether they express ideas in a rational or subjective manner, or whether their posts are received positively or negatively by the readers. Identification of blogs’ influence style could be applied in several applications. For example, we could determine whether influential
product-marketing blogs are persuasive or objective, or whether influential financial blogs tend to post actively or are usually dormant, but would post few highly relevant postings. The identified influence style would give a better description and understanding of the influence exerted by the blogs, and could be used as features to improve influence detection performance. On the other hand, previous studies which assumed a monolithic definition of influence existence between linked blog posts would not be able to differentiate the varying influence styles of the blogs and individual bloggers.
In this paper, we aim to profile the influence styles of blogs, specifically at blogger level, by automatic detection and analysis of the influence styles that exist between linked blog posts. The influence style model used was adopted from (Tan, Na, Theng, and Chang, 2012b), where we define the influence of blogs and bloggers from an objective and social perspective with an expanded description of influence consisting of three possible styles, mainly engagement style, persuasion style, and persona of the bloggers. Engagement style indicates the frequency, scope, originality, and consistency of the blog postings. Persuasion style refers to appeals to reasons or emotions displayed in the blog posts, and persona is the degree of compliance exerted by the bloggers. Additionally, as influence is time dependent (Adar & Adamic, 2005; Agarwal & Liu, 2008) and topic constrained (Agarwal, Liu, Tang, & Yu, 2008), our model evaluated blogger influence within the analyzed time period, and specific to the blog post topics. In contrast to (Tan, Na, Theng, and Chang, 2012b), this paper conduct an in-depth analysis of the individual bloggers influence style to differentiate the manner in which each blogger exert their influence.
The next section describes related work followed by the research design where details of the methods used are given. Next, we present the experiment procedures and results, followed by the discussion and conclusion.
Previous studies had attempted to classify blogs through content analysis. Herring, Scheidt, Bonus, and Wright (2004) analyzed blog content to identify and quantify structural and functional properties of blogs according to their genre. The study analyzed the demographic characteristics of the blog authors from the blogs, and they conducted structural analysis of blogs on features such as number of links, images, presence of search features, and advertisements, as well as frequency of blog updates to categorize blogs based on their respective genres. Other studies (Guadagno, Okdie, & Eno, 2008; Yarkoni, 2010) measured the personality of bloggers in relation to predicting blogging. Costa and McCrae (1992) evaluated personality based on clinical studies through five key traits: neuroticism, extra-version, agreeableness, openness to experience, and conscientiousness. Neuroticism represents an individual’s tendency to experience distress. Extraversion is the dimension underlying a broad group of traits, including sociability, activity, and the tendency to experience positive emotions. Agreeableness is a dimension of interpersonal behavior where high agreeableness individuals are trusting, sympathetic, and cooperative. Openness to Experience refers to traits that describes individuals as imaginative and sensitive to art and beauty and have a rich emotional life. Conscientiousness is a dimension that contrasts scrupulous, well-organized, and diligent people with lax and disorganized individuals. Guadagno, Okdie, and Eno (2008) measured the personality of bloggers based on the five key traits by (Costa & McCrae, 1992) to predict blogging. Their studies indicated that people who are high in openness to new experience and high in neuroticism are likely to be bloggers. The results indicated that personality factors impacted the likelihood of being a blogger and have implications for understanding who blogs. Similarly, Yarkoni (2010) analyzed blogger personality on word use in their blog postings to study the association between personality and language of bloggers. However, these studies had manually measured bloggers’ characteristic and personality with regards to their propensity to blog, and did not relate the characteristic and personality of bloggers to their influence styles. Moreover, the five key personality traits by (Cost & McCrae, 1992) are not directly applicable for measuring influence style. In our study, we study bloggers’ traits in relation to their influence style exerted on other bloggers through automatic analysis of the blog post content.
Influence is often related to conformity, which is the act of matching attitudes, beliefs, and behaviors to group norms (Hogg & Vaughan, 2005). Kelman (1958) identified conformity as form of compliance, which is the expression of agreement towards the people or groups who are influential to the individual, while possibly keeping one’s own original beliefs. In our study, we measure compliance through analyzing similar sentiments on target topics in the textual content between the linked blog posts. Cialdini (2001) defined several human characteristics in relation to influence.
Brehm (1966) observed that emotion and disposition may affect likelihood of conformity or anti-conformity. The arousal and affective states have an effect of discrete emotions on targets’ cognitions as well as on the eventual outcome of the influence attempt (Cialdini & Goldstein, 2004). Persuasion is a process of influence through appeals to reason or appeals to emotion.
Previous studies that used blog features to detect influence were mainly graph-based. Herring, Kouper, Paolillo, Scheidt, Tyworth, Welsch, Wright, and Yu (2005) investigated the extent to which blogs are interconnected using quantitative social network analysis, visualization of link patterns, and qualitative analysis of references and comments of the blogs. Their results showed that the blogosphere is partially interconnected and sporadically conversational. However, the interconnectivity of the blogosphere does not indicate the influence of the bloggers as there could be disagreement between linked blog posts. Adar and Adamic (2005) related the number of blog links to influence. The study applied link inference techniques to find implicit graph links that could further identify influence. In the study by Agarwal and Liu (2008), an influential blogger was defined based on the number of in-links, comments for the posts, and the number of out-links. A high authority value based on a large number of in-links to the blog postings indicates high number of followers. However, having many in-links may not necessary indicate influence. For example, a linking blog post opposing the ideas and opinion of a high authority blog post could express disapproval and not be influenced, while connected to the linked blog post. Hence, number of in-links alone could not accurately describe the influence exerted by a blogger. Community identification was also used to detect influence in the blogosphere. Ghosh and Lerman (2008) generalized the notion of network connectivity to the number of paths that exist between two nodes in relation to blogosphere influence. Agarwal, Liu, Tang, and Yu (2008) proposed to detect blog communities through aggregating similar individual blogs to identify influential bloggers. However, community identity alone would not detect influence accurately as blogs within a community could differ in opinions on certain topics, while blogs outside of the community could also share similar opinions.
The above influence studies utilized positive interactions (e.g., agreement and trust) between individuals, and ignored the negative relationships in the blogosphere. Milgram (1963) observed instances of dissent can greatly wane the strength of an influence, indicating that detecting both agreement (positive sentiments) and disagreement (negative sentiments) is equally important in influence analysis. Recent studies had included the consideration for both positive and negative links in the analysis of influence. Leskovec et al. (2010) adapted a framework of trust and distrust in an attempt to infer the attitude of one user toward another using the observed positive and negative relations. Tan, Na, and Theng (2011) observed that analyzing the positive, neutral, and negative sentiments of linked blog posts on common topics could improve influence propagation detection. Cai et al. (2011) defined social influence through positive and negative social relationships. The study was inspired by the idea of persona in sociology studies where influence is the approvals gained from other reliable people. Granovetter (1973) and Krackhardt (1992) observed that the effects of the social influence by users of varying personae are different. The three general types of persona identified were positive, negative, and controversial.
Influence Style Model
Li et al. (2011) similarly considered the positive and negative edges of the nodes, and computed the influence index and conformity index in their attempt to detect influence in the social network. However, these studies had focused on a single notion of the influence of bloggers in detecting influence, that is, whether influence exists between linked blog posts, and had not studied in details the influence styles of bloggers. Each individual blogger could exhibit his own influence style, and the overall blog site influence style may not be representative of all bloggers in the blog site. Our study further describes influence through the engagement style, persuasion style and persona of the individual bloggers.
In the influence style model adapted from Tan, Na, Theng, and Chang (2012b), influence is further described in terms of
The influence style model adapted the four general influence types from the Klout Influence Matrix, which include
Kelman (1958) defined
Figure 3 shows the influence style analysis framework. In-links are incoming links to the target blog post, while out-links are links to other blog posts from the target blog post. We extracted the in-link blogs URL from the Technorati.com blog directory, and downloaded the in-link blog posts from the respective in-link blog sites. The “
on the subjectivity study on the target blog posts, and the
We measure the
defined as the size of the intersection divided by the size of the union of the two linked posts content (A and B) shown as : J(A
(2005) with the target blog posts terms. The matched number of subjectivity terms is then normalized with the length of the blog post to give the Persuasion Style score. Wiebe, Wilson, Bruce, Bell, and Martin (2004) observed that the percentage of opinionated words over total number of word instances for subjective content ranged from 7% to 12%. The 7% benchmark is used as the threshold for subjectivity in our model. Examples of subjective and objectives phrases found in the blog posts are given in Figure 4 and Figure 5. It can be seen from Figure 4, subjective terms such as ‘
made the blog post’s style objective and reporting in nature.
The bloggers’ Persona is identified by detecting the sentiments expressed between the in-link and target blog posts. In our model, the sentiment analysis rules based on typed dependency rules were adapted from Tan, Na, Theng, and Chang (2012a). The typed dependency polarity pattern rules used include the adjectival modifier (AMOD), adverbial modifier (ADVMOD), direct object modifier (DOBJ), and nominal subject (NSUBJ) rules. The typed dependency polarity pattern rule is denoted as “typed-dependency(governorterm:[ polarity], dependent-term:[polarity])→[polarity]”. For example, the adjectival modifier pattern rule “AMOD([neutral], [+])→[+]” will be used for the
phrase “great phone”: AMOD(phone:[neutral], great :[+]) to give a positive polarity value. The typed dependency polarity pattern rules are evaluated using a bottom up approach within a clause. For example, starting from the bottom phrase in the phrase structure tree, as shown in Figure 6 for the clause “
For the subsequent phrase (P2), the adjectival modifier pattern rule “AMOD([neutral], [neutral])→[neutral]” for the phrase “current state”: AMOD (state :[neutral], current:[neutral]) would give a neutral output. In the recursive evaluation, the preceding lower level sentiment polarity output is used as the governor term polarity of the subsequent typed dependency polarity pattern rule. Hence, the governor term “state” in the subsequent direct object pattern rule would inherit the neutral polarity of the preceding rule “AMOD(state:[neutral], current: [neutral])→[neutral]” evaluation output. With this, the direct object pattern rule “DOBJ([-], [neutral])→[-]” for the phrase “hate state”: DOBJ(hate:[-], state:[neutral]) gives a negative polarity sentiment output within the verb phrase indicated by P3. The subsequent adverb modifier pattern rule “ADVMOD([-], [intensify])→[intensified -]” for
Examples of Target Topics and Their Overall Aspects and Features
the phrase “absolutely hate”: ADVMOD(hate:[-], absolutely:[intensify]) will also yield a negative polarity. The intensifier term “absolutely” further increase the negative value of the polarity, which is recursively input into the governor term in the nominal subject pattern rule “”NSUBJ([-], [neutral])→[-]” for the phrase “I hate”: NSUBJ(hate:[-], I:[neutral]) to give the eventual negative sentiment polarity output for the clause in the final recursive step. The overall blog post's sentiment on the target topic is derived by aggregating the individual clause sentiments for the target topics.
The target topic lexicon was created by listing the aspects and features of the target topics from Apple product related websites (e.g., www.apple.com), with examples of the lexicon records shown in Table 2. In this study, we limit the scope of the target topics to three main topics: iPad, iPhone, and Mac. We identify the target topic by matching the target terms and feature terms in the lexicon list with terms found in the noun phrases of the blog post sentences parsed using the Stanford parser. Feature terms are words describing the product’s functionalities and properties, while aspect terms describe the general characteristics of the product. For example, in the clause “
on the feature term “
In order to differentiate the influence styles of each individual bloggers quantitatively, we carefully chose the threshold values of each influence style type based on the corresponding scales shown in Table 3. The scales were derived from the distribution of scores for each influence type, having the majority score distribution classified into the normal scale. The Listening- Participating score, Sharing-Creating score, and Persuasion Style score are used to determine the scoring scale for the respective influence style types. The Persona Style score is based on the percentage of similar sentiments postings, while the Broad-Focused type and Consistent-Casual type are evaluated through relative comparison amongst the bloggers as the features are specific to the blog sites’ context.
Threshold Alues of Corresponding Influence Style Scores
We identified two influential blog sites (MacRumors, Technorati Authority = 742 and 9to5Mac, Technorati Authority = 779, retrieved on 1 July 2012) from Technorati.com based on their high Technorati Authority values. A total of 753 and 892 in-link posts dated from 1 July 2012 to 23 July 2012 were extracted for MacRumors and 9to5Mac respectively. From the in-link posts, we identified the target blog site posts with MacRumors having 425 posts and 9to5Mac having 391 posts. These numbers refer only to the linked target blog posts within the analyzed period, and not all the blog sites’ posts. Within the target blog posts we extracted 1948 out-link posts for MacRumors and 2297 out-link posts for 9to5Mac. Further to that, we identified the authors of each blog post with the number of blog posts for the MacRumors bloggers and 9to5Mac bloggers shown in Table 4 and Table 5 respectively. 9to5Mac blog site had 10 bloggers as compared to Mac- Rumors with 6 bloggers. Though there were more bloggers in 9to5Mac, the number of target blog posts linked by the in-link posts was lower compared with MacRumors.
4.1.1 Engagement Style: Listening-Participating Type
The Listening-Participating value was computed by counting the number of post titles that contained the target topic terms or related aspect terms, and normalized by the total number of target blog posts in each blog site. The aspect terms found in the blog posts were collated to the target topics to provide the aggregated result at target topic level. As seen from Table 6, the MacRumors bloggers had high participation rate (greater than 90%) on the target topic terms with respect to the other topics postings. This shows that
MacRumors bloggers and their respective blog post count
9to5Mac bloggers and their Respective Blog Post Count
the MacRumors bloggers were active participants towards Apple products related discussions. However, there was a slight deviation to other topics discussion by MacRumors_C (other topics’ Listening-Participating score = 9.0%) and MacRumors_D (other topics’ Listening-Participating score = 5.88%), indicating more participation in other non-Apple related products. We profile MacRumors_C and MacRumors_D as normal participating, with the rest of the bloggers (MacRumors_A, MacRumors_B, MacRumors_E, and MacRumors_F) as high participating type based on their other topics’ Listening-Participating scores being less than 5%. Though MacRumors_E and MacRumors_ F had only few postings, but their postings were specific to Apple related products leading to a low other topics’ Listening-Participating score and subsequent high participating profile.
4.1.2 Engagement Style: Broad-Focused Type
The Broad-Focused type was evaluated by analyzing the unique target topics and the related features contained in the blog post titles for the MacRumors bloggers. MacRumors_A, MacRumors_B, and MacRumors _C were wide in their scope by covering comprehensively the target topics and related aspect features pertaining to Apple brand products. On the other hand, MacRumors_D was restricted in the scope of topics discussed. Only iPhone, iPad, Siri, iOS, iTunes, iCloud, and Mac topics were mentioned in MacRumors_D’s postings. Further to that, MacRumors_E had a limited posting on the Mac topic, while MacRumors_F discussed only on applications pertaining to iPhone and iPad, indicating a focused or limited scope of topics. Nonetheless, the coverage of target topics and aspect features may be limited as the target topic and related aspect-feature list were manually created based on prior knowledge of the Apple brand product domain. We aim to perform automatic topic discovery in our future work to improve the coverage of target topics, aspects, and features.
4.1.3 Engagement Style: Sharing-Creating Type
The Sharing-Creating type was analyzed through the similarity between the target blog posts content and its out-link posts content based on the Jaccard coefficient. Table 7 shows the maximum, minimum, and average Jaccard coefficient values with computed standard deviations. MacRumors_D had a low average self-links engagement style score (4.1%) indicating low content similarity between the self-linked posts. This meant that the blog post content was highly original even
Engagement Style (Jaccard Coefficient) Scores
within self-linked posts, which shows a high creating style. The other MacRumors bloggers had Sharing- Creating scores between 5% and 10%, which classify them as normal creating type. It is noted that MacRumors bloggers are creative and original in its blog posts content even between self-linked content as seen from the similar engagement style values between the self-linked posts and non-self-linked posts.
4.1.4 Engagement Style: Consistent-Casual Type
The Consistent-Casual type measures the consistency of the target blog site to garner in-links over a period of time with respect to the number of target blog posts that are linked by the in-link posts within the analyzed period. Through registering the dates for the linked target blog posts, we grouped the blog posts according to the near-term (Jan 2012 to Jul 2012), mid-term (Jan 2011 to Dec 2011), and long-term (until year 2010) time period. Figure 10 and Figure 11 show a consistent number of links between the in-link blog posts and target blog posts for MacRumors_A, MacRumors_B, and MacRumors_C in the near-term and mid-term duration respectively. Similarly, there were links found in the long-term duration for the three top bloggers, indicating a consistent style. On the other hand, MacRumors_D had two links in the nearterm duration, and one link in the long-term duration. Both MacRumors_E and MacRumors_F had only one link in the long-term duration. The results show MacRumors_D, MacRumors_E, and MacRumors_F to be causal bloggers with inconsistent link history.
4.1.5 Persuasion Style
The persuasion style was measured based on the amount of subjectivity expressed in the target blog post content. From Table 8, MacRumors_A, MacRumors_B, MacRumors_C, MacRumors_D, and MacRumors_F were highly subjective in persuasion with their persuasion style scores greater than 12%. On the other hand, MacRumors_E had a mildly objective persuasion style as seen from the low persuasion style score of 6.9%. From the high subjectivity values, we could infer that bloggers tend to be subjective rather than objective in their persuasion style, which indicates MacRumors to be a subjective product review blog site instead of being objective and reporting in style.
4.1.6 Persona Style
In the persona analysis, the similar sentiments and
dissimilar sentiments ratios between the in-link blog posts and the target blog posts towards the respective target topics were evaluated. From Table 9, it can be seen that MacRumors_A, MacRumors_C, MacRumors_F have Persona Style scores greater than 80% indicating a high positive persona style. The other MacRumors blogger MacRumors_B is also of a normal positive persona style, inferring that MacRumors
Similar Sentiment and Dissimilar Sentiment Values of MacRumors Bloggers
is a blog site that was generally positively received by its readers. However, MacRumors_D has a Persona Style score of 56.7% showing a controversial style within the positively received MacRumors blog site. This means that MacRumors_D blog posts readers expressed both agreement and disagreement on her postings. The evaluation result shows that bloggers from within a blog site could differ in their persona style. The persona style evaluation is not applicable for MacRumors_E because none of the blog postings were related to the target topics.
4.1.7 Macrumors Bloggers’ Influence Profiles
Table 10 shows the evaluated profiles of the Macrumors bloggers. The results show the MacRumors bloggers to be participating and focused on the target topics as evaluated by the influence style
Profiles of MacRumors Bloggers Influence
model. However, there were varying levels of participation and focus amongst the bloggers. In addition, the bloggers were evaluated to be creating in style, with MacRumors_D being more creative and original in blog posts content. MacRumors_A, MacRumors_B, and MacRumors_C had consistent influence over the duration of time compared to the other bloggers who were casual in their influence style. The Macrumors bloggers expressed high degree of subjectivity in their blog posts, except for MacRumors_E who is objective and reporting in nature. Likewise, the bloggers are positive in their persona, while MacRumors_D exhibits a controversial style. These differences in influence style show that bloggers within a common blog site could still exhibit varying style of influence, reflecting the need for further in-depth analysis to differentiate the bloggers’ influence style. By providing an in-depth analysis on the bloggers’ influence style, we could further describe the bloggers’ influence in details.
9to5Mac blog site had 10 bloggers as compared to MacRumors with 6 bloggers. The greater number of individual bloggers in 9to5Mac would create more diversity in influence style amongst the bloggers. This is seen from the Listening-Participating evaluation results in Table 11, where the high Listening-Participating scores of 9to5Mac_J and 9to5Mac_D, and varying
Sharing-Creating (Jaccard Coefficient) Scores
low to high scores of the other bloggers indicate differing engagement styles. In addition for the Broad- Focused type evaluation, 9to5Mac_A, 9to5Mac_B, 9to5Mac_C, and 9to5Mac_E were evaluated to be loosely focused on the Apple related target topics with more other non-target topics discussed, while the other 9to5Mac bloggers were restricted to the target topics range in their postings.
From Table 12, the duplication of content from non-self-link posts is minimal for the 9to5Mac bloggers, possibly due to copyrights constraints on usage of other sites’ content. However, content similarity between self-links blog posts was high with 9to5Mac_I and 9to5Mac_G having Sharing-Creating scores greater than 40%. This shows that though 9to5Mac bloggers do observe the copyrights of other blogs’ content, the tendency is to share their own blog content through the linked blog posts, indicating a sharing type in the influence style. The variations in the sharingcreating style amongst the bloggers are seen in the wide range of average similarity values (9to5Mac_ I=67.3% to 9to5Mac_G=6.0%) between the 9to5Mac bloggers. It is noted that the similarity measure is affected by writing style as seen in short blog posts which tended to give higher Jaccard Coefficient Scores due to the higher similarity between short texts. In the Consistent-Causal type evaluation, it is observed that 9to5Mac_A, 9to5Mac_B, 9to5Mac_C, 9to5Mac_D, and 9to5Mac_E had high number of target posts linked by in-link posts in the near-term time period as seen in Figure 12. However, only 9to5Mac_A, 9to5Mac_B, and 9to5Mac_E had limited number of links (less than 6 for each blogger) in the mid-term duration. In the long-term duration, only 9to5Mac_A and 9to5Mac_F had one linked posting each. This shows that the influence consistency of the 9to5Mac bloggers is limited and differing across the bloggers, for example with 9to5Mac_A being more consistent
than 9to5Mac_J, who had limited number of linked posts in the near-term duration.
The persuasion style scores of the 9to5Mac bloggers are within the range of 10% to 12%, reflecting a subjective persuasion style type for the bloggers with similar level of subjectivity expressed in their blog posts. Only 9to5Mac_D and 9to5Mac_E have a highly subjective persuasion style with a score greater than 12%. Likewise, the 9to5Mac bloggers are positive in their Persona style, with the Persona style scores well above 70%, except for 9to5Mac_E who is controversial in style, and 9to5Mac_J, who did not post on the related target topics. From Table 13, the influence style profiles of the 9to5Mac bloggers show a participating and focused style with the exception of 9to5Mac_D being less active in the target related postings. The 9to5Mac bloggers, other than 9to5Mac_J, are sharing rather than creating in style. There are differing degrees of consistency amongst the bloggers with slightly more than half of them are causal in their influence style. On the whole, the 9to5Mac bloggers are positive in persona style, indicating general consensus from their readers, and they are also subjective in their persuasion style.
A validation of the methods was performed to verify
Profiles of 9to5Mac Bloggers Influence.
the performance of the influence style model and the threshold values used. Approximately 12% (100 records out of 816) of the total target blog post records were extracted for the inter-coder reliability testing in the Persona evaluation, with a balanced distribution for the positive and negative tagged samples. A further 100 records were used for the subjectivity inter-coder reliability testing, where the samples were distributed evenly between the subjective and objective thresholds. A sample of 100 records (Approximately 2.5% of the total number of out-links) was used in the reliability testing for the Sharing-Creating evaluation with a balanced distribution between creating records and sharing records. The threshold values used in the validation are Sharing-Creating score (15%), Persuasion style score (7%), and Persona score (Positive>60%, Negative<=40%). The computed Kappa values for the two person coders’ inter-reliability testing are as follow: Sharing-Creating evaluation (Kappa value=0.97), Persuasion evaluation (Kappa value=0.69), and Persona evaluation (Kappa value=0.61), which are in the acceptable range (Cohen, 1960). The conflicting tags by the two coders were reviewed and manually reclassified and used as the answer keys. The F1 score defined as (F1 score = (2？Precision？Recall )/ (Precision+ Recall)) is used to measure the performance of the influence style model in relation to the precision and recall. The F1 score for both Sharing type (90.9%) and Creating type (90.1%) classification are high. This shows the Sharing-Creating type predictions made by the model to be reliable as validated by the coders.
The model’s F1 scores for Persuasion evaluation were relatively lower (Objective type F1 score=7.1%, Subjective type F1 score=85.4%). Our threshold value (7%) for Objective type classification was too stringent resulting in the poor performance. Rather, a threshold value of 10% improves performance (Objective type F1 score=65.8%, Subjective type F1 score=78.7%), while a threshold value of 12% gives F1 score results of Objective type=36.9%, and Subjective type=49.1%. The results also show that persuasion style could vary even within individual blogger posts as seen from the variation between the maximum, minimum, and average subjective scores of the bloggers.
The F1 scores for positive Persona (74.6%) are higher than the scores for negative Persona (54.1%), because of the assumption that neutrality is considered as agreement, resulting in the higher scores for predicting similar sentiments between blog posts. Performance of the Persona evaluation is dependable on the sentiment analysis; therefore any improvement in the sentiment analysis process would result in better performance in the persona evaluation. In general, bloggers from popular sites have positive persona where in-link bloggers express agreement towards them. Nevertheless, there were bloggers who displayed different persona from the other bloggers as seen in MacRumors_D from Macrumors, and 9to5Mac_E from 9to5Mac, who had controversial persona style.
Our study analyzes blog posts at the blogger-level to give an in-depth evaluation of the individual blogger influence style. Manual observations and description of the blog sites in Technorati.com revealed both MacRumors and 9to5Mac to be specialized blog sites focusing on Apple brand related products, which are indicated by the Participating and Focused types of their bloggers in our evaluation results. It is observed that individual bloggers could differ from the overall blog site and other bloggers in influence style. For example, the overall MacRumors blog site was highly participating towards the main target topics, while individually MacRumors_C and MacRumors_D were less participating on the main target topics, with more diverse range of topics discussed. Similarly, the 9to5Mac bloggers had differing Participating and Focus type level. The level of participation and focus on topics could also differ between the individual bloggers. Being able to differentiate the participation level and topic focus of individual bloggers allows blog readers to determine the bloggers’ depth and scope of knowledge in respective topics. Though bloggers could differ in influence style, there would be certain rules, such as the non-infringement of copyrights commonly observed by bloggers resulting in a similar Sharing-Creating influence style for the bloggers, especially within non-self-link posts. Influence consistency is also observed to differ between bloggers. For example, MacRumors_D, MacRumors_F, and MacRumors_E were casual in their influence style compared with the other bloggers from MacRumors, while 9to5Mac_E, 9to5Mac_B, and 9to5Mac_A were more consistent in the more casual 9to5Mac blog site. Both the MacRumors and 9to5Mac bloggers, except for MacRumors_E were evaluated to be subjective in their persuasion style based on their subjectivity score. The homogeneity in persuasion style is indicative of a product review blog site, which is generally subjective in nature as compared to an objective news reporting blog site. We would attempt to improve subjectivity detection by taking into account the grammatical relations between words in our future work in consideration of the linguistic constraints in matching subjectivity terms for semantic orientation. For example, the subjectivity value of the phrase “
We attempt to derive deterministic thresholds for the scores to provide an objective measurement to the respective influence style evaluation. Through this, we are able to provide a detailed breakdown of the bloggers’ influence styles. Future studies could involve a formal validation of the threshold values through human coders testing, and by analyzing a sizable number of bloggers to improve the test quality. Influence style of a blogger is time dependent, where the bloggers influence on specific topics is based on the analyzed period as seen from the Consistent-Casual influence style result. A different period of analysis could have identified the influence style differently since the measurement values would have changed. In this study, the target topic and related aspects list were manually created based on prior knowledge of the Apple-product domain. We aim to perform automatic topic discovery in our future work to improve the coverage of target topics and aspects. An in-depth topic analysis would provide a more comprehensive coverage of the specific topics discussed.
The results from our study show that influence style is specific to individual bloggers, and the blog site influence style is not representative of all bloggers. By analyzing the influence style of individual bloggers, we are able to provide more fine-grained descriptions of the bloggers’ influence. Previous studies which assumed a monolithic definition of influence would not be able to differentiate the varying influence styles of the individual bloggers. The knowledge on individual blogger’s influence style would be used in our future work to detect influence in the blogosphere. For example, we could use the Participating, Focused, Creating, Consistent, Low Subjective, and Highly Positive influence style of MacRumors_C as features to predict the possibility of influence propagation. Future studies could explore the combination of influence styles that are indicative of high influence, which could determine whether a mixture of influence styles would increase the influence level of a blog site.
In contrast to previous studies which used a monolithic definition of influence for blogs, our study further describes the influence of bloggers in terms of engagement, persuasion, and persona style. The detailed analysis of influence could differentiate the influence style of bloggers, and provide a more comprehensive description of the influence exerted. Our evaluation results show there are differences in influence style between individual bloggers and the overall blog site as well as amongst the bloggers. This indicates a need to analyze individual blogger’s influence style to provide further in-sights into the blog influence profile. The provision of the bloggers’ influence style would enhance the influential blog search experience through the detailed description of the manner in which the bloggers exert influence. Further to that, a more comprehensive and accurate portrayal of the blog influence through the evaluated influence profiles would in turn improve influence detection within the blogosphere.