Google Indexing of Twitter Appears to Be Declining | Perficient Digital

Google Indexing of Twitter Appears to Be Declining

At Perficient Digital, we’ve been actively tracking Google’s indexation of Twitter since July of 2014. Today, I’m publishing our fourth update, and it offers up some fascinating insights. At the end of this post, you’ll find a handy slide deck summary of the whole study.

To start, here are two of the more interesting conclusions of this report:

  1. Google’s indexation of Twitter has peaked. Back in July of 2015 we saw the highest indexation of Twitter ever. In fact, in all our updates since July of 2014, Twitter indexation was continually increasing, but as of this update, Twitter indexation is down overall.
  2. In our prior updates, we showed that Follower count or Social Authority appears to make a difference, but today we’ll show that having a Verified Account has a very high correlation with the percentage of your tweets that get indexed. This a fresh confirmation that clear identity matters quite a bit to Google.

In this study (as with the other three that we’ve published), we looked at more than 90,000 tweets from over 900 accounts, across a wide range of follower counts and social authority. The other three studies we’ve published can be found here:

  1. Twitter indexing as of July 2014
  2. Twitter indexing as of January 2015
  3. Twitter indexing as of July 2015 (right after Google’s use of the Twitter firehose was launched)

Overall Indexation Over Time

The following chart shows us the aggregate indexation of all the tweets looked at in each study:

Google indexation of Tweets appears to have peaked.

Each looked at tweets from the same basic group of people on Twitter. The only adjustments occurred when people dropped off of Twitter, but otherwise the accounts tracked remained the same. Each study included more than 90,000 tweets.

So what we see here is that Google hit an indexation peak around July of 2015, and today indexes only about 64% of the tweets it was indexing back then. As a company, Google is constantly testing and measuring impact of different approaches to indexation and ranking. This drop off is a strong indication that the level of indexation they had in July of 2015 was higher than the optimum for their overall search results, and they’ve scaled it back a bit.

What most people don’t realize is that Google’s indexation of Twitter is often a bit slow. We’ve shown that consistently through our four studies in the topic. Look at how many tweets are indexed after seven days:

Google is indexing Twitter faster over time.

However, as of October of 2016 (when the data I’m publishing today was collected) it’s the fastest it’s ever been, with 4.1% of tweets getting indeed within seven days. Still, this is less than half the tweets that Google eventually indexes, and that means that there are other factors that Google uses to decide that a tweet is worth indexing.

Impact of Favorites and Retweets on Indexation

Here is the data on the impact of Favorites on indexation from the data for this fourth version of the study:

Impact of Favorites on Indexation

And, here is the corresponding data on the effect of Retweets on indexation

Impact of Retweets on Indexation

As you can see, tweets that garner a lot of Favorites and Retweets are indexed at a much higher rate. Our data seems to show a preference for Favorites over Retweets, though I’m still working on why that may be the case. It may be that data shows that Favorites occur somewhat more sparingly than Retweets, perhaps because of all the accounts out there that auto-Retweet all the tweets of any influential account.

Impact of Follower Count / Social Authority

Here is the data using the Follower count of the accounts tracked, showing indexation levels over time:

Impact of follower count on tweet getting indexed by Google

We also tracked indexation levels based on Followerwonk Social Authority, though we have that data only for two of the four studies we’ve done:

Impact of social authority on indexation of tweets in Google

What Social Authority takes into account that Follower counts does not is the level of engagement with an account’s tweets, as well as the authority levels of those who engage with it, and this is why we include this view in our data.

As you can see, higher Follower counts, or higher Social Authority, impacts your level of indexation. This makes sense – more people are interested in what these people have to say. In addition, this data shows that Google has dropped the level of indexation since July 2015 regardless of Follower Count or Social Authority. Higher levels still get more than lower levels, but just not as much as they used to.

Impact of Having a Verified Account

Last, but not least, is a look at the impact of having a verified account. This shows a very powerful impact:

Impact of Verified Accounts on Indexation

This is underscored even more when we look at the indexation of unverified accounts:

Impact of Unverified Accounts on Indexation

Notice how the level of Social Authority matters little for unverified accounts. In contrast, it’s a very big deal for verified accounts. The indexation level for low Social Authority accounts that are verified is not much better than it is for unverified accounts. It looks like you need both for maximum results!

Conclusions

Our data provides some very interesting insights into how Google looks at Twitter. Please bear in mind what follows is my interpretation of, and speculation about, the data.

1. Testing Processes at Google: The evolution of Twitter indexing over time is revealing. Shortly after the Twitter firehose deal was implemented by Google, it looks like indexation levels peaked. This makes sense. Google was conducting testing to see what the optimum levels for indexation were. They will continue to test and iterate those algorithms over time. For example, the continuing shift of consumer attention to engaging with the web via Smartphone devices may well continue to drive shifts in indexation levels.

2. Google Is Not in a Rush to Index a Tweet: Speed is NOT a primary driving factor in indexation. Remember, even after 7 days, less than half the tweets that Google will eventually index are indexed. That means that other factors play a very big role in what gets indexed, and what doesn’t.

3. Activity Levels a Big Factor: Our data suggests that the driving factor is engagement levels (Favorites and Retweets). One could imagine a sophisticated algo that has varying thresholds over time, where a certain rate of initial activity could cause something to get indexed quickly. On the other hand, a sustained level of engagement over time might cause a tweet to be viewed as more valuable evergreen content, worthy of inclusion because of that ongoing engagement.

4. Social is Not the Highest Priority Content: Over the past couple of years, we’ve shown not only in these Twitter studies, but also in a Facebook indexing study, that Google doesn’t make any attempt to index all social media posts. In fact, it’s fair to say that the vast majority of such posts are ignored. This underscores one of the reasons our Mark Traphagen gave for why social media is not a direct ranking signal for Google.

5. Identity Matters: The strong data for verified accounts was pretty revealing. Recall what Eric Schmidt said in his book The New Digital Age: “Within search results, information tied to verified online profiles will be ranked higher than content without such verification, which will result in most users naturally clicking on the top (verified) results. The true cost of remaining anonymous, then, might be irrelevance.” That’s a pretty powerful statement, and the data we have on Twitter indexing seems to back that up.

Slide Deck Version of This Study

Contact Us

Uncertain about which services will best address your business challenge? Let our digital marketing experts help.

CONTACT US

8 responses to “Google Indexing of Twitter Appears to Be Declining”

  1. Andy kuiper says:

    Thanks for sharing – I new retweets were an important factor, but finding that less tweets are being indexed is interesting.

  2. Great update Eric!
    I have a question: the indexation rate of tweets is “the effect” of the tweets that garner a lot of Favorites and Retweets or are first indexed and then these tweets have more Favs and RTs?
    Thanks!

  3. Ryan Schulz says:

    Thanks for the analysis! So, indexing is down overall and it can take days for the Tweets to appear in the search index. I wonder how long these Tweets actually stay in the index?

  4. Eric Enge says:

    Great question! Perhaps in our next Twitter indexing study, we;ll take a look at that.

  5. Clint Butler says:

    Do you think your results reflect just Twitter indexing or site indexing as whole? For example, YouTube indexing has dropped considerably as well. Often times, we are finding we have to resubmit videos two or three times to get them to actually stick in the serps.
    In some cases, even our websites are going in and out of the index.
    To add an additional wrinkle, we have checked with one Google account and the site is not in the index. Then we check on a different machine without a Google account and it’s there. Then we check on the same machine with another Google account it’s there. Yet, a different account, same machine with a proxy and it’s not.
    I am just floating a guess here, but it seems indexing is flexing significantly right now and data centers are returning completely different results beyond personalized search.

  6. Do you think twitter is important to position more? I understood that google cares little how many links you have on twitter, otherwise it will be if those links derive quality traffic to your blog

  7. Mark Traphagen says:

    Twitter can certainly drive traffic to your blog (it’s actually our #1 single traffic driver, second only to Google Search) if you’ve worked hard at building a following of people who would actually care about your content (not just empty followers for the numbers’ sake).
    As for Google search, if you can pass the bar for your tweets to get indexed, showing up in search never hurts, right?

Leave a Reply