Google Caffeine, FeedBurner and Ultra Fast Google Indexing
After you create a new web page, do you wonder how how much time it will take to get in Google’s Index? It’s something I constantly check for my own website as well as for my clients’ websites. But over the past several months, I’ve noticed ultra fast Google indexing when you combine blog posts, Google Caffeine and FeedBurner.
And I mean ultra fast – my posts are indexed by Google in three minutes. The group at Hobo-Web also wrote about this phenomenon.
(Update) In this case – Google indexed the web page in two minutes:
Formula for (Almost) Real Time Indexing
Here’s how I’m set up:
- My blog is WordPress
- The RSS feed is connected to FeedBurner (which pings Google Blog Search)
- My FeedBurner is also using the Socialize feature to update the post on my Twitter account
Here’s what I have observed:
- Blog post is submitted
- Search for the targeted keyword(s) appears in SERPs (search engine results pages) almost instantly as in 3 minutes
- Rankings bounce around for a few days before stabilizing
Google Caffeine, FeedBurner or QDF (Query Deserves Freshness)
Admittedly, this post raises more questions than it answers, but hopefully you will share your own observations and experiences.
The time to get in Google’s Index is likely tied in to the Google Caffeine infrastructure change, FeedBurner integration and the QDF or Query Deserves Freshness part of Google’s algorithm.
QDF – which is covered in more detail by SEOmoz here – deals with a part of Google’s algorithm which identifies certain topics which are deemed to require more frequent updating. So webpages covering topics which fall into this category get indexed more rapidly.
However, I believe Google Caffeine, FeedBurner and technology advancements have more to do with this than the QDF part of the algorithm.
Google Does Not Index all Web Pages at the Same Rate
No kidding right? But seriously, in the last two weeks, I’ve experienced three very different indexing situations.
- Blog Post Indexing
- When connected to FeedBurner, new posts on my WordPress blog are indexed within a few minutes.
- When the blog posts are not connected to FeedBurner, it takes significantly longer.
- Non-Blog Web Page Indexing
- A client’s home page was revised – content, title and meta information only, not a redesign
- 12 days later – the changes are not reflected in the SERPs
- Standard (not a blog) HTML webpage – not connected to FeedBurner or RSS
- Bing picked up the change after about a week
- This is a Page Rank 4 website that gets a respectable amount of website traffic
- New Website
- Created an e-commerce website for another client two weeks ago
- Website was added to Google Webmaster Tools
- Sitemap was submitted
- Links were added from authoritative, established websites
- Website is not indexed in Google, Yahoo or Bing after 2 weeks
- This is what is referred to as “The Sandbox” effect
Shorten the Time to Get in Google’s Index
If you want to shorten the time to get get in Google’s index, hook up your blog to FeedBurner. Whether it’s the new Google Caffeine infrastructure, FeedBurner or a refinement to the QDF portion of Google’s algorithm is a technology question. If you want your blog posts to get immediate visibility – consider adding FeedBurner.