In previous posts I wrote about some potential changes for Google’s infrastructure which Matt Cutts called Caffeine. Now, Matt did say (I guess we are on a first name basis) that they were going to hold off on this update until after Christmas 2009. This was done because last time a big update occurred it was right before Christmas and it negatively affected online retail sales. So, a bit of love – just in case Caffeine would have a significant affect in the SERP’s.

Then there was a ranking change which introduced the idea of how web page speed is being factored into the ranking criteria. I will reiterate here – relevancy is still the key metric.

But, something significant happened in Q1-Q2 2010 and Webmasterworld, as has always been done in the past, called a new, noticed algorithm changed “Mayday”.

This appears to have affected a large number of webmasters with reported traffic drops ranging from a 10% to 90% loss with a very apparent change on how Google is handling long-tail phrases and how far more spammy sites seem to be appearing in some results. This thread on Webmasterworld is long with a lot of analysis and speculation resulting in 13 pages of posts, so I’d suggest going straight to page 13.

This has had a much more noticeable affect and is apparently not finished yet. As Google isn’t too forthcoming Mayday could be a part of Caffeine; however, this shouldn’t necessarily be so because Google stated that Caffeine would be purely an infrastructure change that most users would probably not notice.

One poster, dusky, summarises on May 12th:

“There are too many legitimate white hat sites being whacked to believe it’s a penalty. Many well established gov and edu sites, large commercial and corporate sites, well known news and media sites that seen a change for the worst so far for the last three months at least and starting MayDay in particular. G* sites themselves are affected as noted above and somewhere else, how many more days or weeks this is going to take is probably everyone’s question, at least the people who join my “total re-index” camp anyway, or shall I call it total-recall. We used to think they lost some or most of the data when this happened, and that’s why the crawl rate and the re-indexing, but it turned out it was due to infrastructure and algo updates, Florida and BigDaddy are best examples.”

We have a theory based on TF-IDF. Ian Lavelle, my colleague here at Outrider, took the time to show us how this algorithm change (and apparent surge in spam pages showing in search results) could affect the long-tail. You can read Ian’s post here.

UPDATE

I thought I’d update this post based on the fact that SearchEngineLand has posted a confirmation of the Mayday algorithm change on May 27, 2010 (see excerpt below):

“Google made between 350 and 550 changes in its organic search algorithms in 2009. This is one of the reasons I recommend that site owners not get too fixated on specific ranking factors. If you tie construction of your site to any one perceived algorithm signal, you’re at the mercy of Google’s constant tweaks……

……However, sometimes a Google algorithm change is substantial enough that even those who don’t spend a lot of time focusing on the algorithms notice it. That seems to be the case with what those discussing it at Webmaster World have named “Mayday”. Last week at Google I/O, I was on a panel with Googler Matt Cutts who said, when asked during Q&A,  ”this is an algorithmic change in Google, looking for higher quality sites to surface for long tail queries. It went through vigorous testing and isn’t going to be rolled back.””

There is a lot of talk in the traps about website page speed. Google (via Matt Cutts and Webmaster Tools) has openly stated that page speed will be a factor into the ranking algorithm for 2010 and will likely roll out with Caffeine – faster the better and you’ll be rewarded for it.

Google Webmaster tools have been reporting sample data from sites that have page speed issues (you can find this in the Labs section under Site Performance). Within Google Webmaster it also suggests the supplied Page Speed Firefox plug-in (installs as part of Firebug) should be used to get more accurate and full data. This has been available since July 2009 so I guess we have had plenty of notice. This is already in play for AdWords where page speed will affect your quality score.

This tools reports in the order of priorities – which things are slowing the pages the most and also gives a suggested size savings if recommendations are carried out and, I mean, recommendations. It tells you specifically what files are problematic, which images should be attended to, which JavaScript files can be combined, which CSS definitions (within an include file) aren’t being used and can be excluded, DNS look-ups, browser caching and more.

Google introduced this idea of page speed officially in their blog in June 2009.

Not surprisingly it has been written up on many sites. Webpronews covered this in November 2009.

The goal here is to make the internet faster and improve the user experience. In turn, it is very likely that this will also improve traffic and conversions. Here’s an excerpt:

“If you’re serious about wanting your site to perform better in search engines, and you haven’t given much thought to load times and such, it’s time to readjust your way of thinking.”

Of course there is going to be debate about this within the industry, with marketers and developers. It’s just a new little layer to make our jobs a little more challenging.

At this stage the Caffeine update has yet to roll out. The last update Matt Cutts posted can be found here: Expect Caffeine after the holidays.

Here are some other sites to read up on this:

Google Page Speed Report Comes to Webmaster Tools
Site Speed Google’s Next Ranking Factor
Google Wants the Web to Function like a Magazine
WebPerformance Best Practices
Should Web Page Speed Influence Google PageRank?

Over the last few days it was announced that Google will be making changes to its algorithm; a sizable modification which we may have not seen since the likes of Big Daddy and Jagger’s 1-3 in 2006.

Google has stated:

“For the last several months, a large team of Googlers has been working on a secret project: a next-generation architecture for Google’s web search. It’s the first step in a process that will let us push the envelope on size, indexing speed, accuracy, comprehensiveness and other dimensions. The new infrastructure sits “under the hood” of Google’s search engine, which means that most users won’t notice a difference in search results. But web developers and power searchers might notice a few differences, so we’re opening up a web developer preview to collect feedback.

Some parts of this system aren’t completely finished yet, so we’d welcome feedback on any issues you see.”

Whilst Matt Cutts claims that most of the change will be on infrastructure, we may see some changes in the search results.

It is certainly an unexpected move from Google, which generally does not give the general public this type of insight, let alone coining a term for it before anyone else does. If you want to see a preview of this work in progress you can here: http://www2.sandbox.google.com

As for searches you will see a reordering of results, however, the change is purported to make searching faster and more accurate – more real-time. As usual Google is not revealing what exactly has been altered. Google have opted to make this change in beta for users to test, calling it a developer’s preview.

Users, as you would imagine, have already begun testing. Mashable has done this and published their results:

- Results did return faster and in some cases doubling the speed at which results are returned
- It does seem that some elements of blended search are further down in the page which could mean that not all elements have been implemented in Caffeine. Mashable even speculate that user activity on some sites may have pushed them higher in the results
- The new results do seem more relevant in some cases and it appears that it could be tightly tied with keywords
- Index size is also increased

In my testing I found that indeed the changes to the pages are not hugely significant. Doing a vanity search the first thing I noticed was that social media sites were more prominent. This may tie in with the result above that user activity may play a role in rankings.

So, what does this mean for SEO?

At the moment it simply means that we must be ready when this change rolls out. Will results have a heavier focus on keywords and user activity? If all elements of blended search are included in Caffeine then it would appear that universal results are being pushed down.

Obviously, as Google has put this out for testing, the end results will likely be very different than the current speculation of changes we are seeing at present.

As Tom Krazit stated on CNET:

“That’s not necessarily indicative of how the results would be presented, once Caffeine goes live, but it is evidence that the update will require those dependent on Google to drive traffic to their sites to study the changes. For now, Google is not sharing many details regarding how it reworked its back-end architecture and indexing process with Caffeine.”

It is still early days – so watch this space.

Further references can be found here:
Google’s New Search Index
Google Caffeine Tests

On the 24th of February, Google made the announcement of two new improvements made to their search results. These Google search improvements included:

1. an expanded list of useful related searches – the terms found at the bottom, and sometimes at the top, of the search results page.

For example, if you type in something like “sydney restaurants guide” in to the search box on Google; at the top or bottom of the results page, you will see ‘Searches related to sydney restaurants guide’ which provides more relevant key phrases.

What Google have done is they’ve deployed a new technology based on the 2006 acquisition of “Orion” which can better understand associations and concepts related to a particular search.

So taking the same example of “sydney restaurants guide”, the related terms shown by Google include “sydney thai restaurants” or “café sydney restaurant”.

This update has been rolled out for other languages too, as detailed in the Google blogs, where they state “We are now able to target more queries, more languages, and make our suggestions more relevant to what you actually need to know.”

2. the addition of longer search result descriptions – so when you enter a longer query (more than three words), usually you are presented with a regular-length snippet which may not give you enough information and context. Hence Google has increased the number of lines in the snippet to provide more information and show more of the words you typed in the context of the page.

Another example to show you how this works; if you look up “thai restaurants found in the city” into Google search, the search results will include a variety of results with two to three line snippets.

Ultimately, these Google algorithm updates have been launched to help users find the information they are looking for, more efficiently.