SEO Meter now monitors more than 1,000 websites’ crawling activities, and the number is still growing as of this writing. These websites include many high profile commercial/non-commercial websites manually added by us (30%), as well as user-submitted websites and blogs (70%).

The average crawl cycle of these 1,000 or so websites comes out at 2.19. So on average, Google is updating its cache for these websites once every other day. Comparing your own stat against this average can give you a rough idea where your website is ranked in terms of Google’s crawling activities.

For those folks who are more into statistics, the following scary-looking figure can give you a more accurate way of figuring out your (relative) crawl rank on the web.

The red curve in the figure is so-called cumulative distribution function (CDF) of Google’s crawl cycle obtained from our listed websites. Putting aside nitty-gritty details about CDF, this plot basically tell you your relative crawl ranking (shown in the y-axis) from your crawl cycle (shown in the x-axis). For example, suppose your crawl cycle is 1.0. Then check the y-value of the curve at x=1.0, which is approximately 0.15. This means your site belongs to top-15%. Suppose your crawl cycle is 3.0. Then from the figure, you can see that your site belongs to top-75% (i.e., y=0.75 at x=3.0). Hope I did a good job deciphering this stuff.

One caveat about this CDF is that it was generated from 1,000 or so websites monitored by us. So the resulting ranking distribution may not be a totally accurate snapshot of the entire web. Only Google will know the accurate info on that. Anyway it will be interesting to see how the stats will change as our database grows over time.

So for now, feel free to use this toy metric to infer your relative crawl rank on the web.

You don’t know the crawl cycle of your website? Then feel free to add your site to SEO Meter for free, and start to have your crawl cycle monitored by us.

It’s about one month now since we opened up SEO Meter to the public last month. So far, I’ve received many positive/useful comments about the tool. Here are some of the bloggers’ comments about our tool:

Thumbs up:

All and all SEOmeter is a pretty cool website. I use compete.com a lot so I know I will be using this website a lot too.

SEO Meter is a brilliant name for a brand and I can see this site growing into a very valuable service.

This is the kind of site that I would love to start. It has a good idea, feels a need, and is very brandable.

I love automation of process. All of this information about a site can be obtained by doing a search or looking into Google Webmater tools, but wouldn’t be easier to just set it and forget it? In this case I say yes.

If you run a blog, news site, or very large site, then the fee will probably become worth it…. All in all. Pretty gosh darn neat if you ask me.

I’m just more fascinated on graphs and how much the trends change over time. This gives you different things to check your experiments. Maybe you start posting more or less. It could affect your search engine referrals.

The SEOMeter.com site is easy to use and it explains in greater detail all of the benefits of using this type of Search Engine Optimization Tool.

I must say, it’s a very useful tool, one that every webmaster on earth should take advantage of…Some newer webmasters might not see the need for it for a while, but it’s nice to know that there is something out there to do this efficiently for you.

Seometer is a valuable addition to any blogger or sites owners toolkit and with its ease of use something that won’t take more than a few minutes to get up and running with.

Thumbs down:

Is the system foolproof and 100% accurate? It shows that ReadWriteWeb is visited more often than Engadget, while Engadget is a lot more popular.

after a blog reaches a certain point (becomes really popular), the graphing loses value as every single blogs graph would eventually plateau at the same point

you can have your very own Google Crawl Cycle chart but I’m afraid all this did was make me yawn. Not more stats to pour over,” I thought.

The graph provided by the SEOmeter SEO tool looks an awful lot like the graphs that you see on Alexa.

It is ridiculous to charge price for a service that is completely dependent on Google’s crawling policy and if google, like yahoo and msn, suddenly decides to “not publicise” their crawl timestamp, this service will just go bust.

Suggestions:

Maybe a paid version were it tracks your spider traffic accurately by putting code on your site or server.

Ok the first thing I would do is upgrade the method used to determine Google’s crawl rate… I would use the Statcounter approach, giving people a script or a file to place on their site. They would then come back to SEO Meter to log in and check the results. This would be a lot more accurate method to test the rate and would bring more repeat traffic back to SEO Meter.

I’ll get back to some of these thumbs down comments and suggestions later.

After receiving a number of feedbacks from our users, we decided to make one important change for our tool: making SEOmeter a free tool for everyone!

There are a couple of points that I’d like to highlight for our new free SEOmeter tool:

• Google’s cache history is limited to the latest three months. Any history older than three months will be discarded and won’t be accessible.
• Free submission is limited to top-level domain or sub-domain only. Internal URL submission is still subject to annual payment.
• Website under construction, or with incomplete content or poor design will not be accepted.

If you have any question or suggestion, feel free to add it here.

If you have a website to submit, get onboard!

To celebrate the launch of SEOmeter.com, we are accepting 100 websites in our monitoring system for free. Yes, you heard it right. Free admission with no string attached! To be eligible for free admission, you should add a comment to this blog post, and include your site URL in the comment.

Here are other requirements for free admission:

1. Only one site is allowed for each IP address. If there are multiple entries for a given IP, the one mentioned in the earliest comment will be accepted, and the rest will be automatically rejected.
2. Only top-level domains or sub-domains are allowed. No internal page or folder is allowed.
3. Site should be cached by Google within the last two weeks of your post. Please check with Google by using cache: command.

This post/offer will be closed once 100 eligible entries have been chosen.

There are some internal changes made to our database. Now all the websites monitored by us are categorized by their topics internally; the classification is made by our editor, not by submitter. In the top-20 page, we then list the top-20 sites in each category in terms of their average crawling cycles. The top-20 rankers in each category are automatically updated as their stats change over time. The top-20 list will give you an idea of what kinds of sites are favored by search engines in each category. You should be proud of yourself if your site make the list.

Two updates from SEOmeter.com:

Website submission page has been added. We decided to charge an annual (but modest) fee for each submitted site for monitoring. The reason behind introducing the annual fee is to support the cost of our server and database resources which will increase over time as more sites are monitored by us.

The other update is, an AJAX comparison menu was added in the site information page (see the screenshot below). You can enter two more urls in the comparison form to compare the current website against two other sites in terms of crawling history.

Currently there is one known issue with the AJAX comparison form. For whatever reason, AJAX refuses to retrieve results on any mod-rewrited page. So for example, the comparison form works fine on http://www.seometer.com/index.php?search=google.com, but not on page http://www.seometer.com/cache/google.com . We are working on fixing this issue. The issue was fixed.

SEOmeter.com is open to the public. Our site is still in beta, and we are still working to make it fully functional, including website submission procedure. In the mean time, you still can get a glimpse of our site. We will get back to our blog in a few days, and describe in more detail what our site is about, and what motivated us to develop SEOmeter.com.
Please tune in!