As you all might have red that our team is participating in the SEO World Championships 2007, but only few of you know that we were experiencing some major problems getting our web site indexed quickly with the SERPS. The situation was that the raw web logs showed search engine activities but the site itself was not included in the index as of that point. That brought the idea for the development of a new module for the SEO Website CMS which in fact was already implemented with one of our websites ..

This seo website cms module is made of from two parts. The first one is a browser detector which determines what kind of browser you are using by checking the most popular ones from a given list. If your browser is not included in that list it is assumed that you are using NEW browser or you are a search engine, then your browser identification string, ip, url and date with time so you can back trace when the spiders visited each page and see how fresh it is without bothering going to the se website to check freshness of each url.

The only problem with that seo website cms tool for now is that you have to clean it up from time to time especially if you have more pages. For example we use it on our primary website and we have about 300 pages there, and that averages in about 3k-4k entries per month (search engines spider our site almost every day and there are about 10 large crawlers) and this produces a lot of MySQL data. We strongly suggest that this seo website cms tool is to be used by hardcore seo specialist especially for this issue. Also we are planning to make user friendly report interface for the seo website cms which will be able to automatically clean up duplicates and keep only 2-3 crawl history entries per page per search engine which is going to allow more webmasters to use it without any problem.