Comments on: Blue Hat Technique #10-Teaching The Crawlers To Run http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/ Advanced SEO Tactics and Techniques Wed, 20 Aug 2008 08:48:30 +0000 http://wordpress.org/?v=2.0.7 by: beverly farrar http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-239792 Sun, 22 Jun 2008 18:02:24 +0000 http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-239792 According to my website reporting of crawler hits below, it has slowed considerably. What do you think is the cause and how can I remedy this? Thanks so much! Crawler Hits June 2008 104 May 2008 151 April 2008 0 March 2008 149 February 2008 136 January 2008 128 December 2007 185 November 2007 160 October 2007 153 September 2007 212 August 2007 277 July 2007 580 June 2007 685 May 2007 11 April 2007 791 March 2007 1201 February 2007 948 January 2007 911 December 2006 746 November 2006 460 October 2006 472 September 2006 796 August 2006 1118 July 2006 673 June 2006 820 According to my website reporting of crawler hits below, it has slowed considerably. What do you think is the cause and how can I remedy this? Thanks so much!

Crawler Hits
June 2008 104
May 2008 151
April 2008 0
March 2008 149
February 2008 136
January 2008 128
December 2007 185
November 2007 160
October 2007 153
September 2007 212
August 2007 277
July 2007 580
June 2007 685
May 2007 11
April 2007 791
March 2007 1201
February 2007 948
January 2007 911
December 2006 746
November 2006 460
October 2006 472
September 2006 796
August 2006 1118
July 2006 673
June 2006 820

]]> by: Forumistan http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-220602 Mon, 07 Apr 2008 22:59:31 +0000 http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-220602 Great stats man, keep it on... Great stats man, keep it on…

]]> by: Prosperity Writer http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-217119 Mon, 24 Mar 2008 09:08:07 +0000 http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-217119 from your experiment is it safe to say that putting a blog, mydomain.com/blog, for example, in my non-blog website improve indexing? from your experiment is it safe to say that putting a blog, mydomain.com/blog, for example, in my non-blog website improve indexing?

]]> by: neil strauss http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-198386 Mon, 21 Jan 2008 15:55:39 +0000 http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-198386 These days, blogs that release a new post gets that post index in literally less than an hour! These days, blogs that release a new post gets that post index in literally less than an hour!

]]> by: Eli http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-13524 Sun, 04 Feb 2007 21:27:13 +0000 http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-13524 hehe, I have no idea what labcoat size i am :) I wear a mens large shirt if that helps :) Labcoats are badass, I'd totally wear one all the time. I'd be one of those creepy scientists. So if anyone has an evil looking labcoat to hook me up with you can mail it to my office on BlueHatSEO.com whois info. thanks for the compliments by the way. Feel free to visit anytime. hehe, I have no idea what labcoat size i am :) I wear a mens large shirt if that helps :) Labcoats are badass, I’d totally wear one all the time. I’d be one of those creepy scientists. So if anyone has an evil looking labcoat to hook me up with you can mail it to my office on BlueHatSEO.com whois info.

thanks for the compliments by the way. Feel free to visit anytime.

]]> by: josh http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-13516 Sun, 04 Feb 2007 20:20:14 +0000 http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-13516 Got your cool ass lab coat for you. Just hit me with the size. The wife works for Clinique and they go with the "laboratory" look. They sell to their employees at $200+/coat but for you, my friend, $0. Worth every penny for all the sweet advise from a evil genius. Only been here about an hour and you have already taught me a trick or 2. Any methods discussed on this site your favorite? Got your cool ass lab coat for you. Just hit me with the size. The wife works for Clinique and they go with the “laboratory” look.

They sell to their employees at $200+/coat but for you, my friend, $0.

Worth every penny for all the sweet advise from a evil genius. Only been here about an hour and you have already taught me a trick or 2. Any methods discussed on this site your favorite?

]]> by: Eli http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-60 Sun, 30 Apr 2006 00:11:56 +0000 http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-60 Sure Deep, You will need some experience in coding either cgi or php. Basically you just write all your content and put it into a database. Then write the script to pull one of the sections of content and feed it into the main page. The other way of doing it is to create the pages and then cycle links to them on hte main page on a schedule. Creating a cronjob(scheduled server event) will be needed. Sure Deep,
You will need some experience in coding either cgi or php. Basically you just write all your content and put it into a database. Then write the script to pull one of the sections of content and feed it into the main page. The other way of doing it is to create the pages and then cycle links to them on hte main page on a schedule. Creating a cronjob(scheduled server event) will be needed.

]]> by: deeb basheer http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-59 Fri, 28 Apr 2006 15:25:39 +0000 http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-59 can you tell me how to build a self updated website ??? thank you for the great info deeb basheer can you tell me how to build a self updated website ???

thank you for the great info

deeb basheer

]]> by: George http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-57 Thu, 20 Apr 2006 08:52:46 +0000 http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-57 Thanks for the response. I've been reading about the blog/ping cycle leately (just getting started with technical aspects of SEO -- no hat yet) and I'm simply not clear on it. Could you do a post about blog/ping? There are only two benefits that I see: 1. IF it works, you can get new pages indexed fast by blogging a link and then pinging. 2. You can POSSIBLY give your sites worthwhile links by blogging links then pinging. I've read that this is "dead" (definition: anything I've heard about -- Capri pants, the Decembrists, blogging/pinging) as a technique. What's your take? Thanks for the response.

I’ve been reading about the blog/ping cycle leately (just getting started with technical aspects of SEO — no hat yet) and I’m simply not clear on it. Could you do a post about blog/ping?

There are only two benefits that I see:

1. IF it works, you can get new pages indexed fast by blogging a link and then pinging.

2. You can POSSIBLY give your sites worthwhile links by blogging links then pinging.

I’ve read that this is “dead” (definition: anything I’ve heard about — Capri pants, the Decembrists, blogging/pinging) as a technique. What’s your take?

]]> by: Eli http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-45 Thu, 06 Apr 2006 05:25:08 +0000 http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-45 Great question George. They were auto generated content but put into static pages. They weren't blog sites however. I do think robots do treat blogs differently than traditional static sites, but that is only because blogs are updated at more random intervals than larger sites. Blogging and pinging does have it's effects as well. Great question George. They were auto generated content but put into static pages. They weren’t blog sites however. I do think robots do treat blogs differently than traditional static sites, but that is only because blogs are updated at more random intervals than larger sites. Blogging and pinging does have it’s effects as well.

]]> by: George http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-44 Wed, 05 Apr 2006 16:48:42 +0000 http://www.BlueHatSEO.com/blue-hat-technique-10-teaching-the-crawlers-to-run/#comment-44 Very interesting information! Question: were these hand-built sites or auto-generated content? Do robots treat blogs differently from "traditional" more static sites? Or are the sites treated the same, only crawled more frequently because they're updated regularly? Great site, BTW. Very interesting information! Question: were these hand-built sites or auto-generated content?

Do robots treat blogs differently from “traditional” more static sites? Or are the sites treated the same, only crawled more frequently because they’re updated regularly?

Great site, BTW.

]]>