Page 1 of 1

Google [Bot]

PostPosted: Mon Feb 08, 2010 12:30 pm
by cerebus
What's a "Google [Bot]" and why is it a registered user on this forum?

Re: Google [Bot]

PostPosted: Mon Feb 08, 2010 12:44 pm
by Darth Rock&Roll
a google bot is a spider bot that crawls the web reading page titles, tag clouds, meta data and content blocks as prescribed by the owner of the bot.

It then takes that information and loads it back into the google system so that your site is ranked accordingly and your content is indexed correctly.

so, when you go to google and type in rum soaked fist, it will show you this site in the results. Other "bots" are different little programs that do tasks for the sender. IN this case, it's compiling info in order to continue to serve this site through the google search engine.

between bots and directory submissions, you site works it's way up through the rankings. Most especially through usage and reciprocal linking.

Re: Google [Bot]

PostPosted: Mon Feb 08, 2010 12:46 pm
by Dr.Rob
What ? There is a robot spider crawling around inside my computer! aaaaaaaaaaaaaaaaaaaaaaaaaaa! Darth your kidding right?

Re: Google [Bot]

PostPosted: Mon Feb 08, 2010 12:47 pm
by Darth Rock&Roll
another thing that bots do, especially in forums is index teh data in the discussion content.

which is very helpful for sites that are pure bbs like this one.

so, in a day or two, this very thread will be indexed!

many of the threads here already are indexed.

take a thread title and punch that into google. Or a block of content from a thread.
YOu will get the return. BBS systems get botted more because the content is frequently changing.

Re: Google [Bot]

PostPosted: Mon Feb 08, 2010 12:49 pm
by Darth Rock&Roll
Dr.Rob wrote:What ? There is a robot spider crawling around inside my computer! aaaaaaaaaaaaaaaaaaaaaaaaaaa! Darth your kidding right?

no i'm not kidding and they aren't inside your computer, they only go towards web servers with registered domain names really and they obey the commands that web servers give them as well.

so if you don't want a section of your site to be crawled and indexed, then you can tell the bots to stay out of the folder you don't want indexed.
This is done with the bot.txt file in the root of any webserver.

Your home systems aren't indexed because they are not registered domains.

Re: Google [Bot]

PostPosted: Mon Feb 08, 2010 1:18 pm
by cerebus
Ah. Thanks.

Re: Google [Bot]

PostPosted: Mon Feb 08, 2010 2:57 pm
by Craig
yeah. its the reason that when you google digital handjob rsf is the second hit :D

Re: Google [Bot]

PostPosted: Mon Feb 08, 2010 4:53 pm
by Buddy
It's what makes SEO fun!

Re: Google [Bot]

PostPosted: Tue Feb 09, 2010 10:00 am
by Darth Rock&Roll
Craig wrote:yeah. its the reason that when you google digital handjob rsf is the second hit :D


Only if you wrap it in quotes, but yes, that's why.

Thanks google bot! lol