CouchSurfing Global FreeLoaders HospitalityClub Place2Stay SERVAS Stay4Free BeWelcome other networks
home the networks blogs forum wiki mailinglist

Mailinglist

[Hosp.Ex Ne>t] Forum

this forum (HospitalityGuide.net - Site / Forum)

posted by 'lex(R), 01.06.2007, 14:03

» » Does anyone know the lines for the robot.txt to keep the search bots
» out?
»
» Maybe something like this:
»
» User-agent: *
» Disallow: /

I did so some weeks ago. (/robots.txt) But as not all spiders hear on what they are told in the robots.txt, I would like to put the honeypot up... I have to have a look into this once more.

 


Complete thread:

[Hosp.Ex Ne>t] Forum | Admin contact
78 Postings in 18 Threads, 9622 registered users
 RSS-Feed  ^
   
powered by mlf
Note: Forum Content is NOT available under Creative Commons as not mentioned different. contact | impressum © 2005-01 by hospitalityguide.net
counter statistics