this forum (HospitalityGuide.net - Site / Forum)

posted by 'lex, 01.06.2007, 14:03

» » Does anyone know the lines for the robot.txt to keep the search bots
» out?
»
» Maybe something like this:
»
» User-agent: *
» Disallow: /

I did so some weeks ago. (/robots.txt) But as not all spiders hear on what they are told in the robots.txt, I would like to put the honeypot up... I have to have a look into this once more.

Complete thread:

• this forum - hkroger, 19.04.2007, 21:20 (HospitalityGuide.net - Site / Forum)
  • this forum - torstenhilipp, 20.04.2007, 19:44
  • this forum - 'lex, 22.04.2007, 19:56
    • this forum - torstenhilipp, 23.04.2007, 10:17
      • this forum - 'lex, 24.04.2007, 11:13
        • this forum - andib, 29.04.2007, 20:28
          • this forum - 'lex, 31.05.2007, 13:15
        • this forum - hkroger, 01.06.2007, 11:42
          • this forum - 'lex, 01.06.2007, 14:03
    • this forum - anonymous, 29.04.2007, 20:39
  • this forum - isafakir, 29.04.2007, 20:40
    • this forum - hkroger, 29.04.2007, 22:25
      • this forum - isafakir, 30.04.2007, 01:45
      • this forum - thorgal67, 01.06.2007, 09:34
        • this forum - 'lex, 01.06.2007, 14:15