Log In Sign Up

reidocrime.com
robots.txt

Robots Exclusion Standard data for reidocrime.com

Resource Scan

Scan Details

Site Domain reidocrime.com
Base Domain reidocrime.com
Scan Status Ok
Last Scan2025-09-26T22:37:16+00:00
Next Scan 2025-10-26T22:37:16+00:00

Last Scan

Scanned2025-09-26T22:37:16+00:00
URL https://reidocrime.com/robots.txt
Domain IPs 104.21.3.45, 172.67.130.59
Response IP 104.21.3.45
Found Yes
Hash ef9e3c20d94e9986f9f91a5c18d298ae11a73eacf77fd7cec353c07b23d55a60
SimHash 6c44c392c590

Groups

ia_archiver

Rule Path
Disallow /*
Allow /$

teoma

Rule Path
Disallow /*
Allow /$

googlebot

Rule Path
Disallow /*
Allow /$

msnbot

Rule Path
Disallow /*
Allow /$

slurp

Rule Path
Disallow /*
Allow /$

abachobot

Rule Path
Disallow /*
Allow /$

fireball

Rule Path
Disallow /*
Allow /$

voilabot

Rule Path
Disallow /*
Allow /$

yandex

Rule Path
Disallow /*
Allow /$

*

Rule Path
Disallow /*
Allow /$
Back to top

Comments

  • Alexa
  • Ask
  • Google
  • MSN
  • Yahoo!
  • Abacho
  • Fireball
  • Voila.fr
  • Yandex
  • Others
Back to top