rirealtors.org
robots.txt

Robots Exclusion Standard data for rirealtors.org

Resource Scan

Scan Details

Site Domain rirealtors.org
Base Domain rirealtors.org
Scan Status Ok
Last Scan2024-11-12T11:31:42+00:00
Next Scan 2024-11-19T11:31:42+00:00

Last Scan

Scanned2024-11-12T11:31:42+00:00
URL https://rirealtors.org/robots.txt
Redirect http://www.rirealtors.org/robots.txt
Redirect Domain www.rirealtors.org
Redirect Base rirealtors.org
Domain IPs 104.21.10.15, 172.67.131.58, 2606:4700:3031::ac43:833a, 2606:4700:3037::6815:a0f
Redirect IPs 104.21.10.15, 172.67.131.58, 2606:4700:3031::ac43:833a, 2606:4700:3037::6815:a0f
Response IP 172.67.131.58
Found Yes
Hash 05de55131b008fdca869d05e73c021553f29e920b53f44cd134a90d6ce4f2dda
SimHash ade89ae0e5b6

Groups

*

Rule Path
Disallow /*print%3Dpdf*

Other Records

Field Value
crawl-delay 5

Comments

  • ROBOTS.TXT
  • asoft200348.accrisoft.com
  • Google
  • User-agent: Googlebot
  • Disallow:
  • Yahoo
  • User-agent: Slurp
  • Disallow:
  • Alta-Vista
  • User-agent: Scooter
  • Disallow:
  • Excite
  • User-agent: ArchitextSpider
  • Disallow:
  • InfoSeek
  • User-agent: UltraSeek
  • Disallow:
  • Lycos
  • User-agent: Lycos_Spider_(T-Rex)
  • Disallow:
  • LookSmart
  • User-agent: MantraAgent
  • Disallow:
  • Alltheweb
  • User-agent: FAST-WebCrawler
  • Disallow: