realscout.com
robots.txt

Robots Exclusion Standard data for realscout.com

Resource Scan

Scan Details

Site Domain realscout.com
Base Domain realscout.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-03-18T22:45:45+00:00
Next Scan 2024-06-16T22:45:45+00:00

Last Successful Scan

Scanned2022-10-31T16:03:14+00:00
URL https://www.realscout.com/robots.txt
Response IP 18.205.222.128, 52.202.168.65, 54.161.241.46, 54.237.133.81
Found Yes
Hash 787d6b5aa71b42cceb0a613420ccfe92ebef56e68e8cc7f325025b43236a5704
SimHash a20d4abd6764

Groups

*

Rule Path
Disallow /homesearch/*
Disallow /graphql/*
Disallow /graphql-manager/*
Disallow /graphql-agent/*
Disallow /graphql-homebuyer/*
Disallow /admin/*
Disallow /api/*

*

Rule Path
Allow /

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /