raypoppe.com
robots.txt

Robots Exclusion Standard data for raypoppe.com

Resource Scan

Scan Details

Site Domain raypoppe.com
Base Domain raypoppe.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-19T22:14:43+00:00
Next Scan 2024-11-17T22:14:43+00:00

Last Successful Scan

Scanned2023-08-27T22:04:20+00:00
URL http://raypoppe.com/robots.txt
Domain IPs 208.93.240.54
Response IP 208.93.240.54
Found Yes
Hash 03f2c454fbec1c0dbe1b8834ccdd6520e1f0e056dc42db5482bf785c34529b09
SimHash d9149a206dd3

Groups

*

Rule Path
Disallow /logs/
Disallow /new/
Disallow /newstuff/
Disallow /presentation/
Disallow /root.backup/
Disallow /old/
Disallow /templates/
Disallow /booth/
Disallow /jutvision/
Disallow /scripts/adredir.asp
Disallow /scripts/adview.asp
Disallow /stewarttitle/
Disallow /schoolreport/
Disallow /Platinum/
Disallow /Search/WebResource.axd

mediapartners-google*

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Comments

  • /robots.txt
  • Don't let the search engines reference cgi programs