goldsteinresearch.com
robots.txt
Robots Exclusion Standard data for goldsteinresearch.com
Resource Scan
Scan Details
Site Domain | goldsteinresearch.com |
Base Domain | goldsteinresearch.com |
Scan Status | Ok |
Last Scan | 2024-10-22T06:04:17+00:00 |
Next Scan | 2024-11-21T06:04:17+00:00 |
Last Scan
Scanned | 2024-10-22T06:04:17+00:00 |
URL | https://goldsteinresearch.com/robots.txt |
Redirect | https://www.goldsteinresearch.com/robots.txt |
Redirect Domain | www.goldsteinresearch.com |
Redirect Base | goldsteinresearch.com |
Domain IPs | 104.21.29.54, 172.67.171.96, 2606:4700:3032::ac43:ab60, 2606:4700:3037::6815:1d36 |
Redirect IPs | 104.21.29.54, 172.67.171.96, 2606:4700:3032::ac43:ab60, 2606:4700:3037::6815:1d36 |
Response IP | 104.21.29.54 |
Found | Yes |
Hash | ed8de215481670b4c754bd17deb9f12acbd6d7719ba9cac79856cac2e3ad11f0 |
SimHash | 71555b70da03 |
Groups
*
Rule | Path |
---|---|
Disallow | /home/login/ |
Disallow | /Home/login/ |
Disallow | /cgi-bin/* |
Disallow | /wp-includes/* |
Disallow | /recommended/* |
Disallow | /comments/feed/* |
Disallow | /trackback/* |
Disallow | /request-sample/* |
Disallow | /login |
Disallow | /signup |
Disallow | /send-enquiry/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.goldsteinresearch.com/sitemap.xml |