goldsteinresearch.com
robots.txt
Robots Exclusion Standard data for goldsteinresearch.com
Resource Scan
Scan Details
| Site Domain | goldsteinresearch.com |
| Base Domain | goldsteinresearch.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-09-22T06:03:53+00:00 |
| Next Scan | 2024-10-22T06:03:53+00:00 |
Last Successful Scan
| Scanned | 2024-08-01T06:03:06+00:00 |
| URL | https://goldsteinresearch.com/robots.txt |
| Redirect | https://www.goldsteinresearch.com/robots.txt |
| Redirect Domain | www.goldsteinresearch.com |
| Redirect Base | goldsteinresearch.com |
| Domain IPs | 104.21.29.54, 172.67.171.96, 2606:4700:3032::ac43:ab60, 2606:4700:3037::6815:1d36 |
| Redirect IPs | 104.21.29.54, 172.67.171.96, 2606:4700:3032::ac43:ab60, 2606:4700:3037::6815:1d36 |
| Response IP | 104.21.29.54 |
| Found | Yes |
| Hash | ed8de215481670b4c754bd17deb9f12acbd6d7719ba9cac79856cac2e3ad11f0 |
| SimHash | 71555b70da03 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /home/login/ |
| Disallow | /Home/login/ |
| Disallow | /cgi-bin/* |
| Disallow | /wp-includes/* |
| Disallow | /recommended/* |
| Disallow | /comments/feed/* |
| Disallow | /trackback/* |
| Disallow | /request-sample/* |
| Disallow | /login |
| Disallow | /signup |
| Disallow | /send-enquiry/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.goldsteinresearch.com/sitemap.xml |