golfreview.com
robots.txt
Robots Exclusion Standard data for golfreview.com
Resource Scan
Scan Details
| Site Domain | golfreview.com |
| Base Domain | golfreview.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-08-31T04:50:47+00:00 |
| Next Scan | 2024-11-29T04:50:47+00:00 |
Last Successful Scan
| Scanned | 2022-10-19T01:15:02+00:00 |
| URL | http://golfreview.com/robots.txt |
| Redirect | http://www.golfreview.com/robots.txt |
| Redirect Domain | www.golfreview.com |
| Redirect Base | golfreview.com |
| Response IP | 44.237.142.231, 35.82.65.0 |
| Found | Yes |
| Hash | f3bcc35a4b65dcc86902b083c02c886f74c6fa63689a8d53dff584d2bdc71ec9 |
| SimHash | f8397c92a782 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajaxform/ |
| Disallow | /ajaxsearch/ |
| Disallow | /ajaxsearch/ |
| Disallow | /search.php |
| Disallow | /search1.php |
| Disallow | /userresendcode.php |
| Disallow | /checkuser.php |
| Disallow | /curl.php |
| Disallow | /curl1.php |
| Disallow | /process.php |
| Disallow | /wp-admin/ |
| Disallow | /commerceredirect.html |
| Disallow | /user-login.html |
| Disallow | /user-registration.html |
| Disallow | /user-profile.html |
| Disallow | /user-profile-1.html |
| Disallow | /user-profile-2.html |
| Disallow | /user-profile-3.html |
| Disallow | /user-profile-4.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |