audioreview.com
robots.txt
Robots Exclusion Standard data for audioreview.com
Resource Scan
Scan Details
Site Domain | audioreview.com |
Base Domain | audioreview.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-09-07T05:08:14+00:00 |
Next Scan | 2024-12-06T05:08:14+00:00 |
Last Successful Scan
Scanned | 2022-10-21T20:44:00+00:00 |
URL | http://audioreview.com/robots.txt |
Redirect | http://www.audioreview.com/robots.txt |
Redirect Domain | www.audioreview.com |
Redirect Base | audioreview.com |
Response IP | 35.82.65.0, 44.237.142.231 |
Found | Yes |
Hash | f3bcc35a4b65dcc86902b083c02c886f74c6fa63689a8d53dff584d2bdc71ec9 |
SimHash | f8397c92a782 |
Groups
*
Rule | Path |
---|---|
Disallow | /ajaxform/ |
Disallow | /ajaxsearch/ |
Disallow | /ajaxsearch/ |
Disallow | /search.php |
Disallow | /search1.php |
Disallow | /userresendcode.php |
Disallow | /checkuser.php |
Disallow | /curl.php |
Disallow | /curl1.php |
Disallow | /process.php |
Disallow | /wp-admin/ |
Disallow | /commerceredirect.html |
Disallow | /user-login.html |
Disallow | /user-registration.html |
Disallow | /user-profile.html |
Disallow | /user-profile-1.html |
Disallow | /user-profile-2.html |
Disallow | /user-profile-3.html |
Disallow | /user-profile-4.html |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |