ruthminer.com
robots.txt
Robots Exclusion Standard data for ruthminer.com
Resource Scan
Scan Details
Site Domain | ruthminer.com |
Base Domain | ruthminer.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-08-20T11:01:16+00:00 |
Next Scan | 2024-11-18T11:01:16+00:00 |
Last Successful Scan
Scanned | 2024-04-23T09:53:37+00:00 |
URL | http://www.ruthminer.com/robots.txt |
Domain IPs | 208.93.240.77 |
Response IP | 208.93.240.77 |
Found | Yes |
Hash | 209cef1207ce3a4d03dee21260569ebe12ff1db607945a3ca3c425dae67753cc |
SimHash | 43bf5362cfc3 |
Groups
*
Rule | Path |
---|---|
Disallow | */WebResource.axd |
Disallow | */webresource.axd |
Disallow | */Include/ |
Disallow | */include/ |
Disallow | */Account/ |
Disallow | */account/ |
Allow | */Account/CustomerLogin.aspx |
Allow | */account/CustomerLogin.aspx |
Allow | */account/customerlogin.aspx |
Disallow | */Content/ |
Disallow | */content/ |
Allow | */Content.aspx |
Allow | */content.aspx |
Allow | */ListingSearch.aspx |
Allow | */listingsearch.aspx |
Allow | */listingsearchresults.aspx |
Allow | */ListingSearchResults.aspx |
Disallow | */Listing/SendListing.aspx |
Disallow | */Listing/sendlisting.aspx |
Disallow | */listing/SendListing.aspx |
Disallow | */listing/sendlisting.aspx |
Other Records
Field | Value |
---|---|
sitemap | http://www.ruthminer.com/sitemap.xml |
Comments