myladyagent.com
robots.txt
Robots Exclusion Standard data for myladyagent.com
Resource Scan
Scan Details
Site Domain | myladyagent.com |
Base Domain | myladyagent.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-07-23T03:09:53+00:00 |
Next Scan | 2024-10-21T03:09:53+00:00 |
Last Successful Scan
Scanned | 2023-03-31T04:37:30+00:00 |
URL | http://myladyagent.com/robots.txt |
Domain IPs | 208.93.240.77 |
Response IP | 208.93.240.77 |
Found | Yes |
Hash | b316bdc0de327bf052d8e7c0042367f039c0ddcbe8a41b2f8a9fffac970e0e17 |
SimHash | 62bfc362cf83 |
Groups
*
Rule | Path |
---|---|
Disallow | */officeinfo.aspx |
Disallow | /WebResource.axd |
Disallow | /Include/ |
Disallow | /Public/Include/ |
Disallow | /pages/privacy-policy |
Disallow | /pages/copyright |
Disallow | /pages/terms-of-use |
Disallow | /Listing/SendListing.aspx |
*
Rule | Path |
---|---|
Disallow | */WebResource.axd |
Disallow | */webresource.axd |
Disallow | */Include/ |
Disallow | */include/ |
Disallow | */Account/ |
Disallow | */account/ |
Allow | */Account/CustomerLogin.aspx |
Allow | */account/CustomerLogin.aspx |
Allow | */account/customerlogin.aspx |
Disallow | */Content/ |
Disallow | */content/ |
Allow | */Content.aspx |
Allow | */content.aspx |
Allow | */ListingSearch.aspx |
Allow | */listingsearch.aspx |
Allow | */listingsearchresults.aspx |
Allow | */ListingSearchResults.aspx |
Other Records
Field | Value |
---|---|
sitemap | http://myladyagent.com/sitemap.xml |
Comments