usedwolverhampton.co.uk
robots.txt
Robots Exclusion Standard data for usedwolverhampton.co.uk
Resource Scan
Scan Details
Site Domain | usedwolverhampton.co.uk |
Base Domain | usedwolverhampton.co.uk |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-10-18T18:35:10+00:00 |
Next Scan | 2024-12-17T18:35:10+00:00 |
Last Successful Scan
Scanned | 2024-08-20T18:33:38+00:00 |
URL | https://usedwolverhampton.co.uk/robots.txt |
Domain IPs | 35.179.68.15 |
Response IP | 35.179.68.15 |
Found | Yes |
Hash | eb468fc48d8a0b7a46c3edefee6fde4417987e6999657a54d5ef1310a86196eb |
SimHash | d3df193450c2 |
Groups
*
Rule | Path |
---|---|
Disallow | /index_html |
Disallow | /help |
Disallow | /ListAllCategories |
Disallow | /FormInsertUsedAd |
Disallow | /FormInsertUsedAdAuto |
Disallow | /FormEmailToFriend |
Disallow | /FormUsedAdEmail |
Disallow | /FormEditSearch |
Disallow | /FormFeedback |
Disallow | /FormBadAd |
Disallow | /FormMap |
Disallow | /FormOver18 |
Disallow | /ReportSearchUsedAd2 |
Disallow | /ReportSearchUsedAd2b |
Disallow | /ReportEditUsedAd |
Disallow | /FormGoogleMap |
Disallow | /classifieds-map/ |
Disallow | /insertMyList |
Disallow | /insertAd |
Disallow | /FormInsertUsedAdTruck |
Disallow | /FormInsertUsedAdLooking |
Disallow | /FormInsertUsedAdInfo |
Disallow | /FormInsertUsedAdTickets |
Disallow | /FormInsertUsedAdService |
Disallow | /FormInsertUsedAdBooks |
Disallow | /FormInsertUsedAdPersonals |
Disallow | /FormInsertUsedAdEvent |
Disallow | /FormInsertUsedAdTextbooks |
Disallow | /FormInsertUsedAdJobs |
Disallow | /FormInsertUsedAdLookingParent |
Disallow | /FormInsertUsedAdNew |
Disallow | /ad_gallery |
Disallow | /ReportSelectUsedAdPhoto2 |
Disallow | /FormBadAdJS |
Disallow | /ud_main |
Disallow | /ud_alerts |
Disallow | /ud_manage |
Disallow | /login |
Disallow | /MyAdsById |
Disallow | /*.rss$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.usedwolverhampton.co.uk/sitemapindex.xml |