usedcardiff.co.uk
robots.txt
Robots Exclusion Standard data for usedcardiff.co.uk
Resource Scan
Scan Details
| Site Domain | usedcardiff.co.uk |
| Base Domain | usedcardiff.co.uk |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-10-14T12:38:05+00:00 |
| Next Scan | 2024-12-13T12:38:05+00:00 |
Last Successful Scan
| Scanned | 2024-08-16T12:36:31+00:00 |
| URL | https://usedcardiff.co.uk/robots.txt |
| Domain IPs | 35.179.68.15 |
| Response IP | 35.179.68.15 |
| Found | Yes |
| Hash | 0f2ad6d2fc0e21527fe4d4f0e9cd03fa21c1b5e1c888c0a3471a19bea88ce8ac |
| SimHash | d3df597450c2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /index_html |
| Disallow | /help |
| Disallow | /ListAllCategories |
| Disallow | /FormInsertUsedAd |
| Disallow | /FormInsertUsedAdAuto |
| Disallow | /FormEmailToFriend |
| Disallow | /FormUsedAdEmail |
| Disallow | /FormEditSearch |
| Disallow | /FormFeedback |
| Disallow | /FormBadAd |
| Disallow | /FormMap |
| Disallow | /FormOver18 |
| Disallow | /ReportSearchUsedAd2 |
| Disallow | /ReportSearchUsedAd2b |
| Disallow | /ReportEditUsedAd |
| Disallow | /FormGoogleMap |
| Disallow | /classifieds-map/ |
| Disallow | /insertMyList |
| Disallow | /insertAd |
| Disallow | /FormInsertUsedAdTruck |
| Disallow | /FormInsertUsedAdLooking |
| Disallow | /FormInsertUsedAdInfo |
| Disallow | /FormInsertUsedAdTickets |
| Disallow | /FormInsertUsedAdService |
| Disallow | /FormInsertUsedAdBooks |
| Disallow | /FormInsertUsedAdPersonals |
| Disallow | /FormInsertUsedAdEvent |
| Disallow | /FormInsertUsedAdTextbooks |
| Disallow | /FormInsertUsedAdJobs |
| Disallow | /FormInsertUsedAdLookingParent |
| Disallow | /FormInsertUsedAdNew |
| Disallow | /ad_gallery |
| Disallow | /ReportSelectUsedAdPhoto2 |
| Disallow | /FormBadAdJS |
| Disallow | /ud_main |
| Disallow | /ud_alerts |
| Disallow | /ud_manage |
| Disallow | /login |
| Disallow | /MyAdsById |
| Disallow | /*.rss$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.usedcardiff.co.uk/sitemapindex.xml |