usedsandwell.co.uk
robots.txt

Robots Exclusion Standard data for usedsandwell.co.uk

Resource Scan

Scan Details

Site Domain usedsandwell.co.uk
Base Domain usedsandwell.co.uk
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-16T10:06:00+00:00
Next Scan 2024-12-15T10:06:00+00:00

Last Successful Scan

Scanned2024-08-18T10:00:56+00:00
URL https://usedsandwell.co.uk/robots.txt
Domain IPs 35.179.68.15
Response IP 35.179.68.15
Found Yes
Hash 2e7df62c3aa748d7cd3bce5c704e980ad418df6075caf02facceb882212288db
SimHash 935f593450c2

Groups

mediapartners-google*

Rule Path
Disallow

cityreview

Rule Path
Disallow /

oodlebot

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

browsershots

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /index_html
Disallow /help
Disallow /ListAllCategories
Disallow /FormInsertUsedAd
Disallow /FormInsertUsedAdAuto
Disallow /FormEmailToFriend
Disallow /FormUsedAdEmail
Disallow /FormEditSearch
Disallow /FormFeedback
Disallow /FormBadAd
Disallow /FormMap
Disallow /FormOver18
Disallow /ReportSearchUsedAd2
Disallow /ReportSearchUsedAd2b
Disallow /ReportEditUsedAd
Disallow /FormGoogleMap
Disallow /classifieds-map/
Disallow /insertMyList
Disallow /insertAd
Disallow /FormInsertUsedAdTruck
Disallow /FormInsertUsedAdLooking
Disallow /FormInsertUsedAdInfo
Disallow /FormInsertUsedAdTickets
Disallow /FormInsertUsedAdService
Disallow /FormInsertUsedAdBooks
Disallow /FormInsertUsedAdPersonals
Disallow /FormInsertUsedAdEvent
Disallow /FormInsertUsedAdTextbooks
Disallow /FormInsertUsedAdJobs
Disallow /FormInsertUsedAdLookingParent
Disallow /FormInsertUsedAdNew
Disallow /ad_gallery
Disallow /ReportSelectUsedAdPhoto2
Disallow /FormBadAdJS
Disallow /ud_main
Disallow /ud_alerts
Disallow /ud_manage
Disallow /login
Disallow /MyAdsById
Disallow /*.rss$

Other Records

Field Value
sitemap https://www.usedsandwell.co.uk/sitemapindex.xml