usedbatley.co.uk
robots.txt

Robots Exclusion Standard data for usedbatley.co.uk

Resource Scan

Scan Details

Site Domain usedbatley.co.uk
Base Domain usedbatley.co.uk
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-16T08:32:21+00:00
Next Scan 2024-12-15T08:32:21+00:00

Last Successful Scan

Scanned2024-08-18T08:31:18+00:00
URL https://usedbatley.co.uk/robots.txt
Domain IPs 35.179.68.15
Response IP 35.179.68.15
Found Yes
Hash c7a61941a66bb5a6c9ff5293f34888636f0f5e89ac8e5808e2c02b7665695c0f
SimHash 93df593450c2

Groups

mediapartners-google*

Rule Path
Disallow

cityreview

Rule Path
Disallow /

oodlebot

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

browsershots

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /index_html
Disallow /help
Disallow /ListAllCategories
Disallow /FormInsertUsedAd
Disallow /FormInsertUsedAdAuto
Disallow /FormEmailToFriend
Disallow /FormUsedAdEmail
Disallow /FormEditSearch
Disallow /FormFeedback
Disallow /FormBadAd
Disallow /FormMap
Disallow /FormOver18
Disallow /ReportSearchUsedAd2
Disallow /ReportSearchUsedAd2b
Disallow /ReportEditUsedAd
Disallow /FormGoogleMap
Disallow /classifieds-map/
Disallow /insertMyList
Disallow /insertAd
Disallow /FormInsertUsedAdTruck
Disallow /FormInsertUsedAdLooking
Disallow /FormInsertUsedAdInfo
Disallow /FormInsertUsedAdTickets
Disallow /FormInsertUsedAdService
Disallow /FormInsertUsedAdBooks
Disallow /FormInsertUsedAdPersonals
Disallow /FormInsertUsedAdEvent
Disallow /FormInsertUsedAdTextbooks
Disallow /FormInsertUsedAdJobs
Disallow /FormInsertUsedAdLookingParent
Disallow /FormInsertUsedAdNew
Disallow /ad_gallery
Disallow /ReportSelectUsedAdPhoto2
Disallow /FormBadAdJS
Disallow /ud_main
Disallow /ud_alerts
Disallow /ud_manage
Disallow /login
Disallow /MyAdsById
Disallow /*.rss$

Other Records

Field Value
sitemap https://www.usedbatley.co.uk/sitemapindex.xml