usedlondon.co.uk
robots.txt

Robots Exclusion Standard data for usedlondon.co.uk

Resource Scan

Scan Details

Site Domain usedlondon.co.uk
Base Domain usedlondon.co.uk
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-18T05:19:07+00:00
Next Scan 2024-12-17T05:19:07+00:00

Last Successful Scan

Scanned2024-08-20T05:17:14+00:00
URL https://usedlondon.co.uk/robots.txt
Domain IPs 35.179.68.15
Response IP 35.179.68.15
Found Yes
Hash 6007f21cd5ec878c657380ca0fb58729be49dd8ce949b8fcb06c75de0852b3a0
SimHash 935f193450c2

Groups

mediapartners-google*

Rule Path
Disallow

cityreview

Rule Path
Disallow /

oodlebot

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

browsershots

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /index_html
Disallow /help
Disallow /ListAllCategories
Disallow /FormInsertUsedAd
Disallow /FormInsertUsedAdAuto
Disallow /FormEmailToFriend
Disallow /FormUsedAdEmail
Disallow /FormEditSearch
Disallow /FormFeedback
Disallow /FormBadAd
Disallow /FormMap
Disallow /FormOver18
Disallow /ReportSearchUsedAd2
Disallow /ReportSearchUsedAd2b
Disallow /ReportEditUsedAd
Disallow /FormGoogleMap
Disallow /classifieds-map/
Disallow /insertMyList
Disallow /insertAd
Disallow /FormInsertUsedAdTruck
Disallow /FormInsertUsedAdLooking
Disallow /FormInsertUsedAdInfo
Disallow /FormInsertUsedAdTickets
Disallow /FormInsertUsedAdService
Disallow /FormInsertUsedAdBooks
Disallow /FormInsertUsedAdPersonals
Disallow /FormInsertUsedAdEvent
Disallow /FormInsertUsedAdTextbooks
Disallow /FormInsertUsedAdJobs
Disallow /FormInsertUsedAdLookingParent
Disallow /FormInsertUsedAdNew
Disallow /ad_gallery
Disallow /ReportSelectUsedAdPhoto2
Disallow /FormBadAdJS
Disallow /ud_main
Disallow /ud_alerts
Disallow /ud_manage
Disallow /login
Disallow /MyAdsById
Disallow /*.rss$

Other Records

Field Value
sitemap https://www.usedlondon.co.uk/sitemapindex.xml