useddudley.co.uk
robots.txt

Robots Exclusion Standard data for useddudley.co.uk

Resource Scan

Scan Details

Site Domain useddudley.co.uk
Base Domain useddudley.co.uk
Scan Status Ok
Last Scan2024-06-02T12:08:10+00:00
Next Scan 2024-06-09T12:08:10+00:00

Last Scan

Scanned2024-06-02T12:08:10+00:00
URL https://useddudley.co.uk/robots.txt
Domain IPs 35.179.68.15
Response IP 35.179.68.15
Found Yes
Hash 7feea0c6036b426adebc92f44dadb92fa5ad079de0e33f61e4f47888e558000c
SimHash d3df193450c2

Groups

mediapartners-google*

Rule Path
Disallow

cityreview

Rule Path
Disallow /

oodlebot

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

browsershots

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /index_html
Disallow /help
Disallow /ListAllCategories
Disallow /FormInsertUsedAd
Disallow /FormInsertUsedAdAuto
Disallow /FormEmailToFriend
Disallow /FormUsedAdEmail
Disallow /FormEditSearch
Disallow /FormFeedback
Disallow /FormBadAd
Disallow /FormMap
Disallow /FormOver18
Disallow /ReportSearchUsedAd2
Disallow /ReportSearchUsedAd2b
Disallow /ReportEditUsedAd
Disallow /FormGoogleMap
Disallow /classifieds-map/
Disallow /insertMyList
Disallow /insertAd
Disallow /FormInsertUsedAdTruck
Disallow /FormInsertUsedAdLooking
Disallow /FormInsertUsedAdInfo
Disallow /FormInsertUsedAdTickets
Disallow /FormInsertUsedAdService
Disallow /FormInsertUsedAdBooks
Disallow /FormInsertUsedAdPersonals
Disallow /FormInsertUsedAdEvent
Disallow /FormInsertUsedAdTextbooks
Disallow /FormInsertUsedAdJobs
Disallow /FormInsertUsedAdLookingParent
Disallow /FormInsertUsedAdNew
Disallow /ad_gallery
Disallow /ReportSelectUsedAdPhoto2
Disallow /FormBadAdJS
Disallow /ud_main
Disallow /ud_alerts
Disallow /ud_manage
Disallow /login
Disallow /MyAdsById
Disallow /*.rss$

Other Records

Field Value
sitemap https://www.useddudley.co.uk/sitemapindex.xml