htmaddocks.co.uk
robots.txt

Robots Exclusion Standard data for htmaddocks.co.uk

Resource Scan

Scan Details

Site Domain htmaddocks.co.uk
Base Domain htmaddocks.co.uk
Scan Status Ok
Last Scan2025-08-31T03:12:48+00:00
Next Scan 2025-09-30T03:12:48+00:00

Last Scan

Scanned2025-08-31T03:12:48+00:00
URL https://www.htmaddocks.co.uk/robots.txt
Redirect https://www.htmaddocks.co.uk/Robots/Maddocks/UK/robots.txt
Domain IPs 23.55.39.14, 23.55.39.19
Response IP 23.32.29.104
Found Yes
Hash 82fa1ef77a950e8614d627fe27a4c122b99542b92570d7fa4973fbca07de2345
SimHash 7900c1670b0a

Groups

*

Rule Path
Disallow /cart
Disallow /360
Disallow /api
Disallow /latest-news
Disallow /brochures/smartparts
Disallow /weekly-deals
Disallow /quantity-street
Disallow /the-incredible-bulk
Disallow /smartparts-offer-brochure
Disallow /ProductRange/New-Product-Lines
Disallow /ProductRange/Special-Offers-Promotions
Disallow /ProductRange/Clearance-Lines
Disallow /sca-dev-
Disallow /cms
Disallow /documents
Disallow /c.570222
Disallow /smartparts
Disallow /core
Disallow /sca-dev-2022-1-0/
Disallow /sca-dev*
Disallow /assets
Disallow /pinpoint
Disallow /part-number-enquiry
Disallow /price-crash
Disallow /exclusive-sales-demo
Disallow */Genuine-Compatible/*
Disallow */Product-Stock-Status/*

Other Records

Field Value
crawl-delay 20