department22.uk
robots.txt

Robots Exclusion Standard data for department22.uk

Resource Scan

Scan Details

Site Domain department22.uk
Base Domain department22.uk
Scan Status Ok
Last Scan2025-10-05T20:14:18+00:00
Next Scan 2025-11-04T20:14:18+00:00

Last Scan

Scanned2025-10-05T20:14:18+00:00
URL http://department22.uk/robots.txt
Redirect http://www.department22.uk/robots.txt
Redirect Domain www.department22.uk
Redirect Base department22.uk
Domain IPs 199.34.228.67
Redirect IPs 199.34.228.67
Response IP 199.34.228.67
Found Yes
Hash 6f3a00640de626a671020c8514f1019c36506b4980972bfda3893212600b71d1
SimHash 5e2c0c950372

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path Comment
Disallow /ajax/ -
Disallow /apps/ -
Disallow /http%3A//www.department22.uk/our-offer.html specials
Disallow /http%3A//www.department22.uk/our-offer.html delivery
Disallow /http%3A//www.department22.uk/about-us.html mission
Disallow /services.html -
Disallow /http%3A//www.department22.uk/about-us.html partners
Disallow /http%3A//www.department22.uk/about-us.html clients
Disallow /404.html -
Disallow /home-old.html -
Disallow /home1.html -
Disallow /consulting.html -
Disallow /services-old.html -
Disallow /learning.html -
Disallow /events.html -
Disallow /events-archive.html -
Disallow /london-start-up-safari-application.html -
Disallow /what-others-say.html -
Disallow /work-archive-no-h5.html -
Disallow /beyond-grey.html -
Disallow /london-olympics.html -
Disallow /theredshed.html -
Disallow /news.html -
Disallow /home5.html -
Disallow /about-us-793354.html -
Disallow /nathalie.html -
Disallow /hisbe.html -
Disallow /ms.html -
Disallow /fishproject.html -
Disallow /test.html -

Other Records

Field Value
sitemap http://www.department22.uk/sitemap.xml