dynamicdad.uk
robots.txt

Robots Exclusion Standard data for dynamicdad.uk

Resource Scan

Scan Details

Site Domain dynamicdad.uk
Base Domain dynamicdad.uk
Scan Status Ok
Last Scan2025-10-12T02:54:12+00:00
Next Scan 2025-10-19T02:54:12+00:00

Last Scan

Scanned2025-10-12T02:54:12+00:00
URL https://dynamicdad.uk/robots.txt
Domain IPs 199.250.194.209
Response IP 199.250.194.209
Found Yes
Hash 0f7691ec1427983e6f9ca7fbd579307116dbe0640dd30e600ff44119774ccb4b
SimHash 6008c8d2c7b1

Groups

scrapy

Rule Path
Allow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30