discoverdig.com
robots.txt

Robots Exclusion Standard data for discoverdig.com

Resource Scan

Scan Details

Site Domain discoverdig.com
Base Domain discoverdig.com
Scan Status Ok
Last Scan2025-06-22T01:18:53+00:00
Next Scan 2025-06-29T01:18:53+00:00

Last Scan

Scanned2025-06-22T01:18:53+00:00
URL https://discoverdig.com/robots.txt
Domain IPs 3.13.47.174, 3.146.195.191
Response IP 3.146.195.191
Found Yes
Hash f7647e9244dd5ebdc11b3c68e3a3e9dc6384ce70e3e1a2e51da98f44934a322e
SimHash 6518d454e331

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5