wiki.dfo.world
robots.txt

Robots Exclusion Standard data for wiki.dfo.world

Resource Scan

Scan Details

Site Domain wiki.dfo.world
Base Domain dfo.world
Scan Status Ok
Last Scan2025-10-03T02:07:51+00:00
Next Scan 2025-11-02T02:07:51+00:00

Last Scan

Scanned2025-10-03T02:07:51+00:00
URL https://wiki.dfo.world/robots.txt
Domain IPs 104.21.4.22, 172.67.131.143, 2606:4700:3032::ac43:838f, 2606:4700:3037::6815:416
Response IP 172.67.131.143
Found Yes
Hash bdc659a2e42b96faf06cc5b17c99f0a16e31413b3355ae67c2abc5a9220e74dc
SimHash 4144dc10e7d2

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Warnings

  • 1 invalid line.