develop.tools
robots.txt

Robots Exclusion Standard data for develop.tools

Resource Scan

Scan Details

Site Domain develop.tools
Base Domain develop.tools
Scan Status Ok
Last Scan2025-07-14T01:44:32+00:00
Next Scan 2025-07-21T01:44:32+00:00

Last Scan

Scanned2025-07-14T01:44:32+00:00
URL https://develop.tools/robots.txt
Domain IPs 104.21.87.15, 172.67.139.38
Response IP 104.21.87.15
Found Yes
Hash a6729ac01f18babc3f6dd897c2e150acf105e01f1d34f732f48e18032aee6d74
SimHash 9114d0fa8f43

Groups

megalodon

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

special_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://develop.tools/sitemap.xml