develobe.id
robots.txt

Robots Exclusion Standard data for develobe.id

Resource Scan

Scan Details

Site Domain develobe.id
Base Domain develobe.id
Scan Status Ok
Last Scan2025-10-04T19:38:33+00:00
Next Scan 2025-10-11T19:38:33+00:00

Last Scan

Scanned2025-10-04T19:38:33+00:00
URL https://develobe.id/robots.txt
Domain IPs 104.21.32.252, 172.67.139.12, 2606:4700:3031::ac43:8b0c, 2606:4700:3036::6815:20fc
Response IP 104.21.32.252
Found Yes
Hash 98dc2a76a467f4c291e4564fb3cc0932e4b495e5c9e3527f531d5403f5b4ec50
SimHash 681512008f11

Groups

*

Rule Path
Disallow /
Allow /$
Allow /projects$
Allow /p/

Other Records

Field Value
sitemap https://develobe.id/sitemap.xml