Log In Sign Up

dosbing.id
robots.txt

Robots Exclusion Standard data for dosbing.id

Resource Scan

Scan Details

Site Domain dosbing.id
Base Domain dosbing.id
Scan Status Ok
Last Scan2025-11-12T09:31:43+00:00
Next Scan 2025-12-12T09:31:43+00:00

Last Scan

Scanned2025-11-12T09:31:43+00:00
URL https://dosbing.id/robots.txt
Domain IPs 104.21.19.97, 172.67.185.187, 2606:4700:3034::6815:1361, 2606:4700:3034::ac43:b9bb
Response IP 172.67.185.187
Found Yes
Hash ed8ffdf84b8273d128e8ae3b9ed10f5d4af279938f6f5711af04adc8a662a527
SimHash 0820c882cbba

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /
Back to top

Comments

  • Block archive.org bots
Back to top