daihocbonba.com
robots.txt

Robots Exclusion Standard data for daihocbonba.com

Resource Scan

Scan Details

Site Domain daihocbonba.com
Base Domain daihocbonba.com
Scan Status Ok
Last Scan2025-12-30T10:24:15+00:00
Next Scan 2026-01-06T10:24:15+00:00

Last Scan

Scanned2025-12-30T10:24:15+00:00
URL https://daihocbonba.com/robots.txt
Domain IPs 104.21.45.228, 172.67.219.175, 2606:4700:3033::ac43:dbaf, 2606:4700:3036::6815:2de4
Response IP 104.21.45.228
Found Yes
Hash 58ab991ac7d9945ddfa2977b7350be8f3db58b78ffe3628d03cc7cfa7b908e41
SimHash 290d4a02c792

Groups

gigabot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

yahoo-blogs/v3.9

Rule Path
Disallow /

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://daihocbonba.com/sitemap.xml
sitemap https://daihocbonba.com/thuvien/sitemap.php