banglay.info
robots.txt

Robots Exclusion Standard data for banglay.info

Resource Scan

Scan Details

Site Domain banglay.info
Base Domain banglay.info
Scan Status Ok
Last Scan5/21/2025, 11:08:33 PM
Next Scan 5/28/2025, 11:08:33 PM

Last Scan

Scanned5/21/2025, 11:08:33 PM
URL https://banglay.info/robots.txt
Domain IPs 104.21.77.90, 172.67.205.251, 2606:4700:3033::ac43:cdfb, 2606:4700:3035::6815:4d5a
Response IP 104.21.77.90
Found Yes
Hash eaa5212115d318f5886e5820529f0734b129bc4ddbd477518c1864d4c6491cab
SimHash 6b045250c333

Groups

*

Rule Path
Allow /
Allow /wp-content/uploads/*
Disallow /wp-*
Disallow /xmlrpc.php
Disallow *feed
Disallow *?

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap /sitemap_index.xml