banglay.info
robots.txt
Robots Exclusion Standard data for banglay.info
Resource Scan
Scan Details
Site Domain | banglay.info |
Base Domain | banglay.info |
Scan Status | Ok |
Last Scan | 5/21/2025, 11:08:33 PM |
Next Scan | 5/28/2025, 11:08:33 PM |
Last Scan
Scanned | 5/21/2025, 11:08:33 PM |
URL | https://banglay.info/robots.txt |
Domain IPs | 104.21.77.90, 172.67.205.251, 2606:4700:3033::ac43:cdfb, 2606:4700:3035::6815:4d5a |
Response IP | 104.21.77.90 |
Found | Yes |
Hash | eaa5212115d318f5886e5820529f0734b129bc4ddbd477518c1864d4c6491cab |
SimHash | 6b045250c333 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Allow | /wp-content/uploads/* |
Disallow | /wp-* |
Disallow | /xmlrpc.php |
Disallow | *feed |
Disallow | *? |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | /sitemap_index.xml |