1971.prothomalo.com
robots.txt

Robots Exclusion Standard data for 1971.prothomalo.com

Resource Scan

Scan Details

Site Domain 1971.prothomalo.com
Base Domain prothomalo.com
Scan Status Ok
Last Scan2024-05-28T22:29:04+00:00
Next Scan 2024-06-04T22:29:04+00:00

Last Scan

Scanned2024-05-28T22:29:04+00:00
URL https://1971.prothomalo.com/robots.txt
Domain IPs 104.17.144.114, 104.17.145.114, 2606:4700::6811:9072, 2606:4700::6811:9172
Response IP 104.17.145.114
Found Yes
Hash 80604391652608ef625df7539e4be44b56493279dbd34c695ef80dc6f8d15bdc
SimHash 09049a4087b3

Groups

*

Rule Path
Allow /
Disallow /shell.html

Other Records

Field Value
sitemap https://www.prothomalo.com/sitemap.xml
sitemap https://www.prothomalo.com/news_sitemap.xml