prothomalo.com
robots.txt

Robots Exclusion Standard data for prothomalo.com

Resource Scan

Scan Details

Site Domain prothomalo.com
Base Domain prothomalo.com
Scan Status Ok
Last Scan2024-05-10T13:16:57+00:00
Next Scan 2024-05-17T13:16:57+00:00

Last Scan

Scanned2024-05-10T13:16:57+00:00
URL https://prothomalo.com/robots.txt
Redirect https://www.prothomalo.com/robots.txt
Redirect Domain www.prothomalo.com
Redirect Base prothomalo.com
Domain IPs 104.17.144.114, 104.17.145.114, 2606:4700::6811:9072, 2606:4700::6811:9172
Redirect IPs 104.17.144.114, 104.17.145.114, 2606:4700::6811:9072, 2606:4700::6811:9172
Response IP 104.17.144.114
Found Yes
Hash 80604391652608ef625df7539e4be44b56493279dbd34c695ef80dc6f8d15bdc
SimHash 09049a4087b3

Groups

*

Rule Path
Allow /
Disallow /shell.html

Other Records

Field Value
sitemap https://www.prothomalo.com/sitemap.xml
sitemap https://www.prothomalo.com/news_sitemap.xml