gazetaweb.com
robots.txt

Robots Exclusion Standard data for gazetaweb.com

Resource Scan

Scan Details

Site Domain gazetaweb.com
Base Domain gazetaweb.com
Scan Status Ok
Last Scan2025-04-05T17:57:55+00:00
Next Scan 2025-04-12T17:57:55+00:00

Last Scan

Scanned2025-04-05T17:57:55+00:00
URL https://gazetaweb.com/robots.txt
Redirect https://www.gazetaweb.com/robots.txt
Redirect Domain www.gazetaweb.com
Redirect Base gazetaweb.com
Domain IPs 104.21.15.178, 172.67.163.151, 2606:4700:3033::ac43:a397, 2606:4700:3036::6815:fb2
Redirect IPs 104.21.15.178, 172.67.163.151, 2606:4700:3033::ac43:a397, 2606:4700:3036::6815:fb2
Response IP 172.67.163.151
Found Yes
Hash ecb2f50589a31e67109334b259f01e4cb23185c6f22b55d12439149212681223
SimHash c901d1034713

Groups

*

Rule Path
Disallow /mw
Disallow /dev
Disallow /ajax
Allow /

Other Records

Field Value
sitemap https://www.gazetaweb.com/sitemap/statics/sitemap-news.xml