gazetaby.click
robots.txt

Robots Exclusion Standard data for gazetaby.click

Resource Scan

Scan Details

Site Domain gazetaby.click
Base Domain gazetaby.click
Scan Status Ok
Last Scan2024-11-11T11:47:38+00:00
Next Scan 2024-11-18T11:47:38+00:00

Last Scan

Scanned2024-11-11T11:47:38+00:00
URL https://gazetaby.click/robots.txt
Domain IPs 104.21.40.171, 172.67.155.22, 2606:4700:3035::ac43:9b16, 2606:4700:3037::6815:28ab
Response IP 172.67.155.22
Found Yes
Hash f1add47677e01a39ca6493aa393aa5afc1481a5d4cb65e46797b83643c9efde1
SimHash 494f15421530

Groups

yandex

Rule Path
Allow /rss/yandex/
Allow /rss/news_yand_rdn.xml
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.svg
Disallow /*.pdf
Disallow /images/
Disallow /uploads/
Disallow /cont/art.php?sn_nid=*
Disallow /post/view/?&sn_nid=*
Disallow /bin/lik?id=*

googlebot

Rule Path
Allow /rss/yandex/
Allow /rss/news_yand_rdn.xml
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.svg
Disallow /*.pdf
Disallow /images/
Disallow /uploads/
Disallow /cont/art.php?sn_nid=*
Disallow /post/view/?&sn_nid=*
Disallow /bin/lik?id=*

*

Rule Path
Allow /rss/yandex/
Allow /rss/news_yand_rdn.xml
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.svg
Disallow /*.pdf
Disallow /images/
Disallow /uploads/
Disallow /cont/art.php?sn_nid=*
Disallow /post/view/?&sn_nid=*
Disallow /bin/lik?id=*

Other Records

Field Value
sitemap https://gazetaby.com/sitemap.xml