gazetaby.plus
robots.txt

Robots Exclusion Standard data for gazetaby.plus

Resource Scan

Scan Details

Site Domain gazetaby.plus
Base Domain gazetaby.plus
Scan Status Ok
Last Scan2024-11-13T01:54:45+00:00
Next Scan 2024-11-20T01:54:45+00:00

Last Scan

Scanned2024-11-13T01:54:45+00:00
URL https://gazetaby.plus/robots.txt
Domain IPs 104.21.9.107, 172.67.159.192, 2606:4700:3031::ac43:9fc0, 2606:4700:3033::6815:96b
Response IP 172.67.159.192
Found Yes
Hash f1add47677e01a39ca6493aa393aa5afc1481a5d4cb65e46797b83643c9efde1
SimHash 494f15421530

Groups

yandex

Rule Path
Allow /rss/yandex/
Allow /rss/news_yand_rdn.xml
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.svg
Disallow /*.pdf
Disallow /images/
Disallow /uploads/
Disallow /cont/art.php?sn_nid=*
Disallow /post/view/?&sn_nid=*
Disallow /bin/lik?id=*

googlebot

Rule Path
Allow /rss/yandex/
Allow /rss/news_yand_rdn.xml
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.svg
Disallow /*.pdf
Disallow /images/
Disallow /uploads/
Disallow /cont/art.php?sn_nid=*
Disallow /post/view/?&sn_nid=*
Disallow /bin/lik?id=*

*

Rule Path
Allow /rss/yandex/
Allow /rss/news_yand_rdn.xml
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.svg
Disallow /*.pdf
Disallow /images/
Disallow /uploads/
Disallow /cont/art.php?sn_nid=*
Disallow /post/view/?&sn_nid=*
Disallow /bin/lik?id=*

Other Records

Field Value
sitemap https://gazetaby.com/sitemap.xml