gazetaby.com
robots.txt

Robots Exclusion Standard data for gazetaby.com

Resource Scan

Scan Details

Site Domain gazetaby.com
Base Domain gazetaby.com
Scan Status Ok
Last Scan2024-11-04T18:21:32+00:00
Next Scan 2024-11-11T18:21:32+00:00

Last Scan

Scanned2024-11-04T18:21:32+00:00
URL https://gazetaby.com/robots.txt
Domain IPs 176.9.54.72
Response IP 176.9.54.72
Found Yes
Hash f1add47677e01a39ca6493aa393aa5afc1481a5d4cb65e46797b83643c9efde1
SimHash 494f15421530

Groups

yandex

Rule Path
Allow /rss/yandex/
Allow /rss/news_yand_rdn.xml
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.svg
Disallow /*.pdf
Disallow /images/
Disallow /uploads/
Disallow /cont/art.php?sn_nid=*
Disallow /post/view/?&sn_nid=*
Disallow /bin/lik?id=*

googlebot

Rule Path
Allow /rss/yandex/
Allow /rss/news_yand_rdn.xml
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.svg
Disallow /*.pdf
Disallow /images/
Disallow /uploads/
Disallow /cont/art.php?sn_nid=*
Disallow /post/view/?&sn_nid=*
Disallow /bin/lik?id=*

*

Rule Path
Allow /rss/yandex/
Allow /rss/news_yand_rdn.xml
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.svg
Disallow /*.pdf
Disallow /images/
Disallow /uploads/
Disallow /cont/art.php?sn_nid=*
Disallow /post/view/?&sn_nid=*
Disallow /bin/lik?id=*

Other Records

Field Value
sitemap https://gazetaby.com/sitemap.xml