gazetaby.media
robots.txt

Robots Exclusion Standard data for gazetaby.media

Resource Scan

Scan Details

Site Domain gazetaby.media
Base Domain gazetaby.media
Scan Status Ok
Last Scan2024-05-30T13:43:16+00:00
Next Scan 2024-06-06T13:43:16+00:00

Last Scan

Scanned2024-05-30T13:43:16+00:00
URL https://gazetaby.media/robots.txt
Domain IPs 49.12.103.120
Response IP 49.12.103.120
Found Yes
Hash f1add47677e01a39ca6493aa393aa5afc1481a5d4cb65e46797b83643c9efde1
SimHash 494f15421530

Groups

yandex

Rule Path
Allow /rss/yandex/
Allow /rss/news_yand_rdn.xml
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.svg
Disallow /*.pdf
Disallow /images/
Disallow /uploads/
Disallow /cont/art.php?sn_nid=*
Disallow /post/view/?&sn_nid=*
Disallow /bin/lik?id=*

googlebot

Rule Path
Allow /rss/yandex/
Allow /rss/news_yand_rdn.xml
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.svg
Disallow /*.pdf
Disallow /images/
Disallow /uploads/
Disallow /cont/art.php?sn_nid=*
Disallow /post/view/?&sn_nid=*
Disallow /bin/lik?id=*

*

Rule Path
Allow /rss/yandex/
Allow /rss/news_yand_rdn.xml
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.svg
Disallow /*.pdf
Disallow /images/
Disallow /uploads/
Disallow /cont/art.php?sn_nid=*
Disallow /post/view/?&sn_nid=*
Disallow /bin/lik?id=*

Other Records

Field Value
sitemap https://gazetaby.com/sitemap.xml