d2xtp127735pun.cloudfront.net
robots.txt

Robots Exclusion Standard data for d2xtp127735pun.cloudfront.net

Resource Scan

Scan Details

Site Domain d2xtp127735pun.cloudfront.net
Base Domain d2xtp127735pun.cloudfront.net
Scan Status Ok
Last Scan2025-04-01T03:10:20+00:00
Next Scan 2025-04-08T03:10:20+00:00

Last Scan

Scanned2025-04-01T03:10:20+00:00
URL https://d2xtp127735pun.cloudfront.net/robots.txt
Domain IPs 3.160.185.107, 3.160.185.191, 3.160.185.57, 3.160.185.9
Response IP 18.165.121.55
Found Yes
Hash bafe277f0a85eecdbef6ab4653497272674f54391ac99b51b621f0a7323da23e
SimHash 494715425531

Groups

yandex

Rule Path
Allow /rss/yandex/
Allow /rss/news_yand_rdn.xml
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.svg
Disallow /*.pdf
Disallow /images/
Disallow /uploads/
Disallow /cont/art.php?sn_nid=*
Disallow /post/view/?&sn_nid=*
Disallow /bin/lik?id=*

googlebot

Rule Path
Allow /rss/yandex/
Allow /rss/news_yand_rdn.xml
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.svg
Disallow /*.pdf
Disallow /images/
Disallow /uploads/
Disallow /cont/art.php?sn_nid=*
Disallow /post/view/?&sn_nid=*
Disallow /bin/lik?id=*

*

Rule Path
Allow /rss/yandex/
Allow /rss/news_yand_rdn.xml
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.svg
Allow /uploads/news/
Allow /uploads/news/news-sitemap.xml
Disallow /*.pdf
Disallow /images/
Disallow /uploads/
Disallow /cont/art.php?sn_nid=*
Disallow /post/view/?&sn_nid=*
Disallow /bin/lik?id=*

Other Records

Field Value
sitemap https://gazetaby.com/sitemap.xml
sitemap https://gazetaby.com/news-sitemap.xml