web.brstej.com
robots.txt

Robots Exclusion Standard data for web.brstej.com

Resource Scan

Scan Details

Site Domain web.brstej.com
Base Domain brstej.com
Scan Status Ok
Last Scan2025-09-10T13:38:22+00:00
Next Scan 2025-10-10T13:38:22+00:00

Last Scan

Scanned2025-09-10T13:38:22+00:00
URL https://web.brstej.com/robots.txt
Redirect https://bos.brstej.com/robots.txt
Redirect Domain bos.brstej.com
Redirect Base brstej.com
Domain IPs 104.21.11.206, 172.67.192.161, 2606:4700:3030::6815:bce, 2606:4700:3032::ac43:c0a1
Redirect IPs 104.21.11.206, 172.67.192.161, 2606:4700:3030::6815:bce, 2606:4700:3032::ac43:c0a1
Response IP 104.21.11.206
Found Yes
Hash f07617e711d64b6320f084f64118892d5e52c576634265aad96f42a05500fa27
SimHash 0072474c57d7

Groups

*

Rule Path
Disallow /admin/
Disallow /cPanel/
Disallow /email_template/
Disallow /include/
Disallow /js/
Disallow /lang/
Disallow /players/
Disallow /plugins/
Disallow /Smarty/
Disallow /templates/
Disallow /mobile/
Disallow /uploads/temp/
Disallow /temp/
Disallow /404.php
Disallow /ajax.php
Disallow /ajax_search.php
Disallow /censor_words.txt
Disallow /comment.php
Disallow /config.php
Disallow /cron.php
Disallow /edit-video.php
Disallow /edit_profile.php
Disallow /emoji-help.php
Disallow /fpembed.php
Disallow /login.php
Disallow /register.php
Disallow /relatedclips.php
Disallow /social-thumb.php
Disallow /suggest.php
Disallow /upload.php
Disallow /user.php
Disallow /videoads.php
Disallow /topvideos.php
Disallow /download.php
Disallow /play.php
Disallow /embed.php
Disallow /tag.php?*
Disallow /download.php?*
Disallow /search.php?*
Disallow *sortby%3D*
Disallow *order%3D*
Disallow *page%3D*
Disallow /*.json$
Disallow /*.xml$
Disallow /*.txt$
Allow /uploads/thumbs

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

Other Records

Field Value
sitemap https://bos.brstej.com/sitemaps-index.xml

Comments

  • Bots allowed
  • Sitemap links