brstej.com
robots.txt
Robots Exclusion Standard data for brstej.com
Resource Scan
Scan Details
| Site Domain | brstej.com |
| Base Domain | brstej.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-16T02:07:08+00:00 |
| Next Scan | 2025-02-14T02:07:08+00:00 |
Last Successful Scan
| Scanned | 2023-10-24T01:18:16+00:00 |
| URL | https://brstej.com/robots.txt |
| Redirect | https://wws.brstej.com/robots.txt |
| Redirect Domain | wws.brstej.com |
| Redirect Base | brstej.com |
| Domain IPs | 104.21.56.199, 172.67.156.10, 2606:4700:3034::6815:38c7, 2606:4700:3034::ac43:9c0a |
| Redirect IPs | 104.21.56.199, 172.67.156.10, 2606:4700:3034::6815:38c7, 2606:4700:3034::ac43:9c0a |
| Response IP | 172.67.156.10 |
| Found | Yes |
| Hash | bd3bb81d70eaa73a50120b360013c65a9375708998b360f0bccb4746f8c270d4 |
| SimHash | 0073470dc393 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /cPanel/ |
| Disallow | /email_template/ |
| Disallow | /include/ |
| Disallow | /js/ |
| Disallow | /lang/ |
| Disallow | /players/ |
| Disallow | /plugins/ |
| Disallow | /Smarty/ |
| Disallow | /templates/ |
| Disallow | /404.php |
| Disallow | /ajax.php |
| Disallow | /ajax_search.php |
| Disallow | /censor_words.txt |
| Disallow | /comment.php |
| Disallow | /config.php |
| Disallow | /cron.php |
| Disallow | /play.php |
| Disallow | /edit-video.php |
| Disallow | /edit_profile.php |
| Disallow | /emoji-help.php |
| Disallow | /fpembed.php |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /relatedclips.php |
| Disallow | /social-thumb.php |
| Disallow | /suggest.php |
| Disallow | /upload.php |
| Disallow | /user.php |
| Disallow | /videoads.php |
| Disallow | /topvideos.php |
| Disallow | /download.php |
| Disallow | /mobile/ |
| Disallow | /tag.php?* |
| Disallow | /search.php?* |
| Disallow | *sortby%3D* |
| Disallow | *order%3D* |
| Disallow | *page%3D* |
| Allow | /uploads/thumbs |
Other Records
| Field | Value |
|---|---|
| sitemap | https://wws.brstej.com/sitemap-index.xml |
| sitemap | https://wws.brstej.com/video-sitemap-index.xml |