ser.brstej.com
robots.txt
Robots Exclusion Standard data for ser.brstej.com
Resource Scan
Scan Details
| Site Domain | ser.brstej.com |
| Base Domain | brstej.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-06-03T08:15:11+00:00 |
| Next Scan | 2024-07-03T08:15:11+00:00 |
Last Successful Scan
| Scanned | 2024-04-12T06:52:06+00:00 |
| URL | https://ser.brstej.com/robots.txt |
| Domain IPs | 104.21.11.206, 172.67.192.161, 2606:4700:3030::6815:bce, 2606:4700:3032::ac43:c0a1 |
| Response IP | 104.21.11.206 |
| Found | Yes |
| Hash | 077987d20855534e592f360683b748499685a681dbbf802803ee5c9d67968ca6 |
| SimHash | 0477471e5397 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /cPanel/ |
| Disallow | /email_template/ |
| Disallow | /include/ |
| Disallow | /js/ |
| Disallow | /lang/ |
| Disallow | /players/ |
| Disallow | /plugins/ |
| Disallow | /Smarty/ |
| Disallow | /templates/ |
| Disallow | /404.php |
| Disallow | /ajax.php |
| Disallow | /ajax_search.php |
| Disallow | /censor_words.txt |
| Disallow | /comment.php |
| Disallow | /config.php |
| Disallow | /cron.php |
| Disallow | /play.php |
| Disallow | /edit-video.php |
| Disallow | /edit_profile.php |
| Disallow | /emoji-help.php |
| Disallow | /fpembed.php |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /relatedclips.php |
| Disallow | /social-thumb.php |
| Disallow | /suggest.php |
| Disallow | /upload.php |
| Disallow | /user.php |
| Disallow | /videoads.php |
| Disallow | /topvideos.php |
| Disallow | /download.php |
| Disallow | /mobile/ |
| Disallow | /tag.php?* |
| Disallow | /search.php?* |
| Disallow | *sortby%3D* |
| Disallow | *order%3D* |
| Disallow | *page%3D* |
| Allow | /uploads/thumbs |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ser.brstej.com/sitemap-index.xml |
| sitemap | https://ser.brstej.com/video-sitemap-index.xml |