origin.briefly.co.za
robots.txt
Robots Exclusion Standard data for origin.briefly.co.za
Resource Scan
Scan Details
| Site Domain | origin.briefly.co.za |
| Base Domain | briefly.co.za |
| Scan Status | Ok |
| Last Scan | 2024-09-22T07:26:57+00:00 |
| Next Scan | 2024-09-29T07:26:57+00:00 |
Last Scan
| Scanned | 2024-09-22T07:26:57+00:00 |
| URL | https://origin.briefly.co.za/robots.txt |
| Domain IPs | 18.194.138.148, 18.197.13.244, 3.64.132.61 |
| Response IP | 3.64.132.61 |
| Found | Yes |
| Hash | 96dfb32fe29b968d4c4c90024c8cec10837985393e202dc1b6e263c76a507539 |
| SimHash | 58604409d954 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */away.php? |
| Disallow | */redirect.php? |
| Disallow | /fb_comment_id%3D* |
| Disallow | */maillist/* |
| Disallow | */resource/* |
| Disallow | /member.php* |
| Disallow | *?new_letter |
| Disallow | */feedback.php* |
| Disallow | /?preview_id |
| Disallow | /?pk_campaign=* |
| Disallow | /newsfeed |
| Disallow | /app-landing/ |
| Disallow | /pay.html |
| Disallow | /widget4/ |
| Disallow | /briefly/speed_test.html |
| Disallow | /ajax/visit/ |
| Disallow | /ajax/recommendation/ |
| Disallow | /authors/*?* |
| Disallow | /authors/*?page=*&* |
| Allow | /authors/*?page=*$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://origin.briefly.co.za/briefly/sitemap/sitemap.xml |
| sitemap | https://origin.briefly.co.za/briefly/sitemap/news.xml |
| sitemap | https://origin.briefly.co.za/briefly/sitemap/category-sitemap.xml |
| sitemap | https://origin.briefly.co.za/briefly/sitemap/tag-sitemap.xml |
| sitemap | https://origin.briefly.co.za/briefly/sitemap/author-sitemap.xml |
| sitemap | https://origin.briefly.co.za/briefly/sitemap/expert-sitemap.xml |
| sitemap | https://origin.briefly.co.za/briefly/sitemap/static-sitemap.xml |