briefly.co.za
robots.txt
Robots Exclusion Standard data for briefly.co.za
Resource Scan
Scan Details
| Site Domain | briefly.co.za |
| Base Domain | briefly.co.za |
| Scan Status | Ok |
| Last Scan | 2024-11-11T23:28:06+00:00 |
| Next Scan | 2024-11-18T23:28:06+00:00 |
Last Scan
| Scanned | 2024-11-11T23:28:06+00:00 |
| URL | https://briefly.co.za/robots.txt |
| Domain IPs | 23.209.46.70, 23.209.46.83 |
| Response IP | 23.49.60.58 |
| Found | Yes |
| Hash | 037a3d2a7362e47d517fe573ec75242afebbb873f9fa73aba1c87ee8a91637f3 |
| SimHash | 484904138854 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */away.php? |
| Disallow | */redirect.php? |
| Disallow | /fb_comment_id%3D* |
| Disallow | */maillist/* |
| Disallow | */resource/* |
| Disallow | /member.php* |
| Disallow | *?new_letter |
| Disallow | */feedback.php* |
| Disallow | /?preview_id |
| Disallow | /?pk_campaign=* |
| Disallow | /newsfeed |
| Disallow | /app-landing/ |
| Disallow | /pay.html |
| Disallow | /widget4/ |
| Disallow | /briefly/speed_test.html |
| Disallow | /ajax/visit/ |
| Disallow | /ajax/recommendation/ |
| Disallow | /authors/*?* |
| Disallow | /authors/*?page=*&* |
| Allow | /authors/*?page=*$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://briefly.co.za/briefly/sitemap/sitemap.xml |
| sitemap | https://briefly.co.za/briefly/sitemap/news.xml |
| sitemap | https://briefly.co.za/briefly/sitemap/category-sitemap.xml |
| sitemap | https://briefly.co.za/briefly/sitemap/tag-sitemap.xml |
| sitemap | https://briefly.co.za/briefly/sitemap/author-sitemap.xml |
| sitemap | https://briefly.co.za/briefly/sitemap/expert-sitemap.xml |
| sitemap | https://briefly.co.za/briefly/sitemap/static-sitemap.xml |