static-briefly.akamaized.net
robots.txt

Robots Exclusion Standard data for static-briefly.akamaized.net

Resource Scan

Scan Details

Site Domain static-briefly.akamaized.net
Base Domain akamaized.net
Scan Status Ok
Last Scan2024-06-27T12:44:50+00:00
Next Scan 2024-07-04T12:44:50+00:00

Last Scan

Scanned2024-06-27T12:44:50+00:00
URL https://static-briefly.akamaized.net/robots.txt
Domain IPs 23.202.34.129, 23.202.34.169
Response IP 23.211.60.106
Found Yes
Hash 96dfb32fe29b968d4c4c90024c8cec10837985393e202dc1b6e263c76a507539
SimHash 58604409d954

Groups

*

Rule Path
Disallow */away.php?
Disallow */redirect.php?
Disallow /fb_comment_id%3D*
Disallow */maillist/*
Disallow */resource/*
Disallow /member.php*
Disallow *?new_letter
Disallow */feedback.php*
Disallow /?preview_id
Disallow /?pk_campaign=*
Disallow /newsfeed
Disallow /app-landing/
Disallow /pay.html
Disallow /widget4/
Disallow /briefly/speed_test.html
Disallow /ajax/visit/
Disallow /ajax/recommendation/
Disallow /authors/*?*
Disallow /authors/*?page=*&*
Allow /authors/*?page=*$

Other Records

Field Value
sitemap https://origin.briefly.co.za/briefly/sitemap/sitemap.xml
sitemap https://origin.briefly.co.za/briefly/sitemap/news.xml
sitemap https://origin.briefly.co.za/briefly/sitemap/category-sitemap.xml
sitemap https://origin.briefly.co.za/briefly/sitemap/tag-sitemap.xml
sitemap https://origin.briefly.co.za/briefly/sitemap/author-sitemap.xml
sitemap https://origin.briefly.co.za/briefly/sitemap/expert-sitemap.xml
sitemap https://origin.briefly.co.za/briefly/sitemap/static-sitemap.xml