news.akhbrna.co
robots.txt

Robots Exclusion Standard data for news.akhbrna.co

Resource Scan

Scan Details

Site Domain news.akhbrna.co
Base Domain akhbrna.co
Scan Status Ok
Last Scan2024-08-31T10:10:47+00:00
Next Scan 2024-09-30T10:10:47+00:00

Last Scan

Scanned2024-08-31T10:10:47+00:00
URL https://news.akhbrna.co/robots.txt
Redirect https://www.akhbrna.co/robots.txt
Redirect Domain www.akhbrna.co
Redirect Base akhbrna.co
Domain IPs 172.66.40.235, 172.66.43.21, 2606:4700:3108::ac42:28eb, 2606:4700:3108::ac42:2b15
Redirect IPs 172.66.40.235, 172.66.43.21, 2606:4700:3108::ac42:28eb, 2606:4700:3108::ac42:2b15
Response IP 172.66.40.235
Found Yes
Hash 378ef459df7671e0eff2f7a3e759242473aaae231933082dcf6ec7b7b5215275
SimHash 484807440d93

Groups

*

Rule Path
Disallow /*?fb_comment_id*
Disallow /refer/
Disallow /*?replytocom=*
Disallow /*/embed

googlebot-news

Rule Path
Disallow /pages/*
Disallow /author/*
Disallow /city/*
Disallow /country/*
Disallow /player/*
Disallow /person/*
Disallow /football-club/*
Disallow /governmental-institution/*

Other Records

Field Value
sitemap https://www.akhbrna.co/sitemap.xml