Log In Sign Up

akhbarway.com
robots.txt

Robots Exclusion Standard data for akhbarway.com

Resource Scan

Scan Details

Site Domain akhbarway.com
Base Domain akhbarway.com
Scan Status Ok
Last Scan2024-09-24T21:36:35+00:00
Next Scan 2024-10-01T21:36:35+00:00

Last Scan

Scanned2024-09-24T21:36:35+00:00
URL https://akhbarway.com/robots.txt
Redirect https://www.akhbarway.com/robots.txt
Redirect Domain www.akhbarway.com
Redirect Base akhbarway.com
Domain IPs 104.21.92.96, 172.67.191.93, 2606:4700:3035::6815:5c60, 2606:4700:3036::ac43:bf5d
Redirect IPs 104.21.92.96, 172.67.191.93, 2606:4700:3035::6815:5c60, 2606:4700:3036::ac43:bf5d
Response IP 172.67.191.93
Found Yes
Hash ed4679d85e8c79bf7966345039bd00c9eef79c829c5e5b1d2c3207c5a7d448d2
SimHash 72289af08f9b

Groups

*

Rule Path
Disallow /send.asp
Disallow /print.asp
Allow /

Other Records

Field Value
crawl-delay 60

gptbot
ahrefsbot
awariorssbot
awariosmartbot
amazonbot
applebot
feedburner
dataforseobot
siteauditbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.akhbarway.com/sitemap-main.asp
sitemap http://www.akhbarway.com/sitemap-index-news-adab.asp
sitemap http://www.akhbarway.com/sitemap-index-news-assayyarat.asp
sitemap http://www.akhbarway.com/sitemap-index-news-computer.asp
sitemap http://www.akhbarway.com/sitemap-index-news-economy.asp
sitemap http://www.akhbarway.com/sitemap-index-news-elakhbar.asp
sitemap http://www.akhbarway.com/sitemap-index-news-nogoom.asp
sitemap http://www.akhbarway.com/sitemap-index-news-sehha.asp
sitemap http://www.akhbarway.com/sitemap-index-news-sports.asp
sitemap http://www.akhbarway.com/sitemap-index-news-technology.asp
sitemap http://www.akhbarway.com/sitemap-index-tags.asp
sitemap http://www.akhbarway.com/sitemap-index-tags-adab.asp
sitemap http://www.akhbarway.com/sitemap-index-tags-assayyarat.asp
sitemap http://www.akhbarway.com/sitemap-index-tags-computer.asp
sitemap http://www.akhbarway.com/sitemap-index-tags-economy.asp
sitemap http://www.akhbarway.com/sitemap-index-tags-elakhbar.asp
sitemap http://www.akhbarway.com/sitemap-index-tags-nogoom.asp
sitemap http://www.akhbarway.com/sitemap-index-tags-sehha.asp
sitemap http://www.akhbarway.com/sitemap-index-tags-sports.asp
sitemap http://www.akhbarway.com/sitemap-index-tags-technology.asp
Back to top