iraqtoday.net
robots.txt

Robots Exclusion Standard data for iraqtoday.net

Resource Scan

Scan Details

Site Domain iraqtoday.net
Base Domain iraqtoday.net
Scan Status Ok
Last Scan2025-05-01T18:54:57+00:00
Next Scan 2025-05-08T18:54:57+00:00

Last Scan

Scanned2025-05-01T18:54:57+00:00
URL https://iraqtoday.net/robots.txt
Redirect https://www.iraqtoday.net/robots.txt
Redirect Domain www.iraqtoday.net
Redirect Base iraqtoday.net
Domain IPs 104.21.90.173, 172.67.202.176, 2606:4700:3035::6815:5aad, 2606:4700:3035::ac43:cab0
Redirect IPs 104.21.90.173, 172.67.202.176, 2606:4700:3035::6815:5aad, 2606:4700:3035::ac43:cab0
Response IP 172.67.202.176
Found Yes
Hash d367a58c9ffc96cbd0d320ad99d5db31ad1af1fce5f7cbba619d6b0229596ddd
SimHash 659c57014695

Groups

googlebot

Rule Path
Disallow /application/
Disallow /book/2?page=1
Disallow /book/2?page=2
Disallow /book/2?page=3
Disallow /book/2?page=4
Disallow /book/2?page=5
Disallow /book/2?page=6
Disallow /book/2?page=7
Disallow /book/2?page=8
Disallow /book/2?page=9
Disallow /book/2?page=10
Disallow /cgi-bin/
Disallow /cache/
Disallow /administrator/
Disallow /captcha/
Disallow /ckeditor/
Disallow /siteadmin/
Disallow /system/
Disallow /images/flipbookgallery/
Disallow /~arabstod/
Disallow /cdn-cgi/

yahoo! slurp

Rule Path
Disallow /application/
Disallow /book/2?page=1
Disallow /book/2?page=2
Disallow /book/2?page=3
Disallow /book/2?page=4
Disallow /book/2?page=5
Disallow /book/2?page=6
Disallow /book/2?page=7
Disallow /book/2?page=8
Disallow /book/2?page=9
Disallow /book/2?page=10
Disallow /cgi-bin/
Disallow /cache/
Disallow /administrator/
Disallow /captcha/
Disallow /ckeditor/
Disallow /fonts/
Disallow /siteadmin/
Disallow /system/
Disallow /images/flipbookgallery/
Disallow /~arabstod/
Disallow /cdn-cgi/

msnbot

Rule Path
Disallow /application/
Disallow /book/2?page=1
Disallow /book/2?page=2
Disallow /book/2?page=3
Disallow /book/2?page=4
Disallow /book/2?page=5
Disallow /book/2?page=6
Disallow /book/2?page=7
Disallow /book/2?page=8
Disallow /book/2?page=9
Disallow /book/2?page=10
Disallow /cgi-bin/
Disallow /cache/
Disallow /administrator/
Disallow /captcha/
Disallow /ckeditor/
Disallow /fonts/
Disallow /siteadmin/
Disallow /system/
Disallow /images/flipbookgallery/
Disallow /~arabstod/
Disallow /cdn-cgi/

googlebot-mobile

Rule Path
Disallow /application/
Disallow /book/2?page=1
Disallow /book/2?page=2
Disallow /book/2?page=3
Disallow /book/2?page=4
Disallow /book/2?page=5
Disallow /book/2?page=6
Disallow /book/2?page=7
Disallow /book/2?page=8
Disallow /book/2?page=9
Disallow /book/2?page=10
Disallow /cgi-bin/
Disallow /cache/
Disallow /administrator/
Disallow /captcha/
Disallow /ckeditor/
Disallow /fonts/
Disallow /siteadmin/
Disallow /system/
Disallow /images/flipbookgallery/
Disallow /~arabstod/
Disallow /cdn-cgi/

*

Rule Path
Disallow /application/
Disallow /book/2?page=1
Disallow /book/2?page=2
Disallow /book/2?page=3
Disallow /book/2?page=4
Disallow /book/2?page=5
Disallow /book/2?page=6
Disallow /book/2?page=7
Disallow /book/2?page=8
Disallow /book/2?page=9
Disallow /book/2?page=10
Disallow /cgi-bin/
Disallow /cache/
Disallow /administrator/
Disallow /captcha/
Disallow /ckeditor/
Disallow /fonts/
Disallow /siteadmin/
Disallow /system/
Disallow /images/flipbookgallery/
Disallow /~arabstod/
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://www.iraqtoday.net/sitemapindex.xml
sitemap https://www.iraqtoday.net/sitemapindex.xml
sitemap https://www.iraqtoday.net/sitemapindex.xml
sitemap https://www.iraqtoday.net/sitemapindex.xml

Comments

  • www.iraqtoday.net