israel21c.org
robots.txt

Robots Exclusion Standard data for israel21c.org

Resource Scan

Scan Details

Site Domain israel21c.org
Base Domain israel21c.org
Scan Status Ok
Last Scan2024-11-11T02:27:51+00:00
Next Scan 2024-11-18T02:27:51+00:00

Last Scan

Scanned2024-11-11T02:27:51+00:00
URL https://israel21c.org/robots.txt
Redirect https://www.israel21c.org/robots.txt
Redirect Domain www.israel21c.org
Redirect Base israel21c.org
Domain IPs 104.18.4.244, 104.18.5.244
Redirect IPs 104.18.4.244, 104.18.5.244, 2606:4700::6812:4f4, 2606:4700::6812:5f4
Response IP 104.18.5.244
Found Yes
Hash 53583daa2ad22dc9082dd11e0cf0154039c28d02980bb7d539e37751a1c196c0
SimHash c915c850d471

Groups

googlebot-image

Rule Path
Disallow
Allow /wp-content/uploads/

mediapartners-google*

Rule Path
Disallow

duggmirror

Rule Path
Disallow /

twitterbot

Rule Path
Disallow
Allow /*

googlebot-news

Rule Path
Disallow

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/cache/
Disallow /trackback/
Disallow /rss-feed/
Disallow /feed/
Disallow /comments/

Other Records

Field Value
sitemap http://www.israel21c.org/sitemap_index.xml

Comments

  • Google Image
  • Google AdSense
  • digg mirror
  • Twitter
  • Google News
  • global