jonathan-cook.net
robots.txt

Robots Exclusion Standard data for jonathan-cook.net

Resource Scan

Scan Details

Site Domain jonathan-cook.net
Base Domain jonathan-cook.net
Scan Status Ok
Last Scan2025-11-22T05:50:17+00:00
Next Scan 2025-12-22T05:50:17+00:00

Last Scan

Scanned2025-11-22T05:50:17+00:00
URL https://jonathan-cook.net/robots.txt
Domain IPs 75.98.175.98
Response IP 75.98.175.98
Found Yes
Hash 4f813451229aca39a52933768ebd4bc10ecd827c4ee341912c733634a5f828de
SimHash db0ed502e845

Groups

*

Rule Path
Allow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

twitterbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

*

Rule Path
Allow /sitemap.xml
Allow /wp-content/uploads/*
Allow /wp-content/uploads/*/
Allow /wp-content/uploads/*/*/
Allow /2012-08-03/welcome-to-nazareth/
Allow /2012-08-12/netanyahu-is-the-dangerous-unknown-in-strategy-on-iran/
Disallow /login
Disallow /wp-login.php
Disallow /wp-admin/*
Disallow /feed/
Disallow /*/feed
Disallow /*/*/feed/
Disallow /wp-content/plugins/*
Disallow /wp-content/plugins/*/
Disallow /wp-content/plugins/*/*/
Disallow /category/occupied-territories/west-bank/
Disallow /page/16/?utm_source=bottom_floater&next&id=137
Disallow /page/18/?utm_source=bottom_floater&id=25
Disallow /tag/corporate-capitalism/
Disallow /tag/elections/
Disallow /tag/israel/
Disallow /video/47162372/fallback?noscript
Disallow /xmlrpc.php?rsd
Disallow /333
Disallow /key/ASWD56425CSA
Disallow /category/occupied-territories/peace-process-occupied-territories/
Disallow /%20rel%3D
Disallow /2002-10-18/selling-anti-semitism/%3Ehere
Disallow /2003-06-03/the-new-anti-semitism/%3Ehere
Disallow /2006-09-23/from-the-new-anti-semitism-to-nuclear-holocaust/%3
Disallow /2009-0806/russian-jews-defy-israeli-rabbis-ban-onmarriage/
Disallow /2010-1
Disallow /2010-09-22/israel-jails-arab-activists-for-***ue-contact-with-a-foreign-agent/
Disallow /2013-
Disallow /20131
Disallow /2013-06-29/black-ops-continue-against-snowden/
Disallow /2013-07-09/treatment-of-palestinians-is-apartheid-by-any-other-name/
Disallow /2013-07-10/the-demands-of-a-top-journalist/
Disallow /2013-07-10/why-israels-apartheid-doesnt-make-news/
Disallow /2013-07-10/israels-thriving-arms-trade-is-a-setback-to-peace-agreement/
Disallow /2013-07-15/al-jazeera-in-us-want-to-be-cnn-copy/
Disallow /2013-07-22/time-to-decolonise-our-minds-of-hollywood/
Disallow /2013-07-23/media-courtiers-and-the-royal-baby/
Disallow /2013-07-23/israels-thriving-arms-trade-is-a-setback-to-peace-agreement/%3B
Disallow /2013-07-29/foxs-hounding-of-muslim-bible-scholar/
Disallow /2013-08-03/liberal-jewish-commentary-clouds-our-view/
Disallow /2013-08-03/fear-is-the-panacea-for-us-security-state/
Disallow /2013-08-06/a-tale-of-slavery-for-the-modern-era/
Disallow /2013-08-07/nazareth-dispatch/Middle
Disallow /2013-10-29/peace-process-is-doomed-to-fail-while-israel-stalls-for-time/
Disallow /2013-11-12/israels-gains-from-the-death-of-arafat-cannot-be-ignored
Disallow /2013-12-17/the-us-plan-makes-a-viable-palestinian-state-untenable/
Disallow /2013-12-17/the-us-plan-makes-a-viable-palestinian-state-untenable/_1388019204
Disallow /20131
Disallow /2014-
Disallow /2014-01-22/cracks-in-the-alliance-finally-daylight-between-israel-and-us/
Disallow /2014-02-01/palestinians-in-israel-trapped-in-the-ghetto/%20
Disallow /2014-03-24/when-the-peace-process-grinds-to-a-halt-what-then/
Disallow /2014-07-31/stakes-rising-for-israel-in-gaza/
Disallow /2014-08-03/how-a-kidnapped-soldier-illustrates-israels-deception/_1407159642
Disallow /2014-09-25/is-there-a-plan-to-force-palestinians-into-sinai/Middle
Disallow /2014-12-04/why-netanyahu-wants-early-elections/Part
Disallow /2014-12-05/netanyahus-election-scapegoat-israels-pa1estinian-minority/
Disallow /2015-0...
Disallow /2015-0416/lawfare-israels-continuation-of-war-byother-means/
Disallow /2015-09-28_/israels-army-and-Schools-work-hand-hand
Disallow /2015-10-13/as-unrest-grows-in-israel-and-palestine-netanyahu-seeks-scapegoats/%23sthash.VtVEmlin.dpuf
Disallow /2015-10-16/videos-challenge-israeli-police-account-of-shootings/%23sthash.eAaIoGzL.dpuf
Disallow /2015-12-08/rabbis-miracle-cow-threatens-apocalypse-at-al-aqsa/%23sthash.0wY1ZUeV.dpuf
Disallow /2016-0
Disallow /2016-02-19/how-israel-is-turning-palestinians-into-zionists/
Disallow /2016-03-22/decades-on-israel-tries-to-bury-its-darkest-times/embed/
Disallow /2016-04-02/cold-blooded-killing-puts-israeli-military-culture-on-trial/
Disallow /2016-04-09/israels-bible-trail-demolishing-palestinian-homes-to-make-national-parks/
Disallow /2016-04-25/in-israel-an-ugly-tide-sweeps-over-palestinians/%23sthash.N53lH1RT.dpuf
Disallow /2016-05-23/religious-zealots-waging-a-quiet-revolution-in-israel/_1464340532
Disallow /2016-08-01/palestinians-inside-israel-are-under-attack
Disallow /2016-08-01/palestinians-inside-israel-are-under-attack/
Disallow /2016-08-13/israels%20stolen%20babies-redmains-darkest-secret/
Disallow /2016-08-29/carrot-and-stick-carve-up-will-not-work-for-israel/embed/
Disallow /2017-01-10/elor-azaria-verdict-moment-transition-israel/t_blank/
Disallow /2017-02-07/land-law-is-final-nail-in-the-two-state-solution-coffin/Esta