foreignaffairs.org
robots.txt
Robots Exclusion Standard data for foreignaffairs.org
Resource Scan
Scan Details
Site Domain | foreignaffairs.org |
Base Domain | foreignaffairs.org |
Scan Status | Ok |
Last Scan | 2024-06-27T18:03:02+00:00 |
Next Scan | 2024-07-04T18:03:02+00:00 |
Last Scan
Scanned | 2024-06-27T18:03:02+00:00 |
URL | https://foreignaffairs.org/robots.txt |
Redirect | https://www.foreignaffairs.com/robots.txt |
Redirect Domain | www.foreignaffairs.com |
Redirect Base | foreignaffairs.com |
Domain IPs | 104.18.16.71, 104.18.17.71, 2606:4700::6812:1047, 2606:4700::6812:1147 |
Redirect IPs | 104.18.14.158, 104.18.15.158, 2606:4700::6812:e9e, 2606:4700::6812:f9e |
Response IP | 104.18.14.158 |
Found | Yes |
Hash | 00192f58faeed3007a34e660cdbc9d74e99e5e433af93d7098bb5b421162c5c3 |
SimHash | 3896ad134a68 |
Groups
*
Rule | Path |
---|---|
Allow | /core/*.css$ |
Allow | /core/*.css? |
Allow | /core/*.js$ |
Allow | /core/*.js? |
Allow | /core/*.gif |
Allow | /core/*.jpg |
Allow | /core/*.jpeg |
Allow | /core/*.png |
Allow | /core/*.svg |
Allow | /profiles/*.css$ |
Allow | /profiles/*.css? |
Allow | /profiles/*.js$ |
Allow | /profiles/*.js? |
Allow | /profiles/*.gif |
Allow | /profiles/*.jpg |
Allow | /profiles/*.jpeg |
Allow | /profiles/*.png |
Allow | /profiles/*.svg |
Disallow | /themes/mag/ |
Disallow | /core/ |
Disallow | /profiles/ |
Disallow | /README.md |
Disallow | /composer/Metapackage/README.txt |
Disallow | /composer/Plugin/ProjectMessage/README.md |
Disallow | /composer/Plugin/Scaffold/README.md |
Disallow | /composer/Plugin/VendorHardening/README.txt |
Disallow | /composer/Template/README.txt |
Disallow | /modules/README.txt |
Disallow | /sites/README.txt |
Disallow | /themes/README.txt |
Disallow | /web.config |
Disallow | /fa-search.php |
Disallow | /zh-hans/ |
Disallow | /ru/ |
Disallow | /es/articles/ |
Disallow | /es/reviews/ |
Disallow | /es/authors/ |
Disallow | /es/taxonomy/ |
Disallow | /es/region/ |
Disallow | /admin/ |
Disallow | /comment/reply/ |
Disallow | /filter/tips |
Disallow | /node/add |
Disallow | /user/logout |
Disallow | /media/oembed |
Disallow | /*/media/oembed |
Disallow | /subscribe/ |
Disallow | /gift/ |
Disallow | /tcs/ |
Disallow | /js/ |
Disallow | /node/_search |
Disallow | /tags-regions/json/ |
Disallow | /cart/ |
Disallow | /printmail/ |
Disallow | /taxonomy/ |
Disallow | /newsletter/ |
Disallow | /modules/ |
Disallow | /saml_login?* |
Disallow | /_Incapsula_Resource |
Disallow | /fa-caching/cdn-vary-check |
Disallow | /system/files/ |
Disallow | /themes/fa/build/ |
Disallow | /sites/default/files/google_tag/ |
Disallow | /index.php/admin/ |
Disallow | /index.php/comment/reply/ |
Disallow | /index.php/filter/tips |
Disallow | /index.php/node/add |
Disallow | /index.php/user/logout |
Disallow | /index.php/media/oembed |
Disallow | /index.php/*/media/oembed |
Disallow | /index.php/subscribe/ |
Disallow | /index.php/gift/ |
Disallow | /index.php/tcs/ |
Disallow | /index.php/js/ |
Disallow | /index.php/node/_search |
Disallow | /index.php/tags-regions/json/ |
Disallow | /index.php/cart/ |
Disallow | /index.php/printmail/ |
Disallow | /index.php/taxonomy/ |
Disallow | /index.php/newsletter/ |
Disallow | /index.php/modules/ |
Disallow | /index.php/saml_login?* |
Disallow | /index.php/_Incapsula_Resource |
Disallow | /index.php/fa-caching/cdn-vary-check |
Disallow | /index.php/system/files/ |
Disallow | /index.php/themes/fa/build/ |
Disallow | /index.php/sites/default/files/google_tag/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.foreignaffairs.com/sitemap.xml |
Comments