iso.org
robots.txt
Robots Exclusion Standard data for iso.org
Resource Scan
Scan Details
| Site Domain | iso.org |
| Base Domain | iso.org |
| Scan Status | Ok |
| Last Scan | 2024-05-22T22:30:10+00:00 |
| Next Scan | 2024-06-05T22:30:10+00:00 |
Last Scan
| Scanned | 2024-05-22T22:30:10+00:00 |
| URL | https://iso.org/robots.txt |
| Redirect | https://www.iso.org/robots.txt |
| Redirect Domain | www.iso.org |
| Redirect Base | iso.org |
| Domain IPs | 138.81.131.132 |
| Redirect IPs | 138.81.131.132 |
| Response IP | 138.81.131.132 |
| Found | Yes |
| Hash | b9ecdeff6c96006f1ee11055f9f1736697238b36b33072c619d99873083bc33b |
| SimHash | 2e79d8f0e237 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /files/live/sites/isoorg/files/_noindex |
| Disallow | /fr/search/x |
| Disallow | /ru/search/x |
| Disallow | /search/x |
| Disallow | /advanced-search/x/ |
| Disallow | /fr/advanced-search/x/ |
| Disallow | /ru/advanced-search/x/ |
| Disallow | /em |
| Disallow | /webstore/checkout |
| Disallow | /webstore/shoppingbasket |
| Disallow | /webstore/ShoppingBasket |
| Disallow | /home.isoDocumentsDownload.do? |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.iso.org/sitemap.xml |
| sitemap | https://www.iso.org/sitemap/standard.xml |
| sitemap | https://www.iso.org/sitemap/standard1.xml |
| sitemap | https://www.iso.org/sitemap/fr/standard.xml |
| sitemap | https://www.iso.org/sitemap/fr/standard1.xml |
| sitemap | https://www.iso.org/sitemap/ru/standard.xml |
| sitemap | https://www.iso.org/sitemap/ru/standard1.xml |
| sitemap | https://www.iso.org/sitemap/committee.xml |
| sitemap | https://www.iso.org/sitemap/fr/committee.xml |
| sitemap | https://www.iso.org/sitemap/ru/committee.xml |
| sitemap | https://www.iso.org/sitemap/publication.xml |
| sitemap | https://www.iso.org/sitemap/fr/publication.xml |
| sitemap | https://www.iso.org/sitemap/ru/publication.xml |
| sitemap | https://www.iso.org/obp/sitemapindex.xml |