korea.stripes.com
robots.txt

Robots Exclusion Standard data for korea.stripes.com

Resource Scan

Scan Details

Site Domain korea.stripes.com
Base Domain stripes.com
Scan Status Ok
Last Scan2025-04-01T19:13:21+00:00
Next Scan 2025-04-15T19:13:21+00:00

Last Scan

Scanned2025-04-01T19:13:21+00:00
URL https://korea.stripes.com/robots.txt
Domain IPs 3.170.229.124, 3.170.229.21, 3.170.229.49, 3.170.229.80
Response IP 3.170.229.21
Found Yes
Hash 822e7d1be1dfdd18f21ef1e62a6ab37887b62e3d390b87aee02df38efc6d16cf
SimHash 9c31e8c30cd6

Groups

googlebot

Rule Path
Disallow /migration/
Disallow /news/
Disallow /*?_evDiscoveryPath=
Disallow /*?subcategory=
Disallow /*?*utm_source=
Disallow /*?*utm_campaign=
Disallow /*?*utm_medium=
Disallow /*?offset=
Disallow /*?count=
Disallow /*?total=
Disallow /*-1.*

*

Rule Path
Disallow /migration/
Disallow /news/
Disallow /*?_evDiscoveryPath=
Disallow /*?subcategory=
Disallow /*?*utm_source=
Disallow /*?*utm_campaign=
Disallow /*?*utm_medium=
Disallow /*?offset=
Disallow /*?count=
Disallow /*?total=
Disallow /*-1.*

Other Records

Field Value
sitemap https://www.stripes.com/sitemap/sitemap-index.xml
sitemap https://europe.stripes.com/sitemap/sitemap-index.xml
sitemap https://korea.stripes.com/sitemap/sitemap-index.xml
sitemap https://guam.stripes.com/sitemap/sitemap-index.xml
sitemap https://okinawa.stripes.com/sitemap/sitemap-index.xml
sitemap https://japan.stripes.com/sitemap/sitemap-index.xml

Comments

  • -------------------------------
  • Sitemap locations
  • -------------------------------
  • -------------------------------
  • Googlebot-specific directives
  • -------------------------------
  • Block migration content/directory
  • Block URLs with specific query parameters
  • Block old Polopolly article URLs with numeric IDs at the end (e.g., -1.647382)
  • -------------------------------
  • Directives for all other crawlers
  • -------------------------------
  • Block migration content/directory
  • Block URLs with specific query parameters
  • Block old Polopolly article URLs with numeric IDs at the end