blogs.stripes.com
robots.txt

Robots Exclusion Standard data for blogs.stripes.com

Resource Scan

Scan Details

Site Domain blogs.stripes.com
Base Domain stripes.com
Scan Status Ok
Last Scan2025-03-30T06:12:57+00:00
Next Scan 2025-04-29T06:12:57+00:00

Last Scan

Scanned2025-03-30T06:12:57+00:00
URL https://blogs.stripes.com/robots.txt
Redirect https://www.stripes.com/robots.txt
Redirect Domain www.stripes.com
Redirect Base stripes.com
Domain IPs 15.197.173.226, 3.33.168.159
Redirect IPs 15.197.173.226, 3.33.168.159
Response IP 15.197.173.226
Found Yes
Hash 822e7d1be1dfdd18f21ef1e62a6ab37887b62e3d390b87aee02df38efc6d16cf
SimHash 9c31e8c30cd6

Groups

googlebot

Rule Path
Disallow /migration/
Disallow /news/
Disallow /*?_evDiscoveryPath=
Disallow /*?subcategory=
Disallow /*?*utm_source=
Disallow /*?*utm_campaign=
Disallow /*?*utm_medium=
Disallow /*?offset=
Disallow /*?count=
Disallow /*?total=
Disallow /*-1.*

*

Rule Path
Disallow /migration/
Disallow /news/
Disallow /*?_evDiscoveryPath=
Disallow /*?subcategory=
Disallow /*?*utm_source=
Disallow /*?*utm_campaign=
Disallow /*?*utm_medium=
Disallow /*?offset=
Disallow /*?count=
Disallow /*?total=
Disallow /*-1.*

Other Records

Field Value
sitemap https://www.stripes.com/sitemap/sitemap-index.xml
sitemap https://europe.stripes.com/sitemap/sitemap-index.xml
sitemap https://korea.stripes.com/sitemap/sitemap-index.xml
sitemap https://guam.stripes.com/sitemap/sitemap-index.xml
sitemap https://okinawa.stripes.com/sitemap/sitemap-index.xml
sitemap https://japan.stripes.com/sitemap/sitemap-index.xml

Comments

  • -------------------------------
  • Sitemap locations
  • -------------------------------
  • -------------------------------
  • Googlebot-specific directives
  • -------------------------------
  • Block migration content/directory
  • Block URLs with specific query parameters
  • Block old Polopolly article URLs with numeric IDs at the end (e.g., -1.647382)
  • -------------------------------
  • Directives for all other crawlers
  • -------------------------------
  • Block migration content/directory
  • Block URLs with specific query parameters
  • Block old Polopolly article URLs with numeric IDs at the end