sanspo.com
robots.txt

Robots Exclusion Standard data for sanspo.com

Resource Scan

Scan Details

Site Domain sanspo.com
Base Domain sanspo.com
Scan Status Ok
Last Scan2024-05-09T20:17:11+00:00
Next Scan 2024-05-16T20:17:11+00:00

Last Scan

Scanned2024-05-09T20:17:11+00:00
URL https://sanspo.com/robots.txt
Redirect https://www.sanspo.com/robots.txt
Redirect Domain www.sanspo.com
Redirect Base sanspo.com
Domain IPs 52.193.168.148, 54.64.115.119
Redirect IPs 23.211.140.131, 23.211.140.75, 2600:1413:b000:14::b857:c14a, 2600:1413:b000:14::b857:c14b
Response IP 42.99.140.177
Found Yes
Hash c975558236d27d3c4c9b25c39806718bb2c8fb868672ebb409e831cfd07052fe
SimHash b81c4851c1b5

Groups

*

Rule Path
Disallow /_test/
Disallow /smp/_test/
Disallow */module/
Disallow */print/
Disallow /parts/
Disallow /preview/
Disallow /race/_test/
Disallow /race/parts/
Disallow /race/preview/

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.sanspo.com/feeds/sitemapindex/?outputType=xml
sitemap https://www.sanspo.com/feeds/sitemapindex-category/?outputType=xml
sitemap https://www.sanspo.com/feeds/sitemapindex-category/1/?outputType=xml
sitemap https://www.sanspo.com/feeds/sitemapindex-category/2/?outputType=xml
sitemap https://www.sanspo.com/feeds/google-sitemapindex/?outputType=xml
sitemap https://feed.etf.sanspo.com/global/sitemap
sitemap https://www.sanspo.com/feeds/sitemapindex-race/?outputType=xml
sitemap https://www.sanspo.com/feeds/sitemapindex-category-race/?outputType=xml
sitemap https://www.sanspo.com/common/feed/sitemap/pressrelease/kyodo_prwire.xml
sitemap https://www.sanspo.com/common/feed/sitemap/pressrelease/kyodo_prwire_2.xml
sitemap https://www.sanspo.com/common/feed/sitemap/pressrelease/dreamnews.xml
sitemap https://www.sanspo.com/common/feed/sitemap/pressrelease/atpress.xml

Comments

  • sitemap
  • Sitemap: https://www.sanspo.com/sitemap.xml
  • Sitemap: https://www.sanspo.com/feeds/sitemap-pressrelease/?outputType=xml&from=0
  • Sitemap: https://www.sanspo.com/feeds/sitemap-pressrelease/?outputType=xml&from=100
  • Sitemap: https://www.sanspo.com/feeds/sitemap-pressrelease/?outputType=xml&from=200
  • Sitemap: https://www.sanspo.com/feeds/sitemap-pressrelease/?outputType=xml&from=300
  • Disallow other Search