Log In Sign Up

spare8.com
robots.txt

Robots Exclusion Standard data for spare8.com

Resource Scan

Scan Details

Site Domain spare8.com
Base Domain spare8.com
Scan Status Ok
Last Scan2024-09-20T21:20:36+00:00
Next Scan 2024-09-27T21:20:36+00:00

Last Scan

Scanned2024-09-20T21:20:36+00:00
URL https://spare8.com/robots.txt
Redirect https://www.spare8.com/robots.txt
Redirect Domain www.spare8.com
Redirect Base spare8.com
Domain IPs 198.49.23.144
Redirect IPs 18.155.68.103, 18.155.68.30, 18.155.68.46, 18.155.68.66, 2600:9000:23d2:2000:10:3d9b:a640:93a1, 2600:9000:23d2:4200:10:3d9b:a640:93a1, 2600:9000:23d2:6800:10:3d9b:a640:93a1, 2600:9000:23d2:7c00:10:3d9b:a640:93a1, 2600:9000:23d2:8e00:10:3d9b:a640:93a1, 2600:9000:23d2:9400:10:3d9b:a640:93a1, 2600:9000:23d2:da00:10:3d9b:a640:93a1, 2600:9000:23d2:e200:10:3d9b:a640:93a1
Response IP 18.155.68.30
Found Yes
Hash f4f1462f88e2130da0dbe66bdb2b9235c47f0813e62942c6efa40dccb81d29ec
SimHash 6d52fa4bcc56

Groups

*

Rule Path
Allow /
Disallow /link/

adsbot-google-mobile
adsbot-google

Rule Path
Disallow /_api/*
Disallow /_partials*
Disallow /pro-gallery-webapp/v1/galleries/*

petalbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.spare8.com/sitemap.xml
Back to top

Comments

  • Disallow indexing of deep links
  • Optimization for Google Ads Bot
  • Block PetalBot
Back to top