shouldit.com
robots.txt

Robots Exclusion Standard data for shouldit.com

Resource Scan

Scan Details

Site Domain shouldit.com
Base Domain shouldit.com
Scan Status Ok
Last Scan2025-08-25T22:29:16+00:00
Next Scan 2025-09-01T22:29:16+00:00

Last Scan

Scanned2025-08-25T22:29:16+00:00
URL https://shouldit.com/robots.txt
Domain IPs 104.26.12.22, 104.26.13.22, 172.67.71.86, 2606:4700:20::681a:c16, 2606:4700:20::681a:d16, 2606:4700:20::ac43:4756
Response IP 172.67.71.86
Found Yes
Hash 0e2e2ae914a48cd8ca5383baa6963a74f92cd65522c13a0bd8a67d2a74b201d8
SimHash a05b9a369813

Groups

*

Rule Path
Disallow /%5Bslug%5D
Disallow /*%5Bslug%5D
Disallow /%5Btype%5D
Disallow /*%5Btype%5D
Disallow /cdn-cgi/
Disallow /auth/
Disallow /api/
Disallow /buy/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://shouldit.com/coffee-makers/sitemap.xml
sitemap https://shouldit.com/blenders/sitemap.xml
sitemap https://shouldit.com/knife-sharpeners/sitemap.xml
sitemap https://shouldit.com/sitemap/topic.xml
sitemap https://shouldit.com/sitemap/post.xml
sitemap https://shouldit.com/sitemap/page.xml
sitemap https://shouldit.com/sitemap/category.xml
sitemap https://shouldit.com/toaster-ovens/sitemap.xml
sitemap https://shouldit.com/waffle-makers/sitemap.xml
sitemap https://shouldit.com/vacuum-sealers/sitemap.xml
sitemap https://shouldit.com/ice-makers/sitemap.xml
sitemap https://shouldit.com/author/sitemap.xml
sitemap https://shouldit.com/kettles/sitemap.xml
sitemap https://shouldit.com/thermometers/sitemap.xml
sitemap https://shouldit.com/kitchen-faucets/sitemap.xml
sitemap https://shouldit.com/juicers/sitemap.xml
sitemap https://shouldit.com/range-hoods/sitemap.xml
sitemap https://shouldit.com/water-filters/sitemap.xml
sitemap https://shouldit.com/water-cooler-dispensers/sitemap.xml
sitemap https://shouldit.com/garbage-disposals/sitemap.xml
sitemap https://shouldit.com/electric-skillets/sitemap.xml