scottconary.com
robots.txt
Robots Exclusion Standard data for scottconary.com
Resource Scan
Scan Details
| Site Domain | scottconary.com |
| Base Domain | scottconary.com |
| Scan Status | Ok |
| Last Scan | 2025-10-26T01:26:28+00:00 |
| Next Scan | 2025-11-25T01:26:28+00:00 |
Last Scan
| Scanned | 2025-10-26T01:26:28+00:00 |
| URL | https://www.scottconary.com/robots.txt |
| Domain IPs | 18.205.205.127, 3.211.73.151 |
| Response IP | 3.211.73.151 |
| Found | Yes |
| Hash | b5882c88d43e75e9a659e83f191027655a5a4cf58bc6482226f112f6a5bbf187 |
| SimHash | 30785d41e582 |
Groups
amazonbot
anthropic-ai
applebot-extended
ccbot
chatgpt-user
claude-web
claudebot
cohere-ai
duckassistbot
facebookbot
google-cloudvertexbot
google-extended
gptbot
meta-externalagent
meta-externalagent
perplexitybot
quora-bot
| Rule | Path |
|---|---|
| Disallow | / |
ahrefsbot
ahrefssiteaudit
semrushbot
semrushbot-sa
meta-externalfetcher
meta-externalfetcher
bingbot
pinterest
facebookexternalhit
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
*
| Rule | Path |
|---|---|
| Disallow | /download/* |
| Disallow | /order/* |
| Disallow | /cart$ |
| Disallow | /global-cart$ |
| Disallow | /refresh-token$ |
| Disallow | /blog/tag/* |
| Disallow | /blog/author/* |
| Disallow | /share-image/* |
| Disallow | /site-share-image/* |
| Disallow | /store?page=* |
| Disallow | /?search=* |
| Disallow | /pixpa-social-share?url=* |
| Disallow | /newsletter?_* |
| Disallow | /site$ |
| Disallow | /admin |
| Disallow | /private$ |
| Disallow | /store/thankyou* |
| Disallow | /album/thankyou* |
| Disallow | /order/thankyou* |
| Disallow | /payment/thankyou* |
| Disallow | /custom-page-form?_token=* |
| Disallow | /filters%3Ano_upscale%28%29%3Aquality%28100%29/ |
| Disallow | /called$ |
| Disallow | /assets/* |
| Disallow | /getjsassets/ |
| Disallow | /add-blog-comment$ |
| Disallow | /lazyload-images/* |
| Disallow | /user-css-create/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.scottconary.com/sitemap.xml |
Comments