justintshockley.com
robots.txt
Robots Exclusion Standard data for justintshockley.com
Resource Scan
Scan Details
| Site Domain | justintshockley.com |
| Base Domain | justintshockley.com |
| Scan Status | Ok |
| Last Scan | 2025-11-16T12:54:12+00:00 |
| Next Scan | 2025-12-16T12:54:12+00:00 |
Last Scan
| Scanned | 2025-11-16T12:54:12+00:00 |
| URL | https://www.justintshockley.com/robots.txt |
| Domain IPs | 18.205.205.127, 3.211.73.151 |
| Response IP | 18.205.205.127 |
| Found | Yes |
| Hash | 4caa3be06408f614cc926fd4ddb2e68df8209dad6d1e83da47527d146616ed2c |
| SimHash | 35385c41e982 |
Groups
amazonbot
anthropic-ai
applebot-extended
ccbot
chatgpt-user
claude-web
claudebot
cohere-ai
duckassistbot
facebookbot
google-cloudvertexbot
google-extended
gptbot
meta-externalagent
meta-externalagent
perplexitybot
quora-bot
ahrefsbot
ahrefssiteaudit
semrushbot
semrushbot-sa
meta-externalfetcher
meta-externalfetcher
bingbot
pinterest
facebookexternalhit
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
*
| Rule | Path |
|---|---|
| Disallow | /download/* |
| Disallow | /order/* |
| Disallow | /cart$ |
| Disallow | /global-cart$ |
| Disallow | /refresh-token$ |
| Disallow | /blog/tag/* |
| Disallow | /blog/author/* |
| Disallow | /share-image/* |
| Disallow | /site-share-image/* |
| Disallow | /store?page=* |
| Disallow | /?search=* |
| Disallow | /pixpa-social-share?url=* |
| Disallow | /newsletter?_* |
| Disallow | /site$ |
| Disallow | /admin |
| Disallow | /private$ |
| Disallow | /store/thankyou* |
| Disallow | /album/thankyou* |
| Disallow | /order/thankyou* |
| Disallow | /payment/thankyou* |
| Disallow | /custom-page-form?_token=* |
| Disallow | /filters%3Ano_upscale%28%29%3Aquality%28100%29/ |
| Disallow | /called$ |
| Disallow | /assets/* |
| Disallow | /getjsassets/ |
| Disallow | /add-blog-comment$ |
| Disallow | /lazyload-images/* |
| Disallow | /user-css-create/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.justintshockley.com/sitemap.xml |
Comments