shashwat.in
robots.txt
Robots Exclusion Standard data for shashwat.in
Resource Scan
Scan Details
| Site Domain | shashwat.in |
| Base Domain | shashwat.in |
| Scan Status | Ok |
| Last Scan | 2025-12-05T00:27:52+00:00 |
| Next Scan | 2026-01-04T00:27:52+00:00 |
Last Scan
| Scanned | 2025-12-05T00:27:52+00:00 |
| URL | https://www.shashwat.in/robots.txt |
| Domain IPs | 18.205.205.127, 3.211.73.151 |
| Response IP | 3.211.73.151 |
| Found | Yes |
| Hash | 278c4b2ba0f2a5982e76df889b0d33cd4b44dfb4ab6add0b9dd5de5475ed3867 |
| SimHash | 35385d41e982 |
Groups
amazonbot
anthropic-ai
applebot-extended
ccbot
chatgpt-user
claude-web
claudebot
cohere-ai
duckassistbot
facebookbot
google-cloudvertexbot
google-extended
gptbot
meta-externalagent
meta-externalagent
perplexitybot
quora-bot
ahrefsbot
ahrefssiteaudit
semrushbot
semrushbot-sa
meta-externalfetcher
meta-externalfetcher
bingbot
pinterest
facebookexternalhit
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
*
| Rule | Path |
|---|---|
| Disallow | /download/* |
| Disallow | /order/* |
| Disallow | /cart$ |
| Disallow | /global-cart$ |
| Disallow | /refresh-token$ |
| Disallow | /blog/tag/* |
| Disallow | /blog/author/* |
| Disallow | /share-image/* |
| Disallow | /site-share-image/* |
| Disallow | /store?page=* |
| Disallow | /?search=* |
| Disallow | /pixpa-social-share?url=* |
| Disallow | /newsletter?_* |
| Disallow | /site$ |
| Disallow | /admin |
| Disallow | /private$ |
| Disallow | /store/thankyou* |
| Disallow | /album/thankyou* |
| Disallow | /order/thankyou* |
| Disallow | /payment/thankyou* |
| Disallow | /custom-page-form?_token=* |
| Disallow | /filters%3Ano_upscale%28%29%3Aquality%28100%29/ |
| Disallow | /called$ |
| Disallow | /assets/* |
| Disallow | /getjsassets/ |
| Disallow | /add-blog-comment$ |
| Disallow | /lazyload-images/* |
| Disallow | /user-css-create/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.shashwat.in/sitemap.xml |
Comments