shouts.dev
robots.txt
Robots Exclusion Standard data for shouts.dev
Resource Scan
Scan Details
Site Domain | shouts.dev |
Base Domain | shouts.dev |
Scan Status | Ok |
Last Scan | 2025-04-16T12:55:37+00:00 |
Next Scan | 2025-04-23T12:55:37+00:00 |
Last Scan
Scanned | 2025-04-16T12:55:37+00:00 |
URL | https://shouts.dev/robots.txt |
Domain IPs | 104.21.67.76, 172.67.218.109, 2606:4700:3034::ac43:da6d, 2606:4700:3037::6815:434c |
Response IP | 104.21.67.76 |
Found | Yes |
Hash | fc0645a9f87544c1919e9e223e160aac7c7164075600998575ec245250666fed |
SimHash | 6d51dec745f0 |
Groups
*
Rule | Path |
---|---|
Allow | /?display=wide |
Allow | /wp-content/uploads/ |
Allow | /uploads/ |
Disallow | /*articles/preview/* |
Disallow | /*snippets/preview/* |
Disallow | /*redirect/* |
Disallow | /*articles/tags/* |
Disallow | /*snippets/tags/* |
Disallow | /*?s=* |
Disallow | /*?p=* |
Disallow | /*?search=* |
Disallow | /*?page=* |
Disallow | /*/page/* |
Disallow | /*?tab=* |
Disallow | /*redirect?url=* |
Disallow | /*mcp?redirect_to=* |
Other Records
Field | Value |
---|---|
sitemap | https://shouts.dev/sitemap.xml |
sitemap | https://shouts.dev/sitemap/articles.xml |
sitemap | https://shouts.dev/sitemap/article_topics.xml |
sitemap | https://shouts.dev/sitemap/snippets.xml |
sitemap | https://shouts.dev/sitemap/snippet_topics.xml |