blog.almaftuchin.com
robots.txt
Robots Exclusion Standard data for blog.almaftuchin.com
Resource Scan
Scan Details
Site Domain | blog.almaftuchin.com |
Base Domain | almaftuchin.com |
Scan Status | Ok |
Last Scan | 2024-10-08T16:52:54+00:00 |
Next Scan | 2024-11-07T16:52:54+00:00 |
Last Scan
Scanned | 2024-10-08T16:52:54+00:00 |
URL | https://blog.almaftuchin.com/robots.txt |
Domain IPs | 2404:6800:4003:c11::79, 74.125.68.121 |
Response IP | 142.251.12.121 |
Found | Yes |
Hash | 88084bfc6a43deb467d08da605c000fe70203449b29e52b880bbcb43ef10e824 |
SimHash | 40491135c315 |
Groups
*
Rule | Path |
---|---|
Allow | /* |
Disallow | |
Disallow | /*?url= |
Disallow | /p/go.html |
Disallow | /p/generate.html |
Disallow | /feeds/*/comments/default |
Other Records
Field | Value |
---|---|
sitemap | https://blog.almaftuchin.com/sitemap.xml |
sitemap | https://blog.almaftuchin.com/atom.xml?redirect=false&start-index=1&max-results=500 |
sitemap | https://blog.almaftuchin.com/atom.xml?redirect=false&start-index=501&max-results=500 |
sitemap | https://blog.almaftuchin.com/atom.xml?redirect=false&start-index=1001&max-results=500 |
sitemap | https://blog.almaftuchin.com/atom.xml?redirect=false&start-index=1501&max-results=500 |
sitemap | https://blog.almaftuchin.com/atom.xml?redirect=false&start-index=2001&max-results=500 |
sitemap | https://blog.almaftuchin.com/atom.xml?redirect=false&start-index=2501&max-results=500 |
sitemap | https://blog.almaftuchin.com/atom.xml?redirect=false&start-index=3001&max-results=500 |
sitemap | https://blog.almaftuchin.com/feeds/posts/default |
sitemap | https://blog.almaftuchin.com/sitemap-pages.xml |