neatorama.com
robots.txt
Robots Exclusion Standard data for neatorama.com
Resource Scan
Scan Details
Site Domain | neatorama.com |
Base Domain | neatorama.com |
Scan Status | Ok |
Last Scan | 2024-05-27T10:53:26+00:00 |
Next Scan | 2024-06-03T10:53:26+00:00 |
Last Scan
Scanned | 2024-05-27T10:53:26+00:00 |
URL | https://neatorama.com/robots.txt |
Domain IPs | 96.126.99.242 |
Response IP | 96.126.99.242 |
Found | Yes |
Hash | 859267258699c8aed00fbff6375d9666f931f65c9118f51a0a10283143a34e0a |
SimHash | 05555c65c153 |
Groups
*
Rule | Path |
---|---|
Disallow | /login |
Disallow | /logout |
Disallow | /recover |
Disallow | /signup |
Disallow | |
Disallow | /faq |
Disallow | /comment-policy |
Disallow | /privacy-policy |
Disallow | /plugin/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://www.neatorama.com/sitemaps/index.xml |