statedmag.com
robots.txt
Robots Exclusion Standard data for statedmag.com
Resource Scan
Scan Details
| Site Domain | statedmag.com |
| Base Domain | statedmag.com |
| Scan Status | Ok |
| Last Scan | 2024-08-29T18:52:09+00:00 |
| Next Scan | 2024-09-28T18:52:09+00:00 |
Last Scan
| Scanned | 2024-08-29T18:52:09+00:00 |
| URL | http://statedmag.com/robots.txt |
| Redirect | http://www.statedmag.com/robots.txt |
| Redirect Domain | www.statedmag.com |
| Redirect Base | statedmag.com |
| Domain IPs | 72.167.100.192 |
| Redirect IPs | 198.185.159.176, 198.185.159.177, 198.49.23.176, 198.49.23.177 |
| Response IP | 198.49.23.176 |
| Found | Yes |
| Hash | 03789d8a66b50efedd3c4bc28e91a73f43705e9e29eb9f5b9624ecaa6beb4196 |
| SimHash | 3c5c5170aed7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /display/admin/ |
| Disallow | /display/Search |
| Disallow | /display/Login |
| Disallow | /display/RecoverPassword |
| Disallow | /login |
| Disallow | /contributor |
| Disallow | /login |
| Disallow | /articles/category |
| Disallow | /articles/week |
| Disallow | /articles/month |
| Disallow | /articles/recommend |
| Disallow | /articles/author |
| Disallow | /blog/category |
| Disallow | /blog/week |
| Disallow | /blog/month |
| Disallow | /blog/recommend |
| Disallow | /blog/author |
| Disallow | /sb-wwwirapj |
| Disallow | /contact |
| Disallow | /articles-test-layout/category |
| Disallow | /articles-test-layout/week |
| Disallow | /articles-test-layout/month |
| Disallow | /articles-test-layout/recommend |
| Disallow | /articles-test-layout/author |
| Disallow | /sb-wjoowjht |
Comments