theburghbaby.com
robots.txt
Robots Exclusion Standard data for theburghbaby.com
Resource Scan
Scan Details
Site Domain | theburghbaby.com |
Base Domain | theburghbaby.com |
Scan Status | Ok |
Last Scan | 2024-10-04T23:25:06+00:00 |
Next Scan | 2024-10-11T23:25:06+00:00 |
Last Scan
Scanned | 2024-10-04T23:25:06+00:00 |
URL | http://theburghbaby.com/robots.txt |
Redirect | http://www.theburghbaby.com/robots.txt |
Redirect Domain | www.theburghbaby.com |
Redirect Base | theburghbaby.com |
Domain IPs | 65.39.205.54 |
Redirect IPs | 198.185.159.160, 198.185.159.161, 198.49.23.160, 198.49.23.161 |
Response IP | 198.185.159.161 |
Found | Yes |
Hash | d1973ffd85dfa367a0c25b1eccf80c81069cc33004475204a707b8f86bc2355d |
SimHash | 2c08b4342f7a |
Groups
*
Rule | Path |
---|---|
Disallow | /display/admin/ |
Disallow | /display/Search |
Disallow | /display/Login |
Disallow | /display/RecoverPassword |
Disallow | /login |
Disallow | /contributor |
Disallow | /reviews/category |
Disallow | /reviews/week |
Disallow | /reviews/month |
Disallow | /reviews/recommend |
Disallow | /reviews/author |
Disallow | /burghbaby/category |
Disallow | /burghbaby/week |
Disallow | /burghbaby/month |
Disallow | /burghbaby/recommend |
Disallow | /burghbaby/author |
Disallow | /sb-pbxrykoh |
Disallow | /contact |
Disallow | /blogroll/category |
Disallow | /blogroll/week |
Disallow | /blogroll/month |
Disallow | /blogroll/recommend |
Disallow | /blogroll/author |
Disallow | /photography-blog/category |
Disallow | /photography-blog/week |
Disallow | /photography-blog/month |
Disallow | /photography-blog/recommend |
Disallow | /photography-blog/author |
Comments