bagusprehan.com
robots.txt
Robots Exclusion Standard data for bagusprehan.com
Resource Scan
Scan Details
Site Domain | bagusprehan.com |
Base Domain | bagusprehan.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-09-20T00:23:47+00:00 |
Next Scan | 2024-11-19T00:23:47+00:00 |
Last Successful Scan
Scanned | 2024-06-29T21:04:19+00:00 |
URL | https://bagusprehan.com/robots.txt |
Redirect | https://www.bagusprehan.com/robots.txt |
Redirect Domain | www.bagusprehan.com |
Redirect Base | bagusprehan.com |
Domain IPs | 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21 |
Redirect IPs | 172.217.194.121, 2404:6800:4003:c01::79 |
Response IP | 172.217.194.121 |
Found | Yes |
Hash | 4ffe9fabdbf54ecea52f6ec5cf07bee912473b5e6d888bd82b0b875998434457 |
SimHash | e57959e09dd2 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /*?m=0 |
Disallow | /*?showComment |
Disallow | /search |
Disallow | /*archive.html |
Disallow | /s72-c/ |
Disallow | /s |
Disallow | /cse |
Disallow | /2a/2b/1?15=2c-D-f&q= |
Disallow | /delete-comment.g?blogID= |
Disallow | /2I-c/ |
Disallow | /rt%3Dj/sv%3D1/d%3D1/ed%3D1 |
Disallow | /2013/12/101747732696776844820 |
Disallow | /m%3D |
Disallow | /k%3D |
Disallow | /exm%3D |
Disallow | /2014/04/101747732696776844820 |
Disallow | /2014/10/112894389880911258559 |
Disallow | /complete/search |
Disallow | /cb%3D |
Disallow | /2014/02/101747732696776844820 |
Disallow | /go/privacy |
Disallow | /rs%3D |
Disallow | /am |
Disallow | /ripples/details |
Disallow | /*?google_comment_id= |
*
Rule | Path |
---|---|
Disallow | /?m=1 |
Disallow | /?m=0 |
Disallow | /search |
Disallow | /archive.html |
Disallow | /s72-c/ |
Disallow | /s |
Disallow | /cse |
Disallow | /2a/2b/1?15=2c-D-f&q= |
Disallow | /delete-comment.g?blogID= |
Disallow | /2I-c/ |
Disallow | /rt%3Dj/sv%3D1/d%3D1/ed%3D1 |
Disallow | /2013/12/101747732696776844820 |
Disallow | /m%3D |
Disallow | /k%3D |
Disallow | /exm%3D |
Disallow | /2014/04/101747732696776844820 |
Disallow | /2014/10/112894389880911258559 |
Disallow | /complete/search |
Disallow | /cb%3D |
Disallow | /2014/02/101747732696776844820 |
Disallow | /go/privacy |
Disallow | /rs%3D |
Disallow | /am |
Disallow | /ripples/details |
Disallow | /*?google_comment_id= |
Other Records
Field | Value |
---|---|
sitemap | http://www.bagusprehan.com/feeds/posts/default?orderby=UPDATED |
sitemap | http://www.bagusprehan.com/atom.xml?redirect=false&start-index=1&max-results=500 |