en.paperblog.com
robots.txt
Robots Exclusion Standard data for en.paperblog.com
Resource Scan
Scan Details
Site Domain | en.paperblog.com |
Base Domain | paperblog.com |
Scan Status | Ok |
Last Scan | 2024-11-14T12:19:32+00:00 |
Next Scan | 2024-12-14T12:19:32+00:00 |
Last Scan
Scanned | 2024-11-14T12:19:32+00:00 |
URL | https://en.paperblog.com/robots.txt |
Domain IPs | 104.21.19.19, 172.67.184.119, 2606:4700:3032::ac43:b877, 2606:4700:3036::6815:1313 |
Response IP | 104.21.19.19 |
Found | Yes |
Hash | bb46847620c35cc6ae9490ab9c01187b4ce97efb88b6e31ce9560ddca15b7784 |
SimHash | 2119c54454c1 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /accounts/activate/ |
Disallow | /accounts/logout/ |
Disallow | /accounts/unregister/ |
Disallow | /articles/ |
Disallow | /users/order/ |
Disallow | /users/authors/ |
Disallow | /users/search/ |
Disallow | /users/password_reset/ |
Disallow | /users/actions/ |
Disallow | /espaces/ |
Disallow | /flux/ |
Disallow | /alaune/ |
Disallow | /votes/ |
Disallow | /forum/new-fb-comment/ |
Disallow | /forum/create/ |
Disallow | /1035235/ |
Disallow | /r/* |
Disallow | /i/ |
Disallow | /plugins/feedback.php |
Other Records
Field | Value |
---|---|
sitemap | http://en.paperblog.com/sitemap.xml |