plusfiction.com
robots.txt
Robots Exclusion Standard data for plusfiction.com
Resource Scan
Scan Details
Site Domain | plusfiction.com |
Base Domain | plusfiction.com |
Scan Status | Ok |
Last Scan | 2024-11-15T07:27:19+00:00 |
Next Scan | 2024-11-22T07:27:19+00:00 |
Last Scan
Scanned | 2024-11-15T07:27:19+00:00 |
URL | https://plusfiction.com/robots.txt |
Domain IPs | 104.26.6.102, 104.26.7.102, 172.67.72.164, 2606:4700:20::681a:666, 2606:4700:20::681a:766, 2606:4700:20::ac43:48a4 |
Response IP | 172.67.72.164 |
Found | Yes |
Hash | 6627181548dfd6a28601d214261b1fce228cdf3187267cfb21d0315d1d0e1ad7 |
SimHash | 51150c70cb53 |
Groups
*
Rule | Path |
---|---|
Disallow | /user/login* |
Disallow | /user/logout* |
Disallow | /ping |
Disallow | /csrf |
Disallow | /error |
Disallow | /offline |
Disallow | /ganbatte/* |
Disallow | /tags/categories.json |
Disallow | /tags/search.json |
Disallow | /tags/all.json |
Disallow | /push-subscription/* |
Allow | /articles |
Allow | /article/* |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://plusfiction.com/sitemap-index.xml |
Warnings
- `host` is not a known field.