naruto-base.tv
robots.txt
Robots Exclusion Standard data for naruto-base.tv
Resource Scan
Scan Details
Site Domain | naruto-base.tv |
Base Domain | naruto-base.tv |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-03T22:16:38+00:00 |
Next Scan | 2024-12-02T22:16:38+00:00 |
Last Successful Scan
Scanned | 2023-11-09T21:14:36+00:00 |
URL | https://naruto-base.tv/robots.txt |
Domain IPs | 104.21.10.135, 172.67.131.124, 2606:4700:3031::6815:a87, 2606:4700:3037::ac43:837c |
Response IP | 104.21.10.135 |
Found | Yes |
Hash | befa95de082a43fba1494d30e6873d939da399b8cff5aba19fe48f707cb63ae7 |
SimHash | e84814056a91 |
Groups
*
Rule | Path |
---|---|
Disallow | /a/ |
Disallow | /stat/ |
Disallow | /index/1 |
Disallow | /index/2 |
Disallow | /index/3 |
Disallow | /index/5 |
Disallow | /index/7 |
Disallow | /index/8 |
Disallow | /index/9 |
Disallow | /panel/ |
Disallow | /admin/ |
Disallow | /secure/ |
Disallow | /informer/ |
Disallow | /mchat |
Disallow | /go?* |
Disallow | /highslide/graphics/ |
Disallow | /poll/ |
Disallow | /gb/ |
Disallow | /index/3 |
Disallow | /index/0-35 |
Disallow | /index/0-8 |
Disallow | /index/0-3 |
Disallow | /Online_Manga/ |
Disallow | /index/sub/ |
Disallow | /faq/ |
Disallow | /downloads/manga/14 |
Disallow | /downloads/manga/bleach/23 |
Disallow | /downloads/manga/naruto/15 |
Disallow | /downloads/ehmuljatory/9 |
Disallow | /pda_template/Chat.html |
Disallow | /publ* |
Disallow | /dir* |
Disallow | /?page* |
Disallow | /Sab* |
Disallow | /torrent/*.torrent |
Disallow | /kin4ik.com* |
Disallow | /_ph* |
Disallow | /vhvvx777* |
Disallow | /yasearch/ |
Disallow | /404.htm |
Disallow | /Adsense/ |
Disallow | /register |
Disallow | /Adsense/playbuy.html |
Other Records
Field | Value |
---|---|
sitemap | https://naruto-base.tv/sitemap.xml |
sitemap | https://naruto-base.tv/sitemap-forum.xml |
Warnings
- `host` is not a known field.