shippuden.tv
robots.txt

Robots Exclusion Standard data for shippuden.tv

Resource Scan

Scan Details

Site Domain shippuden.tv
Base Domain shippuden.tv
Scan Status Ok
Last Scan2024-09-19T09:14:39+00:00
Next Scan 2024-09-26T09:14:39+00:00

Last Scan

Scanned2024-09-19T09:14:39+00:00
URL https://shippuden.tv/robots.txt
Domain IPs 104.21.63.102, 172.67.170.140, 2606:4700:3033::ac43:aa8c, 2606:4700:3037::6815:3f66
Response IP 172.67.170.140
Found Yes
Hash 0a9019ed5201029f1716480df0a78ad64ec23e323d351af2965a9c27ba84d1d2
SimHash e10459806afa

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-/
Disallow /feed/
Disallow /trackback/
Disallow /uploads/

googlebot

Rule Path
Disallow /tag/
Disallow /page/*
Disallow /categoria/
Disallow /category/
Disallow /pages/
Disallow /rss.xml
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-login.php
Disallow /search/
Disallow /?s=%2F
Disallow /*.inc$
Disallow /*.cgi$
Disallow /*.wmv$
Disallow /*.xhtml$
Disallow /*?*
Disallow /*?%2F
Disallow /wp-*
Disallow /contacto/
Disallow /politica-de-privacidad/

googlebot-image

Rule Path
Allow /*
Disallow /

mediapartners-google*

Rule Path
Allow /*
Disallow /

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

Other Records

Field Value
sitemap https://shippuden.tv/sitemap.xml