manhwa-raw.com
robots.txt

Robots Exclusion Standard data for manhwa-raw.com

Resource Scan

Scan Details

Site Domain manhwa-raw.com
Base Domain manhwa-raw.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-24T01:55:10+00:00
Next Scan 2024-12-23T01:55:10+00:00

Last Successful Scan

Scanned2023-05-07T09:44:36+00:00
URL https://manhwa-raw.com/robots.txt
Domain IPs 104.26.10.8, 104.26.11.8, 172.67.73.104, 2606:4700:20::681a:a08, 2606:4700:20::681a:b08, 2606:4700:20::ac43:4968
Response IP 172.67.73.104
Found Yes
Hash 7a7dc8acea7737bfd28e8005df0ed45c38fea81a3742d195d81d8626ad82b1c2
SimHash a51a7b9aeaf7

Groups

*

Rule Path
Disallow
Allow /wp-admin/admin-ajax.php
Disallow /zeny23893/
Disallow /wp-admin/
Disallow /trackback/
Disallow /?s=
Disallow /search
Disallow /archives/
Disallow /index.php
Disallow /*?
Disallow /*.php$
Disallow /*.inc$
Disallow */trackback/
Disallow /page/
Disallow /tag/
Disallow /category/
Disallow /user-settings/
Disallow /user/
Disallow /anadir-capitulos-a-tu-manhwa-beta/
Disallow /account/
Disallow /iniciar-sesion/
Disallow /registro/
Disallow /logout/
Disallow /social-user/
Disallow /*.git$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.gz$
Disallow /*.tar$
Disallow /*.svn$
Disallow /*.bz2$
Disallow /*.log$

*

Rule Path
Disallow /*add-to-cart%3D*
Disallow /cart/
Disallow /checkout/
Disallow /my-account/

orthogaffe

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

Other Records

Field Value
sitemap https://manhwa-raw.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
  • No rastrear copias de seguridad
  • No rastrear enlaces de WooCommerce
  • https://closte.com/blog/prevent-robots-crawling-add-to-cart-links-on-woocommerce
  • Reglas para bots conocidos