manhwacrush.me
robots.txt

Robots Exclusion Standard data for manhwacrush.me

Resource Scan

Scan Details

Site Domain manhwacrush.me
Base Domain manhwacrush.me
Scan Status Ok
Last Scan2025-10-10T02:36:35+00:00
Next Scan 2025-11-09T02:36:35+00:00

Last Scan

Scanned2025-10-10T02:36:35+00:00
URL https://manhwacrush.me/robots.txt
Domain IPs 104.21.80.116, 172.67.180.130, 2606:4700:3034::6815:5074, 2606:4700:3035::ac43:b482
Response IP 104.21.80.116
Found Yes
Hash f8e3e2ae72b0909da7a820fc89c6f90b8622380736a5b93c3e7cf66d7ddc36c9
SimHash 186d48408152

Groups

*

Rule Path
Disallow /wp-json/
Disallow /?rest_route=

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://manhwacrush.me/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK