readmanga.me
robots.txt

Robots Exclusion Standard data for readmanga.me

Resource Scan

Scan Details

Site Domain readmanga.me
Base Domain readmanga.me
Scan Status Ok
Last Scan2024-11-12T10:59:13+00:00
Next Scan 2024-11-19T10:59:13+00:00

Last Scan

Scanned2024-11-12T10:59:13+00:00
URL https://readmanga.me/robots.txt
Redirect https://2.readmanga.ru/robots.txt
Redirect Domain 2.readmanga.ru
Redirect Base readmanga.ru
Domain IPs 136.243.110.97
Redirect IPs 82.118.242.218
Response IP 82.118.242.218
Found Yes
Hash 52490822d7e0d2871e1c951e67c4612bcfd4f983166c2d7c0965ccd598e84f49
SimHash 200d9c67c333

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /internal/*

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://2.readmanga.ru/sitemap_index.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
  • `request-rate` is not a known field.