readmanga.io
robots.txt

Robots Exclusion Standard data for readmanga.io

Resource Scan

Scan Details

Site Domain readmanga.io
Base Domain readmanga.io
Scan Status Ok
Last Scan2024-04-29T08:32:34+00:00
Next Scan 2024-05-06T08:32:34+00:00

Last Scan

Scanned2024-04-29T08:32:34+00:00
URL https://readmanga.io/robots.txt
Redirect https://readmanga.live/robots.txt
Redirect Domain readmanga.live
Redirect Base readmanga.live
Domain IPs 104.21.9.77, 172.67.159.78, 2606:4700:3032::6815:94d, 2606:4700:3032::ac43:9f4e
Redirect IPs 104.21.45.200, 172.67.218.185, 2606:4700:3032::ac43:dab9, 2606:4700:3034::6815:2dc8
Response IP 104.21.45.200
Found Yes
Hash 36d9a4a929b49fce1f9c20f72a530078f40ae9fae921b9cffb1732ae9ddc7337
SimHash 680dde66c333

Groups

mediapartners-google

Rule Path
Disallow

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /internal/*

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://readmanga.live/sitemap_index.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
  • `request-rate` is not a known field.