doramatv.live
robots.txt

Robots Exclusion Standard data for doramatv.live

Resource Scan

Scan Details

Site Domain doramatv.live
Base Domain doramatv.live
Scan Status Ok
Last Scan2024-04-26T23:44:09+00:00
Next Scan 2024-05-03T23:44:09+00:00

Last Scan

Scanned2024-04-26T23:44:09+00:00
URL https://doramatv.live/robots.txt
Domain IPs 104.21.43.2, 172.67.215.9, 2606:4700:3034::ac43:d709, 2606:4700:3036::6815:2b02
Response IP 172.67.215.9
Found Yes
Hash 210b8a1a408b590081d5d26e35ffc2b70a9da109b59c03d132e6057f0fe70648
SimHash 29049a66c333

Groups

mediapartners-google

Rule Path
Disallow

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /internal/*

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://doramatv.live/sitemap_index.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
  • `request-rate` is not a known field.