vods.tv
robots.txt

Robots Exclusion Standard data for vods.tv

Resource Scan

Scan Details

Site Domain vods.tv
Base Domain vods.tv
Scan Status Ok
Last Scan2024-09-21T04:28:41+00:00
Next Scan 2024-09-28T04:28:41+00:00

Last Scan

Scanned2024-09-21T04:28:41+00:00
URL https://vods.tv/robots.txt
Redirect https://www.vods.tv/robots.txt
Redirect Domain www.vods.tv
Redirect Base vods.tv
Domain IPs 104.21.49.185, 172.67.165.226, 2606:4700:3033::6815:31b9, 2606:4700:3036::ac43:a5e2
Redirect IPs 104.21.49.185, 172.67.165.226, 2606:4700:3033::6815:31b9, 2606:4700:3036::ac43:a5e2
Response IP 104.21.49.185
Found Yes
Hash d31def6018f194ff6522c83921d6e30b319ed8e5874c2535e68e0f34f975ef43
SimHash 43449c5356b1

Groups

*

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://vods.tv/sitemap.xml
sitemap https://vods.tv/sitemap2.xml

Comments

  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.