Log In Sign Up

fwtv.tv
robots.txt

Robots Exclusion Standard data for fwtv.tv

Resource Scan

Scan Details

Site Domain fwtv.tv
Base Domain fwtv.tv
Scan Status Ok
Last Scan2024-06-29T05:54:02+00:00
Next Scan 2024-07-06T05:54:02+00:00

Last Scan

Scanned2024-06-29T05:54:02+00:00
URL https://fwtv.tv/robots.txt
Domain IPs 18.205.36.100, 52.204.242.176, 54.157.58.70, 54.162.128.250
Response IP 18.205.36.100
Found Yes
Hash c1ada167b845134f7ef0e1fde70ac79ff797ca1bed270466fa61a678a08edc93
SimHash 010486c58f11

Groups

*

Rule Path
Allow /

test-bot

Rule Path
Allow /path
Allow /path-2

black-listed-bot

Rule Path
Disallow /sub-path-1
Disallow /path-2
Back to top

Other Records

Field Value
sitemap https://fwtv.tv/sitemap.xml
sitemap https://fwtv.tv/api/sitemap.xml
Back to top

Comments

  • *
  • test-bot
  • black-listed-bot
  • Host
  • Sitemaps
Back to top

Warnings

  • `host` is not a known field.
Back to top