Log In Sign Up

fwtv.tv
robots.txt

Robots Exclusion Standard data for fwtv.tv

Resource Scan

Scan Details

Site Domain fwtv.tv
Base Domain fwtv.tv
Scan Status Ok
Last Scan2024-11-03T22:38:16+00:00
Next Scan 2024-11-10T22:38:16+00:00

Last Scan

Scanned2024-11-03T22:38:16+00:00
URL https://fwtv.tv/robots.txt
Domain IPs 13.248.132.87, 35.71.145.101, 75.2.97.79, 99.83.151.71
Response IP 99.83.151.71
Found Yes
Hash c1ada167b845134f7ef0e1fde70ac79ff797ca1bed270466fa61a678a08edc93
SimHash 010486c58f11

Groups

*

Rule Path
Allow /

test-bot

Rule Path
Allow /path
Allow /path-2

black-listed-bot

Rule Path
Disallow /sub-path-1
Disallow /path-2
Back to top

Other Records

Field Value
sitemap https://fwtv.tv/sitemap.xml
sitemap https://fwtv.tv/api/sitemap.xml
Back to top

Comments

  • *
  • test-bot
  • black-listed-bot
  • Host
  • Sitemaps
Back to top

Warnings

  • `host` is not a known field.
Back to top