fox21online.com
robots.txt

Robots Exclusion Standard data for fox21online.com

Resource Scan

Scan Details

Site Domain fox21online.com
Base Domain fox21online.com
Scan Status Ok
Last Scan2026-03-04T18:22:21+00:00
Next Scan 2026-03-11T18:22:21+00:00

Last Scan

Scanned2026-03-04T18:22:21+00:00
URL https://fox21online.com/robots.txt
Redirect https://www.fox21online.com/robots.txt
Redirect Domain www.fox21online.com
Redirect Base fox21online.com
Domain IPs 192.104.182.130
Redirect IPs 192.104.182.130
Response IP 192.104.182.130
Found Yes
Hash 79e8a04fa5d16d8e911f6178614fe7412c0295aa1b0da7858a0f96e25bb4982f
SimHash 5a6cc840b873

Groups

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.fox21online.com/wp-sitemap.xml
sitemap https://www.fox21online.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK

Warnings

  • 2 invalid lines.