forumula1.com
robots.txt

Robots Exclusion Standard data for forumula1.com

Resource Scan

Scan Details

Site Domain forumula1.com
Base Domain forumula1.com
Scan Status Ok
Last Scan2025-12-19T02:28:11+00:00
Next Scan 2025-12-26T02:28:11+00:00

Last Scan

Scanned2025-12-19T02:28:11+00:00
URL https://forumula1.com/robots.txt
Redirect https://www.forumula1.com/robots.txt
Redirect Domain www.forumula1.com
Redirect Base forumula1.com
Domain IPs 104.21.38.13, 172.67.216.205, 2606:4700:3031::ac43:d8cd, 2606:4700:3035::6815:260d
Redirect IPs 104.21.38.13, 172.67.216.205, 2606:4700:3031::ac43:d8cd, 2606:4700:3035::6815:260d
Response IP 104.21.38.13
Found Yes
Hash 9338ca8395a33647f065e4498a55cdbd7ee1c2ad6f152df6de1ff21aa7d46d8b
SimHash 62144c40259b

Groups

*

Rule Path
Disallow /test/
Disallow /w/

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap http://www.forumula1.com/sitemap.xml.gz

Comments

  • BEGIN XML-SITEMAP-PLUGIN
  • END XML-SITEMAP-PLUGIN