fylehq.com
robots.txt

Robots Exclusion Standard data for fylehq.com

Resource Scan

Scan Details

Site Domain fylehq.com
Base Domain fylehq.com
Scan Status Ok
Last Scan2024-10-19T17:41:28+00:00
Next Scan 2024-11-18T17:41:28+00:00

Last Scan

Scanned2024-10-19T17:41:28+00:00
URL https://fylehq.com/robots.txt
Redirect https://www.fylehq.com/robots.txt
Redirect Domain www.fylehq.com
Redirect Base fylehq.com
Domain IPs 104.21.63.99, 172.67.145.34, 2606:4700:3034::6815:3f63, 2606:4700:3036::ac43:9122
Redirect IPs 18.139.194.139, 2406:da18:880:3800::c8, 2406:da18:b3d:e202::64, 46.137.195.11
Response IP 46.137.195.11
Found Yes
Hash 70ebb0eb3f16b1a2c95922c4f0dbaab403de539cb5f10cf6471e8580986831ef
SimHash 6c640837e7f7

Groups

*

Rule Path
Allow /
Allow /blog/
Disallow /cdn-cgi/l/email-protection$

Other Records

Field Value
sitemap https://www.fylehq.com/sitemap.xml

Comments

  • Allow all content to be crawled
  • Allow crawling of your Webflow blog