foe-extender.com
robots.txt

Robots Exclusion Standard data for foe-extender.com

Resource Scan

Scan Details

Site Domain foe-extender.com
Base Domain foe-extender.com
Scan Status Ok
Last Scan5/10/2025, 7:22:54 AM
Next Scan 6/9/2025, 7:22:54 AM

Last Scan

Scanned5/10/2025, 7:22:54 AM
URL https://foe-extender.com/robots.txt
Domain IPs 104.21.66.187, 172.67.163.117, 2606:4700:3032::6815:42bb, 2606:4700:3036::ac43:a375
Response IP 104.21.66.187
Found Yes
Hash d33282495e56033ef4335104ea05b7579e48883c69ab77d6938da8693662bfd3
SimHash 6f288863e7b3

Groups

*

Rule Path
Allow /*.jpg
Allow /*.png
Allow /*.gif
Allow /*.css
Allow /*.js
Allow /*.xml

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://qload.info/sitemap.xml

Warnings

  • 3 invalid lines.
  • `host` is not a known field.