foe-extender.com
robots.txt
Robots Exclusion Standard data for foe-extender.com
Resource Scan
Scan Details
Site Domain | foe-extender.com |
Base Domain | foe-extender.com |
Scan Status | Ok |
Last Scan | 5/10/2025, 7:22:54 AM |
Next Scan | 6/9/2025, 7:22:54 AM |
Last Scan
Scanned | 5/10/2025, 7:22:54 AM |
URL | https://foe-extender.com/robots.txt |
Domain IPs | 104.21.66.187, 172.67.163.117, 2606:4700:3032::6815:42bb, 2606:4700:3036::ac43:a375 |
Response IP | 104.21.66.187 |
Found | Yes |
Hash | d33282495e56033ef4335104ea05b7579e48883c69ab77d6938da8693662bfd3 |
SimHash | 6f288863e7b3 |
Groups
*
Rule | Path |
---|---|
Allow | /*.jpg |
Allow | /*.png |
Allow | /*.gif |
Allow | /*.css |
Allow | /*.js |
Allow | /*.xml |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://qload.info/sitemap.xml |
Warnings
- 3 invalid lines.
- `host` is not a known field.