freeagent.com
robots.txt
Robots Exclusion Standard data for freeagent.com
Resource Scan
Scan Details
Site Domain | freeagent.com |
Base Domain | freeagent.com |
Scan Status | Ok |
Last Scan | 2024-05-21T09:49:29+00:00 |
Next Scan | 2024-06-04T09:49:29+00:00 |
Last Scan
Scanned | 2024-05-21T09:49:29+00:00 |
URL | https://freeagent.com/robots.txt |
Redirect | https://www.freeagent.com/robots.txt |
Redirect Domain | www.freeagent.com |
Redirect Base | freeagent.com |
Domain IPs | 147.75.40.150 |
Redirect IPs | 13.215.246.123, 175.41.180.202, 2406:da18:b3d:e201::1f4, 2406:da18:b3d:e202::1f4 |
Response IP | 175.41.180.202 |
Found | Yes |
Hash | 056d0fde7d1e729c0316c30ee9b6dcf8edd156005f416b041a5923185190cf57 |
SimHash | 7b543a40dfd1 |
Groups
*
Rule | Path |
---|---|
Disallow | /scripts/ |
Disallow | /images/ |
Disallow | /downloads/ |
Disallow | /freestyle/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.freeagent.com/sitemap.xml |
sitemap | http://app.wistia.com/sitemaps/10525.xml |
Comments