spotfund.com
robots.txt
Robots Exclusion Standard data for spotfund.com
Resource Scan
Scan Details
Site Domain | spotfund.com |
Base Domain | spotfund.com |
Scan Status | Ok |
Last Scan | 2024-05-21T17:47:06+00:00 |
Next Scan | 2024-06-20T17:47:06+00:00 |
Last Scan
Scanned | 2024-05-21T17:47:06+00:00 |
URL | https://spotfund.com/robots.txt |
Redirect | https://www.spotfund.com/robots.txt |
Redirect Domain | www.spotfund.com |
Redirect Base | spotfund.com |
Domain IPs | 2607:f1c0:100f:f000::200, 74.208.236.194 |
Redirect IPs | 18.205.222.128, 52.202.168.65, 54.161.241.46, 54.237.133.81 |
Response IP | 54.237.133.81 |
Found | Yes |
Hash | ac2c42714025a2412c4721d13ce99bea5e371212be7a4f8d420afb51d340e84c |
SimHash | 0910de7020f3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /flash-fund-rules |
Disallow | /terms-and-conditions |
Disallow | /privacy |
Disallow | /recurring-donations |
Disallow | /rules |
Disallow | /terms |
Disallow | /privacy |
Other Records
Field | Value |
---|---|
sitemap | https://www.spotfund.com/sitemap.xml |