thinkadvisor.com
robots.txt

Robots Exclusion Standard data for thinkadvisor.com

Resource Scan

Scan Details

Site Domain thinkadvisor.com
Base Domain thinkadvisor.com
Scan Status Ok
Last Scan2024-11-11T08:53:20+00:00
Next Scan 2024-11-18T08:53:20+00:00

Last Scan

Scanned2024-11-11T08:53:20+00:00
URL https://thinkadvisor.com/robots.txt
Redirect https://www.thinkadvisor.com/robots.txt
Redirect Domain www.thinkadvisor.com
Redirect Base thinkadvisor.com
Domain IPs 104.18.18.56, 104.18.19.56, 2606:4700::6812:1238, 2606:4700::6812:1338
Redirect IPs 104.18.18.56, 104.18.19.56, 2606:4700::6812:1238, 2606:4700::6812:1338
Response IP 104.18.19.56
Found Yes
Hash 5df4e146819a974fe8904b2d86c1060ba6b0f84c7c7c05a17877b7311103d99e
SimHash 611cdc53e793

Groups

*

Rule Path
Disallow /search/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.thinkadvisor.com/sitemap.xml