cdn.thecollegeinvestor.com
robots.txt

Robots Exclusion Standard data for cdn.thecollegeinvestor.com

Resource Scan

Scan Details

Site Domain cdn.thecollegeinvestor.com
Base Domain thecollegeinvestor.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-17T07:59:13+00:00
Next Scan 2024-07-16T07:59:13+00:00

Last Successful Scan

Scanned2023-05-31T07:29:42+00:00
URL https://cdn.thecollegeinvestor.com/robots.txt
Redirect https://thecollegeinvestor.com/robots.txt
Redirect Domain thecollegeinvestor.com
Redirect Base thecollegeinvestor.com
Domain IPs 52.84.251.117, 52.84.251.71, 52.84.251.77, 52.84.251.88
Redirect IPs 18.235.185.117
Response IP 18.235.185.117
Found Yes
Hash f362d489ccbb080e2979b030fb326ebe295a74a1794bbe8823a0f888e0507281
SimHash 7c515907e991

Groups

*

Rule Path
Disallow /tags/
Disallow /feed/
Disallow /go/