cgtopcolleges.com
robots.txt

Robots Exclusion Standard data for cgtopcolleges.com

Resource Scan

Scan Details

Site Domain cgtopcolleges.com
Base Domain cgtopcolleges.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-10-16T11:44:21+00:00
Next Scan 2024-11-15T11:44:21+00:00

Last Successful Scan

Scanned2024-09-09T11:37:06+00:00
URL https://cgtopcolleges.com/robots.txt
Redirect https://www.cgtopcolleges.com/robots.txt
Redirect Domain www.cgtopcolleges.com
Redirect Base cgtopcolleges.com
Domain IPs 104.21.42.36, 172.67.155.196, 2606:4700:3033::6815:2a24, 2606:4700:3035::ac43:9bc4
Redirect IPs 104.21.42.36, 172.67.155.196, 2606:4700:3033::6815:2a24, 2606:4700:3035::ac43:9bc4
Response IP 104.21.42.36
Found Yes
Hash 1918460e6ed05a4c0edf1a7745928b573cde904a1d1f2a15d0ea0693b7fe1d16
SimHash 4100c8004bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php