biginternships.com
robots.txt

Robots Exclusion Standard data for biginternships.com

Resource Scan

Scan Details

Site Domain biginternships.com
Base Domain biginternships.com
Scan Status Ok
Last Scan2024-09-22T15:13:24+00:00
Next Scan 2024-09-29T15:13:24+00:00

Last Scan

Scanned2024-09-22T15:13:24+00:00
URL https://biginternships.com/robots.txt
Redirect https://www.biginternships.com/robots.txt
Redirect Domain www.biginternships.com
Redirect Base biginternships.com
Domain IPs 104.21.8.251, 172.67.188.219, 2606:4700:3030::6815:8fb, 2606:4700:3035::ac43:bcdb
Redirect IPs 104.21.8.251, 172.67.188.219, 2606:4700:3030::6815:8fb, 2606:4700:3035::ac43:bcdb
Response IP 172.67.188.219
Found Yes
Hash 920f836015ed8188923827047d0627bcd92b598a138d22fc75cc26f28193baaa
SimHash 682044484b10

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /xmlrpc.php