myjobgator.com
robots.txt

Robots Exclusion Standard data for myjobgator.com

Resource Scan

Scan Details

Site Domain myjobgator.com
Base Domain myjobgator.com
Scan Status Ok
Last Scan2024-09-26T17:09:40+00:00
Next Scan 2024-10-03T17:09:40+00:00

Last Scan

Scanned2024-09-26T17:09:40+00:00
URL https://myjobgator.com/robots.txt
Redirect https://www.myjobgator.com/robots.txt
Redirect Domain www.myjobgator.com
Redirect Base myjobgator.com
Domain IPs 104.21.96.69, 172.67.174.1, 2606:4700:3032::ac43:ae01, 2606:4700:3035::6815:6045
Redirect IPs 104.21.96.69, 172.67.174.1, 2606:4700:3032::ac43:ae01, 2606:4700:3035::6815:6045
Response IP 172.67.174.1
Found Yes
Hash 13baa54e611c715229800f1603d5eb9367a87eca74f0ef5f311c1a881b0095d0
SimHash 811cc8686f33

Groups

*

Rule Path
Allow /

ahrefsbot
baiduspider
easouspider
ezooms
yandexbot
mj12bot
sitesucker
httrack

Rule Path
Disallow /
Disallow /app/
Disallow /administrator/