doit.co.id
robots.txt

Robots Exclusion Standard data for doit.co.id

Resource Scan

Scan Details

Site Domain doit.co.id
Base Domain doit.co.id
Scan Status Ok
Last Scan2024-06-26T04:59:33+00:00
Next Scan 2024-07-03T04:59:33+00:00

Last Scan

Scanned2024-06-26T04:59:33+00:00
URL https://doit.co.id/robots.txt
Redirect https://www.doit.co.id/robots.txt
Redirect Domain www.doit.co.id
Redirect Base doit.co.id
Domain IPs 104.21.15.105, 172.67.162.44, 2606:4700:3031::6815:f69, 2606:4700:3035::ac43:a22c
Redirect IPs 104.21.15.105, 172.67.162.44, 2606:4700:3031::6815:f69, 2606:4700:3035::ac43:a22c
Response IP 104.21.15.105
Found Yes
Hash 50dc358a917f90b1991a6ef7353ec744da03849dcb2fe6839c5b66bfe1459b10
SimHash 2c7cd7735591

Groups

googlebot

Rule Path
Allow /
Allow /?display=wide

googlebot-mobile

Rule Path
Allow /
Allow /?display=wide

mediapartners-google

Rule Path
Allow /
Allow /?display=wide

googlebot-image

Rule Path
Allow /
Allow /?display=wide

*

Rule Path
Disallow /cgi-bin/
Disallow /adminm1n2/
Disallow /adminm1n2/login.php

Comments

  • disallow all files in these directories