uptti.unej.ac.id
robots.txt

Robots Exclusion Standard data for uptti.unej.ac.id

Resource Scan

Scan Details

Site Domain uptti.unej.ac.id
Base Domain unej.ac.id
Scan Status Ok
Last Scan2024-04-30T21:45:45+00:00
Next Scan 2024-05-30T21:45:45+00:00

Last Scan

Scanned2024-04-30T21:45:45+00:00
URL https://uptti.unej.ac.id/robots.txt
Domain IPs 185.199.108.153, 185.199.109.153, 185.199.110.153, 185.199.111.153, 2606:50c0:8000::153, 2606:50c0:8001::153, 2606:50c0:8002::153, 2606:50c0:8003::153
Response IP 185.199.111.153
Found Yes
Hash 7d53d6ec910026835ce045f7c876a4f6374da98b2ef25167873ac3471bf29895
SimHash 6859c3817317

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/