gresik.info
robots.txt

Robots Exclusion Standard data for gresik.info

Resource Scan

Scan Details

Site Domain gresik.info
Base Domain gresik.info
Scan Status Ok
Last Scan2025-09-08T09:46:51+00:00
Next Scan 2025-09-15T09:46:51+00:00

Last Scan

Scanned2025-09-08T09:46:51+00:00
URL https://gresik.info/robots.txt
Redirect https://www.gresik.info/robots.txt
Redirect Domain www.gresik.info
Redirect Base gresik.info
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.48.1
Found Yes
Hash b0f410e510a4dbfc6a96e2f84c259801c5b17e79676fa6ca43315eb23707a10a
SimHash 580643428334

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

yandex

Rule Path
Disallow /

majestic-12

Rule Path
Disallow /

radian6

Rule Path
Disallow /

Comments

  • Internet Archiver Wayback Machine
  • digg mirror
  • Deny Soso spider in the site
  • Deny Sogou in the site
  • Deny Yandex in the site
  • Deny Majestic-12 in the site
  • Deny Radian6 in the site