Log In Sign Up

zbekz.com
robots.txt

Robots Exclusion Standard data for zbekz.com

Resource Scan

Scan Details

Site Domain zbekz.com
Base Domain zbekz.com
Scan Status Ok
Last Scan2025-10-16T15:06:09+00:00
Next Scan 2025-10-23T15:06:09+00:00

Last Scan

Scanned2025-10-16T15:06:09+00:00
URL https://zbekz.com/robots.txt
Domain IPs 104.21.4.94, 172.67.131.230, 2606:4700:3034::ac43:83e6, 2606:4700:3037::6815:45e
Response IP 104.21.4.94
Found Yes
Hash 8895f7c0d06927eddb6ccb9f148c865dbed4e8d032a67ff17060e2b180e712f5
SimHash 09040b11cdf4

Groups

admob

Rule Path
Allow /app-ads.txt

admob

Rule Path
Disallow

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

*

Rule Path
Disallow /
Back to top

Comments

  • Allow AdMob crawler to access app-ads.txt
  • You can also explicitly allow AdMob to crawl all other areas of your site if desired
  • Example rules for other crawlers
  • Block all other crawlers from accessing the rest of your site
Back to top