Log In Sign Up

ng.certifyos.com
robots.txt

Robots Exclusion Standard data for ng.certifyos.com

Resource Scan

Scan Details

Site Domain ng.certifyos.com
Base Domain certifyos.com
Scan Status Ok
Last Scan2025-07-31T23:52:08+00:00
Next Scan 2025-08-30T23:52:08+00:00

Last Scan

Scanned2025-07-31T23:52:08+00:00
URL https://ng.certifyos.com/robots.txt
Domain IPs 35.190.25.146
Response IP 35.190.25.146
Found Yes
Hash 8ccc6aef251aa7ad6e64f10fb2b0b180b66836553bb721adb7f6cfd94e679968
SimHash 44515800a392

Groups

googlebot

Rule Path
Disallow /

googlebot
adsbot-google

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top

Comments

  • Example 2: Block Googlebot and Adsbot
  • Example 3: Block all crawlers except AdsBot (AdsBot crawlers must be named explicitly)
Back to top