Log In Sign Up

waffarx.com
robots.txt

Robots Exclusion Standard data for waffarx.com

Resource Scan

Scan Details

Site Domain waffarx.com
Base Domain waffarx.com
Scan Status Ok
Last Scan2025-10-06T07:06:47+00:00
Next Scan 2025-10-20T07:06:47+00:00

Last Scan

Scanned2025-10-06T07:06:47+00:00
URL https://waffarx.com/robots.txt
Redirect https://www.waffarx.com/robots.txt
Redirect Domain www.waffarx.com
Redirect Base waffarx.com
Domain IPs 104.20.33.225, 172.66.163.118, 2606:4700:10::6814:21e1, 2606:4700:10::ac42:a376
Redirect IPs 104.20.33.225, 172.66.163.118, 2606:4700:10::6814:21e1, 2606:4700:10::ac42:a376
Response IP 104.20.33.225
Found Yes
Hash 848dc0ab159985276e634525e599e8e597d57b1753a49b40db1e8f7f3796bc5c
SimHash 6414d6f5e2ff

Groups

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Disallow /eclick
Disallow /settings
Disallow /landing
Disallow /cashback
Disallow /cashout
Disallow /help
Disallow /blog
Disallow /product

bingbot

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top

Comments

  • 1) Google’s main crawler
  • 2) Google’s mobile crawler
  • 3) Google AdSense crawler
  • 4) Google’s image crawler with custom path restrictions
  • 5) Bing’s crawler
  • 6) Everything else: blocked
Back to top