go4whatsup.com
robots.txt

Robots Exclusion Standard data for go4whatsup.com

Resource Scan

Scan Details

Site Domain go4whatsup.com
Base Domain go4whatsup.com
Scan Status Ok
Last Scan2026-02-21T02:44:12+00:00
Next Scan 2026-03-23T02:44:12+00:00

Last Scan

Scanned2026-02-21T02:44:12+00:00
URL https://go4whatsup.com/robots.txt
Domain IPs 104.26.0.212, 104.26.1.212, 172.67.69.144, 2606:4700:20::681a:1d4, 2606:4700:20::681a:d4, 2606:4700:20::ac43:4590
Response IP 172.67.69.144
Found Yes
Hash afc6ca5e290ce49c34de62af461dca463324a7409c687c73c22234a654bf2491
SimHash 417cc800a592

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /tool/
Disallow /private/

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

claudebot

Rule Path
Allow /

claude-user

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

perplexity-user

Rule Path
Allow /

ccbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

amazonbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

applebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.go4whatsup.com/sitemap_index.xml

Comments

  • Purpose: SEO-friendly + AI crawler friendly
  • Block internal or non-SEO utility paths
  • Allow all major search engines
  • Allow AI & LLM crawlers explicitly