wogha.com
robots.txt

Robots Exclusion Standard data for wogha.com

Resource Scan

Scan Details

Site Domain wogha.com
Base Domain wogha.com
Scan Status Ok
Last Scan2026-02-09T05:16:15+00:00
Next Scan 2026-03-11T05:16:15+00:00

Last Scan

Scanned2026-02-09T05:16:15+00:00
URL https://wogha.com/robots.txt
Redirect https://www.wogha.com/robots.txt
Redirect Domain www.wogha.com
Redirect Base wogha.com
Domain IPs 104.21.2.17, 172.67.128.148, 2606:4700:3037::6815:211, 2606:4700:3037::ac43:8094
Redirect IPs 104.21.2.17, 172.67.128.148, 2606:4700:3037::6815:211, 2606:4700:3037::ac43:8094
Response IP 172.67.128.148
Found Yes
Hash 5a5f42e90dc2f7b225deb3703251a6e577455dadfa66e4f0b29b52b01a9e44bb
SimHash e0148bb4eea2

Groups

*

Rule Path
Allow /company/
Allow /sam$
Disallow /search
Disallow /api/
Disallow /_next/
Disallow /_vercel
Disallow /.next/
Disallow /node_modules/
Disallow /*.json$
Disallow /*.map$
Disallow /*?_rsc=
Disallow /*?_next=
Disallow /sam?q=
Disallow /sam?query=

Other Records

Field Value
crawl-delay 1

googlebot
bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

slurp
duckduckbot
yandexbot
baiduspider
sogou
exabot
qwantify
seznambot
mail.ru_bot
ahrefsbot
semrushbot
dotbot
mj12bot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

twitterbot
facebookexternalhit
linkedinbot
whatsapp

Rule Path
Allow /company/
Disallow /search

amazonbot
anthropic-ai
applebot-extended
awariorssbot
awariosmartbot
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
dataforseobot
gptbot
imagesiftbot
magpie-crawler
omgili
omgilibot
peer39_crawler
peer39_crawler/1.0
perplexitybot
youbot

Rule Path
Disallow /

Comments

  • #### ##### ######## ############# ### ####### ########
  • ##### #### ############# ############## ##############
  • ###### #### #### ##### ##### ##### ##### #### #####
  • ####### #### #### #### ##### ### #### #### #####
  • #### ### #### #### #### #### ### ### #### ####
  • ######### #### #### #### #### ### #### ####
  • ####### ####### ##### ###### ############## ### #### ######
  • ###### ##### ############ ########### ### ####
  • #### #### ###### ###### ### ### #####
  • Business Search Engine | v2 | 2025
  • Guide for crawlers:
  • Bot legittimi che vogliamo
  • Bot di ricerca secondari - limite leggero
  • Social media bot (per preview link)
  • Blocco totale bot AI