word-grabber.com
robots.txt

Robots Exclusion Standard data for word-grabber.com

Resource Scan

Scan Details

Site Domain word-grabber.com
Base Domain word-grabber.com
Scan Status Ok
Last Scan2024-11-14T05:00:51+00:00
Next Scan 2024-11-21T05:00:51+00:00

Last Scan

Scanned2024-11-14T05:00:51+00:00
URL https://word-grabber.com/robots.txt
Redirect https://www.word-grabber.com/robots.txt
Redirect Domain www.word-grabber.com
Redirect Base word-grabber.com
Domain IPs 144.202.60.205, 2001:19f0:5c01:920:144:202:60:205
Redirect IPs 144.202.60.205, 2001:19f0:5c01:920:144:202:60:205
Response IP 144.202.60.205
Found Yes
Hash fabfa30fa7600db55af935fd7f6edf18a9c6f57c872d981cfee6e0250152b181
SimHash eb7dda63a78b

Groups

grapeshot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yandexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

hybridbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /kreuzwortraetsel-hilfe/
Disallow /scrabble-hilfe/?
Disallow /wort-guru-loesung/?
Disallow /wordfeud-helper/?
Disallow /anagramm-generator/?
Disallow /schuettelraetsel-loeser/?
Disallow /generador-anagramas/?
Disallow /resolver-ensalada-de-letras/?
Disallow /ayuda-scrabble/?
Disallow /letter-sorting/?
Disallow /buchstabensalat-loesen/?
Disallow /word-chums-cheat/?
Disallow /words-with-friends-cheat/?
Disallow /crossword-solver/all-clues-for/
Disallow /letter-sorting?
Disallow /word-chums-cheat?
Disallow /words-with-friends-cheat?
Disallow /wordfeud-helper?
Disallow /word-unscrambler?
Disallow /scrabble-word-finder?
Disallow /?s=
Disallow /search/

*

Rule Path
Disallow /scrabble-hilfe/?
Disallow /wort-guru-loesung/?
Disallow /wordfeud-helper/?
Disallow /anagramm-generator/?
Disallow /schuettelraetsel-loeser/?
Disallow /generador-anagramas/?
Disallow /resolver-ensalada-de-letras/?
Disallow /ayuda-scrabble/?
Disallow /letter-sorting/?
Disallow /buchstabensalat-loesen/?
Disallow /word-chums-cheat/?
Disallow /words-with-friends-cheat/?
Disallow /letter-sorting?
Disallow /word-chums-cheat?
Disallow /words-with-friends-cheat?
Disallow /wordfeud-helper?
Disallow /word-unscrambler?
Disallow /scrabble-word-finder?
Disallow /?s=
Disallow /search/