crossword-solver.io
robots.txt

Robots Exclusion Standard data for crossword-solver.io

Resource Scan

Scan Details

Site Domain crossword-solver.io
Base Domain crossword-solver.io
Scan Status Ok
Last Scan2024-09-27T20:25:24+00:00
Next Scan 2024-10-04T20:25:24+00:00

Last Scan

Scanned2024-09-27T20:25:24+00:00
URL https://crossword-solver.io/robots.txt
Domain IPs 172.66.40.220, 172.66.43.36, 2606:4700:3108::ac42:28dc, 2606:4700:3108::ac42:2b24
Response IP 172.66.43.36
Found Yes
Hash d166b4666438b16dd5012b93961799d13c5759763a89752e9aba96f1390b3787
SimHash 4a52e932aa18

Groups

ccbot
chatgpt
chatgpt-user
perplexitybot
blexbot
dotbot
ahrefsbot
semrushbot
ahrefssiteaudit
mj12bot
barkrowler
siteliner
linkbot
cliqzbot
ninjbot
ninjabot
seznam.cz
yandexbot

Rule Path
Disallow /clue/
Disallow /crossword-clues/
Disallow /crossword-answers/

*

Rule Path
Disallow /clue/*/1000$