crosswordeg.net
robots.txt

Robots Exclusion Standard data for crosswordeg.net

Resource Scan

Scan Details

Site Domain crosswordeg.net
Base Domain crosswordeg.net
Scan Status Ok
Last Scan2024-11-14T15:23:52+00:00
Next Scan 2024-11-21T15:23:52+00:00

Last Scan

Scanned2024-11-14T15:23:52+00:00
URL https://crosswordeg.net/robots.txt
Domain IPs 104.21.21.159, 172.67.199.89, 2606:4700:3035::6815:159f, 2606:4700:3036::ac43:c759
Response IP 172.67.199.89
Found Yes
Hash e67847f62622527d730eece81469e9fe6ae656dc9deb80733a495964980928e4
SimHash 4e5eec2afe18

Groups

blexbot
dotbot
ahrefsbot
semrushbot
ahrefssiteaudit
mj12bot
barkrowler
siteliner
linkbot
cliqzbot
ninjbot
ninjabot

No rules defined. All paths allowed.