cryptalker.com
robots.txt

Robots Exclusion Standard data for cryptalker.com

Resource Scan

Scan Details

Site Domain cryptalker.com
Base Domain cryptalker.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-21T08:36:27+00:00
Next Scan 2026-01-19T08:36:27+00:00

Last Successful Scan

Scanned2024-06-28T19:39:16+00:00
URL https://cryptalker.com/robots.txt
Domain IPs 104.21.3.53, 172.67.130.67, 2606:4700:3031::6815:335, 2606:4700:3035::ac43:8243
Response IP 104.21.3.53
Found Yes
Hash 11a174fd1923f147323c1c721ea6beea5afc99c1a74944174a3d666b3768a52f
SimHash 25b0ab221e7c

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /?
Disallow /wp-
Disallow *?s=
Disallow *%26s%3D
Disallow /search
Disallow /author/
Disallow */embed
Disallow */page/
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-*.svg
Allow /wp-*.pdf
Allow /wp-admin/admin-ajax.php