cryptotips.eu
robots.txt

Robots Exclusion Standard data for cryptotips.eu

Resource Scan

Scan Details

Site Domain cryptotips.eu
Base Domain cryptotips.eu
Scan Status Ok
Last Scan2025-10-07T23:15:20+00:00
Next Scan 2025-10-21T23:15:20+00:00

Last Scan

Scanned2025-10-07T23:15:20+00:00
URL https://cryptotips.eu/robots.txt
Domain IPs 194.5.132.18, 2a12:5040:1:301:d81c:f7ff:feb9:d8df
Response IP 194.5.132.18
Found Yes
Hash 4f6d902648a93a4e52d7b8b1595759afadae9d603b462bb534ec8e3c1bbeeda0
SimHash 7000888a6b32

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /project/
Disallow /timeline/
Disallow /team/
Disallow /highlight/
Disallow /tbuilder-layout-part/
Disallow */?cid=*
Disallow */?ccpw=*