dreams-al.co
robots.txt

Robots Exclusion Standard data for dreams-al.co

Resource Scan

Scan Details

Site Domain dreams-al.co
Base Domain dreams-al.co
Scan Status Ok
Last Scan2025-03-05T11:43:03+00:00
Next Scan 2025-04-04T11:43:03+00:00

Last Scan

Scanned2025-03-05T11:43:03+00:00
URL https://dreams-al.co/robots.txt
Domain IPs 104.21.39.110, 172.67.144.147, 2606:4700:3032::6815:276e, 2606:4700:3032::ac43:9093
Response IP 104.21.39.110
Found Yes
Hash 2da2b31df6e4c4abe6cdaa4959bba18b2231d8eeb0fcce31aa1a679ee4a2c2da
SimHash 8874c640e7c2

Groups

*

Rule Path
Disallow /page/

mediapartners-google

Rule Path
Disallow

ia_archiver

Rule Path
Disallow /

*
*

Rule Path
Disallow /dream/

mediapartners-google

Rule Path
Disallow

Warnings

  • `noarchive` is not a known field.