dreams.alanbary.com
robots.txt

Robots Exclusion Standard data for dreams.alanbary.com

Resource Scan

Scan Details

Site Domain dreams.alanbary.com
Base Domain alanbary.com
Scan Status Ok
Last Scan2025-04-02T22:55:35+00:00
Next Scan 2025-05-02T22:55:35+00:00

Last Scan

Scanned2025-04-02T22:55:35+00:00
URL https://dreams.alanbary.com/robots.txt
Domain IPs 104.21.48.39, 172.67.176.176, 2606:4700:3035::6815:3027, 2606:4700:3037::ac43:b0b0
Response IP 104.21.48.39
Found Yes
Hash d1d1fa1c41407967488800fb3e82800a17fb55497abc26b6e1b53a92b7dd7e14
SimHash e818cc43e092

Groups

*

Rule Path
Disallow /post/*
Disallow */page/*
Disallow /tags/*
Disallow */404.html
Disallow /search/
Disallow *?page=
Disallow */cdn-cgi
Disallow */cdn-cgi/zaraz/

Other Records

Field Value
sitemap https://dreams.alanbary.com/sitemap.xml