dreams.alanbary.com
robots.txt
Robots Exclusion Standard data for dreams.alanbary.com
Resource Scan
Scan Details
Site Domain | dreams.alanbary.com |
Base Domain | alanbary.com |
Scan Status | Ok |
Last Scan | 2025-04-02T22:55:35+00:00 |
Next Scan | 2025-05-02T22:55:35+00:00 |
Last Scan
Scanned | 2025-04-02T22:55:35+00:00 |
URL | https://dreams.alanbary.com/robots.txt |
Domain IPs | 104.21.48.39, 172.67.176.176, 2606:4700:3035::6815:3027, 2606:4700:3037::ac43:b0b0 |
Response IP | 104.21.48.39 |
Found | Yes |
Hash | d1d1fa1c41407967488800fb3e82800a17fb55497abc26b6e1b53a92b7dd7e14 |
SimHash | e818cc43e092 |
Groups
*
Rule | Path |
---|---|
Disallow | /post/* |
Disallow | */page/* |
Disallow | /tags/* |
Disallow | */404.html |
Disallow | /search/ |
Disallow | *?page= |
Disallow | */cdn-cgi |
Disallow | */cdn-cgi/zaraz/ |
Other Records
Field | Value |
---|---|
sitemap | https://dreams.alanbary.com/sitemap.xml |