blogdaily.us
robots.txt
Robots Exclusion Standard data for blogdaily.us
Resource Scan
Scan Details
| Site Domain | blogdaily.us |
| Base Domain | blogdaily.us |
| Scan Status | Ok |
| Last Scan | 2025-01-08T12:34:32+00:00 |
| Next Scan | 2025-01-15T12:34:32+00:00 |
Last Scan
| Scanned | 2025-01-08T12:34:32+00:00 |
| URL | https://blogdaily.us/robots.txt |
| Domain IPs | 104.21.49.180, 172.67.165.133, 2606:4700:3032::6815:31b4, 2606:4700:3034::ac43:a585 |
| Response IP | 104.21.49.180 |
| Found | Yes |
| Hash | 0a995dffee28be0ad9c8a267cac46e8781b25d5d1f4bc4ca1ec7cbf97aaf6bd7 |
| SimHash | 2a341e50c447 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /search |
| Disallow | /admin |
| Allow | /blog-daily-us/*.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://blogdaily.us/sitemap.html |
| sitemap | https://blogdaily.us/news_sitemap.xml |
Comments