windowsnews.ai
robots.txt
Robots Exclusion Standard data for windowsnews.ai
Resource Scan
Scan Details
| Site Domain | windowsnews.ai |
| Base Domain | windowsnews.ai |
| Scan Status | Ok |
| Last Scan | 2025-12-01T00:58:19+00:00 |
| Next Scan | 2025-12-08T00:58:19+00:00 |
Last Scan
| Scanned | 2025-12-01T00:58:19+00:00 |
| URL | https://windowsnews.ai/robots.txt |
| Domain IPs | 104.21.37.224, 172.67.213.236, 2606:4700:3032::6815:25e0, 2606:4700:3035::ac43:d5ec |
| Response IP | 172.67.213.236 |
| Found | Yes |
| Hash | 90ea4e2d07d73da45cebf7fffbd3c4764c97e24832da409f4aabd6fd3130099a |
| SimHash | 0866f0f70770 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
*
| Rule | Path |
|---|---|
| Disallow | /test/ |
| Disallow | /includes/ |
| Disallow | /templates/ |
| Disallow | /admin/ |
| Disallow | /src/ |
| Disallow | /vendor/ |
| Disallow | /node_modules/ |
| Disallow | /audio/ |
| Disallow | /podcast-audio/ |
*
| Rule | Path |
|---|---|
| Allow | /includes/api-proxy.php |
| Allow | /includes/ai-chat-proxy.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://windowsnews.ai/sitemap.php |
| sitemap | https://windowsnews.ai/sitemap.xml |
| sitemap | https://windowsnews.ai/sitemap-news.xml |
| sitemap | https://windowsnews.ai/sitemaps/sitemap_index.xml |
Comments