whyislam.to
robots.txt
Robots Exclusion Standard data for whyislam.to
Resource Scan
Scan Details
| Site Domain | whyislam.to |
| Base Domain | whyislam.to |
| Scan Status | Ok |
| Last Scan | 2024-09-24T23:47:19+00:00 |
| Next Scan | 2024-10-24T23:47:19+00:00 |
Last Scan
| Scanned | 2024-09-24T23:47:19+00:00 |
| URL | https://whyislam.to/robots.txt |
| Redirect | https://www.whyislam.to/robots.txt |
| Redirect Domain | www.whyislam.to |
| Redirect Base | whyislam.to |
| Domain IPs | 104.21.23.51, 172.67.209.52, 2606:4700:3031::6815:1733, 2606:4700:3031::ac43:d134 |
| Redirect IPs | 104.21.23.51, 172.67.209.52, 2606:4700:3031::6815:1733, 2606:4700:3031::ac43:d134 |
| Response IP | 172.67.209.52 |
| Found | Yes |
| Hash | 75594343ed421d7697dd15e86f50d53392c6431c9f3c9aff2ddbdf250d5e8991 |
| SimHash | 0b4893331214 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /read-offline |
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-content/themes |
| Disallow | /wp-content/w3tc |
| Disallow | /wp-content/plugins1 |
| Disallow | /wp-content/languages |
| Disallow | /wp-trackback |
| Disallow | /wp-feed |
| Disallow | /wp-comments |
| Disallow | */trackback |
| Disallow | */feed |
| Disallow | */comments |
| Disallow | */style.css |
| Disallow | */tag/ |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */comments/ |
| Disallow | /?feed= |
| Disallow | /?s= |
| Allow | /tag/ramadan |
yandex
| Rule | Path |
|---|---|
| Allow | /tag/ramadan |
| Disallow | /read-offline |
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-content/themes |
| Disallow | /wp-content/plugins1 |
| Disallow | /wp-content/languages |
| Disallow | /wp-content/w3tc |
| Disallow | /wp-trackback |
| Disallow | /wp-feed |
| Disallow | /wp-comments |
| Disallow | */trackback |
| Disallow | */feed |
| Disallow | */comments |
| Disallow | /undex |
| Disallow | */style.css |
| Disallow | */tag/ |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */comments/ |
| Disallow | /?feed= |
| Disallow | /?s= |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.whyislam.to/sitemap_index.xml |
Warnings
- `host` is not a known field.