toislam.ws
robots.txt
Robots Exclusion Standard data for toislam.ws
Resource Scan
Scan Details
| Site Domain | toislam.ws |
| Base Domain | toislam.ws |
| Scan Status | Ok |
| Last Scan | 2024-06-17T08:07:16+00:00 |
| Next Scan | 2024-07-17T08:07:16+00:00 |
Last Scan
| Scanned | 2024-06-17T08:07:16+00:00 |
| URL | https://toislam.ws/robots.txt |
| Domain IPs | 104.21.41.99, 172.67.164.44, 2606:4700:3031::ac43:a42c, 2606:4700:3037::6815:2963 |
| Response IP | 172.67.164.44 |
| Found | Yes |
| Hash | 694d474b9eba31c612f944943e63aadec57e3851d2d84e3fcc3908ee7d5febf1 |
| SimHash | 3408f0438d7d |
Groups
*
| Product | Comment |
|---|---|
| * | обÑие пÑавила Ð´Ð»Ñ ÑобоÑов, кÑоме ЯндекÑа и Google, |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | папка на Ñ |
| Disallow | /? | вÑе паÑамеÑÑÑ Ð·Ð°Ð¿ÑоÑа на главной |
| Disallow | /wp- | вÑе ÑÐ°Ð¹Ð»Ñ WP: /wp-json/, /wp-includes, /wp-content/plugins |
| Disallow | /wp/ | еÑли еÑÑÑ Ð¿Ð¾Ð´ÐºÐ°Ñалог /wp/, где ÑÑÑановлена CMS (еÑли неÑ, |
| Disallow | *?s= | поиÑк |
| Disallow | *%26s%3D | поиÑк |
| Disallow | /search/ | поиÑк |
| Disallow | /author/ | аÑÑ |
| Disallow | /users/ | аÑÑ |
| Disallow | */trackback | ÑÑекбеки, ÑÐ²ÐµÐ´Ð¾Ð¼Ð»ÐµÐ½Ð¸Ñ Ð² комменÑаÑиÑÑ |
| Disallow | */feed | вÑе ÑÐ¸Ð´Ñ |
| Disallow | */rss | rss Ñид |
| Disallow | */embed | вÑе вÑÑÑÐ°Ð¸Ð²Ð°Ð½Ð¸Ñ |
| Disallow | */wlwmanifest.xml | xml-Ñайл маниÑеÑÑа Windows Live Writer (еÑли не иÑполÑзÑеÑе, |
| Disallow | /xmlrpc.php | Ñайл WordPress API |
| Disallow | *utm*%3D | ÑÑÑлки Ñ utm-меÑками |
| Disallow | *openstat%3D | ÑÑÑлки Ñ Ð¼ÐµÑками openstat |
| Allow | */uploads | оÑкÑÑваем Ð¿Ð°Ð¿ÐºÑ Ñ Ñайлами uploads |
googlebot
| Product | Comment |
|---|---|
| googlebot | пÑавила Ð´Ð»Ñ Google (комменÑаÑии не дÑблиÑÑÑ) |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | - |
| Disallow | /? | - |
| Disallow | /wp- | - |
| Disallow | /wp/ | - |
| Disallow | *?s= | - |
| Disallow | *%26s%3D | - |
| Disallow | /search/ | - |
| Disallow | /author/ | - |
| Disallow | /users/ | - |
| Disallow | */trackback | - |
| Disallow | */feed | - |
| Disallow | */rss | - |
| Disallow | */embed | - |
| Disallow | */wlwmanifest.xml | - |
| Disallow | /xmlrpc.php | - |
| Disallow | *utm*%3D | - |
| Disallow | *openstat%3D | - |
| Allow | */uploads | - |
| Allow | /*/*.js | оÑкÑÑваем js-ÑкÑипÑÑ Ð²Ð½ÑÑÑи /wp- (/*/ - Ð´Ð»Ñ Ð¿ÑиоÑиÑеÑа) |
| Allow | /*/*.css | оÑкÑÑваем css-ÑÐ°Ð¹Ð»Ñ Ð²Ð½ÑÑÑи /wp- (/*/ - Ð´Ð»Ñ Ð¿ÑиоÑиÑеÑа) |
| Allow | /wp-*.png | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
| Allow | /wp-*.jpg | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
| Allow | /wp-*.jpeg | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
| Allow | /wp-*.gif | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
| Allow | /wp-admin/admin-ajax.php | иÑполÑзÑеÑÑÑ Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ð¼Ð¸, ÑÑÐ¾Ð±Ñ Ð½Ðµ блокиÑоваÑÑ JS и CSS |
yandex
| Product | Comment |
|---|---|
| yandex | пÑавила Ð´Ð»Ñ Ð¯Ð½Ð´ÐµÐºÑа (комменÑаÑии не дÑблиÑÑÑ) |
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /? |
| Disallow | /wp- |
| Disallow | /wp/ |
| Disallow | *?s= |
| Disallow | *%26s%3D |
| Disallow | /search/ |
| Disallow | /author/ |
| Disallow | /users/ |
| Disallow | */trackback |
| Disallow | */feed |
| Disallow | */rss |
| Disallow | */embed |
| Disallow | */wlwmanifest.xml |
| Disallow | /xmlrpc.php |
| Allow | */uploads |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | /wp-*.gif |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://toislam.ws/sitemap.xml |
| sitemap | https://toislam.ws/sitemap.xml.gz |
Warnings
- 9 invalid lines.
- `clean-param` is not a known field.
- `host` is not a known field.
Comments