myquotes.co
robots.txt
Robots Exclusion Standard data for myquotes.co
Resource Scan
Scan Details
Site Domain | myquotes.co |
Base Domain | myquotes.co |
Scan Status | Ok |
Last Scan | 2024-11-10T02:43:15+00:00 |
Next Scan | 2024-11-17T02:43:15+00:00 |
Last Scan
Scanned | 2024-11-10T02:43:15+00:00 |
URL | https://myquotes.co/robots.txt |
Domain IPs | 104.21.39.246, 172.67.172.45, 2606:4700:3035::6815:27f6, 2606:4700:3037::ac43:ac2d |
Response IP | 104.21.39.246 |
Found | Yes |
Hash | 102f239b3c091c9552497ffcd8a1595265f26d21ebb9e8d3a833c07d093355b0 |
SimHash | 296816423450 |
Groups
semrushbot
semrushbot-sa
mj12bot
dotbot
rogerbot
megaindex.ru
megaindex.com
megaindex.ru/2.0
alexibot
surveybot
backlinkcrawler
sistrix crawler
sistrix
sistrix
uptimerobot/2.0
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path | Comment |
---|---|---|
Disallow | */*?page=* | - |
Disallow | */*?filter=* | - |
Allow | /*/*.js | внутри /wp- (/*/ - для приоритета) |
Allow | /*/*.css | внутри /wp- (/*/ - для приоритета) |
Allow | */*.png | картинки в плагинах, cache папке и т.д. |
Allow | */*.jpeg | картинки в плагинах, cache папке и т.д. |
Other Records
Field | Value |
---|---|
sitemap | https://myquotes.co/sitemap_index.xml |
Warnings
- `host` is not a known field.
Comments