armeniatoday.news
robots.txt
Robots Exclusion Standard data for armeniatoday.news
Resource Scan
Scan Details
Site Domain | armeniatoday.news |
Base Domain | armeniatoday.news |
Scan Status | Ok |
Last Scan | 2024-06-17T18:42:27+00:00 |
Next Scan | 2024-06-24T18:42:27+00:00 |
Last Scan
Scanned | 2024-06-17T18:42:27+00:00 |
URL | https://armeniatoday.news/robots.txt |
Domain IPs | 104.26.10.250, 104.26.11.250, 172.67.68.105, 2606:4700:20::681a:afa, 2606:4700:20::681a:bfa, 2606:4700:20::ac43:4469 |
Response IP | 104.26.10.250 |
Found | Yes |
Hash | 385a7aee49316c215b1e788d9ed3e1ba93576eadcc6605a7a4e6d05277c8e213 |
SimHash | 648c81628c9d |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /cgi-bin/ |
Disallow | /?%2F |
Disallow | /wp-/ |
Disallow | /wp/ |
Disallow | /*?s=%2F |
Disallow | /*%26s%3D/ |
Disallow | /search/ |
Disallow | /author/ |
Disallow | /users/ |
Disallow | /*/trackback/ |
Disallow | /*/feed/ |
Disallow | /*/rss/ |
Disallow | /*/embed/ |
Disallow | /*/wlwmanifest.xml |
Disallow | /xmlrpc.php |
Disallow | /*utm*%3D/ |
Disallow | /*openstat%3D/ |
Disallow | /tag/* |
Disallow | /category/* |
Disallow | /*/page/* |
Disallow | |
Allow | /*/uploads/ |
googlebot
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /?%2F |
Disallow | /wp-/ |
Disallow | /wp/ |
Disallow | /*?s=%2F |
Disallow | /*%26s%3D/ |
Disallow | /search/ |
Disallow | /author/ |
Disallow | /users/ |
Disallow | /*/trackback/ |
Disallow | /*/feed/ |
Disallow | /*/rss/ |
Disallow | /*/embed/ |
Disallow | /xmlrpc.php |
Disallow | /*utm*%3D/ |
Disallow | /*openstat%3D/ |
Disallow | /tag/* |
Disallow | /category/* |
Disallow | /*/page/* |
Disallow | |
Allow | /*/uploads/ |
Allow | /*/*.js |
Allow | /*/*.css |
Allow | /wp-*.png |
Allow | /wp-*.jpg |
Allow | /wp-*.jpeg |
Allow | /wp-*.gif |
yandex
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /?%2F |
Disallow | /wp-/ |
Disallow | /wp/ |
Disallow | /*?s=%2F |
Disallow | /*%26s%3D/ |
Disallow | /search/ |
Disallow | /author/ |
Disallow | /users/ |
Disallow | /*/trackback/ |
Disallow | /*/feed/ |
Disallow | /*/rss/ |
Disallow | /*/embed/ |
Disallow | /*/wlwmanifest.xml |
Disallow | /xmlrpc.php |
Disallow | /tag/* |
Disallow | /category/* |
Disallow | /*/page/* |
Disallow | |
Disallow | /blog-immigration/ |
Allow | /*/uploads/ |
Allow | /*/*.js |
Allow | /*/*.css |
Allow | /wp-*.png |
Allow | /wp-*.jpg |
Allow | /wp-*.jpeg |
Allow | /wp-*.gif |
Other Records
Field | Value |
---|---|
sitemap | https://armeniatoday.news/sitemap.xml |