trend.az
robots.txt

Robots Exclusion Standard data for trend.az

Resource Scan

Scan Details

Site Domain trend.az
Base Domain trend.az
Scan Status Ok
Last Scan2024-05-30T22:14:44+00:00
Next Scan 2024-06-06T22:14:44+00:00

Last Scan

Scanned2024-05-30T22:14:44+00:00
URL https://trend.az/robots.txt
Redirect https://www.trend.az/robots.txt
Redirect Domain www.trend.az
Redirect Base trend.az
Domain IPs 104.21.85.203, 172.67.210.55, 2606:4700:3036::6815:55cb, 2606:4700:3036::ac43:d237
Redirect IPs 104.21.85.203, 172.67.210.55, 2606:4700:3036::6815:55cb, 2606:4700:3036::ac43:d237
Response IP 172.67.210.55
Found Yes
Hash c270cfa5f6dd9008fcc57103e23802097b327b1136dee80ed933ef839d483954
SimHash 68792dc44591

Groups

googlebot

Rule Path
Disallow /index.php
Disallow /cgi-bin/
Disallow /dataimage/
Disallow /admin/
Disallow /import/
Disallow /registration.php
Disallow /search.php
Disallow *Desktop/
Disallow /news_print.php

mediapartners-google

Rule Path
Disallow

*
googlebot

Rule Path
Disallow /index.php
Disallow /cgi-bin/
Disallow /dataimage/
Disallow /admin/
Disallow /import/
Disallow /registration.php
Disallow /search.php
Disallow *Desktop/
Disallow /news_print.php

Other Records

Field Value
sitemap https://www.trend.az/sitemap_ru.xml
sitemap https://www.trend.az/sitemap_ru.xml

Warnings

  • `host` is not a known field.