themoscowtimes.com
robots.txt

Robots Exclusion Standard data for themoscowtimes.com

Resource Scan

Scan Details

Site Domain themoscowtimes.com
Base Domain themoscowtimes.com
Scan Status Ok
Last Scan2024-05-31T03:49:10+00:00
Next Scan 2024-06-07T03:49:10+00:00

Last Scan

Scanned2024-05-31T03:49:10+00:00
URL https://themoscowtimes.com/robots.txt
Redirect https://www.themoscowtimes.com/robots.txt
Redirect Domain www.themoscowtimes.com
Redirect Base themoscowtimes.com
Domain IPs 95.215.189.12
Redirect IPs 95.215.189.12
Response IP 95.215.189.12
Found Yes
Hash 5be29d53c474505eedbcb5b2d2fd5eec726f7ce4917a78aa4c01bf6113e167eb
SimHash fb38cd40cfb3

Groups

*

Rule Path
Disallow /preview/
Disallow /search/
Disallow *?utm
Disallow *%26utm

yandex

Rule Path
Disallow /preview/
Disallow /search/
Disallow */amp/
Disallow */amp$
Disallow *?amp
Disallow *?utm
Disallow *%26utm

Other Records

Field Value
sitemap https://static.themoscowtimes.com/sitemap/sitemap.xml