centralasian.org
robots.txt

Robots Exclusion Standard data for centralasian.org

Resource Scan

Scan Details

Site Domain centralasian.org
Base Domain centralasian.org
Scan Status Ok
Last Scan2024-11-15T18:16:06+00:00
Next Scan 2024-11-29T18:16:06+00:00

Last Scan

Scanned2024-11-15T18:16:06+00:00
URL https://centralasian.org/robots.txt
Redirect https://www.centralasian.org/robots.txt
Redirect Domain www.centralasian.org
Redirect Base centralasian.org
Domain IPs 23.215.7.14, 23.215.7.32, 2600:1413:1::1720:1d10, 2600:1413:1::6011:b433
Redirect IPs 2600:1413:1::6011:b430, 2600:1413:1::6011:b431, 96.17.180.48, 96.17.180.49
Response IP 96.17.180.48
Found Yes
Hash 731c523e53362ec2ef0edf5f56dea9b7e760a5498b7f9707309d4c9913bc3799
SimHash 780c8c46ea03

Groups

*

Rule Path
Disallow /z/*/*/*/*
Disallow /ebar*
Disallow /api/*
Disallow /tv/*/*/*/*/*
Disallow /radio/*/*/*/*/*
Disallow /schedule/*/*/*/*/*
Disallow /*?p=*
Disallow /comments/*
Disallow /embed/*
Disallow /s?k=*
Disallow /navigation.html
Disallow /captcha/iframe.html
Disallow /office365/login.html
Disallow /podcast/sublink/*

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.centralasian.org/sitemap.xml

Warnings

  • `clean-param` is not a known field.