turkmenportal.com
robots.txt

Robots Exclusion Standard data for turkmenportal.com

Resource Scan

Scan Details

Site Domain turkmenportal.com
Base Domain turkmenportal.com
Scan Status Ok
Last Scan2024-09-21T12:53:25+00:00
Next Scan 2024-09-28T12:53:25+00:00

Last Scan

Scanned2024-09-21T12:53:25+00:00
URL https://turkmenportal.com/robots.txt
Domain IPs 95.85.126.182
Response IP 95.85.126.182
Found Yes
Hash 8cc4798dfbb7d9378d2a5a0699a2443d60e3857b499f4bb90fd2da8718f55337
SimHash 6504c8404bb4

Groups

petalbot

Rule Path
Disallow /*

*

Rule Path
Disallow /index.php
Disallow /admin
Disallow /cgi-sys
Disallow /search
Disallow /calendar
Disallow /comments
Disallow /*_sort

Other Records

Field Value
sitemap https://turkmenportal.com/sitemap.xml

Warnings

  • 1 invalid line.
  • `host` is not a known field.