ankarabilim.info
robots.txt

Robots Exclusion Standard data for ankarabilim.info

Resource Scan

Scan Details

Site Domain ankarabilim.info
Base Domain ankarabilim.info
Scan Status Ok
Last Scan2025-08-02T23:56:16+00:00
Next Scan 2025-09-01T23:56:16+00:00

Last Scan

Scanned2025-08-02T23:56:16+00:00
URL https://ankarabilim.info/robots.txt
Domain IPs 104.21.27.41, 172.67.168.227, 2606:4700:3035::6815:1b29, 2606:4700:3037::ac43:a8e3
Response IP 172.67.168.227
Found Yes
Hash a41cff9d6c0dff59139d0810f6828b025fcfc1e65aebe0f11ccd7b65dd6cfc56
SimHash aa4a4e105ef2

Groups

*

Rule Path
Disallow
Disallow /*.php$
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /*.wmv$
Disallow /*.tar$
Disallow /*.tgz$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /wp-admin/
Disallow /archives/
Disallow /wp-includes/
Disallow */trackback/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /wp-login.php
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/cache/
Disallow /*ref%3D*
Disallow /*?ref=
Disallow *?replytocom
Disallow *?amp-wp-skip-redirect=1
Disallow /trackback/
Disallow /undefined/
Disallow */wp-*.php
Disallow *?wptheme=
Disallow */comment-page-
Disallow *?comments=
Disallow *locale
Disallow *function.implode

httrack

Rule Path
Disallow /

webzip

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

prowebwalker

Rule Path
Disallow /
Disallow /wp-includes
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow */trackback/
Disallow */feed/
Disallow /*/feed/rss/$

Other Records

Field Value
sitemap https://www.ankarabilim.info/sitemap.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK

Warnings

  • 2 invalid lines.