Log In Sign Up

dilbilgisi.net
robots.txt

Robots Exclusion Standard data for dilbilgisi.net

Resource Scan

Scan Details

Site Domain dilbilgisi.net
Base Domain dilbilgisi.net
Scan Status Ok
Last Scan2024-11-14T06:04:29+00:00
Next Scan 2024-11-21T06:04:29+00:00

Last Scan

Scanned2024-11-14T06:04:29+00:00
URL https://dilbilgisi.net/robots.txt
Domain IPs 78.142.211.235
Response IP 78.142.211.235
Found Yes
Hash 3c06b3a4b18a92e0c831a60155fba3029d35de7cbde3ff7aa11039a23dd518e1
SimHash 2b1cde237239

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow */trackback
Disallow */comment-
Disallow *?replytocom=
Disallow /?s=
Disallow /xmlrpc.php
Disallow /archives/date/
Disallow /archives/tag/
Disallow /archives/author/
Disallow /page/
Disallow /tag/
Disallow /category/
Disallow /wp-content/plugins/
Disallow /readme.html
Disallow /*.pdf$
Disallow /*.doc$
Disallow /*.docx$
Disallow /*.xls$
Disallow /*.xlsx$
Allow /wp-content/uploads/

googlebot-image

Rule Path
Allow /wp-content/uploads/

ia_archiver

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.dilbilgisi.net/sitemap_index.xml
Back to top

Comments

  • Google AdSenseUser-agent: Mediapartners-Google*Allow: /# Google AdsbotUser-agent: Adsbot-GoogleAllow: /
Back to top

Warnings

  • `host` is not a known field.
Back to top