Log In Sign Up

tarzmeselesi.net
robots.txt

Robots Exclusion Standard data for tarzmeselesi.net

Resource Scan

Scan Details

Site Domain tarzmeselesi.net
Base Domain tarzmeselesi.net
Scan Status Ok
Last Scan2026-02-10T00:37:33+00:00
Next Scan 2026-02-17T00:37:33+00:00

Last Scan

Scanned2026-02-10T00:37:33+00:00
URL https://tarzmeselesi.net/robots.txt
Domain IPs 212.7.211.17
Response IP 212.7.211.17
Found Yes
Hash a619a6bd492775a61013affb9ccf34915cbb53df02e43593aa1f9dec320e8aec
SimHash 4b2ed630e41d

Groups

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /wp-json/oembed/

Other Records

Field Value
crawl-delay 20

bytespider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

tiktokspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /xmlrpc.php
Disallow /?s=
Allow /wp-content/uploads/

Other Records

Field Value
crawl-delay 10

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top

Comments

  • 1. Block AI bots that are hitting you most frequently
  • 2. Restrict Amazonbot (highly active in your oembed logs)
  • 3. Slow down Bytedance/TikTok (very active in your image logs)
  • 4. Standard WordPress Protections
  • 5. Keep Search Engines Fast
Back to top