testleri.gen.tr
robots.txt

Robots Exclusion Standard data for testleri.gen.tr

Resource Scan

Scan Details

Site Domain testleri.gen.tr
Base Domain testleri.gen.tr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-24T02:53:43+00:00
Next Scan 2024-12-23T02:53:43+00:00

Last Successful Scan

Scanned2024-05-28T02:25:16+00:00
URL https://testleri.gen.tr/robots.txt
Domain IPs 94.102.2.81
Response IP 94.102.2.81
Found Yes
Hash 3dc82fe6acaf05e6f4d9dae87ac6971403bc2548620d83fd7fdc4f401d1f4246
SimHash 7b05eb72ce9b

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /archives/
Disallow /*?*
Disallow *?replytocom
Disallow /*/comment
Disallow /comments/feed/
Disallow /attachments/
Disallow /?attachment_id=*
Disallow /page/*

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://testleri.gen.tr/sitemap.xml

Comments

  • disallow all files in these directories