tatlisohbet.org
robots.txt

Robots Exclusion Standard data for tatlisohbet.org

Resource Scan

Scan Details

Site Domain tatlisohbet.org
Base Domain tatlisohbet.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-16T04:14:11+00:00
Next Scan 2024-11-14T04:14:11+00:00

Last Successful Scan

Scanned2023-04-25T00:52:43+00:00
URL https://tatlisohbet.org/robots.txt
Domain IPs 193.223.107.71
Response IP 193.223.107.71
Found Yes
Hash 0d53f4eb2047d580745015b570aa4e4d7e110fc4aeac5b1c72cfd5d2fa615f39
SimHash 4be1dbb546b1

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /tmp/
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /.well-known/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /humans.txt
Disallow /author/63omerati21/

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

mediapartners

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

yandex

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yandexmedia

Rule Path
Allow /

yandeximages

Rule Path
Allow /

yandexcatalog

Rule Path
Allow /

yandexdirect

Rule Path
Allow /

yandexblogs

Rule Path
Allow /

yandexnews

Rule Path
Allow /

yandexpagechecker

Rule Path
Allow /

httrack

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.tatlisohbet.org/sitemap.xml
sitemap https://www.tatlisohbet.org/sitemap.rss