sevginehri.net
robots.txt

Robots Exclusion Standard data for sevginehri.net

Resource Scan

Scan Details

Site Domain sevginehri.net
Base Domain sevginehri.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-01T08:57:55+00:00
Next Scan 2024-07-08T08:57:55+00:00

Last Successful Scan

Scanned2024-05-31T08:57:32+00:00
URL https://sevginehri.net/robots.txt
Domain IPs 212.64.215.187
Response IP 212.64.215.187
Found Yes
Hash a6eb4eed403b100a3451c96a111eb1dd41b3f4792c505141c14808fc53a1ac37
SimHash 69c1dba052b1

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /tmp/
Disallow /wp-admin/
Disallow /cgi-bin/

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

mediapartners

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

yandex

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yandexmedia

Rule Path
Allow /

yandeximages

Rule Path
Allow /

yandexcatalog

Rule Path
Allow /

yandexdirect

Rule Path
Allow /

yandexblogs

Rule Path
Allow /

yandexnews

Rule Path
Allow /

yandexpagechecker

Rule Path
Allow /

httrack

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.sevginehri.net/sitemap.xml