doktortakvimi.com
robots.txt

Robots Exclusion Standard data for doktortakvimi.com

Resource Scan

Scan Details

Site Domain doktortakvimi.com
Base Domain doktortakvimi.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-05T22:01:36+00:00
Next Scan 2024-08-03T22:01:36+00:00

Last Successful Scan

Scanned2023-07-11T20:51:05+00:00
URL https://doktortakvimi.com/robots.txt
Redirect https://www.doktortakvimi.com/robots.txt
Redirect Domain www.doktortakvimi.com
Redirect Base doktortakvimi.com
Domain IPs 13.224.249.122, 13.224.249.15, 13.224.249.34, 13.224.249.80
Redirect IPs 13.224.249.122, 13.224.249.15, 13.224.249.34, 13.224.249.80
Response IP 13.226.34.27
Found Yes
Hash 12b3c6d88c2d3765eebc85332c6d9c75f342540a8d88631f39945bf52c50117b
SimHash 4153d6104797

Groups

*

Rule Path
Allow /
Disallow /stats.php
Disallow /ajax.php

*

Rule Path
Disallow /kayit-doktor
Disallow /kontrol-al/
Disallow /doctor-add
Disallow /profil-degisiklik-talebi/*
Disallow /gorusler-ekle/*
Disallow /edit-opinion/
Disallow /ara?
Disallow /%40RegisterFacility
Disallow /social-connect
Disallow /marketing/
Disallow /*/marketing/
Disallow /ajax/
Disallow /link
Disallow /klinikler/link

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

piplbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

neticle.hu

Rule Path
Disallow /

*

Rule Path
Disallow /public/doc