emlaksitem.com
robots.txt

Robots Exclusion Standard data for emlaksitem.com

Resource Scan

Scan Details

Site Domain emlaksitem.com
Base Domain emlaksitem.com
Scan Status Ok
Last Scan2024-05-31T15:35:17+00:00
Next Scan 2024-06-07T15:35:17+00:00

Last Scan

Scanned2024-05-31T15:35:17+00:00
URL https://emlaksitem.com/robots.txt
Response IP 77.223.135.126
Found Yes
Hash 867681c83bdbe899e4d40ec0b0e50e1d398142d21561ef0440cf9f44a62de8fa
SimHash 3f3d4dd146b1

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /panel/
Disallow /admin/
Disallow /popular/
Disallow /report/
Disallow /public/index.php*
Disallow /php-api*
Disallow /*/forgot-password.html
Disallow /*/login.html
Disallow /*/register.html
Disallow /*/profil.html
Disallow /kategori/ara*

googlebot

Rule Path
Disallow /cgi-bin/
Disallow /panel/
Disallow /admin/
Disallow /popular/
Disallow /report/
Disallow /public/index.php*
Disallow /php-api*
Disallow /*/forgot-password.html
Disallow /*/login.html
Disallow /*/register.html
Disallow /*/profil.html

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 200

scrappy
scrappy bot
discobot
dotbot
yacybot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://emlaksitem.com/sitemaps/sitemap.xml