101evler.com
robots.txt

Robots Exclusion Standard data for 101evler.com

Resource Scan

Scan Details

Site Domain 101evler.com
Base Domain 101evler.com
Scan Status Ok
Last Scan2024-11-16T05:02:10+00:00
Next Scan 2024-11-23T05:02:10+00:00

Last Scan

Scanned2024-11-16T05:02:10+00:00
URL https://101evler.com/robots.txt
Redirect https://www.101evler.com:443/robots.txt
Redirect Domain www.101evler.com
Redirect Base 101evler.com
Domain IPs 104.26.12.149, 104.26.13.149, 172.67.71.41, 2606:4700:20::681a:c95, 2606:4700:20::681a:d95, 2606:4700:20::ac43:4729
Redirect IPs 104.26.12.149, 104.26.13.149, 172.67.71.41, 2606:4700:20::681a:c95, 2606:4700:20::681a:d95, 2606:4700:20::ac43:4729
Response IP 104.26.13.149
Found Yes
Hash 6d18f296f3c49ea072201ba2a8615417517275ac841018218bdcbeb1d60d4853
SimHash 0258dcd2e3b1

Groups

*

Rule Path
Disallow /emlak-yazdir/*
Disallow /property-print/*

mj12bot

Rule Path
Disallow /

spriftcrawler

Rule Path
Disallow /

cbbot

Rule Path
Disallow /

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10