nettimokki.com
robots.txt

Robots Exclusion Standard data for nettimokki.com

Resource Scan

Scan Details

Site Domain nettimokki.com
Base Domain nettimokki.com
Scan Status Ok
Last Scan2025-05-02T07:25:26+00:00
Next Scan 2025-05-09T07:25:26+00:00

Last Scan

Scanned2025-05-02T07:25:26+00:00
URL https://nettimokki.com/robots.txt
Redirect https://www.nettimokki.com:443/robots.txt
Redirect Domain www.nettimokki.com
Redirect Base nettimokki.com
Domain IPs 34.254.210.13, 46.137.155.214, 52.51.79.147
Redirect IPs 34.254.210.13, 46.137.155.214, 52.51.79.147
Response IP 52.51.79.147
Found Yes
Hash 8b28f1a83c94506b1909e23538c6f766b69b0ac741818d8fa92c8872c763f398
SimHash 631f4840a333

Groups

admantx

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ias_crawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

proximic

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

sirdatabot

Rule Path
Disallow /

verity

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow *?keywords_autocomplete=*
Disallow *rentee/ad-booking/list*
Disallow *my_lists*
Disallow *oma-tili*
Disallow *item-review/ajax/list*
Disallow *get-avaialble-dates-without-rental-model*
Disallow *get-avaialble-dates*
Disallow *booking/ajax-get-booking-price-for-ad-detail*

Other Records

Field Value
sitemap https://www.nettimokki.com/sitemap.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449