drop.fi
robots.txt

Robots Exclusion Standard data for drop.fi

Resource Scan

Scan Details

Site Domain drop.fi
Base Domain drop.fi
Scan Status Ok
Last Scan2025-12-11T06:40:34+00:00
Next Scan 2026-01-10T06:40:34+00:00

Last Scan

Scanned2025-12-11T06:40:34+00:00
URL https://drop.fi/robots.txt
Redirect https://www.drop.fi/robots.txt
Redirect Domain www.drop.fi
Redirect Base drop.fi
Domain IPs 62.121.59.249
Redirect IPs 62.121.59.249
Response IP 62.121.59.249
Found Yes
Hash 1e55aab5b36a0d60362e63497c5647f9bb08ee1aef03b312411c52c469842ff3
SimHash 580cdd60c711

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

addsearchbot

Rule Path
Disallow /admin
Disallow /tmp
Disallow /wp-content
Disallow /wp-content2
Disallow /tiedostopankki
Disallow /uutiskirjeet
Disallow /lataaesite
Disallow /cgi-bin/webio2-pdf
Disallow /cgi-bin/webio2-kalenteri2
Disallow /cgi-bin/webio2kauppa?time=*&naytasivu=*&tapaus=verkkokauppatilaus&tapaus2=*

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

cookiebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot-sa

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

riddler

Rule Path
Disallow /

yandex

Rule Path
Disallow /

slurp

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

tinytestbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot/1.0

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

storebot-google

Rule Path
Disallow /
Disallow /cgi-bin

addsearchbot

Rule Path
Disallow /cgi-bin

Other Records

Field Value
sitemap https://www.drop.fi/sitemap.xml