1001renkaat.com
robots.txt

Robots Exclusion Standard data for 1001renkaat.com

Resource Scan

Scan Details

Site Domain 1001renkaat.com
Base Domain 1001renkaat.com
Scan Status Ok
Last Scan2024-05-25T04:14:14+00:00
Next Scan 2024-06-24T04:14:14+00:00

Last Scan

Scanned2024-05-25T04:14:14+00:00
URL https://1001renkaat.com/robots.txt
Redirect https://www.1001renkaat.com/robots.txt
Redirect Domain www.1001renkaat.com
Redirect Base 1001renkaat.com
Domain IPs 162.19.191.2
Redirect IPs 162.19.191.2
Response IP 162.19.191.2
Found Yes
Hash 5df68a985bd496a5a59e8f93a21d7279ddbcc088833dcd291cb0cbf837046088
SimHash cd0cd4128025

Groups

*

Rule Path
Disallow /invoice*
Disallow /get_invoice*
Disallow /repayment*
Disallow /get_repayment*
Disallow /download*
Disallow /*.ppt$
Disallow /*.csv$
Disallow /*.xls$
Disallow /*.xlsx$
Disallow /*.zip$
Disallow /*.rar$
Disallow /*?*tyre_id=*
Disallow /*?*vehicule=*
Disallow /*?*callback=*
Disallow /oma-tilini/*
Disallow /cart/*
Disallow /rengaspaketti/*
Disallow /haku*

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

vbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

awariobot
awariorssbot
awariosmartbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.1001renkaat.com/G-sitemaps/sitemap.xml