top10potovanja.com
robots.txt

Robots Exclusion Standard data for top10potovanja.com

Resource Scan

Scan Details

Site Domain top10potovanja.com
Base Domain top10potovanja.com
Scan Status Ok
Last Scan6/3/2025, 7:54:24 PM
Next Scan 7/3/2025, 7:54:24 PM

Last Scan

Scanned6/3/2025, 7:54:24 PM
URL https://top10potovanja.com/robots.txt
Domain IPs 104.21.19.130, 172.67.186.102, 2606:4700:3032::ac43:ba66, 2606:4700:3036::6815:1382
Response IP 104.21.19.130
Found Yes
Hash ca5f3cf6cb05312ad10c3d6ead4220dc0217354a44e3e8100004f091676401d6
SimHash ef451c3aa900

Groups

*

Rule Path
Disallow /assets/handlers/
Disallow /Assets/Handlers/
Disallow /edocs/
Disallow /*?set-currency=GBP
Disallow /*?set-currency=EUR
Disallow /*?set-currency=AED
Disallow /*?set-currency=USD
Disallow /*?set-currency=HRK
Disallow /*?set-currency=RUB
Disallow /flightsearch.aspx
Disallow /accommsearch.aspx
Disallow /packageholidaysearch.aspx
Disallow /dynamicpackagesearch.aspx
Disallow /holidaysearch.aspx
Disallow /holidaysearchaccomm.aspx
Disallow /carhiresearch.aspx
Disallow /transfersearch.aspx
Disallow /attractionsearch.aspx
Disallow /packagebanksearch.aspx
Disallow /packagebankview.aspx
Disallow /extras.aspx
Disallow /basket.aspx
Disallow /basket-thankyou.aspx
Disallow /submit-review.aspx
Disallow /multicitysearch.aspx
Disallow /multicityextras.aspx
Disallow /test/test.aspx
Disallow /test/testlastminute.aspx
Disallow /info/flagito.aspx
Disallow /info/uni.aspx
Disallow /info/airbaltic.aspx
Disallow /info/icarhire.aspx
Disallow /collection/departure-airports.aspx
Disallow /collection/mauri-eno-ja-lasse.aspx
Disallow /test/landingtest.aspx
Disallow /hotels-brandx.aspx
Disallow /WebResource.axd
Disallow /webresource.axd

Other Records

Field Value
crawl-delay 5

turnitinbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

datagnionbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.top10matkatarjoukset.com/sitemap.xml

Comments

  • eVolve CMS v3.34 Robots.txt Generator