Log In Sign Up

ameteo.eu
robots.txt

Robots Exclusion Standard data for ameteo.eu

Resource Scan

Scan Details

Site Domain ameteo.eu
Base Domain ameteo.eu
Scan Status Ok
Last Scan2024-05-29T17:01:50+00:00
Next Scan 2024-06-05T17:01:50+00:00

Last Scan

Scanned2024-05-29T17:01:50+00:00
URL http://ameteo.eu/robots.txt
Redirect https://meteobox.com/robots.txt
Redirect Domain meteobox.com
Redirect Base meteobox.com
Domain IPs 217.11.235.79
Redirect IPs 162.0.227.212
Response IP 162.0.227.212
Found Yes
Hash 044f1b54ee639e2ff1b9b29aee5ddd1836e5fe8f19cd8e4a95f357340bef1f34
SimHash 7a1e50c0c498

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /api/*
Disallow *d%3D*
Disallow *flavour%3D*
Disallow /po-*
Disallow /err/*
Disallow /json/*
Disallow /post-data/*

yandexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

applebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

msnbot
seekportbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://meteobox.com/siteindex.xml
Back to top

Comments

  • meteobox.com
  • nove views.py re_robot_no_yrno
  • User-agent: Bingbot
  • Disallow: /
  • User-agent: BingPreview
  • Disallow: /
  • User-agent: SemrushBot
  • Disallow: /
  • User-agent: Slurp
  • Disallow: /
  • User-agent: AhrefsBot
  • Disallow: /
Back to top

Warnings

  • `request-rate` is not a known field.
Back to top