Log In Sign Up

meteobox.co
robots.txt

Robots Exclusion Standard data for meteobox.co

Resource Scan

Scan Details

Site Domain meteobox.co
Base Domain meteobox.co
Scan Status Ok
Last Scan2024-11-13T20:15:59+00:00
Next Scan 2024-11-20T20:15:59+00:00

Last Scan

Scanned2024-11-13T20:15:59+00:00
URL https://meteobox.co/robots.txt
Domain IPs 217.11.235.74
Response IP 217.11.235.74
Found Yes
Hash cf192dc0a39d999061284572b5f1aea288a551d9fc69c1d1495eebdd7e4762da
SimHash 7a1f40c0e090

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /api/*
Disallow *d%3D*
Disallow *flavour%3D*
Disallow /po-*
Disallow /err/*
Disallow /json/*
Disallow /post-data/*

yandexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

bingpreview

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

applebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

ttd-content

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

senutobot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://meteobox.co/siteindex.xml
Back to top

Comments

  • meteobox.co
  • nove views.py re_robot_no_yrno
  • User-agent: AspiegelBot
  • Request-rate: 500/1d
  • User-agent: SeznamBot
  • Request-rate: 10/1m
  • User-agent: BLEXBot
  • Request-rate: 500/1d
  • User-agent: DotBot
  • Request-rate: 500/1d
  • User-agent: MJ12bot
  • Request-rate: 500/1d
  • User-agent: AhrefsBot
  • Request-rate: 1/1m
  • User-agent: YandexBot
  • Request-rate: 500/1d
  • User-agent: SEOkicks
  • Request-rate: 500/1d
  • User-agent: msnbot
  • Request-rate: 500/1d
Back to top