Log In Sign Up

costacalidanachrichten.com
robots.txt

Robots Exclusion Standard data for costacalidanachrichten.com

Resource Scan

Scan Details

Site Domain costacalidanachrichten.com
Base Domain costacalidanachrichten.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-15T22:13:17+00:00
Next Scan 2024-12-14T22:13:17+00:00

Last Successful Scan

Scanned2024-02-19T22:06:47+00:00
URL http://costacalidanachrichten.com/robots.txt
Redirect https://www.costanachrichten.com/robots.txt
Redirect Domain www.costanachrichten.com
Redirect Base costanachrichten.com
Domain IPs 95.130.17.35
Redirect IPs 91.234.30.220
Response IP 91.234.30.220
Found Yes
Hash 530f7afa7df1e1fe7314826fbaa3915c09b7b9e7d123e8af896fff2a152ad2b5
SimHash 2b211b5c4f71

Groups

*

Rule Path
Disallow /lightweight-ajax
Disallow /*?trafficsource
Disallow /suche/
Disallow /*?cmp=defrss
Disallow /test/
Disallow /bi/bootstrap/
Disallow /bi/doop/
Disallow /sso/

xovi

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /test/

gptbot

Rule Path
Allow /ueber-uns/
Disallow /

ccbot

Rule Path
Allow /ueber-uns/
Disallow /

msnbot

Rule Path
Disallow /test/

Other Records

Field Value
crawl-delay 5
Back to top

Comments

  • robots.txt www.costanachrichten.com
  • Legal notice: www.costanachrichten.com expressly reserves the right to use its content for commercial text and data mining (ยง 44b UrhG).
  • The use of robots or other automated means to access www.costanachrichten.com or collect or mine data without the express permission of www.costanachrichten.com is strictly prohibited.
Back to top