planetekiosque.com
robots.txt

Robots Exclusion Standard data for planetekiosque.com

Resource Scan

Scan Details

Site Domain planetekiosque.com
Base Domain planetekiosque.com
Scan Status Ok
Last Scan2024-10-10T01:40:11+00:00
Next Scan 2024-10-17T01:40:11+00:00

Last Scan

Scanned2024-10-10T01:40:11+00:00
URL https://planetekiosque.com/robots.txt
Domain IPs 145.239.192.164
Response IP 145.239.192.164
Found Yes
Hash f31d4330b3ae7d5208b4c588fc322c0954fc80097d2ced4086ee0dd841a903a8
SimHash f71d52d0ea94

Groups

semrushbot

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

*

Rule Path
Disallow /script/

semanticscholarbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

awariobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Comments

  • Baiduspider
  • Yandex