upcycledzine.com
robots.txt

Robots Exclusion Standard data for upcycledzine.com

Resource Scan

Scan Details

Site Domain upcycledzine.com
Base Domain upcycledzine.com
Scan Status Ok
Last Scan2024-06-01T20:34:38+00:00
Next Scan 2024-06-08T20:34:38+00:00

Last Scan

Scanned2024-06-01T20:34:38+00:00
URL https://www.upcycledzine.com/robots.txt
Domain IPs 104.21.59.42, 172.67.213.199, 2606:4700:3032::ac43:d5c7, 2606:4700:3036::6815:3b2a
Response IP 104.21.59.42
Found Yes
Hash 92975bda89b85b94b6fbf0b4962faeb81d5abd3a7dd02b0a2367af292e9879a2
SimHash c4145504e313

Groups

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Disallow */feed/

siteauditbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Comments

  • Baiduspider
  • Yandex