Log In Sign Up

casa.allweb360.com
robots.txt

Robots Exclusion Standard data for casa.allweb360.com

Resource Scan

Scan Details

Site Domain casa.allweb360.com
Base Domain allweb360.com
Scan Status Ok
Last Scan2024-05-16T04:28:49+00:00
Next Scan 2024-06-15T04:28:49+00:00

Last Scan

Scanned2024-05-16T04:28:49+00:00
URL http://casa.allweb360.com/robots.txt
Domain IPs 46.252.150.222
Response IP 46.252.150.222
Found Yes
Hash 642abb04cb0a459cc3c796d99ea6950d30692c8ccdc12f7ee43b1d417f61fde6
SimHash 86b65b1663ab

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

moget
ichiro

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot

Rule Path
Disallow /

yandex

Rule Path
Disallow /
Back to top

Comments

  • Simple Robots.txt 0.1
  • MOTORI DI RICERCA GIAPPONESI
  • MOTORI DI RICERCA COREANI
  • MOTORI DI RICERCA CINESI
  • MOTORI DI RICERCA RUSSI
Back to top