susi.live
robots.txt

Robots Exclusion Standard data for susi.live

Resource Scan

Scan Details

Site Domain susi.live
Base Domain susi.live
Scan Status Ok
Last Scan2024-09-03T07:22:37+00:00
Next Scan 2024-10-03T07:22:37+00:00

Last Scan

Scanned2024-09-03T07:22:37+00:00
URL https://susi.live/robots.txt
Domain IPs 52.84.45.110, 52.84.45.43, 52.84.45.61, 52.84.45.80
Response IP 3.164.68.46
Found Yes
Hash 845bc3d5849691e9c3e12d348914cfa1d1b8573f259a97732d83d1f11c7afc96
SimHash 611fd8242bbb

Groups

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sougou

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Comments

  • GUPPYWEB1