torrentkitty.fun
robots.txt

Robots Exclusion Standard data for torrentkitty.fun

Resource Scan

Scan Details

Site Domain torrentkitty.fun
Base Domain torrentkitty.fun
Scan Status Ok
Last Scan2024-05-27T23:39:51+00:00
Next Scan 2024-06-26T23:39:51+00:00

Last Scan

Scanned2024-05-27T23:39:51+00:00
URL https://torrentkitty.fun/robots.txt
Domain IPs 104.21.4.54, 172.67.153.231, 2606:4700:3030::ac43:99e7, 2606:4700:3035::6815:436
Response IP 104.21.4.54
Found Yes
Hash a4bb9dd3fd77a40bb255f026196fcfe7d045760561363d1ffa167941f16f3d97
SimHash 661b400041b5

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

yeti

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

petalbot

Rule Path
Disallow /