rain-pods.com
robots.txt
Robots Exclusion Standard data for rain-pods.com
Resource Scan
Scan Details
| Site Domain | rain-pods.com |
| Base Domain | rain-pods.com |
| Scan Status | Ok |
| Last Scan | 2024-10-28T22:44:10+00:00 |
| Next Scan | 2024-11-27T22:44:10+00:00 |
Last Scan
| Scanned | 2024-10-28T22:44:10+00:00 |
| URL | http://rain-pods.com/robots.txt |
| Domain IPs | 18.214.235.150, 2600:1f18:2302:f01:32c4:c3c1:8ac4:86e, 2600:1f18:2302:f02:c627:466e:7b9a:407a, 54.82.139.218 |
| Response IP | 18.214.235.150 |
| Found | Yes |
| Hash | 642b7e7974b26ec2bd3a0ffb218b2c859939360ca2013d6abe7b84007cc271ff |
| SimHash | d31455d23f09 |
Groups
*
| Rule | Path |
|---|---|
| Disallow |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
blexbot
mj12bot
goodzer
ahrefsbot
spbot
dotbot
dotbot
turnitinbot
seznambot
the knowledge ai
checkmarknetwork
ever accountable
seekportbot
claudebot
mauibot
houzzbot
baiduspider
baiduspider-image
serpstatbot
sogou blog
sogou inst spider
sogou news spider
sogou orion spider
sogou spider2
sogou web spider
uptimebot
yandex
yandexmobilebot
zoominfobot
megaindex.ru
alphaseobot-sa
proximic
amazonbot
petalbot
re-re studio
barkrowler
siteauditbot
awariorssbot
awariosmartbot
bytespider
dataforseobot
ioncrawl
nutch
oai-searchbot
gptbot
chatgpt-user
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 1 invalid line.
Comments