rdwab.info
robots.txt
Robots Exclusion Standard data for rdwab.info
Resource Scan
Scan Details
Site Domain | rdwab.info |
Base Domain | rdwab.info |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2025-08-16T12:19:52+00:00 |
Next Scan | 2025-11-14T12:19:52+00:00 |
Last Successful Scan
Scanned | 2023-10-04T02:41:13+00:00 |
URL | https://rdwab.info/robots.txt |
Redirect | https://rtwab.fun/robots.txt |
Redirect Domain | rtwab.fun |
Redirect Base | rtwab.fun |
Domain IPs | 104.21.69.61, 172.67.205.206, 2606:4700:3030::ac43:cdce, 2606:4700:3035::6815:453d |
Redirect IPs | 104.21.2.15, 172.67.128.146, 2606:4700:3033::6815:20f, 2606:4700:3034::ac43:8092 |
Response IP | 104.21.2.15 |
Found | Yes |
Hash | 4d1696fe0c07e4f9296d5d8125cfb2e7d071e429c9628f1f99fe40fc51163c48 |
SimHash | 4d14cbb7c6d1 |
Groups
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
adsbot-google-mobile
adsbot-google
mediapartners-google
googlebot-image/1.0
googlebot-news
googlebot-video/1.0
google favicon
storebot-google
google-inspectiontool
googleother
apis-google
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
baiduspider
baiduspider-video
baiduspider-image
baiduspider-news
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
*
Rule | Path |
---|---|
Disallow | / |