mining4people.com
robots.txt
Robots Exclusion Standard data for mining4people.com
Resource Scan
Scan Details
| Site Domain | mining4people.com |
| Base Domain | mining4people.com |
| Scan Status | Ok |
| Last Scan | 2024-06-08T03:03:23+00:00 |
| Next Scan | 2024-07-08T03:03:23+00:00 |
Last Scan
| Scanned | 2024-06-08T03:03:23+00:00 |
| URL | https://mining4people.com/robots.txt |
| Domain IPs | 104.26.10.24, 104.26.11.24, 172.67.69.155, 2606:4700:20::681a:a18, 2606:4700:20::681a:b18, 2606:4700:20::ac43:459b |
| Response IP | 172.67.69.155 |
| Found | Yes |
| Hash | cf10b7c5c1a935f9dfd240d9c56827ca56f9c426c99a58a72bdda3e6e20f3f05 |
| SimHash | 4f7157d6c39c |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /account |
googlebot
googlebot-news
googlebot-video
googlebot-image
mediapartners-google
adsbot-google
adsbot-google-mobile-apps
bingbot
msnbot
msnbot-media
adidxbot
bingpreview
desktop
mobile
business search (advertisements)
baidu union
baidu favorites
image search
news search
video search
yandexbot
yandexmobilebot
yandex
yandexdirect
yandexdirectdyn
yandexmedia
yandeximages
yadirectfetcher
yandexblogs
yandexnews
yandexpagechecker
yandexmetrika
yandexcalendar
yandexscreenshotbot
yandexfavicons
yandexwebmaster
yandeximageresizer
yandexsitelinks
yandexantivirus
yandexvertis
slurp
duckduckbot
ia_archiver
aolbuild
teoma
petalbot
yisouspider
bytespider
zoominfobot
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /notifications |
Warnings
- 1 invalid line.