ngslot.org
robots.txt
Robots Exclusion Standard data for ngslot.org
Resource Scan
Scan Details
| Site Domain | ngslot.org |
| Base Domain | ngslot.org |
| Scan Status | Ok |
| Last Scan | 2025-04-18T07:58:36+00:00 |
| Next Scan | 2025-05-18T07:58:36+00:00 |
Last Scan
| Scanned | 2025-04-18T07:58:36+00:00 |
| URL | https://www.ngslot.org/robots.txt |
| Domain IPs | 104.21.7.64, 172.67.187.135, 2606:4700:3031::6815:740, 2606:4700:3036::ac43:bb87 |
| Response IP | 104.21.7.64 |
| Found | Yes |
| Hash | 0b6757618087d3dddc71188d76a742c81d713ee52d3afeec2891b3849058f156 |
| SimHash | 44501740ee11 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
mj12bot
semrushbot
yandex
yandexbot
zoominfobot
um-ln
mtrobot
safednsbot
bytespider
bitlybot
barkrowle
coccocbot-image
petalbot
dotbot
blexbot
aspiegelbot
baiduspider
trovitbot
mail.ru_bot
seznambot
yisouspider
zh-cn
slackbot
slackbot-linkexpanding
rogerbot
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://niagabet.io/sitemap.xml |
Warnings
- 2 invalid lines.
Comments