tradeniagabet.com
robots.txt
Robots Exclusion Standard data for tradeniagabet.com
Resource Scan
Scan Details
| Site Domain | tradeniagabet.com |
| Base Domain | tradeniagabet.com |
| Scan Status | Ok |
| Last Scan | 2025-05-14T23:31:12+00:00 |
| Next Scan | 2025-06-13T23:31:12+00:00 |
Last Scan
| Scanned | 2025-05-14T23:31:12+00:00 |
| URL | https://tradeniagabet.com/robots.txt |
| Domain IPs | 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001 |
| Response IP | 104.21.48.1 |
| Found | Yes |
| Hash | 0b6757618087d3dddc71188d76a742c81d713ee52d3afeec2891b3849058f156 |
| SimHash | 44501740ee11 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
mj12bot
semrushbot
yandex
yandexbot
zoominfobot
um-ln
mtrobot
safednsbot
bytespider
bitlybot
barkrowle
coccocbot-image
petalbot
dotbot
blexbot
aspiegelbot
baiduspider
trovitbot
mail.ru_bot
seznambot
yisouspider
zh-cn
slackbot
slackbot-linkexpanding
rogerbot
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://niagabet.io/sitemap.xml |
Warnings
- 2 invalid lines.
Comments