niagajp.cc
robots.txt
Robots Exclusion Standard data for niagajp.cc
Resource Scan
Scan Details
| Site Domain | niagajp.cc |
| Base Domain | niagajp.cc |
| Scan Status | Ok |
| Last Scan | 2025-08-19T01:13:28+00:00 |
| Next Scan | 2025-09-18T01:13:28+00:00 |
Last Scan
| Scanned | 2025-08-19T01:13:28+00:00 |
| URL | https://niagajp.cc/robots.txt |
| Domain IPs | 104.21.43.174, 172.67.182.141, 2606:4700:3036::6815:2bae, 2606:4700:3037::ac43:b68d |
| Response IP | 104.21.43.174 |
| Found | Yes |
| Hash | 0b6757618087d3dddc71188d76a742c81d713ee52d3afeec2891b3849058f156 |
| SimHash | 44501740ee11 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
mj12bot
semrushbot
yandex
yandexbot
zoominfobot
um-ln
mtrobot
safednsbot
bytespider
bitlybot
barkrowle
coccocbot-image
petalbot
dotbot
blexbot
aspiegelbot
baiduspider
trovitbot
mail.ru_bot
seznambot
yisouspider
zh-cn
slackbot
slackbot-linkexpanding
rogerbot
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://niagabet.io/sitemap.xml |
Warnings
- 2 invalid lines.
Comments