norfipc.com
robots.txt
Robots Exclusion Standard data for norfipc.com
Resource Scan
Scan Details
| Site Domain | norfipc.com |
| Base Domain | norfipc.com |
| Scan Status | Ok |
| Last Scan | 2026-01-17T10:34:51+00:00 |
| Next Scan | 2026-01-24T10:34:51+00:00 |
Last Scan
| Scanned | 2026-01-17T10:34:51+00:00 |
| URL | https://norfipc.com/robots.txt |
| Domain IPs | 104.26.6.55, 104.26.7.55, 172.67.74.216, 2606:4700:20::681a:637, 2606:4700:20::681a:737, 2606:4700:20::ac43:4ad8 |
| Response IP | 172.67.74.216 |
| Found | Yes |
| Hash | badb7b10ce24c8e390919386576052e74f4d9b8fdf7945fc32986f0ad96e2291 |
| SimHash | 7a082911d457 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /probar/ |
ai2bot
ai2bot-dolma
amazonbot
applebot
applebot-extended
bytespider
bytedance
ccbot
chatgpt-user
gptbot
claude-web
claudebot
diffbot
friendlycrawler
icc-crawler
imagesiftbot
perplexitybot
petalbot
scrapy
timpibot
velenpublicwebcrawler
webzio-extended
anthropic-ai
cohere-ai
iaskspider/2.0
img2dataset
omgili
omgilibot
| Product | Comment |
|---|---|
| bytespider | ByteDance, the Chinese owner of TikTok |
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://norfipc.com/sitemap.xml |
| sitemap | https://norfipc.com/pages.xml |
| sitemap | https://norfipc.com/sitemap-news.xml |
Comments