uni.cinccdn.com
robots.txt

Robots Exclusion Standard data for uni.cinccdn.com

Resource Scan

Scan Details

Site Domain uni.cinccdn.com
Base Domain cinccdn.com
Scan Status Ok
Last Scan2024-11-15T22:42:59+00:00
Next Scan 2024-12-15T22:42:59+00:00

Last Scan

Scanned2024-11-15T22:42:59+00:00
URL https://uni.cinccdn.com/robots.txt
Domain IPs 18.161.97.102, 18.161.97.122, 18.161.97.14, 18.161.97.40, 2600:9000:23d0:3200:13:b61a:6cc0:93a1, 2600:9000:23d0:3800:13:b61a:6cc0:93a1, 2600:9000:23d0:7800:13:b61a:6cc0:93a1, 2600:9000:23d0:7e00:13:b61a:6cc0:93a1, 2600:9000:23d0:9600:13:b61a:6cc0:93a1, 2600:9000:23d0:be00:13:b61a:6cc0:93a1, 2600:9000:23d0:e800:13:b61a:6cc0:93a1, 2600:9000:23d0:f000:13:b61a:6cc0:93a1
Response IP 13.226.2.88
Found Yes
Hash cb31cfd3a66072194b84f082c24745745fb1e95f6e673b9f2b8ad74c10035e23
SimHash 7f7b5cfa8e10

Groups

*

Rule Path
Disallow /dashboard/
Disallow /myaccount/
Disallow /profile/
Disallow /signin/
Disallow /signout/
Disallow /ajax/
Disallow /api/
Disallow /cincapi/
Disallow /v0/cincapi/
Disallow /rss/
Disallow /error/
Disallow /preview/
Disallow /mls/
Disallow /account/
Disallow /forgot/
Disallow /m/
Disallow /content/
Disallow /scripts/
Disallow /CastleFramework/
Disallow /signalr/
Disallow /*.asp$
Disallow /*.php$

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mail.ru_bot/2.0

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mail.ru_bot/2.0; +http://go.mail.ru/help/robots

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

semrush

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

crowdtanglebot

Rule Path
Disallow /

go-resty

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

seekport

Rule Path
Disallow /

checkmarknetwork

Rule Path
Disallow /

indeedbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mycinc.com/sitemap.xml

Comments

  • MJ12bot
  • AhrefsBot
  • Mail.RU_Bot/2.0 Russia
  • Mail.RU Russia
  • Mail.Ru Russia
  • TurnitinBot
  • Yandex
  • Baidu
  • ZoomInfoBot
  • SeznamBot
  • MauiBot
  • TweetmemeBot
  • magpie-crawler
  • YisouSpider
  • Sogou
  • bytespider
  • semrush
  • BLEXbot
  • serpstatbot
  • CrowdTanglebot
  • go-resty
  • Researchscan
  • Seekport
  • CheckMarkNetwork
  • IndeedBot
  • 360Spider
  • Amazonbot
  • OpenAI
  • DataForSeoBot
  • Barkrowler/babbar.tech
  • Valen
  • SEOkicks

Warnings

  • 2 invalid lines.