colab55.com
robots.txt

Robots Exclusion Standard data for colab55.com

Resource Scan

Scan Details

Site Domain colab55.com
Base Domain colab55.com
Scan Status Ok
Last Scan2024-09-21T16:02:32+00:00
Next Scan 2024-10-21T16:02:32+00:00

Last Scan

Scanned2024-09-21T16:02:32+00:00
URL https://colab55.com/robots.txt
Redirect https://www.colab55.com/robots.txt
Redirect Domain www.colab55.com
Redirect Base colab55.com
Domain IPs 104.21.48.120, 172.67.151.57, 2606:4700:3037::6815:3078, 2606:4700:3037::ac43:9739
Redirect IPs 104.21.48.120, 172.67.151.57, 2606:4700:3037::6815:3078, 2606:4700:3037::ac43:9739
Response IP 172.67.151.57
Found Yes
Hash d687880d9167ec00069e2055815d05817055f82040a2a2cd780c520d017c94f6
SimHash 2fbccd62ee13

Groups

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

qsdb

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

everyonesocialbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /lab
Disallow /search
Disallow /login
Disallow /checkout
Disallow /order
Disallow /newstudio
Disallow /%40*/sales
Disallow /%40*/insights
Disallow /%40*/embed
Disallow /%40*/fetch
Disallow /%40*/tools
Disallow /surveys

Other Records

Field Value
sitemap https://www.colab55.com/sitemap.xml

Comments

  • block crawlers first. case sensitive spelling
  • general rules