Log In Sign Up

cylect.io
robots.txt

Robots Exclusion Standard data for cylect.io

Resource Scan

Scan Details

Site Domain cylect.io
Base Domain cylect.io
Scan Status Ok
Last Scan2025-09-30T18:49:41+00:00
Next Scan 2025-10-07T18:49:41+00:00

Last Scan

Scanned2025-09-30T18:49:41+00:00
URL https://cylect.io/robots.txt
Domain IPs 104.21.65.171, 172.67.164.240, 2606:4700:3035::ac43:a4f0, 2606:4700:3037::6815:41ab
Response IP 104.21.65.171
Found Yes
Hash 8403f1ab5cff6aeb95734ffb96a583fee9671dd683a0d9da3546b160664136fe
SimHash 780e4f3d645b

Groups

*
googlebot

Rule Path
Allow /

slurp

Rule Path
Disallow /

msnbot

Rule Path
Disallow

ia_archiver

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

becomejpbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

litefinder

Rule Path
Disallow /

slurp

Rule Path
Disallow /

baidu

Rule Path
Disallow /

*

Rule Path
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /INSTALL.sqlite.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /Never/
Disallow /Gonna/
Disallow /Give/
Disallow /You/
Disallow /Up/
Disallow /Never/
Disallow /Gonna/
Disallow /Let/
Disallow /You/
Disallow /Down/
Disallow /Never/
Disallow /Gonna/
Disallow /Run/
Disallow /Around/
Disallow /And/
Disallow /Desert/
Disallow /You/
Disallow /Never/
Disallow /Gonna/
Disallow /Make/
Disallow /You/
Disallow /Cry/
Disallow /Never/
Disallow /Gonna/
Disallow /Say/
Disallow /Goodbye/
Disallow /Never/
Disallow /Gonna/
Disallow /Tell/
Disallow /A/
Disallow /Lie/
Disallow /And/
Disallow /Hurt/
Disallow /You/
Disallow /cgi-bin/
Disallow /print/
Disallow /pdfs/
Disallow /low.html
Disallow /lib/
Disallow /rd/
Disallow /tools/
Disallow /tmp/
Disallow /*?
Disallow /view/pdf/faq/*.php
Disallow /view/pdf/tips/*.php
Disallow /view/pdf/cms/*.php
Disallow /includes/
Disallow /misc/
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Disallow *?p=*

*

Rule Path
Disallow /search
Allow /search/about
Allow /search/static
Allow /search/howsearchworks
Disallow /sdch
Disallow /groups
Disallow /index.html?
Disallow /?
Allow /?hl=
Disallow /?hl=*&
Allow /?hl=*&gws_rd=ssl$
Disallow /?hl=*&*&gws_rd=ssl
Allow /?gws_rd=ssl$
Allow /?pt1=true$
Disallow /imgres
Disallow /u/
Disallow /preferences
Disallow /setprefs
Disallow /default
Disallow /m?
Disallow /m/
Allow /m/finance
Disallow /wml?
Disallow /wml/?
Disallow /wml/search?
Disallow /xhtml?
Disallow /xhtml/?
Disallow /xhtml/search?
Disallow /xml?
Disallow /imode?
Disallow /imode/?
Disallow /imode/search?
Disallow /jsky?
Disallow /jsky/?
Disallow /jsky/search?
Disallow /pda?
Disallow /pda/?
Disallow /pda/search?
Disallow /sprint_xhtml
Disallow /sprint_wml
Disallow /pqa
Disallow /palm
Disallow /gwt/
Disallow /purchases
Disallow /local?
Disallow /local_url
Disallow /shihui?
Disallow /shihui/
Disallow /products?
Disallow /product_
Disallow /products_
Disallow /products%3B
Disallow /print
Disallow /books/
Disallow /bkshp?*q=*
Disallow /books?*q=*
Disallow /books?*output=*
Disallow /books?*pg=*
Disallow /books?*jtp=*
Disallow /books?*jscmd=*
Disallow /books?*buy=*
Disallow /books?*zoom=*
Allow /books?*q=related%3A*
Allow /books?*q=editions%3A*
Allow /books?*q=subject%3A*
Allow /books/about
Allow /booksrightsholders
Allow /books?*zoom=1*
Allow /books?*zoom=5*
Allow /books/content?*zoom=1*
Allow /books/content?*zoom=5*
Disallow /ebooks/
Disallow /ebooks?*q=*
Disallow /ebooks?*output=*
Disallow /ebooks?*pg=*
Disallow /ebooks?*jscmd=*
Disallow /ebooks?*buy=*
Disallow /ebooks?*zoom=*
Allow /ebooks?*q=related%3A*
Allow /ebooks?*q=editions%3A*
Allow /ebooks?*q=subject%3A*
Allow /ebooks?*zoom=1*
Allow /ebooks?*zoom=5*
Disallow /patents?
Disallow /patents/download/
Disallow /patents/pdf/
Disallow /patents/related/
Disallow /scholar
Disallow /citations?
Allow /citations?user=
Disallow /citations?*cstart=
Allow /citations?view_op=new_profile
Allow /citations?view_op=top_venues
Allow /scholar_share
Disallow /s?
Allow /maps?*output=classic*
Allow /maps?*file=
Allow /maps/api/js?
Allow /maps/d/
Disallow /maps?
Disallow /mapstt?
Disallow /mapslt?
Disallow /maps/stk/
Disallow /maps/br?
Disallow /mapabcpoi?
Disallow /maphp?
Disallow /mapprint?
Disallow /maps/api/js/
Disallow /maps/api/staticmap?
Disallow /maps/api/streetview
Disallow /mld?
Disallow /staticmap?
Disallow /maps/preview
Disallow /maps/place
Disallow /help/maps/streetview/partners/welcome/
Disallow /help/maps/indoormaps/partners/
Disallow /lochp?
Disallow /center
Disallow /ie?
Disallow /blogsearch/
Disallow /blogsearch_feeds
Disallow /advanced_blog_search
Disallow /uds/
Disallow /chart?
Disallow /transit?
Disallow /extern_js/
Disallow /xjs/
Disallow /calendar/feeds/
Disallow /calendar/ical/
Disallow /cl2/feeds/
Disallow /cl2/ical/
Disallow /coop/directory
Disallow /coop/manage
Disallow /trends?
Disallow /trends/music?
Disallow /trends/hottrends?
Disallow /trends/viz?
Disallow /trends/embed.js?
Disallow /trends/fetchComponent?
Disallow /trends/beta
Disallow /trends/topics
Disallow /musica
Disallow /musicad
Disallow /musicas
Disallow /musicl
Disallow /musics
Disallow /musicsearch
Disallow /musicsp
Disallow /musiclp
Disallow /urchin_test/
Disallow /movies?
Disallow /wapsearch?
Allow /safebrowsing/diagnostic
Allow /safebrowsing/report_badware/
Allow /safebrowsing/report_error/
Allow /safebrowsing/report_phish/
Disallow /reviews/search?
Disallow /orkut/albums
Disallow /cbk
Allow /cbk?output=tile&cb_client=maps_sv
Disallow /maps/api/js/AuthenticationService.Authenticate
Disallow /maps/api/js/QuotaService.RecordEvent
Disallow /recharge/dashboard/car
Disallow /recharge/dashboard/static/
Disallow /profiles/me
Allow /profiles
Disallow /s2/profiles/me
Allow /s2/profiles
Allow /s2/oz
Allow /s2/photos
Allow /s2/search/social
Allow /s2/static
Disallow /s2
Disallow /transconsole/portal/
Disallow /gcc/
Disallow /aclk
Disallow /cse?
Disallow /cse/home
Disallow /cse/panel
Disallow /cse/manage
Disallow /tbproxy/
Disallow /imesync/
Disallow /shenghuo/search?
Disallow /support/forum/search?
Disallow /reviews/polls/
Disallow /hosted/images/
Disallow /ppob/?
Disallow /ppob?
Disallow /accounts/ClientLogin
Disallow /accounts/ClientAuth
Disallow /accounts/o8
Allow /accounts/o8/id
Disallow /topicsearch?q=
Disallow /xfx7/
Disallow /squared/api
Disallow /squared/search
Disallow /squared/table
Disallow /qnasearch?
Disallow /app/updates
Disallow /sidewiki/entry/
Disallow /quality_form?
Disallow /labs/popgadget/search
Disallow /buzz/post
Disallow /compressiontest/
Disallow /analytics/feeds/
Disallow /analytics/partners/comments/
Disallow /analytics/portal/
Disallow /analytics/uploads/
Allow /alerts/manage
Allow /alerts/remove
Disallow /alerts/
Allow /alerts/$
Disallow /ads/search?
Disallow /ads/plan/action_plan?
Disallow /ads/plan/api/
Disallow /ads/hotels/partners
Disallow /phone/compare/?
Disallow /travel/clk
Disallow /hotelfinder/rpc
Disallow /hotels/rpc
Disallow /flights/rpc
Disallow /async/flights/
Disallow /commercesearch/services/
Disallow /evaluation/
Disallow /chrome/browser/mobile/tour
Disallow /compare/*/apply*
Disallow /forms/perks/
Disallow /shopping/suppliers/search
Disallow /ct/
Disallow /edu/cs4hs/
Disallow /trustedstores/s/
Disallow /trustedstores/tm2
Disallow /trustedstores/verify
Disallow /adwords/proposal
Disallow /shopping/product/
Disallow /shopping/seller
Disallow /shopping/reviewer
Disallow /about/careers/applications/
Disallow /landing/signout.html
Disallow /webmasters/sitemaps/ping?
Disallow /ping?
Disallow /gallery/
Disallow /landing/now/ontap/
Allow /searchhistory/
Allow /maps/reserve
Allow /maps/reserve/partners
Disallow /maps/reserve/api/
Disallow /maps/reserve/search
Disallow /maps/reserve/bookings
Disallow /maps/reserve/settings
Disallow /maps/reserve/manage
Disallow /maps/reserve/payment
Disallow /maps/reserve/receipt
Disallow /maps/reserve/sellersignup
Disallow /maps/reserve/payments
Disallow /maps/reserve/feedback
Disallow /maps/reserve/terms
Disallow /maps/reserve/m/
Disallow /maps/reserve/b/
Disallow /maps/reserve/partner-dashboard
Disallow /about/views/
Disallow /intl/*/about/views/
Disallow /local/dining/
Disallow /local/place/reviews/
Disallow /local/place/rap/
Disallow /local/tab/
Disallow /travel/hotels/
Allow /finance
Disallow /finance?*q=*

twitterbot

Rule Path
Allow /imgres

facebookexternalhit

Rule Path
Allow /imgres
Disallow /wp-includes/
Disallow /wp-login.php
Disallow /wp-admin/*
Disallow /wp-register.php
Disallow /wp-content/themes/icetea/includes/*
Disallow */tag/*
Disallow *?s=*
Disallow /search/*
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node/add/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /?q=user%2Flogout%2F
Disallow /
Disallow /search
Allow /search/about
Allow /search/static
Allow /search/howsearchworks
Disallow /sdch
Disallow /groups
Disallow /index.html?
Disallow /?
Allow /?hl=
Disallow /?hl=*&
Allow /?hl=*&gws_rd=ssl$
Disallow /?hl=*&*&gws_rd=ssl
Allow /?gws_rd=ssl$
Allow /?pt1=true$
Disallow /imgres
Disallow /u/
Disallow /preferences
Disallow /setprefs
Disallow /default
Disallow /m?
Disallow /m/
Allow /m/finance
Disallow /wml?
Disallow /wml/?
Disallow /wml/search?
Disallow /xhtml?
Disallow /xhtml/?
Disallow /xhtml/search?
Disallow /xml?
Disallow /imode?
Disallow /imode/?
Disallow /imode/search?
Disallow /jsky?
Disallow /jsky/?
Disallow /jsky/search?
Disallow /pda?
Disallow /pda/?
Disallow /pda/search?
Disallow /sprint_xhtml
Disallow /sprint_wml
Disallow /pqa
Disallow /palm
Disallow /gwt/
Disallow /purchases
Disallow /local?
Disallow /local_url
Disallow /shihui?
Disallow /shihui/
Disallow /products?
Disallow /product_
Disallow /products_
Disallow /products%3B
Disallow /print
Disallow /books/
Disallow /bkshp?*q=*
Disallow /books?*q=*
Disallow /books?*output=*
Disallow /books?*pg=*
Disallow /books?*jtp=*
Disallow /books?*jscmd=*
Disallow /books?*buy=*
Disallow /books?*zoom=*
Allow /books?*q=related%3A*
Allow /books?*q=editions%3A*
Allow /books?*q=subject%3A*
Allow /books/about
Allow /booksrightsholders
Allow /books?*zoom=1*
Allow /books?*zoom=5*
Allow /books/content?*zoom=1*
Allow /books/content?*zoom=5*
Disallow /ebooks/
Disallow /ebooks?*q=*
Disallow /ebooks?*output=*
Disallow /ebooks?*pg=*
Disallow /ebooks?*jscmd=*
Disallow /ebooks?*buy=*
Disallow /ebooks?*zoom=*
Allow /ebooks?*q=related%3A*
Allow /ebooks?*q=editions%3A*
Allow /ebooks?*q=subject%3A*
Allow /ebooks?*zoom=1*
Allow /ebooks?*zoom=5*
Disallow /patents?
Disallow /patents/download/
Disallow /patents/pdf/
Disallow /patents/related/
Disallow /scholar
Disallow /citations?
Allow /citations?user=
Disallow /citations?*cstart=
Allow /citations?view_op=new_profile
Allow /citations?view_op=top_venues
Allow /scholar_share
Disallow /s?
Allow /maps?*output=classic*
Allow /maps?*file=
Allow /maps/api/js?
Allow /maps/d/
Disallow /maps?
Disallow /mapstt?
Disallow /mapslt?
Disallow /maps/stk/
Disallow /maps/br?
Disallow /mapabcpoi?
Disallow /maphp?
Disallow /mapprint?
Disallow /maps/api/js/
Disallow /maps/api/staticmap?
Disallow /maps/api/streetview
Disallow /mld?
Disallow /staticmap?
Disallow /maps/preview
Disallow /maps/place
Disallow /help/maps/streetview/partners/welcome/
Disallow /help/maps/indoormaps/partners/
Disallow /lochp?
Disallow /center
Disallow /ie?
Disallow /blogsearch/
Disallow /blogsearch_feeds
Disallow /advanced_blog_search
Disallow /uds/
Disallow /chart?
Disallow /transit?
Disallow /extern_js/
Disallow /xjs/
Disallow /calendar/feeds/
Disallow /calendar/ical/
Disallow /cl2/feeds/
Disallow /cl2/ical/
Disallow /coop/directory
Disallow /coop/manage
Disallow /trends?
Disallow /trends/music?
Disallow /trends/hottrends?
Disallow /trends/viz?
Disallow /trends/embed.js?
Disallow /trends/fetchComponent?
Disallow /trends/beta
Disallow /trends/topics
Disallow /musica
Disallow /musicad
Disallow /musicas
Disallow /musicl
Disallow /musics
Disallow /musicsearch
Disallow /musicsp
Disallow /musiclp
Disallow /urchin_test/
Disallow /movies?
Disallow /wapsearch?
Allow /safebrowsing/diagnostic
Allow /safebrowsing/report_badware/
Allow /safebrowsing/report_error/
Allow /safebrowsing/report_phish/
Disallow /reviews/search?
Disallow /orkut/albums
Disallow /cbk
Allow /cbk?output=tile&cb_client=maps_sv
Disallow /maps/api/js/AuthenticationService.Authenticate
Disallow /maps/api/js/QuotaService.RecordEvent
Disallow /recharge/dashboard/car
Disallow /recharge/dashboard/static/
Disallow /profiles/me
Allow /profiles
Disallow /s2/profiles/me
Allow /s2/profiles
Allow /s2/oz
Allow /s2/photos
Allow /s2/search/social
Allow /s2/static
Disallow /s2
Disallow /transconsole/portal/
Disallow /gcc/
Disallow /aclk
Disallow /cse?
Disallow /cse/home
Disallow /cse/panel
Disallow /cse/manage
Disallow /tbproxy/
Disallow /imesync/
Disallow /shenghuo/search?
Disallow /support/forum/search?
Disallow /reviews/polls/
Disallow /hosted/images/
Disallow /ppob/?
Disallow /ppob?
Disallow /accounts/ClientLogin
Disallow /accounts/ClientAuth
Disallow /accounts/o8
Allow /accounts/o8/id
Disallow /topicsearch?q=
Disallow /xfx7/
Disallow /squared/api
Disallow /squared/search
Disallow /squared/table
Disallow /qnasearch?
Disallow /app/updates
Disallow /sidewiki/entry/
Disallow /quality_form?
Disallow /labs/popgadget/search
Disallow /buzz/post
Disallow /compressiontest/
Disallow /analytics/feeds/
Disallow /analytics/partners/comments/
Disallow /analytics/portal/
Disallow /analytics/uploads/
Allow /alerts/manage
Allow /alerts/remove
Disallow /alerts/
Allow /alerts/$
Disallow /ads/search?
Disallow /ads/plan/action_plan?
Disallow /ads/plan/api/
Disallow /ads/hotels/partners
Disallow /phone/compare/?
Disallow /travel/clk
Disallow /hotelfinder/rpc
Disallow /hotels/rpc
Disallow /flights/rpc
Disallow /async/flights/
Disallow /commercesearch/services/
Disallow /evaluation/
Disallow /chrome/browser/mobile/tour
Disallow /compare/*/apply*
Disallow /forms/perks/
Disallow /shopping/suppliers/search
Disallow /ct/
Disallow /edu/cs4hs/
Disallow /trustedstores/s/
Disallow /trustedstores/tm2
Disallow /trustedstores/verify
Disallow /adwords/proposal
Disallow /shopping/product/
Disallow /shopping/seller
Disallow /shopping/reviewer
Disallow /about/careers/applications/
Disallow /landing/signout.html
Disallow /webmasters/sitemaps/ping?
Disallow /ping?
Disallow /gallery/
Disallow /landing/now/ontap/
Allow /searchhistory/
Allow /maps/reserve
Allow /maps/reserve/partners
Disallow /maps/reserve/api/
Disallow /maps/reserve/search
Disallow /maps/reserve/bookings
Disallow /maps/reserve/settings
Disallow /maps/reserve/manage
Disallow /maps/reserve/payment
Disallow /maps/reserve/receipt
Disallow /maps/reserve/sellersignup
Disallow /maps/reserve/payments
Disallow /maps/reserve/feedback
Disallow /maps/reserve/terms
Disallow /maps/reserve/m/
Disallow /maps/reserve/b/
Disallow /maps/reserve/partner-dashboard
Disallow /about/views/
Disallow /intl/*/about/views/
Disallow /local/dining/
Disallow /local/place/reviews/
Disallow /local/place/rap/
Disallow /local/tab/
Disallow /travel/hotels/
Allow /finance
Disallow /finance?*q=*
Disallow /admin/
Disallow /search/
Disallow /includes/
Disallow /modules/
Disallow /xmlrpc.php
Disallow /search
Disallow /LICENSE.txt
Disallow /scripts/
Disallow /cron.php
Disallow /themes/
Disallow /images/
Disallow /install.php
Disallow /profiles/
Disallow /api/
Disallow /misc/
Disallow /comment/reply/
Disallow /node/add/
Disallow /user/password/
Disallow /user/login/
Disallow /user/register/
Disallow /cache/
Disallow /update.php
Disallow /CHANGELOG.txt
Disallow /MAINTAINERS.txt
Disallow /UPGRADE.txt
Disallow /INSTALL.txt
Disallow /INSTALL.pgsql.txt
Disallow /INSTALL.mysql.txt
Disallow /templates/
Disallow /filter/tips/
Disallow /js/
Disallow /search.php
Disallow /install/
Disallow /plugins/
Disallow /user/
Disallow /user/logout/
Disallow /INSTALL.sqlite.txt
Disallow /tmp/
Disallow /tag/
Disallow /language/
Disallow /admin
Disallow /logs/
Disallow /data/
Disallow /ajax/
Disallow /admin.php
Disallow /administrator/
Disallow /media/
Disallow /bin/
Disallow /libraries/
Disallow /components/
Disallow /installation/
Disallow /template/
Disallow /config/
Disallow /static/
Disallow /css/
Disallow /misc.php
Disallow /member.php
Disallow /login/
Disallow /login
Disallow /checkout/
Disallow /trackback/
Disallow /backup/
Disallow /api.php
Disallow /test/
Disallow /login.php
Disallow /feed/
Disallow /cli/
Disallow /logout/
Disallow /source/
Disallow /languages/
Disallow /page/
Disallow /connect.php
Disallow /readme.html
Disallow /lib/
Disallow /libs/
Disallow /account
Disallow /trackback
Disallow /statistics.html
Disallow /go/
Disallow /account/
Disallow /include/
Disallow /checkout
Disallow /internal/
Disallow /index.php
Disallow /app/
Disallow /newposts/
Disallow /live/
Disallow /include
Disallow /3rdparty/
Disallow /api
Disallow /engine/go.php
Disallow /today/
Disallow /recent/
Disallow /img/
Disallow /m/
Disallow /files/
Disallow /week/
Disallow /year/
Disallow /searchurl/
Disallow /nullze/
Back to top

Other Records

Field Value
sitemap https://cylect.io/sitemap.xml
Back to top

Comments

  • cylect.io robots.txt
Back to top

Warnings

  • 2 invalid lines.
Back to top