Log In Sign Up

cedmax.net
robots.txt

Robots Exclusion Standard data for cedmax.net

Resource Scan

Scan Details

Site Domain cedmax.net
Base Domain cedmax.net
Scan Status Ok
Last Scan2025-08-25T11:24:06+00:00
Next Scan 2025-09-24T11:24:06+00:00

Last Scan

Scanned2025-08-25T11:24:06+00:00
URL https://cedmax.net/robots.txt
Domain IPs 104.21.0.141, 172.67.128.17, 2606:4700:3034::ac43:8011, 2606:4700:3035::6815:8d
Response IP 172.67.128.17
Found Yes
Hash 1d86b2fece54d5d10b0d799d5ef69bb148a641dabbfc79069cd7dff242c1baf7
SimHash 598d3f330e95

Groups

a360-search

Rule Path
Disallow /

activecomply

Rule Path
Disallow /

adagiobot

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /

adsbot-google-mobile

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

amazon adbot

Rule Path
Disallow /

amazonadbot

Rule Path
Disallow /

anderspinkbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

archivebot

Rule Path
Disallow /

awario

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

bigupdatabot

Rule Path
Disallow /

bing ads

Rule Path
Disallow /

bitsightbot

Rule Path
Disallow /

blackboard

Rule Path
Disallow /

brandverity

Rule Path
Disallow /

brightedge bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

channable

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

cloudvertexbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

cohere-training-data-crawler

Rule Path
Disallow /

contxbot

Rule Path
Disallow /

cotoyogi

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

cxensebot

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

datenbank crawler

Rule Path
Disallow /

dcrawl

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

echobot bot

Rule Path
Disallow /

epivozcrawler

Rule Path
Disallow /

ev-crawler

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

factset_spyderbot

Rule Path
Disallow /

fdl stats bot

Rule Path
Disallow /

google adsbot

Rule Path
Disallow /

google adsense

Rule Path
Disallow /

google-adwords-instant

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

googleother

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

groovinaadsbot

Rule Path
Disallow /

helloworkjobpostingbot

Rule Path
Disallow /

httrack

Rule Path
Disallow /

httrack 3.0

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

indeedjobbot

Rule Path
Disallow /

innguma

Rule Path
Disallow /

interactiveadvertisingbureau

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

jugendschutzprogramm-crawler

Rule Path
Disallow /

kangaroo bot

Rule Path
Disallow /

klaviyo

Rule Path
Disallow /

kstandbot

Rule Path
Disallow /

leikibot

Rule Path
Disallow /

lightspeedsystemscrawler

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

macrobondbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

medialogiabot

Rule Path
Disallow /

mediamonitoringbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

mediavine medatada parser

Rule Path
Disallow /

mediavinemetadataparser

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

metainspector

Rule Path
Disallow /

mgidbot

Rule Path
Disallow /

missinglettr bot

Rule Path
Disallow /

muckrack

Rule Path
Disallow /

netcraft

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

netestate imprint crawler

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

netvibes

Rule Path
Disallow /

newspaper

Rule Path
Disallow /

nutch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

omgili

Rule Path
Disallow /

openindexspider

Rule Path
Disallow /

outbrain

Rule Path
Disallow /

page-preview-tool

Rule Path
Disallow /

pandalytics

Rule Path
Disallow /

pangubot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

potions

Rule Path
Disallow /

proximic

Rule Path
Disallow /

quantcastbot

Rule Path
Disallow /

retrolistecom

Rule Path
Disallow /

salesviewerbot

Rule Path
Disallow /

scoop.it

Rule Path
Disallow /

scraping@nytimes.com

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

serverhunterspider

Rule Path
Disallow /

slickbot

Rule Path
Disallow /

slickstream

Rule Path
Disallow /

smartologybot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

statistikaustria

Rule Path
Disallow /

statsdronebot

Rule Path
Disallow /

taboola

Rule Path
Disallow /

taboolabot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

trendsmapresolver

Rule Path
Disallow /

ttd-content

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

twingly

Rule Path
Disallow /

um-ln

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

virustotal

Rule Path
Disallow /

webspidermount

Rule Path
Disallow /

webzio

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

yahoo ad monitoring

Rule Path
Disallow /

yahoo japan

Rule Path
Disallow /

yext inc

Rule Path
Disallow /

yextbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

*

Rule Path
Disallow /404/
Disallow /p/
Disallow /private/

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://cedmax.net/sitemap-index.xml
Back to top

Comments

  • Scraper
  • https://darkvisitors.com/agents/008
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/a360-search
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/activecomply
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/adagiobot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/adbeat-bot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/adidxbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/adsbot-google
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/adsbot-google-mobile
  • AI Data Scraper
  • https://darkvisitors.com/agents/ai2bot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/aihitbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/amazon-adbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/amazonadbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/anderspinkbot
  • Undocumented AI Agent
  • https://darkvisitors.com/agents/anthropic-ai
  • AI Data Scraper
  • https://darkvisitors.com/agents/applebot-extended
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/archivebot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/awario
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/awariobot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/awariosmartbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/bigupdatabot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/bing-ads
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/bitsightbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/blackboard
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/brandverity
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/brightedge-bot
  • AI Data Scraper
  • https://darkvisitors.com/agents/bytespider
  • AI Data Scraper
  • https://darkvisitors.com/agents/ccbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/channable
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/cincraw
  • Undocumented AI Agent
  • https://darkvisitors.com/agents/claude-web
  • AI Data Scraper
  • https://darkvisitors.com/agents/claudebot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/clickagy-intelligence-bot-v2
  • AI Data Scraper
  • https://darkvisitors.com/agents/cloudvertexbot
  • Undocumented AI Agent
  • https://darkvisitors.com/agents/cohere-ai
  • AI Data Scraper
  • https://darkvisitors.com/agents/cohere-training-data-crawler
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/contxbot
  • AI Data Scraper
  • https://darkvisitors.com/agents/cotoyogi
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/criteobot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/cxensebot
  • Scraper
  • https://darkvisitors.com/agents/dataprovider-com
  • AI Data Scraper
  • https://darkvisitors.com/agents/datenbank-crawler
  • Scraper
  • https://darkvisitors.com/agents/dcrawl
  • AI Data Scraper
  • https://darkvisitors.com/agents/diffbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/echobot-bot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/epivozcrawler
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/ev-crawler
  • AI Data Scraper
  • https://darkvisitors.com/agents/facebookbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/factset-spyderbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/fdl-stats-bot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/google-adsbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/google-adsense
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/google-adwords-instant
  • AI Data Scraper
  • https://darkvisitors.com/agents/google-extended
  • AI Data Scraper
  • https://darkvisitors.com/agents/googleother
  • AI Data Scraper
  • https://darkvisitors.com/agents/gptbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/grapeshotcrawler
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/groovinaadsbot
  • Scraper
  • https://darkvisitors.com/agents/helloworkjobpostingbot
  • Scraper
  • https://darkvisitors.com/agents/httrack
  • Scraper
  • https://darkvisitors.com/agents/httrack-3-0
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/hubspot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/ias-crawler
  • AI Data Scraper
  • https://darkvisitors.com/agents/icc-crawler
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/imagesiftbot
  • Scraper
  • https://darkvisitors.com/agents/indeedjobbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/innguma
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/interactiveadvertisingbureau
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/ioncrawl
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/jugendschutzprogramm-crawler
  • AI Data Scraper
  • https://darkvisitors.com/agents/kangaroo-bot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/klaviyo
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/kstandbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/leikibot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/lightspeedsystemscrawler
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/linkfluence
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/linkwalker
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/macrobondbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/magpie-crawler
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/medialogiabot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/mediamonitoringbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/mediapartners-google
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/mediatoolkitbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/mediavine-medatada-parser
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/mediavinemetadataparser
  • AI Data Scraper
  • https://darkvisitors.com/agents/meta-externalagent
  • Scraper
  • https://darkvisitors.com/agents/metainspector
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/mgidbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/missinglettr-bot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/muckrack
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/netcraft
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/netcraftsurveyagent
  • AI Data Scraper
  • https://darkvisitors.com/agents/netestate-imprint-crawler
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/netestate-ne-crawler
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/netvibes
  • Scraper
  • https://darkvisitors.com/agents/newspaper
  • Scraper
  • https://darkvisitors.com/agents/nutch
  • Scraper
  • https://darkvisitors.com/agents/offline-explorer
  • AI Data Scraper
  • https://darkvisitors.com/agents/omgili
  • Scraper
  • https://darkvisitors.com/agents/openindexspider
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/outbrain
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/page-preview-tool
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/pandalytics
  • AI Data Scraper
  • https://darkvisitors.com/agents/pangubot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/panscient-com
  • Scraper
  • https://darkvisitors.com/agents/potions
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/proximic
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/quantcastbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/retrolistecom
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/salesviewerbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/scoop-it
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/scrapingnytimes-com
  • Scraper
  • https://darkvisitors.com/agents/scrapy
  • Scraper
  • https://darkvisitors.com/agents/serverhunterspider
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/slickbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/slickstream
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/smartologybot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/smtbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/statistikaustria
  • Scraper
  • https://darkvisitors.com/agents/statsdronebot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/taboola
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/taboolabot
  • AI Data Scraper
  • https://darkvisitors.com/agents/timpibot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/trendictionbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/trendsmapresolver
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/ttd-content
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/turnitinbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/tweetmemebot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/twingly
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/um-ln
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/velenpublicwebcrawler
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/virustotal
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/webspidermount
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/webzio
  • AI Data Scraper
  • https://darkvisitors.com/agents/webzio-extended
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/yahoo-ad-monitoring
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/yahoo-japan
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/yext-inc
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/yextbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/zoominfobot
Back to top

Warnings

  • 2 invalid lines.
Back to top