cbeditz.com
robots.txt

Robots Exclusion Standard data for cbeditz.com

Resource Scan

Scan Details

Site Domain cbeditz.com
Base Domain cbeditz.com
Scan Status Ok
Last Scan2025-09-20T15:38:44+00:00
Next Scan 2025-09-27T15:38:44+00:00

Last Scan

Scanned2025-09-20T15:38:44+00:00
URL https://cbeditz.com/robots.txt
Domain IPs 104.21.73.28, 172.67.137.250, 2606:4700:3032::6815:491c, 2606:4700:3036::ac43:89fa
Response IP 104.21.73.28
Found Yes
Hash b3563172f17790de914df31959c2e90a53078a2926cd8f2472ebee5908b15360
SimHash 091557f06f13

Groups

*

Rule Path
Allow /
Disallow /download/
Disallow /ajax/
Disallow /tags/
Disallow /index.php/
Disallow /colors/
Disallow /*page%3D
Disallow /cameras
Disallow /*/following
Disallow /*/followers
Disallow /collection
Disallow /?slug=

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

hyscore

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

musobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

qwantify/bleriot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

hubspot crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cbeditz.com/subcat.xml
sitemap https://cbeditz.com/images-sitemaps.xml
sitemap https://cbeditz.com/sitemaps-cat.xml
sitemap https://cbeditz.com/subgallery.xml