Log In Sign Up

cvtfile.com
robots.txt

Robots Exclusion Standard data for cvtfile.com

Resource Scan

Scan Details

Site Domain cvtfile.com
Base Domain cvtfile.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-09-04T19:36:04+00:00
Next Scan 2025-10-04T19:36:04+00:00

Last Successful Scan

Scanned2025-08-06T16:08:34+00:00
URL https://cvtfile.com/robots.txt
Domain IPs 138.199.24.219
Response IP 138.199.46.68
Found Yes
Hash 60bab87cfc508cdc6c8a6cc7efa130f192c352fccaf26b188816239ed103f8e3
SimHash 811542707d02

Groups

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

hyscore

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

musobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

qwantify/bleriot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

hubspot crawler

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

*

Rule Path
Allow /

bingbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://cvtfile.com/sitemap.xml
Back to top