vidmateapp.cc
robots.txt

Robots Exclusion Standard data for vidmateapp.cc

Resource Scan

Scan Details

Site Domain vidmateapp.cc
Base Domain vidmateapp.cc
Scan Status Ok
Last Scan2025-10-04T00:33:54+00:00
Next Scan 2025-10-11T00:33:54+00:00

Last Scan

Scanned2025-10-04T00:33:54+00:00
URL https://vidmateapp.cc/robots.txt
Redirect https://www.vidmateapp.cc/robots.txt
Redirect Domain www.vidmateapp.cc
Redirect Base vidmateapp.cc
Domain IPs 104.21.57.159, 172.67.164.168, 2606:4700:3031::ac43:a4a8, 2606:4700:3037::6815:399f
Redirect IPs 104.21.57.159, 172.67.164.168, 2606:4700:3031::ac43:a4a8, 2606:4700:3037::6815:399f
Response IP 172.67.164.168
Found Yes
Hash 10ad8d56388a9e8557b6e9cf36768d123a752f583a0c08473ad593d3d77b429e
SimHash 6f08b8b1c1b6

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /_next/
Disallow /admin/

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

gptbot
chatgpt-user
claude-web
anthropic-ai
googlebot
google-extended
googleother
bingbot
perplexitybot
ccbot
duckassistbot
youbot
bard
coherebot
huggingfacebot
stabilitybot
midjourneybot
dall-e-bot
characterai-bot
replikabot
jasperbot
copyai-bot
writesonicbot
rytrbot
wordtunebot
grammarlybot
quillbot
deepl-bot
deepai-bot
deepseekbot
deepmindbot
deepbrainbot
deepcodebot
deeplensbot
deepspeechbot
deepstackbot
deepthoughtbot
deepvisionbot
deepwriterbot
deepzenbot

Rule Path
Allow /llms.txt
Allow /llms-full.txt
Allow /blog/
Allow /products/
Allow /about/

Other Records

Field Value
sitemap https://vidmateapp.cc/sitemap.xml

Comments

  • Sitemaps
  • Crawl-delay
  • Disallow certain paths
  • Allow specific bots
  • AI rule
  • OpenAI
  • Anthropic
  • Google
  • Microsoft
  • Other AI
  • AI Allow