artlabs.ai
robots.txt

Robots Exclusion Standard data for artlabs.ai

Resource Scan

Scan Details

Site Domain artlabs.ai
Base Domain artlabs.ai
Scan Status Ok
Last Scan2025-10-28T09:35:40+00:00
Next Scan 2025-11-27T09:35:40+00:00

Last Scan

Scanned2025-10-28T09:35:40+00:00
URL https://artlabs.ai/robots.txt
Domain IPs 104.26.6.104, 104.26.7.104, 172.67.74.136, 2606:4700:20::681a:668, 2606:4700:20::681a:768, 2606:4700:20::ac43:4a88
Response IP 104.26.6.104
Found Yes
Hash 183728be012e49c4db9e5830b5518d0fb198ea09d8da0c270a3fbfd79643549b
SimHash 63153336e591

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /preview/
Disallow /staging/
Disallow /search
Disallow /*?replytocom=
Disallow /*?sessionid=
Disallow /_nuxt/
Disallow /cdn-cgi/
Disallow /api/
Disallow /temp/
Disallow /cache/
Disallow /blog/tag/
Disallow /images/
Disallow /comments/
Allow /blog/
Allow /3d-ecommerce/
Allow /virtual-try-on/
Allow /platform/
Allow /about-us/
Allow /contact/
Allow /augmented-reality/

gptbot

Rule Path
Allow /

ccbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

claudebot

Rule Path
Allow /

bard

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

searchgpt

Rule Path
Allow /

you-bot

Rule Path
Allow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

*

Rule Path
Disallow /_nuxt/
Disallow /blog/tag/
Disallow /images/
Disallow /comments/
Disallow /user-agreement/
Disallow /company/
Disallow /our-solutions/
Disallow /cdn-cgi/
Disallow /privacy-policy/
Allow /

Other Records

Field Value
sitemap https
sitemap https
sitemap https
sitemap https
sitemap https://artlabs.ai/sitemap_index.xml