civitai.green
robots.txt

Robots Exclusion Standard data for civitai.green

Resource Scan

Scan Details

Site Domain civitai.green
Base Domain civitai.green
Scan Status Ok
Last Scan2024-09-15T10:00:23+00:00
Next Scan 2024-09-22T10:00:23+00:00

Last Scan

Scanned2024-09-15T10:00:23+00:00
URL https://civitai.green/robots.txt
Domain IPs 104.21.82.166, 172.67.159.210, 2606:4700:3036::6815:52a6, 2606:4700:3036::ac43:9fd2
Response IP 104.21.82.166
Found Yes
Hash f4fe7759e0836d368f3a002fadcb50559a1bb49974a9999e386c7726121b5e58
SimHash 7725cc65c796

Groups

*

Rule Path
Allow /api/trpc/*
Disallow /*/create
Disallow /api/*
Disallow /discord/*
Disallow /dmca/*
Disallow /intent/*
Disallow /models/train
Disallow /moderator/*
Disallow /payment/*
Disallow /redirect
Disallow /search/*
Disallow /testing/*
Disallow /user/account
Disallow /user/downloads
Disallow /user/notifications
Disallow /user/transactions
Disallow /user/buzz-dashboard
Disallow /user/vault

Other Records

Field Value
sitemap https://civitai.com/sitemap.xml
sitemap https://civitai.com/sitemap-articles.xml
sitemap https://civitai.com/sitemap-models.xml
sitemap https://civitai.com/sitemap-questions.xml

Comments

  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.