universes.art
robots.txt

Robots Exclusion Standard data for universes.art

Resource Scan

Scan Details

Site Domain universes.art
Base Domain universes.art
Scan Status Ok
Last Scan2025-11-25T00:47:53+00:00
Next Scan 2025-12-02T00:47:53+00:00

Last Scan

Scanned2025-11-25T00:47:53+00:00
URL https://universes.art/robots.txt
Domain IPs 2a00:1169:103:4de0::, 92.204.236.159
Response IP 92.204.236.159
Found Yes
Hash 85f8f219b177a39e6f8cf340f5c145cbf716512f171e386edc73eb3bcb1bd7d8
SimHash 3a59f9246893

Groups

*

Rule Path
Disallow /typo3conf/ext/armuiu/
Disallow /typo3/
Disallow /es/nafas/
Disallow /dbbackup/
Disallow /ar/nafas/editorial
Disallow /ar/art-destinations/
Disallow /ar/biennials/
Disallow /ar/specials/
Disallow /ar/magazine/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://universes.art/en/?type=1533906435
sitemap https://universes.art/de/?type=1533906435
sitemap https://universes.art/es/?type=1533906435