cosmosfactory.net
robots.txt

Robots Exclusion Standard data for cosmosfactory.net

Resource Scan

Scan Details

Site Domain cosmosfactory.net
Base Domain cosmosfactory.net
Scan Status Ok
Last Scan2025-09-03T11:03:08+00:00
Next Scan 2025-09-04T11:03:08+00:00

Last Scan

Scanned2025-09-03T11:03:08+00:00
URL https://cosmosfactory.net/robots.txt
Domain IPs 104.21.93.4, 172.67.201.216, 2606:4700:3034::6815:5d04, 2606:4700:3037::ac43:c9d8
Response IP 104.21.93.4
Found Yes
Hash c5cc4d29136f65a8c3679c20625cef3058f657f1d4cdcb2c8e0273f6ad67c207
SimHash c05dc01ceb36

Groups

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 300

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 300

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 300

semrushbot-desktop

Rule Path
Disallow

camofed

Rule Path
Allow /.well-known/
Allow /%40blog
Allow /wp-json/
Allow /wp-json/activitypub/

mastodon

Rule Path
Allow /.well-known/
Allow /%40blog
Allow /wp-json/
Allow /wp-json/activitypub/

lemmy

Rule Path
Allow /.well-known/
Allow /%40blog
Allow /wp-json/
Allow /wp-json/activitypub/

pleroma

Rule Path
Allow /.well-known/
Allow /%40blog
Allow /wp-json/
Allow /wp-json/activitypub/

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /feed/
Allow /.well-known/
Allow /%40blog
Allow /wp-json/
Allow /wp-json/activitypub/

Other Records

Field Value
crawl-delay 300

Comments

  • ⚡️ Permitir el Fediverso (ActivityPub, Mastodon, Lemmy, etc.)
  • 🦾 Permitir a servidores Fediverso acceder al perfil y entradas