ajuntamentdegironella.entradium.com
robots.txt

Robots Exclusion Standard data for ajuntamentdegironella.entradium.com

Resource Scan

Scan Details

Site Domain ajuntamentdegironella.entradium.com
Base Domain entradium.com
Scan Status Ok
Last Scan2024-10-24T09:46:09+00:00
Next Scan 2024-11-23T09:46:09+00:00

Last Scan

Scanned2024-10-24T09:46:09+00:00
URL https://ajuntamentdegironella.entradium.com/robots.txt
Domain IPs 54.155.41.15
Response IP 54.155.41.15
Found Yes
Hash 155847b7339c1c4f94f0025886527bc441a760bff3055c402f3d5ba3057e5c6e
SimHash 1b54ddc66460

Groups

*

Rule Path
Disallow /*/tag*
Disallow /es/tag*
Disallow /gl/tag*
Disallow /ca/tag*
Disallow /eu/tag*
Disallow /pt/tag*
Disallow /en/tag*
Disallow /de/tag*
Disallow /it/tag*

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

googlebot

Rule Path
Disallow /*/tag*
Disallow /es/tag*
Disallow /gl/tag*
Disallow /ca/tag*
Disallow /eu/tag*
Disallow /pt/tag*
Disallow /en/tag*
Disallow /de/tag*
Disallow /it/tag*

Comments

  • ALLOW ROBOTS