universia.net
robots.txt

Robots Exclusion Standard data for universia.net

Resource Scan

Scan Details

Site Domain universia.net
Base Domain universia.net
Scan Status Ok
Last Scan2024-05-17T23:25:47+00:00
Next Scan 2024-05-24T23:25:47+00:00

Last Scan

Scanned2024-05-17T23:25:47+00:00
URL https://universia.net/robots.txt
Redirect https://www.universia.net:443/robots.txt
Redirect Domain www.universia.net
Redirect Base universia.net
Domain IPs 45.223.160.57, 45.223.180.57
Redirect IPs 45.223.168.57
Response IP 45.223.168.57
Found Yes
Hash f4679b70a8a74ed09cab36996e2bba2c73f736bc5021663bc177f43bfdab631e
SimHash 198cd054c151

Groups

*

Rule Path
Allow /
Disallow *.pdf
Disallow *.model.json
Disallow *.model.json/
Disallow /es/lifelong-learning/landings/
Disallow /media/abre-tus-sentidos/
Disallow /content/dam/universia/abre-tus-sentidos/

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.universia.net/sitemap.xml
sitemap https://www.universia.net/es/sitemap.xml
sitemap https://www.universia.net/pt/sitemap.xml
sitemap https://www.universia.net/ar/sitemap.xml
sitemap https://www.universia.net/br/sitemap.xml
sitemap https://www.universia.net/cl/sitemap.xml
sitemap https://www.universia.net/co/sitemap.xml
sitemap https://www.universia.net/ec/sitemap.xml
sitemap https://www.universia.net/mx/sitemap.xml
sitemap https://www.universia.net/pe/sitemap.xml
sitemap https://www.universia.net/uy/sitemap.xml

Comments

  • Sitemap files