Log In Sign Up

univadis.it
robots.txt

Robots Exclusion Standard data for univadis.it

Resource Scan

Scan Details

Site Domain univadis.it
Base Domain univadis.it
Scan Status Ok
Last Scan2025-09-02T18:42:31+00:00
Next Scan 2025-09-09T18:42:31+00:00

Last Scan

Scanned2025-09-02T18:42:31+00:00
URL https://univadis.it/robots.txt
Redirect https://www.univadis.it/robots.txt
Redirect Domain www.univadis.it
Redirect Base univadis.it
Domain IPs 104.21.77.4, 172.67.202.195, 2606:4700:3033::6815:4d04, 2606:4700:3035::ac43:cac3
Redirect IPs 104.21.77.4, 172.67.202.195, 2606:4700:3033::6815:4d04, 2606:4700:3035::ac43:cac3
Response IP 104.21.77.4
Found Yes
Hash cea695f192df78d2ea42d5d7505ca7960be459d78a7aa09ecafe71a50cca5750
SimHash 5b0cad46af92

Groups

*

Rule Path
Disallow /login*
Disallow /register*
Disallow /viewarticle/s/*
Disallow /s/*

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.univadis.it/sitemap-index.xml
Back to top

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
Back to top