Log In Sign Up

extraverti.com
robots.txt

Robots Exclusion Standard data for extraverti.com

Resource Scan

Scan Details

Site Domain extraverti.com
Base Domain extraverti.com
Scan Status Ok
Last Scan2025-10-05T06:10:57+00:00
Next Scan 2025-10-12T06:10:57+00:00

Last Scan

Scanned2025-10-05T06:10:57+00:00
URL https://extraverti.com/robots.txt
Redirect https://www.extraverti.com/robots.txt
Redirect Domain www.extraverti.com
Redirect Base extraverti.com
Domain IPs 2a00:7ee0:9:3:60:1:0:8c, 91.234.194.199
Redirect IPs 2a00:7ee0:9:3:60:1:0:8c, 91.234.194.199
Response IP 91.234.194.199
Found Yes
Hash 0e8813a624804d0bfe6daa441c6a0e980038980d6b8a578df92fdc9e87ce7acc
SimHash 6a70e89075b3

Groups

*

Rule Path
Allow /sitemap.xml
Disallow /production-audiovisuelle/video-pro/

googlebot

Rule Path
Allow /
Disallow /production-audiovisuelle/video-pro/

googlebot-image

Rule Path
Allow /

bingbot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /
Allow /sitemap.xml
Disallow /production-audiovisuelle/video-pro/

slurp

Rule Path
Allow /
Disallow /production-audiovisuelle/video-pro/

acunetix

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.extraverti.com/sitemap-17.11.2024.xml
Back to top

Comments

  • Autoriser Googlebot
  • Autoriser les bots d'images
  • Autoriser les crawlers mobiles
  • Autoriser Bingbot (règle explicite)
  • Autoriser Yahoo Slurp
  • Exclure les bots problématiques connus
Back to top

Warnings

  • 2 invalid lines.
Back to top