autosvalls.com
robots.txt

Robots Exclusion Standard data for autosvalls.com

Resource Scan

Scan Details

Site Domain autosvalls.com
Base Domain autosvalls.com
Scan Status Ok
Last Scan2024-05-04T09:20:02+00:00
Next Scan 2024-06-03T09:20:02+00:00

Last Scan

Scanned2024-05-04T09:20:02+00:00
URL https://autosvalls.com/robots.txt
Redirect https://www.autosvalls.com/robots.txt
Redirect Domain www.autosvalls.com
Redirect Base autosvalls.com
Domain IPs 104.26.8.148, 104.26.9.148, 172.67.69.62, 2606:4700:20::681a:894, 2606:4700:20::681a:994, 2606:4700:20::ac43:453e
Redirect IPs 104.26.8.148, 104.26.9.148, 172.67.69.62, 2606:4700:20::681a:894, 2606:4700:20::681a:994, 2606:4700:20::ac43:453e
Response IP 104.26.8.148
Found Yes
Hash e2a0ce854fdf30e9dab22fe1467bc6ca60f3a6ed8ce71d388bdfe537abb1671a
SimHash 2abc19d0992a

Groups

*

Rule Path
Allow /
Allow /comprar/
Disallow /wp-admin/
Disallow /wp-admin/admin-ajax.php
Disallow /search.php
Disallow /fr/wp-json/
Disallow /en/wp-json/
Disallow /de/wp-json/
Disallow /ru/wp-json/
Disallow /sv/wp-json/
Disallow /view.grid
Disallow /?view=grid
Disallow /?view=list
Disallow /wp-json/
Disallow /*.html$
Disallow *.html$
Disallow *?share=*
Disallow /wp-json/oembed/1.0/embed?url=*
Disallow /alertas/
Disallow /wp-content/cache/min/

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

twitterbot

Rule Path
Allow /blog/*
Allow /ranking-factors/*
Allow /forrester-marketing-silos

Other Records

Field Value
sitemap https://www.autosvalls.com/sitemap_index.xml
sitemap https://www.autosvalls.com/en/sitemap_index.xml
sitemap https://www.autosvalls.com/fr/sitemap_index.xml
sitemap https://www.autosvalls.com/it/sitemap_index.xml
sitemap https://www.autosvalls.com/fr/sitemap_index.xml