ultimatespecs.com
robots.txt

Robots Exclusion Standard data for ultimatespecs.com

Resource Scan

Scan Details

Site Domain ultimatespecs.com
Base Domain ultimatespecs.com
Scan Status Ok
Last Scan2024-04-21T17:31:39+00:00
Next Scan 2024-04-28T17:31:39+00:00

Last Scan

Scanned2024-04-21T17:31:39+00:00
URL https://ultimatespecs.com/robots.txt
Domain IPs 104.26.2.229, 104.26.3.229, 172.67.75.10, 2606:4700:20::681a:2e5, 2606:4700:20::681a:3e5, 2606:4700:20::ac43:4b0a
Response IP 104.26.3.229
Found Yes
Hash 5653e61a45da8c8692e0a5d69f65191c292ac927437199cf768dbb3370db9281
SimHash 880a9d24d413

Groups

*

Rule Path
Disallow /includes/
Disallow /lang/
Disallow /webmail/
Disallow /car-comparator/sitemap
Disallow /nl/auto-vergelijker/sitemap
Disallow /pl/porownaj-samochody/sitemap
Disallow /br/comparar-carros/sitemap
Disallow /tr/araba-karsilastirma/sitemap

imagesiftbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ultimatespecs.com/sitemap.xml
sitemap https://www.ultimatespecs.com/sitemapgen.xml
sitemap https://www.ultimatespecs.com/sitemapversions.xml
sitemap https://www.ultimatespecs.com/sitemap_tractors.xml
sitemap https://www.ultimatespecs.com/sitemap_bikes.xml