carrentalmaui.com
robots.txt

Robots Exclusion Standard data for carrentalmaui.com

Resource Scan

Scan Details

Site Domain carrentalmaui.com
Base Domain carrentalmaui.com
Scan Status Ok
Last Scan2024-05-18T14:50:53+00:00
Next Scan 2024-06-17T14:50:53+00:00

Last Scan

Scanned2024-05-18T14:50:53+00:00
URL https://carrentalmaui.com/robots.txt
Redirect https://www.carrentalmaui.com/robots.txt
Redirect Domain www.carrentalmaui.com
Redirect Base carrentalmaui.com
Domain IPs 104.26.8.145, 104.26.9.145, 172.67.69.20, 2606:4700:20::681a:891, 2606:4700:20::681a:991, 2606:4700:20::ac43:4514
Redirect IPs 104.26.8.145, 104.26.9.145, 172.67.69.20, 2606:4700:20::681a:891, 2606:4700:20::681a:991, 2606:4700:20::ac43:4514
Response IP 172.67.69.20
Found Yes
Hash b1ae0c80deff4d7836900f6c8ad1566cf97881ced13127bb74fa4aad395225ab
SimHash 003c1d949868

Groups

*

Rule Path
Allow /
Allow /comprar/
Disallow /wp-admin/
Disallow /wp-admin/admin-ajax.php
Disallow /search.php
Disallow /fr/wp-json/
Disallow /en/wp-json/
Disallow /de/wp-json/
Disallow /ru/wp-json/
Disallow /sv/wp-json/
Disallow /view.grid
Disallow /?view=grid
Disallow /?view=list
Disallow /wp-json/
Disallow /*.html$
Disallow *.html$
Disallow *?share=*
Disallow /wp-json/oembed/1.0/embed?url=*
Disallow /web/
Disallow */feed/
Allow /wp-content/cache/min/

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

twitterbot

Rule Path
Allow /blog/*
Allow /ranking-factors/*
Allow /forrester-marketing-silos

Other Records

Field Value
sitemap https://www.carrentalmaui.com/post-sitemap.xml
sitemap https://www.carrentalmaui.com/page-sitemap.xml
sitemap https://www.carrentalmaui.com/car_rental_item-sitemap.xml