corvaircentral.com
robots.txt

Robots Exclusion Standard data for corvaircentral.com

Resource Scan

Scan Details

Site Domain corvaircentral.com
Base Domain corvaircentral.com
Scan Status Ok
Last Scan2025-05-15T19:38:26+00:00
Next Scan 2025-05-22T19:38:26+00:00

Last Scan

Scanned2025-05-15T19:38:26+00:00
URL https://corvaircentral.com/robots.txt
Redirect https://www.corvaircentral.com/robots.txt
Redirect Domain www.corvaircentral.com
Redirect Base corvaircentral.com
Domain IPs 104.21.11.130, 172.67.149.60, 2606:4700:3030::ac43:953c, 2606:4700:3034::6815:b82
Redirect IPs 104.21.11.130, 172.67.149.60, 2606:4700:3030::ac43:953c, 2606:4700:3034::6815:b82
Response IP 172.67.149.60
Found Yes
Hash ed9e4085057b20625b21f8c83962797f381102016561629ca6662c14d9b0232d
SimHash c9cd508089c0

Groups

*

Rule Path
Allow /
Allow /wp-content/uploads/*
Allow /wp-content/*.js
Allow /wp-includes/*.js
Disallow /cgi-bin
Disallow /wp-includes/
Disallow /*/attachment/
Disallow /tag/*/page/
Disallow /?attachment_id*
Disallow /*?
Disallow /trackback
Disallow /*/trackback
Allow /feed/$
Disallow /*/feed/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$

slurpbot

Rule Path
Disallow /Sitemap

duckduckbot

Rule Path
Disallow /Sitemap

googlebot

Rule Path
Disallow /Sitemap

yandex

Rule Path
Disallow /Sitemap

bingbot

Rule Path
Disallow /Sitemap

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

linko

Rule Path
Disallow /

libwww

Rule Path
Disallow /

wget

Rule Path
Disallow /

npbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.corvaircentral.com/sitemapindex.xml