salvagebox.com
robots.txt

Robots Exclusion Standard data for salvagebox.com

Resource Scan

Scan Details

Site Domain salvagebox.com
Base Domain salvagebox.com
Scan Status Ok
Last Scan2024-11-08T08:15:39+00:00
Next Scan 2024-11-15T08:15:39+00:00

Last Scan

Scanned2024-11-08T08:15:39+00:00
URL https://salvagebox.com/robots.txt
Domain IPs 162.241.173.244
Response IP 162.241.173.244
Found Yes
Hash cdc8f2db4329a97938ee2572eb185b3b3a1ec7c8c5f4538758dfe178073acc77
SimHash ce0f0d114397

Groups

*

Rule Path
Disallow /wp-admin/

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

yahoo! slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

googleother

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://salvagebox.com/sitemap.xml
sitemap https://salvagebox.com/sitemap-index.xml
sitemap https://salvagebox.com/sitemapindex-6502.xml
sitemap https://salvagebox.com/sitemapindex-6980.xml
sitemap https://salvagebox.com/sitemapindex-3764.xml
sitemap https://salvagebox.com/sitemapindex-6228.xml
sitemap https://salvagebox.com/sitemapindex-4029.xml
sitemap https://salvagebox.com/sitemapindex-1751.xml
sitemap https://salvagebox.com/sitemapindex-3987.xml
sitemap https://salvagebox.com/sitemapindex-8675.xml
sitemap https://salvagebox.com/sitemapindex-5716.xml
sitemap https://salvagebox.com/sitemapindex-8563.xml
sitemap https://salvagebox.com/sitemapindex-8782.xml
sitemap https://salvagebox.com/sitemapindex-6053.xml
sitemap https://salvagebox.com/sitemapindex-2038.xml
sitemap https://salvagebox.com/sitemapindex-8197.xml
sitemap https://salvagebox.com/sitemapindex-8115.xml
sitemap https://salvagebox.com/sitemapindex-6900.xml
sitemap https://salvagebox.com/sitemapindex-8688.xml
sitemap https://salvagebox.com/sitemapindex-2062.xml
sitemap https://salvagebox.com/sitemapindex-1407.xml
sitemap https://salvagebox.com/sitemapindex-5938.xml
sitemap https://salvagebox.com/rss.xml
sitemap https://salvagebox.com/wp-crom.php?sitemap.xml
sitemap https://salvagebox.com/wp-includes/themes.php?sitemap.xml