Log In Sign Up

backpacking-united.com
robots.txt

Robots Exclusion Standard data for backpacking-united.com

Resource Scan

Scan Details

Site Domain backpacking-united.com
Base Domain backpacking-united.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-25T19:22:35+00:00
Next Scan 2026-02-23T19:22:35+00:00

Last Successful Scan

Scanned2023-10-14T22:23:01+00:00
URL https://backpacking-united.com/robots.txt
Redirect https://www.backpacking-united.com/robots.txt
Redirect Domain www.backpacking-united.com
Redirect Base backpacking-united.com
Domain IPs 192.124.249.152
Redirect IPs 192.124.249.152
Response IP 192.124.249.152
Found Yes
Hash 208dd5e631dd072ebfb5181e012ba61660650d2c71bd089fc595843dbe96a57c
SimHash 4b04d858c21f

Groups

pricebot
applebot

Rule Path
Disallow /

*

Rule Path
Disallow /index.php/
Disallow /*?SID=
Disallow /imprint/
Disallow /terms//
Disallow /roc/
Disallow /*?cat=
Disallow /*?dir=
Disallow /*?color=
Disallow /*?limit=
Disallow /*?price=
Disallow /*?manufacturer=
Disallow /*?filter_gender=
Disallow /*?comffilter=
Disallow /*?mode=
Disallow /admin/
Disallow /app/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /customer/
Disallow /downloader/
Disallow /lib/
Disallow /newsletter/
Disallow /pkginfo/
Disallow /report/
Disallow /review/
Disallow /directory/currency/
Disallow /var/
Disallow /wishlist/
Back to top

Other Records

Field Value
sitemap http://www.backpacking-united.com/sitemap/en_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/de_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/se_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/dk_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/at_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/be_fr_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/ch_de_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/pl_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/fi_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/es_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/be_nl_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/no_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/ca_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/nl_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/au_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/fr_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/it_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/ch_fr_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/ca_fr_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/cz_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/pt_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/ie_index.xml.gz
sitemap http://www.backpacking-united.com/sitemap/sk_index.xml.gz
Back to top

Comments

  • Crawl-delay: 2
  • Disallow: /*.js$
  • Disallow: /*.css$
  • Disallow: /*.php$
  • Disallow: /js/
  • Disallow: /skin/
Back to top