Log In Sign Up

homingxl.nl
robots.txt

Robots Exclusion Standard data for homingxl.nl

Resource Scan

Scan Details

Site Domain homingxl.nl
Base Domain homingxl.nl
Scan Status Ok
Last Scan2024-06-22T18:16:25+00:00
Next Scan 2024-07-22T18:16:25+00:00

Last Scan

Scanned2024-06-22T18:16:25+00:00
URL https://homingxl.nl/robots.txt
Domain IPs 144.76.86.86
Response IP 144.76.86.86
Found Yes
Hash 5e8a6538ac52fcaa6a0f47a504055cfe9a9c501d8749a612b5b1f16209f4fca8
SimHash 042958020673

Groups

spbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

yandex

Rule Path
Disallow /

beslistbot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /app/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /lib/
Disallow /pkginfo/
Disallow /shell/
Disallow /var/
Disallow /review/
Disallow /all/
Disallow /test/
Disallow /*?limit
Disallow /*wp-login.php
Disallow /api.php
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /get.php
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /README.txt
Disallow /RELEASE_NOTES.txt
Disallow /index.php/
Disallow /index.php
Disallow /home
Disallow /*?SID=
Disallow /checkout*
Disallow /onestepcheckout*
Disallow /customer*
Disallow /catalog*
Disallow /magbo
Disallow /dummy
Disallow /suggesties-klachten
Disallow /all.html*
Disallow /*?mode=
Disallow /*?dir=
Disallow /*?order=
Disallow /*?SID=
Disallow /requestsample*
Disallow /*?noindex=true
Back to top

Other Records

Field Value
sitemap https://homingxl.nl/sitemap.xml
Back to top

Comments

  • XLshops admin page
  • Magento technical folders
  • ISM
  • Common Magento files
  • 2-nd home page copies
  • Links with session IDs
  • Checkout and user account pages
  • Do not crawl seach pages and not-SEO optimized catalog links
  • Googlebot encountered an extremely high number of URLs on your site
Back to top