exxpozed.com
robots.txt

Robots Exclusion Standard data for exxpozed.com

Resource Scan

Scan Details

Site Domain exxpozed.com
Base Domain exxpozed.com
Scan Status Ok
Last Scan2024-10-25T12:21:20+00:00
Next Scan 2024-11-24T12:21:20+00:00

Last Scan

Scanned2024-10-25T12:21:20+00:00
URL https://exxpozed.com/robots.txt
Domain IPs 104.26.8.3, 104.26.9.3, 172.67.71.239, 2606:4700:20::681a:803, 2606:4700:20::681a:903, 2606:4700:20::ac43:47ef
Response IP 104.26.8.3
Found Yes
Hash 3ef106ec09a8a5718b24f545e64bac1ed69bec968b621f9ecfbe643c16f1a3b8
SimHash 0e34f77ec8b0

Groups

*

Rule Path
Disallow /index.php/
Disallow /checkout/
Disallow /checkout/onepage/
Disallow /checkout/onestep/
Disallow /review/
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /customer/
Disallow /404/
Disallow /api/
Disallow /magazin/lagerverkauf/
Disallow /support/impressum/
Disallow /support/
Disallow /support/kontakt/
Disallow /support/neubau/
Disallow /support/versand/
Disallow /customer/account/login/
Disallow /customer/account/

telegrambot

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

wozukaufenbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

baidubot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

lipperhey

Rule Path
Disallow /

gigablastopensource

Rule Path
Disallow /

getintentcrawler

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

openlinkprofiler

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

implisensebot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.exxpozed.de/media/sitemap/de/sitemap.xml
sitemap https://www.exxpozed.eu/media/sitemap/eu/sitemap.xml
sitemap https://www.exxpozed.com/media/sitemap/us/sitemap.xml
sitemap https://www.exxpozed.co.uk/media/sitemap/uk/sitemap.xml
sitemap https://www.exxpozed.ch/media/sitemap/ch/sitemap.xml
sitemap https://www.exxpozed.fr/media/sitemap/fr/sitemap.xml

Comments

  • The try to stop bad bots

Warnings

  • 2 invalid lines.