industrialdiscount.it
robots.txt

Robots Exclusion Standard data for industrialdiscount.it

Resource Scan

Scan Details

Site Domain industrialdiscount.it
Base Domain industrialdiscount.it
Scan Status Ok
Last Scan2024-06-28T18:18:22+00:00
Next Scan 2024-07-05T18:18:22+00:00

Last Scan

Scanned2024-06-28T18:18:22+00:00
URL https://industrialdiscount.it/robots.txt
Redirect https://www.industrialdiscount.it:443/robots.txt
Redirect Domain www.industrialdiscount.it
Redirect Base industrialdiscount.it
Domain IPs 107.154.75.118, 45.60.99.118
Redirect IPs 107.154.77.118
Response IP 107.154.77.118
Found Yes
Hash 9f6d593624fc70e22814911ae30663aee939264c9df1c2c7768375d9c98523ba
SimHash 23268b62a123

Groups

*

Rule Path
Disallow /registrati/
Disallow /newsletter/
Disallow /admin/
Disallow /default/
Disallow /file/
Disallow /fonts/
Disallow /images/
Allow /images/come_funziona/
Allow /images/extraText/
Disallow /auctions/
Disallow /underconstruction/
Disallow /upload/
Disallow /data-room/
Allow /build/
Allow /min/
Allow /css/default/
Allow /fonts/
Allow /get-images/
Allow /images/default/
Disallow /images/default/advanced-slider/
Disallow /images/default/cread/
Disallow /images/default/fancybox/
Disallow /images/default/fancybox2/
Disallow /images/default/news/
Disallow /images/default/nivo-slider/
Disallow /images/default/special-auctions/
Disallow /images/default/team/
Disallow /*.pdf$
Disallow /aste-giudiziarie-chiuse/
Disallow /calendario-aste/
Disallow /statistiche-aste/

yandex
yandexturbo
yandexbot
yandexbot/3.0
baiduspider
baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot
moget
ichiro
naverbot
yeti

Rule Path
Disallow /

dotbot
dotbot/1.1
mj12bot
ahrefsbot
rogerbot/1.0
yandexmetrika
yandexmetrika/2.0
xenu's
xenu's link sleuth 1.1c
sistrix
ahrefsbot/5.2
ahrefsbot
seokicks
seokicks-robot
yisouspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.industrialdiscount.it/sitemap/
sitemap https://www.industrialdiscount.com/sitemap/

Comments

  • General
  • Spider
  • Seo Tools