Log In Sign Up

usedmachinery.bz
robots.txt

Robots Exclusion Standard data for usedmachinery.bz

Resource Scan

Scan Details

Site Domain usedmachinery.bz
Base Domain usedmachinery.bz
Scan Status Ok
Last Scan2024-09-08T22:44:05+00:00
Next Scan 2024-10-08T22:44:05+00:00

Last Scan

Scanned2024-09-08T22:44:05+00:00
URL https://usedmachinery.bz/robots.txt
Redirect https://www.jp.usedmachinery.bz/robots.txt
Redirect Domain www.jp.usedmachinery.bz
Redirect Base usedmachinery.bz
Domain IPs 43.207.251.173, 52.199.167.89, 57.181.194.236
Redirect IPs 43.207.251.173, 52.199.167.89, 57.181.194.236
Response IP 57.181.194.236
Found Yes
Hash 2354040e96114413f99d407cfe3a505190acfed85ffe87cfb37cf5f526bd0623
SimHash 4b1414d2c610

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

*

Rule Path
Disallow /admin/
Disallow /god/
Disallow /sellmachines/
Back to top

Other Records

Field Value
sitemap https://www.jp.usedmachinery.bz/sitemap.xml
sitemap https://www.jp.usedmachinery.bz/nk/sitemap2.xml
Back to top

Comments

  • AhrefsBot
  • SEMrushBot
  • MegaIndex.ru/2.0
  • BLEXBot/1.0
  • BLEXBot
  • Linguee Bot
  • Seekport
  • bingbot/2.0(Allow every 4 seconds)
Back to top