Log In Sign Up

jp.usedmachinery.bz
robots.txt

Robots Exclusion Standard data for jp.usedmachinery.bz

Resource Scan

Scan Details

Site Domain jp.usedmachinery.bz
Base Domain usedmachinery.bz
Scan Status Ok
Last Scan2024-09-27T06:00:05+00:00
Next Scan 2024-10-27T06:00:05+00:00

Last Scan

Scanned2024-09-27T06:00:05+00:00
URL https://jp.usedmachinery.bz/robots.txt
Redirect https://www.jp.usedmachinery.bz/robots.txt
Redirect Domain www.jp.usedmachinery.bz
Redirect Base usedmachinery.bz
Domain IPs 3.112.183.207, 52.68.228.219, 54.92.37.51
Redirect IPs 3.112.183.207, 52.68.228.219, 54.92.37.51
Response IP 52.68.228.219
Found Yes
Hash 2354040e96114413f99d407cfe3a505190acfed85ffe87cfb37cf5f526bd0623
SimHash 4b1414d2c610

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

*

Rule Path
Disallow /admin/
Disallow /god/
Disallow /sellmachines/
Back to top

Other Records

Field Value
sitemap https://www.jp.usedmachinery.bz/sitemap.xml
sitemap https://www.jp.usedmachinery.bz/nk/sitemap2.xml
Back to top

Comments

  • AhrefsBot
  • SEMrushBot
  • MegaIndex.ru/2.0
  • BLEXBot/1.0
  • BLEXBot
  • Linguee Bot
  • Seekport
  • bingbot/2.0(Allow every 4 seconds)
Back to top