freelance.levtech.jp
robots.txt

Robots Exclusion Standard data for freelance.levtech.jp

Resource Scan

Scan Details

Site Domain freelance.levtech.jp
Base Domain levtech.jp
Scan Status Ok
Last Scan2025-12-29T17:24:15+00:00
Next Scan 2026-01-28T17:24:15+00:00

Last Scan

Scanned2025-12-29T17:24:15+00:00
URL https://freelance.levtech.jp/robots.txt
Domain IPs 108.156.144.129, 108.156.144.6, 108.156.144.82, 108.156.144.85
Response IP 108.156.144.85
Found Yes
Hash 425317b30626b35fcd7b40560d55588f428ee5b8f156bff93664861988938927
SimHash 02567c8183d2

Groups

*

Rule Path
Disallow /ank/
Disallow /admin/
Disallow /contact/private/
Disallow /history/
Disallow /keeplist/
Disallow /member/
Disallow /entry/
Disallow /lp/
Disallow /redirection/
Disallow /_ltf-nuxt/image_mv*
Disallow /_ltf-nuxt/image_mv_bg*
Disallow /_ltf-nuxt/image_project_vol2*
Disallow /_ltf-nuxt/image_reason_top*
Disallow /_ltf-nuxt/image_bg*
Disallow /_ltf-nuxt/*.js/*.js
Disallow /_ltf-nuxt/*.js/*.css

googlebot

Rule Path
Disallow /ank/
Disallow /admin/
Disallow /contact/private/
Disallow /history/
Disallow /keeplist/
Disallow /member/
Disallow /entry/
Disallow /lp/
Disallow /redirection/
Disallow /_ltf-nuxt/image_mv*
Disallow /_ltf-nuxt/image_mv_bg*
Disallow /_ltf-nuxt/image_project_vol2*
Disallow /_ltf-nuxt/image_reason_top*
Disallow /_ltf-nuxt/image_bg*
Disallow /_ltf-nuxt/*.js/*.js
Disallow /_ltf-nuxt/*.js/*.css
Disallow /browserMonitoringPrd.js
Disallow *?*st=*

bingbot

Rule Path
Disallow /ank/
Disallow /admin/
Disallow /contact/private/
Disallow /history/
Disallow /keeplist/
Disallow /member/
Disallow /entry/
Disallow /lp/
Disallow /redirection/
Disallow /_ltf-nuxt/image_mv*
Disallow /_ltf-nuxt/image_mv_bg*
Disallow /_ltf-nuxt/image_project_vol2*
Disallow /_ltf-nuxt/image_reason_top*
Disallow /_ltf-nuxt/image_bg*
Disallow /_ltf-nuxt/*.js/*.js
Disallow /_ltf-nuxt/*.js/*.css
Disallow *?*st=*

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /ank/
Disallow /admin/
Disallow /contact/private/
Disallow /history/
Disallow /keeplist/
Disallow /member/
Disallow /entry/
Disallow /lp/
Disallow /redirection/
Disallow /_ltf-nuxt/image_mv*
Disallow /_ltf-nuxt/image_mv_bg*
Disallow /_ltf-nuxt/image_project_vol2*
Disallow /_ltf-nuxt/image_reason_top*
Disallow /_ltf-nuxt/image_bg*
Disallow /_ltf-nuxt/*.js/*.js
Disallow /_ltf-nuxt/*.js/*.css

Other Records

Field Value
crawl-delay 120

rogerbot

Rule Path
Disallow /ank/
Disallow /lp/
Disallow /_ltf-nuxt/image_mv*
Disallow /_ltf-nuxt/image_mv_bg*
Disallow /_ltf-nuxt/image_project_vol2*
Disallow /_ltf-nuxt/image_reason_top*
Disallow /_ltf-nuxt/image_bg*
Disallow /_ltf-nuxt/*.js/*.js
Disallow /_ltf-nuxt/*.js/*.css

Other Records

Field Value
crawl-delay 2

facebookexternalhit

Rule Path
Disallow /project/search/

node-fetch

Rule Path
Disallow /project/search/

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

baidumobaider

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /