dsh-tool-vision

English | 中文

A DeepSeek Harness plugin: the model-facing image_describe（识图） tool. It reads a local image file and asks the DashScope OpenAI-compatible API (qwen3.7-flash) to describe it or answer a focused question.

Works in every agent preset: the bundle patch inserts the tool at the host plane, so every session sees it in the tool catalog.

Install

dsh plugin --profile web add dsh-tool-vision

Restart dsh web (or install it from the Plugin Market with one click). The tool appears as image_describe in the model's tool catalog.

API key

The plugin ships no key. Set the key in the environment that starts DSH:

DASHSCOPE_API_KEY=sk-xxxx

You can also pass it per-row in cordis.patch.yml:

- id: tool-vision
  name: 'dsh-tool-vision'
  config:
    apiKey: sk-xxxx

Without a key the tool registers normally and fails with VISION_NO_API_KEY on use, naming the fix.

Tool

Tool	Args	Behavior
image_describe	path (string), prompt (string, optional)	Resolves the image (absolute path, or relative to the workspace), sends it as a base64 data URL plus the prompt to POST {baseUrl}/chat/completions, and returns the assistant text. Omitting prompt uses defaultPrompt (a complete content description).

Config

Key	Default	Meaning
baseUrl	https://dashscope.aliyuncs.com/compatible-mode/v1	DashScope OpenAI-compatible endpoint.
apiKey	DASHSCOPE_API_KEY environment variable	DashScope API key; an explicit config value wins over the environment.
model	qwen3.7-flash	Vision model id.
defaultPrompt	请详细描述这张图片的内容：画面主体、关键细节、文字信息（如有）、布局与结构。	Instruction used when a call omits prompt.
timeoutMs	120000	Cooperative tool-call timeout budget (ms).
maxImageBytes	20971520	Cap on one image's byte size.
maxOutputChars	65536	Cap on the returned description text.

Security

• No credentials ship with the package; the key stays in your environment or profile config.
• The HTTP client sets redirect: 'error': the configured endpoint receives the credential, and a redirect fails the call instead of forwarding the key or the image to another origin.
• The image bytes go only to the configured endpoint.

Known Limitations and Deferred Work

• Single provider, single request shape — the tool targets the DashScope OpenAI-compatible endpoint only; a provider-selection seam is deferred until a second vision backend needs the same schema.
• No vision-specific permission policy — the tool executes without requesting ctx.approval; a deployment that needs confirmation must add a tools/pre-execute policy.

License

MIT