DSH Read Image Plugin

中文说明

An image-input fallback for DeepSeek Harness (DSH) that routes images according to the selected model's declared capabilities:

• Models whose inputModalities include image use DSH's native attachment flow.
• Text-only models get a fallback image button backed by the configured Volcengine Ark vision model and the read_image_via_ark tool.

This keeps native multimodal models on their direct path while giving text-only DeepSeek models a practical way to inspect images.

Features

• Image picker and clipboard image paste in the conversation input.
• Host-side upload endpoint with a 20 MB limit.
• Local file paths and HTTP(S) image URLs.
• Reuses the DSH volcengine provider, credential, model, and API protocol.
• Supports OpenAI-compatible Responses and Chat Completions APIs.
• Automatically hides the fallback UI for models that natively accept images.

Layout

dsh-read-image-plugin/
  host.mjs
  pkg/

Install or link pkg as @local/dsh-read-image in the Web profile, enable @local/dsh-read-image/client, and load the host module from cordis.patch.yml:

- insert:
    - id: read-image
      name: 'file:///absolute/path/to/dsh-read-image-plugin/host.mjs'

Restart the DSH Web UI after changing the profile. DSH profile paths and loading details may vary by release, so follow the plugin-loading convention used by your installed version.

Configuration

Configure a volcengine provider in DSH. The plugin reads its base URL, API type, first model ID, and credential reference. These optional environment variables override individual values:

ARK_API_KEY
ARK_BASE_URL
ARK_VISION_MODEL
DSH_UPLOAD_DIR

Store API keys in DSH credentials. Never commit credentials to this repository.

Limitations

• This plugin delegates image understanding to a Volcengine Ark vision model; it is not a vision model itself.
• API access and provider charges may apply.
• Local paths must be readable by the machine running the DSH host.
• The Web integration depends on DSH slot and model-directory APIs and may need updates after major DSH releases.
• The current release is primarily verified on Windows. Linux and macOS should be possible with platform-specific profile paths and configuration.

Privacy

Images are uploaded to the local DSH host and are sent to the configured Volcengine Ark service when the fallback tool runs. Use it only for images appropriate for that service.

License

MIT