Features

Features and capabilities.

VisionBase Studio covers acquisition, processing, decision, communication, and reporting. Inspections are built from 47 vision components across eight categories, and the application runs on Windows and Linux. The sections below list the available capabilities.

Vision tools

Components, arranged into a sequence.

Each tool is a step in the pipeline. Components are packaged as plugins, so the set can be extended.

Preprocessing 9

Condition the image before detection: convert, threshold, filter, mask, and remap.

Gray ConversionThresholdEdge Detection Color AnalysisMorphologyImage Filter Mask ROIPixel MapperTransform

Detection 10

Locate features, codes, text, and defects.

Blob AnalysisTemplate MatchingBarcode Reader Defect DetectionOCR ReaderPaddleOCR Line DetectorCircle DetectorContour Matching Blob Array (BGA)

Measurement 6

Produce dimensions, gauges, and pass/fail verdicts in real-world units.

MeasurementInspectorColor Comparison Edge CaliperBrightness ProfileFocus

Alignment & scripting 4

Align the inspection to a moving part, and add logic and derived values.

FixtureCalibration from Fiducials Expression EvaluatorConditional Gate
VisionBase Studio Template Matching — a fiducial cross located on a PCB with the correlation score, ROI template, matching mode, and live PASS results

Template Matching — correlation and feature-based (ORB + RANSAC) search locates a taught pattern under rotation, scale, and partial occlusion, gated by a score threshold.

AI & deep learning

Model inference and training.

ONNX inference runs in the pipeline with DirectML GPU acceleration. Labelling, augmentation, and training are available within the application, so a separate machine-learning service is not required.

Inference

ONNX ClassifierONNX DetectorObject Detection SegmentationAnomaly Detection

Model input size and layout (NCHW/NHWC) are detected automatically. CPU fallback is used when no GPU is available.

Data & training

Model TrainerYOLO TrainerDataset Collector YOLO Dataset CollectorBlob LabelingImages Labeling Data Augmentation

Collect, label, and augment images from the line; train detection, classification, or segmentation models; export to ONNX. Training can run offline.

VisionBase Studio Object Detection — pills and capsules located in a bag with labelled bounding boxes, DirectML GPU inference, and 100% yield results

Object Detection — a trained model locates and classifies multiple parts per frame, running on DirectML GPU acceleration with full per-run result logging.

3D & depth

Process 16-bit depth maps for height, flatness, and volume checks.

Depth HeatmapDepth → Point CloudPlane Fitting Point Cloud ROIStereo RectifyVolumetric Measurement
VisionBase Studio Depth to Point Cloud — a colour-mapped 3D point cloud rendered from a 16-bit depth map with camera intrinsics, 3D bounding-box filtering, and PASS results

Depth → Point Cloud — converts a 16-bit depth map into a calibrated 3D point cloud using camera intrinsics, with interactive rotation, plane/bbox tools, and metric filtering.

AI assistant & AI-agent control

A copilot that speaks machine vision.

An in-app AI copilot plus a Model Context Protocol server that gives external AI agents the same disciplined control surface. The model only ever proposes; the station validates, caps, and executes deterministically.

In-app assistant

  • Grounded Ask — answers from the built-in component guides via on-device hybrid retrieval (BM25 + local embeddings).
  • Build — natural-language task becomes a validated sequence proposal, applied behind an Engineer-gated single undo.
  • Parameter Sweep & Collect — deterministic experiments over values × images with pass-rate curves and an "Apply best value" action.
  • Bring your own model — Claude API, any OpenAI-compatible endpoint, or offline Ollama; keys encrypted at rest.

MCP server for AI agents

A JSON-RPC 2.0 server over Streamable HTTP exposes 21 tools to external agents (Claude and others) — run inspections, sweep and collect, snap/live, get status, sequence and parameters, set parameters, read results, images, and statistics, load sequences and recipes, and search the docs.

run_inspectionrun_sweepset_parameter get_statisticsget_imageload_recipesearch_docs

Optional bearer token (required for remote binding); guide retrieval runs locally and only chat text reaches the configured provider.

VisionBase Studio AI Assistant building an annulus inspection — a proposed 5-component sequence (Image Filter, two Circle Detectors, Expression Evaluator, Inspector) applied to the panel with pass/fail rules

AI Assistant — Build — a plain-language request becomes a validated multi-component sequence with pass/fail rules, applied to the live panel behind an Engineer-gated single undo.

Cameras & acquisition

Industrial, IP, and USB cameras.

Supported cameras

Basler (Pylon)The Imaging Source (IC4) Do3ThinkInovance GigE/USB3 AravisIP RTSP/MJPEG USB / DirectShowSimulated

Acquisition control

  • Manual, timer, external hardware, and software triggering
  • Exposure, gain, ROI, and frame-rate control; on-camera user sets
  • One-shot white balance; per-stream frame-rate readout
  • Pooled, reference-counted frame buffer so acquisition is not blocked
Communication & I/O

Line, data, and signal interfaces.

PLC & line

OPC UAModbus TCPModbus RTU-over-TCP MQTTRaw TCPMES / SCADA

Data & logging

SQLiteSQL ServerPostgreSQL CSV / file logger

Digital I/O

Modbus TCP I/ORaspberry Pi GPIORemote GPIO agent

An input edge can trigger acquisition; pass, fail, busy, and ready outputs are written after each cycle.

Remote control

Communication plugins accept LOAD_SEQUENCE and LOAD_RECIPE commands and return a structural-compatibility result, so a line controller can change the active inspection for the next product.

Quality, SPC & reporting

Inspection results as process data.

Quality dashboard — SPC control chart with Cp/Cpk panel

SPC & capability

X-bar/R control charts (A2/D3/D4 constants), Cp/Cpk, and out-of-control detection.

Yield & trends

Yield, cycle-time statistics, defect breakdown, and trend charts per station.

Traceability

Operator, shift, batch, and serial captured from the barcode; daily audit logs.

Reports & dashboard

Scheduled PDF reports (QuestPDF) and a web dashboard over HTTP and WebSocket.

Logging & replay

Image logging (never, fail-only, or always), replay from a folder, and recent run-history snapshots.

Test suites

Headless .vbtest suites assert measurements and pass/fail per image, for use in CI.

Platform & deployment

Architecture, setup, and delivery.

Architecture

  • Plugin SDK: ZIP components, runtime loading, isolated load contexts
  • Dual UI: WPF on Windows, Avalonia on Linux, sharing one core
  • GPU: OpenCL/UMat paths and DirectML for ONNX

Setup & tooling

  • Calibration: line, checkerboard, multi-point affine/homography, per-cycle dynamic
  • ROIs: rectangle, rotated, circle, annular, polygon; fixture-relative
  • Recipes: versioning, history, and compare; undo/redo, copy/paste, import/export

Security & delivery

  • Roles: Operator, Engineer, Developer; PBKDF2 login and audit trail
  • Licensing: Ed25519-signed, per-component, hardware-bound
  • Installers: Windows setup, Linux .deb, Raspberry Pi; en / zh / th
Contact

Discuss your inspection.

Describe the inspection and we can prepare a sequence from these components, with the camera, communication, and reporting configured.