Draft fallback review#200

Draft

cavusmustafa wants to merge 88 commits into

ravi9:dev_backend_openvinofrom

cavusmustafa:draft_fallback_review

Commits on May 20, 2026

Add interface is_model_splitted() to check the c-graph is splited or not

zhaixuejun1993
authored and
wine99
committed
Infer and propagate dynamic-dimension indices for all tensors in the GGML graph in api compute_model_outputs()

zhaixuejun1993
authored and
wine99
committed
Only do this for fallback sub graph

zhaixuejun1993
authored and
wine99
committed
Move dynamic dims compute in graph missmatch

zhaixuejun1993
authored and
wine99
committed
ggml-openvino: fix tensor data handling for PERMUTE/VIEW ops in split models

zhaixuejun1993
authored and
wine99
committed
ggml-openvino:add comments

zhaixuejun1993
authored and
wine99
committed
ggml-openvino: override VIEW op_case to 0 for split model inputs

zhaixuejun1993
authored and
wine99
committed
openvino backend: Handle unsupported VIEW shape-mismatch in OpenVINO backend

zhaixuejun1993
authored and
wine99
committed
Enable additional mul_mat tests and add tensor data saving function (#81)

zhaixuejun1993
authored and
wine99
committed
ggml-openvino: fix CONT/TRANSPOSE mapping and improve dynamic-dimension handling

zhaixuejun1993
authored and
wine99
committed
OpenVINO: add NORM/TANH support and rework SOFT_MAX translation

zhaixuejun1993
authored and
wine99
committed
ggml-openvino: extend VIEW handling

zhaixuejun1993
authored and
wine99
committed
Enable -fa off (#118)
wine99
committed
Enable --context-shift
wine99
committed
Fix llm param compute error for normal softmax not the softmax in attention

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: fix error for attention size compute in llm param

zhaixuejun1993
authored and
wine99
committed
use tensor->extra in infer_request i/o
wine99
committed
OpenVINO backend: refacter the compute_llm_params() func add get_attention_pattern_case to easy extand

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: clean unused code

zhaixuejun1993
authored and
wine99
committed
1to1 match op update (#146)

authored and
wine99
committed
initial gemma4 support

Mustafa Cavus
authored and
wine99
committed
removed hardcoded names for kv cache slicing

cavusmustafa
authored and
wine99
committed
OpenVINO backend: Add new attention pattern for llm parameters compute

zhaixuejun1993
authored and
wine99
committed
flash attn Q shape static conversion

cavusmustafa
authored and
wine99
committed
Remove slice in permute translation when n_seq is 1

cavusmustafa
authored and
wine99
committed
return optional in extract_layer_from_name
wine99
committed
OpenVINO backend: refactor VIEW related operation (#148)

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: Add ops l2_norm & pad

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend does not support CPY with non-contiguous data or mismatched types

zhaixuejun1993
authored and
wine99
committed
add op SSM_CONV GATED_DELTA_NET
wine99
committed
OpenVINO backend: fix error for bf16 in OV gpu plugin

zhaixuejun1993
authored and
wine99
committed
reverted static Q input shape for attention layer

cavusmustafa
authored and
wine99
committed
OpenVINO backend: remove hardcode name inp_tokens, which ignore some leaf case

zhaixuejun1993
authored and
wine99
committed
Disable remote tensor due to bug in ov gpu
wine99
committed
Disable n_token > 1 GATED_DELTA_NET on gpu
wine99
committed
OpenVINO backend: fix the view op dynamic handling issue in gemma4 & enable view + get_row

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: clean code

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: enable view + norm/rms_norm

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: concat op

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: argsort op

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: enable unary + view & GGML_UNARY_OP_SOFTPLUS

zhaixuejun1993
authored and
wine99
committed
Fix issue for test-backend-ops in TOPK_MOE, which compare VIEW ops result, VIEW node in OpenVINO no need compare, the whole graph result is correct

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: enable sum_rows

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: enable clamp

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: enable DIV

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: enable GGML_OP_MUL_MAT_ID

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: disable MUL_MAT_ID_FUSION case with large mem needed

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: Disable GGML_OP_ARGSORT, cause test_backend-ops failed

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: fix issue in mul_mat_id

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: Disable DIV with broadcast on GPU

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: update DIV

zhaixuejun1993
authored and
wine99
committed
use ov internal op GatedDeltaNet
wine99
committed
OpenVINO backend: enable llama erch test qwen3next

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: enable RMS_NORM + VIEW & remove op_case 2 for rope

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: fix error

zhaixuejun1993
authored and
wine99
committed
suggested changes, need review
wine99
committed
suggested changes, need review
wine99
committed
OpenVINO backend: clean unused code & fix build warning

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: enable minicpm3 for arch test

zhaixuejun1993
authored and
wine99
committed

Commits on May 21, 2026

Disable GDN op (#177)
wine99
authored

Commits on May 22, 2026

Commits on May 25, 2026

Commits on May 26, 2026