Skip to content

[BUG] Ascend: the deepgemm heuristic models an FP8×FP4 configuration that both entry points refuse #4379

Open

Description

@cn-sys

Required prerequisites

What version of TileLang are you using?

0.1.15+cuda.git210611d

System information

Ascend 950PR, CANN 9.0.0-beta.2, Linux 6.6.0-13, Python 3.12. Source build of main @ 210611d.

Problem description

// examples/ascend/deepgemm/_heuristics.pyx:161-164
elif desc.a_dtype == "float8_e4m3fn" and desc.b_dtype in ("float8_e4m3fn", "float4_e2m1fn_x2"):
    ...
    dtype.dequant_b = desc.b_dtype == "float4_e2m1fn_x2"
// plus :111 fp4_decode_bytes_per_cycle, :496 dequant_bytes, :602-612 dequant cost

Both callers raise instead:

// api.py:71-73
    raise NotImplementedError("FP8 x FP4 (FP8 dequant) kernels are not implemented")
// config.py:96-98  (same rejection)

and kernels/fp8_gemm.py has no dequant branch at all. So select_gemm_config returns a fully populated configuration (L2 controls, direct_store, version counts) for a combination that cannot be built — the caller discovers it one layer later, from a different error.

Activity

  1. cn-sys commented on Nov 15, 2026

    @cn-sys
    Author

    /formal

  2. added
    bugSomething isn't working
    UXImprovements to user experience, usability, or design flow.
    on Nov 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    UXImprovements to user experience, usability, or design flow.ascendbugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions