Quacomm AI Engine Direct - Enable FCB feature to Qualcomm HTP - #22521
Draft
quic-boyuc wants to merge 1 commit into
Draft
Quacomm AI Engine Direct - Enable FCB feature to Qualcomm HTP#22521quic-boyuc wants to merge 1 commit into
quic-boyuc wants to merge 1 commit into
Conversation
quic-boyuc
requested review from
abhinaykukkadapu,
mergennachin and
psiddh
as code owners
September 3, 2026 16:13
QNN Flexible Context Binary (FCB) multi-SoC HTP support
Adds offline FCB export for shipping one ExecuTorch artifact containing QNN HTP
contexts for multiple known Snapdragon SoCs. Requires QNN SDK >= 2.48.
User-facing API
generate_qnn_executorch_compiler_spec()now accepts paired lists:soc_model=[...]andbackend_options=[...].the existing single-SoC behavior.
fcb_reference_weight_sharing=Trueby default. It shares referencedweights while host AOT appends target contexts to the FCB DLC.
QnnQuantizerandmake_quantizer()accept FCB target lists and validateagainst the least-capable requested HTP architecture.
lists, duplicate SoCs, and DLBC when reference-weight sharing is enabled.
Architecture
reference-weight-sharing configuration.
(backend type, SoC)during lowering.registration state is reset after every compile, including failures.
context, retrieve its bytes, and free the DLC.
deserialize its graph metadata.
multi-SoC weight-sharing examples.
Usage
Build the Android runner: