Skip to content

Commit 018b022

Browse files
committed
fix
Signed-off-by: junq <[email protected]>
1 parent 99fc347 commit 018b022

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

tensorrt_llm/_torch/pyexecutor/model_engine.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -174,6 +174,7 @@ def __init__(
174174
self.model = loader.load(checkpoint_dir=model_path,
175175
checkpoint_loader=checkpoint_loader,
176176
drafting_loop_wrapper=drafting_loop_wrapper)
177+
self.model_is_wrapped = drafting_loop_wrapper is not None
177178
# In case that some tests use stub models and override `_load_model`.
178179
if not hasattr(self.model, 'extra_attrs'):
179180
self.model.extra_attrs = {}

0 commit comments

Comments
 (0)