Skip to content

gpu_memory_utilization参数检查,如果用户配置超过0.95时,给出警告提示 #4016

@Jiang-Jia-Jun

Description

@Jiang-Jia-Jun

该参数不能配置过大,当配置过大,有可能会因为推理过程中显存的波动导致显存OOM问题,建议配置低于0.9。在代码中添加该警告提示(当配置的gpu_memory_utilization大于或等于0.95时,通过console_logger输出警告信息到终端)

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions