Skip to content

Lower bound on kernel execution time #9018

@flxinxout

Description

@flxinxout

Hello developers,

While creating a very simple kernel using MLIR-AIE and testing it, I noticed a kind of lower bound on the kernel execution time, using XRT. I measured the time difference between the end of computation of my kernel and the start, and I get around 60 microseconds (so the function kernel() and wait())

Because I was not satisfied by this time, I created an "empty" kernel, doing nothing and moving no data. Using always XRT to call the kernel, I did the same computation to find the time for the kernel to run, and I found something like 45 microseconds.

My questions are

is it normal to have this overhead?
If yes, what are the option? Because actually, my CPU runs my computation faster then, and the NPU would be no need.
Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions