How do you get API key for self hosted Openmeter?

[ianaware]

Sorry if this is a silly question.

We have self-hosted LiteLLM and self-hosted Openmeter and we want to send the events of LiteLLM to Openmeter so we can track costing.

I'm a little confused how this works.

For self-hosted Openmeter, where do you get the API key from? Do you still need to point the self-hosted Openmeter to the cloud?

It seems so, as the LiteLLM docs here even say to sign up for an Openmeter API key - is that correct?

LiteLLM Openmeter docs - https://docs.litellm.ai/docs/observability/openmeter

I thought that with self-hosted Openmeter the OPENMETER_BASE_URL points to the self-hosted instance and the OPENMETER_API_KEY, I have no idea where to get that? I left it blank and pointed the OPENMETER_BASE_URL to my instance, but it doesn't work.

I get this error:

Error initializing custom logger: Missing keys=['OPENMETER_API_KEY'] in environment

I can only get it to work if the OPENMETER_BASE_URL is pointing to Openmeter Cloud and I have an API key from there.

But if that is how it works, why would you need a self-hosted version?

Can someone kindly help me out here to get my self-hosted version working?

Kind regards.

[andreeib]

Hello, looks like litellm requires the OPENMETER_API_KEY env var:
https://github.com/BerriAI/litellm/blob/781f9df883cab63703f9a994941b205965913d55/litellm/integrations/openmeter.py#L37

Try filling a random value:
os.environ["OPENMETER_API_KEY"] = "xxx"

[ianaware]

Thank you for replying @andreeib

I did some more testing on this; it has to be an actual Openmeter cloud API key. No fake keys or having the variable empty will work. I guess for LiteLLM integration, even though Openmeter can be self-hosted, which is what we have, that makes no sense for us if we want to link to LiteLLM, I could just use their cloud version.

That kind of defeats the purpose for us though, we want it self-hosted.

[andreeib]

What error do you get?

The Open Source variant of OpenMeter does not authenticate API calls, and it seems to accept requests with Authorization: Bearer xxx header.

[ianaware]

What error do you get?

The Open Source variant of OpenMeter does not authenticate API calls, and it seems to accept requests with Authorization: Bearer xxx header.

I just get this each time:

Error initializing custom logger: Missing keys=['OPENMETER_API_KEY'] in environment.

Setting OPENMETER_API_KEY as '' (blank) or putting in a fake key with the same parameters as a legitimate cloud one or putting in something like 'self-hosted' as the value all fail.

This is probably just me, I am brand new to this, but it only works with an Openmeter Cloud API key I generated from the cloud account.

Thanks very much for your assistance.

[andreeib]

Are you sure it's the same error when you set os.environ["OPENMETER_API_KEY"] = "fake value" vs os.environ["OPENMETER_API_KEY"] = ""?

You can also try to:

• set the env variables via config.yaml or shell
• you might have other changes in your code that causes the issue, reproduce the issue from scratch using the example from https://docs.litellm.ai/docs/observability/openmeter

[ianaware]

Are you sure it's the same error when you set os.environ["OPENMETER_API_KEY"] = "fake value" vs os.environ["OPENMETER_API_KEY"] = ""?

You can also try to:

• set the env variables via config.yaml or shell
• you might have other changes in your code that causes the issue, reproduce the issue from scratch using the example from https://docs.litellm.ai/docs/observability/openmeter

Thank you for replying @andreeib. I did test in both scenarios, and I just could not get past that error. For now, I point to Openmeter cloud and I have another issue which I have created a topic for.