-
Notifications
You must be signed in to change notification settings - Fork 3.1k
Adding images to vibe editor #11780
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding images to vibe editor #11780
Conversation
🪼 branch checks and previews
Install Gradio from this PR pip install https://gradio-pypi-previews.s3.amazonaws.com/1b697bcc1bce300a2afb9c201820196b47f56b41/gradio-5.46.0-py3-none-any.whlInstall Gradio Python Client from this PR pip install "gradio-client @ git+https://github.com/gradio-app/gradio@1b697bcc1bce300a2afb9c201820196b47f56b41#subdirectory=client/python"Install Gradio JS Client from this PR npm install https://gradio-npm-previews.s3.amazonaws.com/1b697bcc1bce300a2afb9c201820196b47f56b41/gradio-client-1.19.0.tgz |
🦄 change detectedThis Pull Request includes changes to the following packages.
✅ Changeset approved
|
…to vibe-images
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I couldn't get the GLM model to work 😢 It failed on every prompt, even a simple "make a demo that looks like this" and the demo is a calculator.
It also failed when I uploaded a screenshot of another gradio demo and asked it to update the demo to look like the screenshot. I think we need to update the prompt to make better use of theming I think most models would have a hard time of that tbh.
@AK391 do you have thoughts on how we can improve this?
Can upload images with the prompt. If images are uploaded, editor will switch to using a vision language model instead of gpt-oss. Still playing around with the different models and the prompt to find the right setup - but its not bad as is
upload-images.mp4
Using zai-org/GLM-4.5V, best so far, though still gets some things wrong.