Skip to content

workflow: inference hardcoded endpoint improvements - #13710

Open
hannahblair wants to merge 11 commits into
mainfrom
workflow-task-improvements
Open

workflow: inference hardcoded endpoint improvements#13710
hannahblair wants to merge 11 commits into
mainfrom
workflow-task-improvements

Conversation

@hannahblair

@hannahblair hannahblair commented Aug 5, 2026

Copy link
Copy Markdown
Collaborator

Description

  • tweak remaining vision endpoints
  • add custom param ui
  • add (new?) image-text-to-video pipeline_tag for MiniMax H3

- add custom param ui
- add image-text-to-video tag
@hannahblair
hannahblair requested a review from abidlabs August 5, 2026 21:41
@abidlabs

abidlabs commented Aug 5, 2026

Copy link
Copy Markdown
Member

Could we add a couple of Workflow demos to the all_demos that are deployed when a Space is launched to make it easier to easily inspect the visual changes?

Comment thread gradio/workflow.py
Comment on lines +894 to +896
"image-to-text": "chat_completion",
"visual-question-answering": "chat_completion",
"document-question-answering": "chat_completion",

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So for these other task types, should we automatically add the optional inputs? Like for vqa, we add an image, for dqa, we add a file input?

@hannahblair hannahblair Aug 7, 2026

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if im understanding your Q correctly, we already do via TASK_SCHEMAS in node-library.ts. though image to text was missing the optional text prompt so ive added that in

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

btw for dqa we use image not file because dqa routes through chat_completion, which only accepts types text and image_url :/

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

rather annoying UX

outputs: { id: string; label: string; type: PortType }[];
}

export const TASK_SCHEMAS: Record<string, TaskSchema> = {

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

see here

@gradio-pr-bot

gradio-pr-bot commented Aug 10, 2026

Copy link
Copy Markdown
Collaborator

🪼 branch checks and previews

Name Status URL
Spaces ready! Spaces preview
Website ready! Website preview
Storybook ready! Storybook preview
🦄 Changes failed! Workflow log

Install Gradio from this PR

pip install https://huggingface.co/buckets/gradio/pypi-previews/resolve/438c55ca3915ab19f6b1511a3277eb9e93f9e25e/gradio-6.22.0-py3-none-any.whl

Install Gradio Python Client from this PR

pip install "gradio-client @ git+https://github.com/gradio-app/gradio@438c55ca3915ab19f6b1511a3277eb9e93f9e25e#subdirectory=client/python"

Import Gradio JS Client from this PR via CDN

import { Client } from "https://huggingface.co/buckets/gradio/npm-previews/resolve/438c55ca3915ab19f6b1511a3277eb9e93f9e25e/browser.js";

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants