integrations

Gradio Integration

Speed up Gradio prediction functions.

Published May 30, 2026

Prediction Function

import gradio as gr

def predict(text):
    return compiled_model(text)

gr.Interface(fn=predict, inputs="text", outputs="text").launch()