mirror of
https://github.com/vegu-ai/talemate.git
synced 2026-09-02 12:09:31 +02:00
206 lines
10 KiB
Markdown
206 lines
10 KiB
Markdown
# Inline Visuals
|
|
|
|
Inline visuals is a feature introduced in version 0.35.0 that displays generated images directly within your scene feed. When you create images through the scene tools or director actions, they can now appear alongside the messages in your story, providing a more immersive visual experience.
|
|
|
|
|
|
|
|
## How It Works
|
|
|
|
When you generate an image using Talemate's visualization features, the image can be automatically attached to messages in your scene feed. The type of image and where it appears depends on how it was generated:
|
|
|
|
- **Scene illustrations** appear with narrator messages or the most recent relevant message
|
|
- **Character portraits** appear alongside character dialogue
|
|
- **Character cards** can be attached to messages featuring that character
|
|
|
|
The images are displayed inline with the message text, or above the message for larger scene illustrations.
|
|
|
|
## Generating Inline Visuals
|
|
|
|
There are several ways to generate images that appear in your scene feed:
|
|
|
|
### Scene Tools
|
|
|
|
The quickest way to generate inline visuals is through the scene tools visualizer menu.
|
|
|
|
|
|
|
|
From this menu you can:
|
|
|
|
- **Visualize Scene (Card)**: Generate a cover image of the current scene
|
|
- **Visualize Scene (Background)**: Generate a purely environmental image
|
|
- **[Character]** submenu (one per character in the scene):
|
|
- **Card**: Generate a cover image portrait of that character
|
|
- **Portrait**: Generate a face-focused portrait of that character
|
|
- **Visualize Moment (Illustration)**: Generate an image of the current moment in the story
|
|
|
|
!!! note "Per-character submenus (0.37.0)"
|
|
As of version 0.37.0, each character in the scene is grouped into its own submenu instead of appearing as separate top-level entries. Hover a character's name to open their submenu and pick **Card** or **Portrait**. See [Scene Tools — Visualizer](scenario-tools.md#material-image-frame-visualizer) for the full menu reference.
|
|
|
|
!!! tip "Keyboard Modifiers"
|
|
- Hold **ALT** to generate only the prompt without creating an image
|
|
- Hold **CTRL** to open a dialog where you can provide custom instructions
|
|
|
|
When you generate an image and the **Auto-attach visuals** option is enabled, the resulting image will automatically appear in your scene feed attached to the most relevant message.
|
|
|
|
### Director Chat
|
|
|
|
You can also ask the Director to generate images through the director chat interface. Simply describe what you want to visualize, and if the Director has visual generation capabilities enabled, it will create the image and attach it to the conversation.
|
|
|
|
|
|
|
|
For more information on using the Director chat, see the [Director Chat documentation](agents/director/chat.md).
|
|
|
|
### Autonomous Scene Direction
|
|
|
|
When using the autonomous scene direction feature, the Director can automatically generate images at appropriate moments during scene progression. These images appear in the scene feed just like manually generated ones.
|
|
|
|
### Context Investigation Messages
|
|
|
|
Context investigation messages are the short, descriptive results that appear in your scene feed when you take a closer look at something. They are produced by actions such as:
|
|
|
|
- **Look at Scene** — a visually focused description of the current moment (from the scene tools narrator menu)
|
|
- **Look at (Character)** — a description of a character's appearance and current action (from the scene tools narrator menu or the [World State](world-state.md) sidebar)
|
|
- **Add Detail** — an expanded "closer look" at an entity (character, place, or item) you have selected in the scene
|
|
|
|
When you hover over one of these messages, a **Visualize** action appears in the message toolbar. Clicking it generates an image directly into that message, matched to whatever the investigation was about.
|
|
|
|
#### How the image is matched to the subject
|
|
|
|
Talemate looks at what the investigation was about and chooses the most fitting image type automatically. You don't need to pick one yourself:
|
|
|
|
| Investigation | Image generated |
|
|
|---------------|-----------------|
|
|
| Look at Scene | Scene illustration of the current moment |
|
|
| Look at (Character) | Character card portrait of that character |
|
|
| Add Detail on a character in the scene | Character card portrait of that character |
|
|
| Add Detail on a character not in the scene | Scene illustration |
|
|
| Add Detail on a place | Scene background |
|
|
| Add Detail on an item | Object illustration |
|
|
|
|
The text of the investigation message is used to guide the generated image, so the result reflects the specific details described in that message.
|
|
|
|
!!! note "Query results are not visualizable"
|
|
A plain **Query** (asking the narrator a free-form question) does not show a Visualize action, because there is no single visual subject to match it to.
|
|
|
|
Once an image has been generated, the **Visualize** action disappears for that message. From that point on you can regenerate, replace, or remove the image using the [inline visual actions](#viewing-and-managing) described below, just like any other attached image.
|
|
|
|
## Interacting with Inline Visuals
|
|
|
|
Once an image appears in your scene feed, you can interact with it in several ways.
|
|
|
|
### Viewing and Managing
|
|
|
|
Click on any inline visual to open a context menu with options:
|
|
|
|
|
|
|
|
- **View Image**: Open a full-size view of the image (also available with Ctrl+click)
|
|
- **Open in Visual Library**: View and manage the image in the Visual Library
|
|
- **Regenerate Illustration**: Create a new version of the image (Shift+click shortcut)
|
|
- **Regenerate and Delete**: Replace the current image with a new one (Alt+click shortcut)
|
|
- **Edit Illustration**: Regenerate with custom editing instructions
|
|
- **Select illustration**: Choose from existing scene illustrations
|
|
- **Clear Image**: Remove the image from this message (keeps the image in your library)
|
|
- **Delete Image**: Permanently remove the image
|
|
|
|
### Quick Actions
|
|
|
|
For faster workflow, inline visuals support several keyboard shortcuts when clicking:
|
|
|
|
| Action | Shortcut |
|
|
|--------|----------|
|
|
| View full image | Ctrl+click |
|
|
| Regenerate | Shift+click |
|
|
| Regenerate and delete old | Alt+click |
|
|
|
|
### Managing Portraits
|
|
|
|
For character portraits (avatars), you have additional options:
|
|
|
|
- **Auto-select portrait**: Let the AI determine the best portrait for this message
|
|
- **Generate new portrait**: Create a new portrait based on the current scene context
|
|
- **Select portrait**: Choose from existing portraits for this character
|
|
|
|
## Configuring Display Settings
|
|
|
|
You can customize how inline visuals appear through the [Appearance Settings](app-settings/appearance.md#visuals).
|
|
|
|
|
|
|
|
### Visual Types
|
|
|
|
Configure settings independently for each type of visual:
|
|
|
|
- **Portrait**: Character face images
|
|
- **Card**: Character or scene cards
|
|
- **Scene Illustration**: Full scene images
|
|
|
|
### Render Cadence
|
|
|
|
Control when visuals are displayed:
|
|
|
|
| Setting | Behavior |
|
|
|---------|----------|
|
|
| **Always** | Show on every message that has a visual attached |
|
|
| **Never** | Never show visuals inline (images still saved in Visual Library) |
|
|
| **On change** | Only show when the visual differs from the previous one (portraits only) |
|
|
|
|
!!! note "On Change Tracking"
|
|
The "On change" cadence tracks portraits per character. So if character A speaks twice with the same portrait, only the first message shows the portrait. But character B speaking between them would show B's portrait normally.
|
|
|
|
### Display Size
|
|
|
|
Control how large visuals appear:
|
|
|
|
| Size | Description |
|
|
|------|-------------|
|
|
| **Small** | Compact display, minimal space usage |
|
|
| **Medium** | Balanced size (default) |
|
|
| **Big** | Large display; scene illustrations appear above messages |
|
|
|
|
### Auto-attach Visuals
|
|
|
|
The **Auto-attach visuals** toggle controls whether newly generated images are automatically attached to messages. When disabled, images go to the Visual Library but don't appear in the scene feed unless you manually attach them.
|
|
|
|
You can also toggle this setting quickly from the scene tools visualizer menu without opening the full settings panel.
|
|
|
|
## Visual Types Explained
|
|
|
|
Understanding the different visual types helps you choose the right one for your needs:
|
|
|
|
### Scene Illustration
|
|
|
|
Best for capturing a specific moment in the story. These images typically show the environment and characters together, depicting what's happening at a particular point in the narrative. Scene illustrations work well for important story beats or visually striking moments.
|
|
|
|
### Scene Background
|
|
|
|
Environmental images without characters. Use these when you want to establish the setting or atmosphere without focusing on any particular character.
|
|
|
|
### Scene Card
|
|
|
|
A portrait-oriented cover image for the scene. Good for establishing shots or title cards.
|
|
|
|
### Character Card
|
|
|
|
Full-body or half-body portrait of a character in the current scene context. These are larger, more detailed character images.
|
|
|
|
### Character Portrait
|
|
|
|
Face-focused images of characters. These are ideal for showing expressions and emotions during dialogue.
|
|
|
|
## Requirements
|
|
|
|
To use inline visuals, you need:
|
|
|
|
1. A configured [Visualizer Agent](agents/visualizer/index.md) with a working image generation backend
|
|
2. A scene loaded with at least some content
|
|
|
|
The feature works with any of the supported image generation backends, including Google, ComfyUI, OpenAI, and others. See the [Visualizer Agent documentation](agents/visualizer/index.md) for setup instructions.
|
|
|
|
## Related Features
|
|
|
|
- [Visual Library](agents/visualizer/visual-library.md) - Managing and organizing your generated images
|
|
- [Visualizer Agent](agents/visualizer/index.md) - Configuring image generation
|
|
- [Director Chat](agents/director/chat.md) - Generating images through conversation
|
|
- [Appearance Settings](app-settings/appearance.md) - Customizing display options
|