com.thefilmradar/filmlab

Est-ce que com.thefilmradar/filmlab est sûr ?

Au dernier audit MCP Hub, le serveur MCP « com.thefilmradar/filmlab » est classé « Non encore testé ». Référencé dans l'annuaire. Seul le pentest comportemental fait foi, et il n'a pas encore été exécuté sur ce serveur. Le verdict est réévalué en continu ; consultez la fiche pour l'état à jour.

Méthode : MCP Hub analyse la description de chaque outil (couche 1) et, pour le verdict fort, exécute le serveur dans une micro-VM isolée avec leurres et réseau bloqué (couche 2). On publie des noms et des compteurs, jamais le contenu brut renvoyé par un outil.

Les 127 outils

• lab_abgleich≈ 347 tokens

  Prompt check of ONE generated image or clip: does the result show what its prompt asked for? The backend first DESCRIBES the result without seeing the prompt, then splits the prompt into checkable claims (counts as digits, quoted text, identity, place, framing, style; for clips the motion) and scores each. verdict: pass | mismatch | unverified, plus `checks`, `issues` and the neutral `beschreibung`. Runs automatically after every generation (lab_job_status shows it as `abgleich`); call this to read it, or with neu=true to check again. On mismatch: offer at most ONE retry per original, lead the new prompt with the failed claim; never re-run a video on your own. Free for the account (FilmLab carries the cost).

  Paramètres, retour & exemple (3)

  Paramètres

  • id · string · requis
    Asset id (positive integer as string)
  • neu · boolean · optionnel
    Discard an existing result and check again (ignored within 60 s of the last check)
  • reference_type · string · requis · image | video
    What kind of asset

  Exemple d'appel

  {"name": "lab_abgleich", "arguments": {"id": "texte", "reference_type": "image"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_add_clip≈ 718 tokens

  Append a shot to a sequence's timeline. Call it once per shot, in cutting order — `start_time` is computed from the clips already there, so appending in order is enough. The continuity pass reads exactly this timeline: a shot missing here is a shot nobody checks. Returns the new clip's index and the sequence's total duration.

  Paramètres, retour & exemple (7)

  Paramètres

  • text · string · optionnel
    Text content for type 'title', 'credits' or 'lower_third'
  • type · string · requis · video | image | title | credits | lower_third
    What this clip is. 'image' references a generated image via source_id; 'title', 'credits' and 'lower_third' carry `text` instead. 'lower_third' is an OVERLAY: appended without start_time it is laid over the clip before it (track V2), takes no time of its own and never runs past that clip's end; metadata.versatz_s delays it inside that clip. As the very first clip it is a card on black. 'video' is where it gets sharp — read the source_id note before using it
  • seq_id · string · requis
    Sequence id (from lab_create_sequence/lab_list_sequences) — positive integer as string
  • metadata · object · optionnel
    JSON stored alongside the clip. The continuity pass reads video_id (a generated video's id — it checks the start image), image_url (a frame URL), location_id and scene_num from here; for a 'lower_third', versatz_s (seconds into the clip it sits on) sets when it appears; other keys are stored as-is
  • source_id · string · optionnel
    For type 'image': the id of a generated image (from lab_generate). For type 'video': source_id is IGNORED by the continuity pass (a video id used to be misread as an unrelated image, see vault/followups/2026-08-04-continuity-loest-source-id-blind-auf.md). Give a video clip its frame via metadata instead: metadata.video_id = the generated video's id (the pass checks the video's start image), or metadata.image_url = a frame URL. Without either, the shot is counted as 'not checked' (summary.ohne_frame).
  • start_time · number · optionnel
    Absolute start on the timeline. Omit to append after the last clip (the normal case); set it only to place a clip deliberately
  • duration_seconds · number · optionnel
    Clip duration in seconds. Backend default is 5.0 — pass the clip's REAL length, otherwise the sequence duration and the render drift apart

  Exemple d'appel

  {"name": "lab_add_clip", "arguments": {"type": "video", "seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_add_media≈ 645 tokens

  Bring your own video, audio or image into a project — not generated, yours. Two ways: `media_url` (a public http(s) address; the server fetches it, max 100 MB) or `file_name` + `content_type` (you get a signed `upload_url` and the `header` that are part of its signature: PUT the file's raw bytes there within the hour with EXACTLY those headers — the answer's `anleitung` has the ready curl line; a missing header is a 403). Either way the answer is the `asset_key` — use it in lab_timeline_apply as clips[].asset_key (video) or bett.asset_key (audio). Exception: in projects that check images, an uploaded image is not in the project after the PUT — the answer then carries `abschluss_noetig` and an `abschluss_key`; after the PUT call lab_add_media again with the same project_id, art, herkunft and `abschluss_key` only. That call checks the image and returns the `asset_key`, or says why it was refused. Free. Internal addresses are refused.

  Paramètres, retour & exemple (7)

  Paramètres

  • art · string · requis · video | audio | image
    What the file is
  • herkunft · string · requis · eigen | ki
    Required, no default: 'eigen' = shot, recorded or made by people (no AI generation); 'ki' = generated or altered with AI. Decides the EU AI Act Art. 50 disclosure of every export that uses this file. If the file itself carries an AI mark (C2PA or IPTC source type), it stays AI material whatever you declare, and the answer says so.
  • file_name · string · optionnel
    Name of a local file to upload, with extension. Give this OR media_url
  • media_url · string · optionnel
    Public http(s) URL of the file. Give this OR file_name
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string
  • content_type · string · optionnel
    Media type of the upload, e.g. video/mp4, audio/mpeg — required with file_name
  • abschluss_key · string · optionnel
    Only after an upload whose answer said `abschluss_noetig`: the `abschluss_key` from that answer, given AFTER the PUT returned 200. Give it instead of media_url and file_name

  Exemple d'appel

  {"name": "lab_add_media", "arguments": {"art": "video", "herkunft": "eigen", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_analyze_location_image≈ 270 tokens

  Read a photo and extract location fields from it (Gemini Vision, costs credits — exact price via get_cost: true). Returns the fields — it does NOT create a board; feed the result into lab_create_location yourself. Note the payload: the image travels as base64 inside the call, so keep it small (a downscaled JPEG, not a full-resolution capture).

  Paramètres, retour & exemple (3)

  Paramètres

  • get_cost · boolean · optionnel
    Free: the exact price of this operation; nothing is rendered or charged. Name it to the person before the real run.
  • mime_type · string · optionnel
    Defaults to 'image/jpeg'
  • image_base64 · string · optionnel
    The image as base64. A data-URL prefix ('data:image/jpeg;base64,…') is stripped by the backend

  Exemple d'appel

  {"name": "lab_analyze_location_image", "arguments": {"get_cost": true, "mime_type": "texte", "image_base64": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_animate≈ 3730 tokens

  Animate a completed image into a clip with a video model. Pick the model from lab_list_models; check the price with get_cost or let the user confirm a card via lab_propose. Costs credits when called without get_cost.

  Paramètres, retour & exemple (31)

  Paramètres

  • seed · integer · optionnel
    Seed for a repeatable run. Omit it and the project's stored seed applies (POST /api/lab/projects/{id}/einstellungen), and without that the provider picks one. The seed that actually rendered comes back in lab_job_status as `seed` with `seed_quelle` ('provider' = read from the provider's answer, 'gesetzt' = the one sent, null = the model tells no seed). Models whose endpoint has no seed field do not drop a given seed silently: the run proceeds and the row carries `seed_hinweis: seed_nicht_unterstuetzt` — some models tell their seed but take none, others take one but tell none.
  • tool · string · optionnel
    Video model id — copy it verbatim from lab_list_models (kind: video). Omit to let the intent router choose. Every model has its own resolutions, duration grid, audio behaviour and price; the catalog is the only place those live, this text deliberately names none.
  • shots · array · optionnel
    Multi-shot: a sequence of shots rendered as ONE output, holding character, place and voice across the cuts. This is NOT the same as several clips stitched together — those you pay for individually and they do not hold the cast. PRICE: the billed length is the SUM of the shot durations, not duration_seconds. Three 5s shots cost the same as one 15s clip (140 credits at the reference resolution), not the same as one 5s clip (47). The sum must fit the provider's 3-15s window — each shot may be legal on its own and the sum still too long. Only kling_3_pro. Requesting it elsewhere is rejected before quota is spent.
  • in_sec · number · optionnel
    Cut the reference clip server-side before it reaches the provider: start of the excerpt, in seconds from the clip's beginning. Only together with out_sec, and only with source_video_id.
  • intent · string · optionnel
    Say WHAT the shot is instead of picking a model — the router chooses by priority and a cost cap. 'draft' and 'ambient' route to the cheapest provider, 'dialog' to the one with the steadiest faces, 'hero' to the most expensive on purpose, 'atmo' for atmosphere. Prefer intent over tool: it also gives you an automatic fallback to the next provider if the first one hard-fails. An explicitly set `tool` always wins over intent.
  • prompt · string · requis
    Motion/camera instruction for the animation
  • familie · string · optionnel · seedance-2.0 | seedance-2.5
    Pick the MODEL, not the access route: 'seedance-2.0' or 'seedance-2.5'. The server takes the cheapest route that this account may use and that can do the job (OpenRouter only with the user's consent; references, 1080p for 2.5, or audio switched off go to fal) and falls back to fal if a cheaper route fails — the fallback can cost more than the preflight price. Mutually exclusive with tool and intent.
  • out_sec · number · optionnel
    End of the excerpt in the reference clip, in seconds. Must lie behind in_sec; both are set together or neither. Only with source_video_id.
  • get_cost · boolean · optionnel
    Preflight: return the price in credits and your balance WITHOUT generating, reading the same catalog as lab_list_models. Do this before a batch or when the user wants to see the cost. For a card the user confirms, use lab_propose instead.
  • metadata · object · optionnel
    Free-form JSON stored alongside the video. Not interpreted by the pipeline.
  • audio_url · string · optionnel
    URL of an existing audio track to lay under the clip. Independent of generate_audio, which asks the PROVIDER to synthesise its own.
  • scene_ref · string · optionnel
    Scene label (e.g. 'SZ 04'). Stored on the row, so clips can be matched back to a shot list and reviewed per scene with lab_review_queue.
  • shot_type · string · optionnel · customize | intelligent
    How to cut a multi-shot clip. 'customize' (default) renders exactly the shots you gave. 'intelligent' lets the model decide the cutting — your shot prompts become a suggestion, not a spec. Belongs to `shots`; alone it is rejected.
  • apply_lens · boolean · optionnel
    Defaults to TRUE on the backend: the project's lens_state UrPrompt is appended to the prompt. Pass false only to deliberately opt out for this one call.
  • kamerapfad · object · optionnel
    The camera move as INPUT instead of prose: an object following shared/kamerapfad/schema.json — poses over time (position, look-at or quaternion, metres, Y up) from the Kadrage terrain flight or drawn by hand, or motion phases as lab_kamerafahrt reads them from a clip (its answer carries a ready `kamerapfad`). The backend validates it, derives phases, and then writes the move into the prompt IN THE FORM THIS MODEL UNDERSTANDS: prose at the camera slot for most families, bracketed director commands inside the prompt string for the MiniMax/Hailuo family, which parses them. NO MODEL RECEIVES THE POSES TODAY — the answer says which form went out (kamerapfad.angewandt = als_text or als_regiebefehle), names the family rule and the source it rests on (kamerapfad.sprache), and lists what that form could not carry (kamerapfad.nicht_gesendet, kamerapfad.befehle_weggefallen next to kamerapfad.befehle_gesamt). IF YOUR OWN PROMPT ALREADY CARRIES BRACKETED COMMANDS and the model parses them, the path is NOT sent on top of them — two chains would contradict each other at the same parser; the answer then says angewandt = eigene_regie and names what it found in kamerapfad.eigene_regiebefehle, and your prompt goes out unchanged. A `zusammenfassung` inside the path is display only and is NEVER sent — the move is always rebuilt from the phases; if nothing can be built (phases without tempo/verlauf), the answer says angewandt = nicht_ableitbar with the reason, and nothing of the path is in the prompt. Mutually exclusive with kamerapfad_url.
  • project_id · string · requis
    Project id (from lab_list_projects)
  • referenzen · array · optionnel
    Typed references for the clip path (source_video_id). The position IS the address: the first image is @Image1, the first extra clip is @Video2 (the reference clip itself is @Video1), the first sound is @Audio1. Write @bild1/@video1/@ton1 in the prompt and they are resolved to exactly these positions HERE, before anything is sent — no detour through lab_prompt_transform needed (it resolves them too when it rewrites a prompt). Every image reference is MEASURED before it is sent and scaled up to the model's minimum if it is below it; nothing is ever rejected for being small.
  • resolution · string · optionnel
    Resolution tier, exactly as listed for the model in lab_list_models. Omit for the model's default. Some models have no resolution field at all — then leave it out.
  • location_id · string · optionnel
    Location board id (from lab_list_locations). The board's `prompt_prefix_en` is appended to your prompt as 'Location: …', so a clip stays in the same place as the images shot there. A board WITHOUT a prefix anchors nothing and fails silently — check with lab_list_locations.
  • end_image_id · string · optionnel
    id of a completed image to land the clip on (last frame). REQUIRES a start frame (source_image_id or character_refs) — an end frame alone is rejected before quota is spent. Only kling_3_pro.
  • camera_motion · string · optionnel · dolly_in | dolly_out | dolly_left | dolly_right | jib_up | jib_down | static | focus_shift
    Structured camera move sent to the model itself — only models whose lab_list_models entry lists camera_motions. Prefer this over prose when a keyframe chain must MOVE rather than cross-fade.
  • ohne_keyframe · boolean · optionnel
    Skip the keyframe checkpoint on purpose. By default a paid clip only starts from a start image the user has approved (lab_review_asset verdict: accepted) — look at the frame first, then spend on the clip. Set true only when the user explicitly asked to skip the frame check.
  • character_refs · array · optionnel
    Character ids (positive integer strings) whose reference image locks the cast's identity for this clip. On most providers only the FIRST character's image is used, as the start frame — with two characters in frame the second is unbound. On kling_3_pro each character additionally becomes its own reference element (frontal view plus up to 3 further angles from its sheet), so all of them are bound. The response reports `elements_bound` and `characters_without_reference`.
  • generate_audio · boolean · optionnel
    Ask for the model's native audio track. Only meaningful where lab_list_models says audio: schaltbar — models with audio: immer always have it, audio: nie never.
  • kamerapfad_url · string · optionnel
    Address of a kamerapfad JSON instead of the object — the url of a file in THIS project (lab_list_assets), e.g. the kamerapfad JSON that Kadrage writes next to its flight video. Fetched by the backend under the same ownership rule as every reference: a file of another project is a named rejection before anything is charged. Mutually exclusive with kamerapfad.
  • source_image_id · string · optionnel
    id of a completed image (from lab_generate/lab_job_status) to animate — positive integer as string. Required unless get_cost is true. Imported Midjourney images work directly: use an image_id from lab_umzug.
  • source_video_id · string · optionnel
    Animate FROM A CLIP instead of a still: the id of a generated video (from lab_animate/lab_job_status) or the asset key of an uploaded one (from lab_list_assets, asset_type 'video'). The run then goes to the reference-motion path — your clip leads, the model restyles it. Mutually exclusive with source_image_id, and only for models that take a video reference (lab_list_models says v2v); The picture-side fields (end frame, shots, audio, location) do not travel this path and are rejected rather than dropped; character references exist here under a different name (ready image URLs instead of sheet ids) and are rejected too, with that reason. An intent IS resolved before the run and travels as the chosen model.
  • character_states · object · optionnel
    Which STATE each character is in for this clip, as { characterId: stateKey } — e.g. { "12": "wet" }. A state is its own asset with its own full descriptor (clean / soaked / bloodied are three assets, not one with a note), and it is the ONLY way that descriptor reaches a generation: the reference image always carries the BASE state, so without this field you get dry Cal in a scene where he just came out of the Thames — and the clip looks correct. Get the keys from lab_get_character_sheet. Every id here must also appear in character_refs (who is not in the frame is not described), and an unknown key is rejected before any quota is spent.
  • character_voices · object · optionnel
    Bind a voice per character: character id -> fal voice id. Voice ids come from fal-ai/kling-video/create-voice — FilmLab keeps no voice registry of its own, the id is passed through unverified. Every character named here must also be in character_refs AND must have a generated reference image (no image → no element → nothing to bind the voice to; rejected before quota is spent). Only kling_3_pro.
  • duration_seconds · number · optionnel
    Clip length in seconds. Must lie inside the model's duration grid from lab_list_models; inside the grid the provider may snap to its nearest step. IGNORED when `shots` is given — then the rendered length is the sum of the shot durations.
  • abdruck_startframe · boolean · optionnel
    Generate frame one WITH the character's trained Figurenabdruck (LoRA) instead of taking the flat studio portrait from the character sheet — the clip then starts IN the scene rather than in a photo studio. Opt-in: it costs one extra image (3 credits). Needs EXACTLY ONE character_ref that has a finished Abdruck, and is rejected together with source_image_id (that one PICKS frame one, this one MAKES it). Refused before any quota is spent.

  Exemple d'appel

  {"name": "lab_animate", "arguments": {"prompt": "texte", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_animate_batch≈ 1694 tokens

  Animate MANY images into videos in ONE call (max 25 jobs). Prefer this over looping lab_animate: it validates every job BEFORE spending any quota, so an invalid job 12 of 15 does not leave 11 paid-for generations running. Quota is spent once, collectively (one ledger row); refunds stay per-clip, so a partial failure refunds only that clip. Returns a batch_id — poll lab_batch_status with it instead of polling each id separately. `get_cost: true` preflights the whole batch without generating anything.

  Paramètres, retour & exemple (4)

  Paramètres

  • jobs · array · requis
    One entry per clip, max 25. All jobs are validated before any quota is spent
  • get_cost · boolean · optionnel
    Preflight: return the summed price in credits for the WHOLE batch and your balance WITHOUT generating, reading the same catalog as lab_list_models. For a card the user confirms, use lab_propose instead.
  • project_id · string · requis
    Project id (from lab_list_projects)
  • ohne_keyframe · boolean · optionnel
    Skip the keyframe checkpoint on purpose. By default a paid clip only starts from a start image the user has approved (lab_review_asset verdict: accepted) — look at the frame first, then spend on the clip. Set true only when the user explicitly asked to skip the frame check.

  Exemple d'appel

  {"name": "lab_animate_batch", "arguments": {"jobs": [], "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_apply_rhythm≈ 628 tokens

  Compute the sequence's clip durations from the project's cutting preset and — when the tempo allows it — pull the cut points onto the measured beat grid. WRITES the timeline; costs nothing. The old duration of every changed clip is kept in `clip.metadata.dauer_vorher`, so one undo step exists (a second differing run overwrites it — there is no history). Clip count is never changed: no clip is added or removed. SNAPPING IS NOT GUARANTEED, AND A REFUSAL TO SNAP IS A RESULT, NOT A FAILURE — read `gerastet` and `raster.grund` before you repeat anything: 'tempo_unverlaesslich' = measured below the confidence threshold (deliberate; pass trotz_unsicherem_tempo to override), 'nicht_gemessen' = run lab_beatgrid first, 'keine_musikspur'/'musikspur_nicht_aufgeloest' = run lab_bind_audio first, 'rhythmus_ohne_raster' = the preset's rhythm is 'frei' or 'atmend', which means not snapping IS the promise ('auf den Beat', 'auf die Songstruktur' and 'gegen den Takt' are the three that snap), 'toleranz_null' = you passed toleranz_s 0. In every one of those cases the durations are still recomputed from the preset and written — that alone is the difference between 40 and 6 cuts over 30 seconds. Also read `raster.getroffen` of `raster.von`: `gerastet: true` only says snapping ran; this pair says whether it landed. And `geklemmt` lists clips the renderer's own duration clamp moved back OFF the grid.

  Paramètres, retour & exemple (3)

  Paramètres

  • seq_id · string · requis
    Sequence id (from lab_create_sequence/lab_list_sequences) — positive integer as string
  • toleranz_s · number · optionnel
    How far a cut point may travel to land on a beat, in seconds (default 0.12 — three frames at 25 fps). 0 disables snapping entirely and only recomputes the durations
  • trotz_unsicherem_tempo · boolean · optionnel
    Snap onto a grid whose own measurement reports `verlaesslich: false`. Default false, and that default is the honest one: below the threshold the detector has not confirmed it found the pulse. Set it only as a deliberate decision — the answer then carries raster.unsicheres_tempo_uebergangen: true

  Exemple d'appel

  {"name": "lab_apply_rhythm", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_aufloesung≈ 584 tokens

  Break one scene down into a STRUCTURED shot list of 2, 4 or 6 shots — each with shot size, camera angle, purpose and its own ready prompt, plus one shared floor plan (anchor, axis, light) so the shots cut together. Two families: an 'aufloesung' shows ONE moment from several angles (coverage, dialog, orbit, pov, zwischenschnitte for cutaways …); a 'montage' lets time pass between shots (ursache_wirkung, zeitverlauf, kleiner_bogen …). An unknown art is rejected with the list of known ones. Costs no credits: it is one text-model call and renders nothing; generate the shots afterwards with lab_generate / lab_animate, one prompt each. This is NOT lab_shots_ableiten — that one groups clips that already exist on a timeline; this one plans shots that do not exist yet. By default nothing is written. uebernehmen=true appends the shots as scenes to the project's shot list (mod_shotlist), which the image and video steps read — ask before you set it.

  Paramètres, retour & exemple (6)

  Paramètres

  • art · string · optionnel
    Which breakdown. Default coverage. Known: coverage, dialog, winkel, hoehen, orbit, pov, naehe, gesicht, haende, reaktionen, zwischenschnitte (aufloesung); ursache_wirkung, entdeckung, zeitverlauf, gefuehlswende, kleiner_bogen (montage).
  • laenge · integer · optionnel
    Number of shots: 2, 4 or 6. Default 4. Never odd — a breakdown runs in pairs.
  • prompt · string · requis
    The scene or the master prompt to break down
  • scene_ref · string · optionnel
    Optional scene reference the shots are filed under when uebernehmen=true
  • project_id · integer · requis
    The project the scene belongs to
  • uebernehmen · boolean · optionnel
    Default false. true appends the shots to the project's shot list — ask first.

  Exemple d'appel

  {"name": "lab_aufloesung", "arguments": {"prompt": "texte", "project_id": 1}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_auto_lauf≈ 471 tokens

  Auto run with a hard spending cap: the person approves ONE run with an upper limit in credits; inside it you may generate without asking per item, but never above the cap. aktion: anlegen (project_id + deckel_credits → status 'angelegt', nothing can be spent yet) · freigeben (ONLY after the person explicitly approved the cap) · stand (cap, reserved, free, items) · beenden. While a run is active, EVERY paid call in that project reserves its price against the cap — whichever tool makes it; reservations are never refunded (a failed item keeps its share, a retry reserves again), upscales and exports count too. The cap counts credits: runs on the person's OWN provider key (BYOK, 0 credits) are not counted. Other projects are not affected. When the cap would be crossed the backend answers budget_exceeded: stop, report what finished, what is open and the minimum budget still needed. Under budget pressure lower the resolution first, never cut runtime, never drop character or location variants.

  Paramètres, retour & exemple (4)

  Paramètres

  • aktion · string · requis · anlegen | freigeben | stand | beenden
    What to do
  • lauf_id · string · optionnel
    freigeben / stand / beenden: the id from anlegen
  • project_id · string · requis
    Project id (from lab_list_projects)
  • deckel_credits · integer · optionnel
    anlegen only: the cap in credits. Name it to the person in credits AND in the price list's terms before freigeben

  Exemple d'appel

  {"name": "lab_auto_lauf", "arguments": {"aktion": "anlegen", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_auto_storyboard≈ 1086 tokens

  Auto-generate a storyboard from either script OR situationen (mutually exclusive). An LLM splits script into scenes; situationen bypasses that LLM entirely and generates exactly one frame per entry, ignoring max_scenes. situationen requires figur_id of an existing character sheet with a reference image: every frame uses that character on seedream_5_pro, without creating a new sheet. format selects 16:9 (default) or 9:16 for every model. bewegung_en is saved in each frame’s metadata for later animation. COSTS CREDITS — every scene is one generated image, charged up front for the number of scenes the script is split into (at most max_scenes). Ask the human before running it. CHARACTERS ARE NOT GUESSED: every character who appears in more than one frame first gets a reference image (an existing project character with a reference is reused for free; a new one is created and its reference sheet is charged separately as character_sheet_generate), and every frame showing such a character is generated WITH those references on seedream_5_pro instead of `model`. Frames without a recurring character use `model`. The answer lists `figuren` (name, status, scenes), `figuren_kosten_geschaetzt` and `kosten_je_bild`; prices per model come from lab_list_models. If a reference cannot be made, the frames that need it fail and are refunded — they are never generated without it. The scene split is SYNCHRONOUS and can take up to ~55s and then time out (504) for long scripts; run it in the app if so. The answer lists the new image ids; the frames themselves render in the background as pending images — poll them with lab_job_status (type 'image').

  Paramètres, retour & exemple (10)

  Paramètres

  • model · string · optionnel · krea_2_medium | krea_2_large | krea_2_turbo | flux_pro
    Image model for the frames. Default krea_2_medium. Prices per model: lab_list_models.
  • format · string · optionnel · 16:9 | 9:16
    Frame aspect ratio for every model, default 16:9
  • script · string · optionnel
    Screenplay or scene description; provide either script or situationen. The backend splits script into scenes; each scene becomes one image.
  • figur_id · integer · optionnel
    Existing character-sheet id with a reference image; required for situationen, only used with situationen
  • creativity · string · optionnel · raw | low | medium | high
    Krea 2 creativity setting; ignored by flux_pro. Default medium.
  • max_scenes · integer · optionnel
    Upper limit for the number of scenes, and therefore images charged. Backend default when omitted.
  • project_id · string · requis
    Project id
  • situationen · array · optionnel
    Independent situations, each exactly one frame. Requires figur_id; excludes script and figuren_raten.
  • figuren_raten · boolean · optionnel
    Opt-out, off by default: true skips the character references and lets the image model invent every character from the text — a different face in every frame. Only set it when the human explicitly asks for that; it is recorded on every frame (figuren_geraten).
  • style_reference_url · string · optionnel
    Shared moodboard image applied to ALL frames for one consistent look. Used by Krea 2 and by the Seedream character-reference path (one additional reference, included in pricing). Must be an asset of this project or an absolute URL — anything else is refused before credits are spent.

  Exemple d'appel

  {"name": "lab_auto_storyboard", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_batch_status≈ 213 tokens

  Aggregated progress of a video batch started by lab_animate_batch. Returns {total, completed, failed, pending, done, items[]} — poll this ONCE per batch instead of calling lab_job_status per clip. `done: true` means nothing is pending any more (some items may still have failed). Each item carries retry_count (an automatic second attempt happened) and fallback_from (the provider was swapped after a content-policy rejection).

  Paramètres, retour & exemple (1)

  Paramètres

  • batch_id · string · requis
    The batch_id returned by lab_animate_batch (format: vb_<hex>)

  Exemple d'appel

  {"name": "lab_batch_status", "arguments": {"batch_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_beat_clips≈ 444 tokens

  Turn the still-image clips of a sequence into video clips that exactly fill their beat-snapped slots. Free — this tool itself generates nothing. aktion plan: one job per image clip, ready for lab_animate_batch — start image, the frame's motion (bewegung_en), and the SMALLEST duration the model can deliver that still covers the clip's timeline duration (a shorter video would end early and shift every later cut off the beat). Refuses with 409 if a start image is not accepted yet. Pass the returned `jobs` unchanged to lab_animate_batch (get_cost first, then run). aktion einsetzen: once the videos are done, each finished video replaces its image clip — same duration, source in-point 0. Repeatable; reports what is still open and any video shorter than its slot (left as still). Run lab_beatgrid and lab_apply_rhythm on the sequence BEFORE plan, so the durations are the beat durations.

  Paramètres, retour & exemple (4)

  Paramètres

  • tool · string · optionnel
    plan only: video model id from lab_list_models — default vidu_q3_turbo (1-second grid)
  • aktion · string · requis · plan | einsetzen
    plan: build the animate jobs; einsetzen: put finished videos into the timeline
  • seq_id · string · requis
    Sequence id (from lab_create_sequence/lab_list_sequences) — positive integer as string
  • resolution · string · optionnel
    plan only: resolution tier from lab_list_models — default 720p

  Exemple d'appel

  {"name": "lab_beat_clips", "arguments": {"aktion": "plan", "seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_beatgrid≈ 702 tokens

  Measure the TEMPO of the sequence's bound music track and store the beat grid — opens the real file with ffmpeg and analyses it, no guessing and no provider, so it costs nothing but a few seconds. Writes `bpm` and `metadata.beat_grid` on the audio row; it does NOT touch the timeline (`timeline_geaendert: false`). Deterministic and cached: a second call returns the same numbers without downloading again (pass `neu_messen` to force). READ `confidence` AND `verlaesslich` BEFORE YOU CUT. Below the threshold (0.35) lab_apply_rhythm computes durations but deliberately does NOT snap them to the grid — that is a decision, not a failure. Soft material measures badly: a real swing track came out at 0.164, an ordered hard pulse (techno, 128 bpm) at 0.621. Half and double tempo are the classic misreads, so `bpm_alternativen` is part of the answer. `frame_konflikt` reports the collision between beat grid and frame grid, for BOTH renderers: `export` (24 fps, the delivered MP4) and `murnau` (25 fps, the editor timeline). Read `frames_pro_schlag` as a DEVIATION, not a count: it is how far one beat sits from a whole frame, between 0 and 0.5. 0 means beat and frame coincide (100, 125 and 150 bpm at 25 fps do); anything above means beat-accurate and frame-accurate cannot both hold, and the rounding error accumulates across clips — measured on a finished MP4 at 128 bpm: up to 64.7 ms off the audible beat although every cut point had snapped. Shown here, not fixed: that decision belongs to a human. Refusals that name their own remedy: 409 without a bound music track (run lab_bind_audio), 409 when the track is pending (poll lab_list_audio), 502/504 when the audio host is unreachable or slow, 422 when the file carries no usable audio, 503 when ffmpeg is missing.

  Paramètres, retour & exemple (3)

  Paramètres

  • takt · integer · optionnel
    Beats per bar (default 4). INPUT, not detection — time-signature detection is explicitly out of scope. It only affects where the downbeats fall, which is what the rhythm 'auf die Songstruktur' snaps to
  • seq_id · string · requis
    Sequence id (from lab_create_sequence/lab_list_sequences) — positive integer as string
  • neu_messen · boolean · optionnel
    Measure again even though a result for this exact file already exists. Default false. The measurement is deterministic — the same file gives the same number, so this only helps after the track behind the url was swapped

  Exemple d'appel

  {"name": "lab_beatgrid", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_bilder≈ 436 tokens

  See a clip at EXACT seconds: up to 12 frames, in the order you list them, tiled into one image and shown. Use it to check what is on screen where you plan a cut, whether a motion has ended, or whether a face drifted between two moments — lab_contact_sheet spreads frames evenly and cannot answer 'what is at 3.2 s'. A second past the clip's end is rejected by name, not clamped. Works on generated clips (video_id) AND on your own uploaded footage (project_id + asset_key from lab_add_media) — look at it before you cut it. Free (no credits).

  Paramètres, retour & exemple (6)

  Paramètres

  • preview · boolean · optionnel
    Show the image inline (default true)
  • sekunden · array · requis
    Seconds into the clip, e.g. [0.5, 3.2, 3.24]. Order is kept: left to right, then the next row (4 per row)
  • video_id · string · optionnel
    Generated video id (from lab_animate/lab_job_status) — positive integer as string. Give this OR asset_key
  • asset_key · string · optionnel
    Storage key of uploaded footage (from lab_add_media / lab_list_assets). Needs project_id
  • project_id · string · optionnel
    Project the asset_key belongs to — required with asset_key
  • kachel_breite · integer · optionnel
    Width of one frame in px (default 480)

  Exemple d'appel

  {"name": "lab_bilder", "arguments": {"sekunden": []}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_bind_audio≈ 580 tokens

  Bind the project's generated audio to a sequence's tracks — ONE call that does both halves of the job, because doing only the first half silently produces a silent film. Half one (`POST …/soundmix`) creates the four empty tracks (dialog, music, sfx, atmo); half two (`POST …/soundmix/resolve-stems`) is what actually attaches the audio rows to them. On 2026-08-28 that split cost a complete silent export: the mix looked configured, and every track was empty. From here it is one tool, and it is idempotent — an existing mix is NOT re-initialised (that would throw away volumes, effects and the other tracks' bindings), only re-resolved. Per track it takes the audio row marked `selected`, otherwise the newest one with a url. Rows still pending have no url and stay unbound. That choice is re-made on every call: generate a second music track and run this again, and the music track follows the NEWER row — unless one row is pinned with `selected`, which is set in the web UI. With `audio_ids` the named rows are bound and PINNED, and every track you do NOT name is pinned EMPTY (so an old narrator or sfx row of the project cannot slip into the mix); later automatic resolves, e.g. before a render, keep all of that. A call WITHOUT `audio_ids` releases every pin and resolves as described above. Changes state, costs nothing. Next: lab_beatgrid.

  Paramètres, retour & exemple (2)

  Paramètres

  • seq_id · string · requis
    Sequence id (from lab_create_sequence/lab_list_sequences) — positive integer as string
  • audio_ids · object · optionnel
    Bind EXACTLY these rows instead of the newest/selected one per track, as { music: '12', dialog: '13' }. Named tracks are pinned to these rows, tracks you leave out are pinned empty. Each row must belong to this project, match the track's audio type and have a file.

  Exemple d'appel

  {"name": "lab_bind_audio", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_capture≈ 456 tokens

  See the CUT at exact seconds of the finished film: up to 12 frames, tiled into one image and shown. Each second is mapped like the export maps it — which clip is on screen, where in its source (src_in_s counts), the export's framing (scaled and letterboxed), title cards drawn. A video whose source is shorter than its clip duration ends early in the export, and everything after it moves forward; this tool follows that, so you see the film that will be rendered. The answer names per frame the clip (position, clip_id), clip start and offset; a clip that would render black says so ('schwarz'). NOT in the image: lens/grade, lower thirds, the AI badge — that needs lab_start_export. Use it after lab_timeline_apply to check cut points before exporting. Free (no credits).

  Paramètres, retour & exemple (5)

  Paramètres

  • seq_id · string · requis
    Sequence id — positive integer as string
  • preview · boolean · optionnel
    Show the image inline (default true)
  • profile · string · optionnel
    Export profile key (default 'web'); a 9:16 profile gives portrait frames — see lab_export_profiles
  • sekunden · array · requis
    Seconds into the finished film, e.g. [0.5, 4.9, 5.1]. Order is kept: left to right, then the next row (4 per row)
  • kachel_breite · integer · optionnel
    Width of one frame in px (default 480)

  Exemple d'appel

  {"name": "lab_capture", "arguments": {"seq_id": "texte", "sekunden": []}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_cast_autopopulate≈ 242 tokens

  Create character sheets for the people found in a project's material — the writing counterpart to lab_cast_gaps. Creates at most 6 per call and binds each to the project. Costs an LLM run per call. Run lab_cast_gaps first if you want to see what it would create. The sheets it creates have NO reference image: each one still needs lab_generate_character_reference before lab_generate accepts it as `character_refs`. Fail-open: no script or no AI key returns an EMPTY `created` list with a `note`, not an error.

  Paramètres, retour & exemple (1)

  Paramètres

  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string

  Exemple d'appel

  {"name": "lab_cast_autopopulate", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_cast_gaps≈ 233 tokens

  Find people who appear in a project's material (script / cast module) but have NO character sheet yet. Returns up to 6 `missing` entries, each with a name and a short hint from the text. It creates nothing — lab_cast_autopopulate does that. Costs an LLM run, so it is credit-gated. Fail-open by design: no script, no AI key, or an unparseable answer all come back as an EMPTY list (with a `note` saying which) — an empty list is the correct answer, not an error.

  Paramètres, retour & exemple (1)

  Paramètres

  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string

  Exemple d'appel

  {"name": "lab_cast_gaps", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_contact_sheet≈ 428 tokens

  Build a contact sheet for a generated clip — N frames spread evenly over its runtime, tiled into ONE image — and show it. This is how a clip gets judged at all: MCP has no video content type, so without a sheet a clip is just a URL and a promise. It is also the fastest way to SEE camera drift: measured 2026-08-04, the wander in one clip was a PSNR number until frames sat side by side. The sheet is cached on the video row — a second call returns the same URL without re-rendering (pass force to redo it). Rendering downloads the clip and runs ffmpeg, so the first call takes a few seconds.

  Paramètres, retour & exemple (6)

  Paramètres

  • cols · integer · optionnel
    Grid columns (default 3)
  • rows · integer · optionnel
    Grid rows (default 3). cols x rows = number of frames
  • force · boolean · optionnel
    Re-render even if a sheet already exists
  • width · integer · optionnel
    Total sheet width in px (default 1280)
  • preview · boolean · optionnel
    Attach the sheet itself, downscaled to 512px, instead of only its URL. Default true — showing it is the whole point; pass false to get just the URL.
  • video_id · string · requis
    Generated video id (from lab_animate/lab_job_status) — positive integer as string

  Exemple d'appel

  {"name": "lab_contact_sheet", "arguments": {"video_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_continuity_check≈ 416 tokens

  Start the continuity pass over a sequence — every shot is compared against its PREDECESSOR and, with check_references, against the character and location reference boards. This is the pass that catches drift (the flat that changed between two shots, the cardigan that turned into a coat), which is the actual enemy in AI film, not the cut. Runs in the BACKGROUND: returns a `job_id` with HTTP 202 — poll it with lab_get_job until status is done|failed, the findings sit in the job result. Two refusals worth knowing before you spend time: an empty timeline is rejected with 400 (add shots with lab_add_clip first), and the backend answers 503 if GEMINI_API_KEY is not configured.

  Paramètres, retour & exemple (3)

  Paramètres

  • model · string · optionnel
    Vision model for the comparison. Omit it — the backend resolves its default through the model catalogue, so it follows a model retirement on its own. A literal passed here does not, and that is how a dead model id stays wired in
  • seq_id · string · requis
    Sequence id (from lab_create_sequence/lab_list_sequences) — positive integer as string
  • check_references · boolean · optionnel
    Also check every shot against the character and location reference boards, not just against its predecessor. Backend default is true; pass false for a cheaper neighbour-only pass

  Exemple d'appel

  {"name": "lab_continuity_check", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_create_character≈ 654 tokens

  Create a character sheet for a human, animal or creature in the cast register. The backend derives an English `prompt_prefix_en` from the fields you give — that prefix is what later describes this character in every image, so the richer the description, the more stable the identity. This is step 1 of 2: a fresh sheet has NO reference image and is therefore not yet usable as `character_refs`. Run lab_generate_character_reference on the returned id to finish it. Free — it writes a row, it burns no credits.

  Paramètres, retour & exemple (14)

  Paramètres

  • age · integer · optionnel
    Age in years, as a number
  • eyes · string · optionnel
    Eye colour and expression
  • hair · string · optionnel
    Hair colour, length, cut
  • name · string · requis
    Character name, e.g. 'Maren' — the only required field
  • skin · string · optionnel
    Skin tone and texture
  • build · string · optionnel
    Body build and posture
  • gender · string · optionnel
    e.g. 'female', 'male', 'non-binary'
  • gattung · string · optionnel · mensch | tier | kreatur |
    Character kind: human, animal or creature. Omitted or empty means mensch. For tier/kreatur, begin the description with the species and its distinctive features.
  • clothing · string · optionnel
    Default costume the character is seen in
  • demeanor · string · optionnel
    How the character moves and behaves, in prose
  • project_id · string · optionnel
    Bind the sheet to this project (from lab_list_projects) — positive integer as string. PASS THIS whenever the character belongs to a project. Without it the sheet stays an orphan: lab_cast_gaps will not count it as created, and image generation will not find it as a char_ref.
  • project_name · string · optionnel
    Free-text project label shown in listings (does NOT bind the sheet — that is project_id)
  • facial_features · string · optionnel
    Face shape, nose, mouth, jaw — what makes this face recognisable
  • distinctive_features · string · optionnel
    Scars, tattoos, glasses, anything that must appear in every image

  Exemple d'appel

  {"name": "lab_create_character", "arguments": {"name": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_create_location≈ 424 tokens

  Create a location board. The backend derives an English `prompt_prefix_en` from the fields you give — that prefix is what later anchors every image and clip shot there, so the richer the description, the more consistent the place. Pass project_id to bind the board to a project (recommended: unbound boards are invisible to lab_list_project_locations).

  Paramètres, retour & exemple (11)

  Paramètres

  • name · string · requis
    Board name, e.g. 'Wohnung Hanna — Balkon'
  • props · string · optionnel
    Objects that must be present
  • colors · string · optionnel
    Dominant palette
  • atmosphere · string · optionnel
    Mood, weather, sound of the place
  • project_id · string · optionnel
    Bind the board to this project (from lab_list_projects) — positive integer as string
  • description · string · optionnel
    What the place is, in prose
  • time_of_day · string · optionnel
    e.g. 'morning', 'blue hour', 'night'
  • architecture · string · optionnel
    Building style, era, materials
  • project_name · string · optionnel
    Free-text project label shown in listings
  • location_type · string · optionnel
    e.g. 'interior', 'exterior', 'apartment', 'street'
  • lighting_notes · string · optionnel
    Light direction, quality, sources

  Exemple d'appel

  {"name": "lab_create_location", "arguments": {"name": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_create_project≈ 114 tokens

  Create a new FilmLab project. Returns the new project id. Optionally set a title.

  Paramètres, retour & exemple (1)

  Paramètres

  • title · string · optionnel
    Project title (optional)

  Exemple d'appel

  {"name": "lab_create_project", "arguments": {"title": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_create_sequence≈ 220 tokens

  Create a sequence (Stage 9 timeline) inside a project — START HERE to turn generated shots into something the continuity pass can read. The new sequence is EMPTY: add shots with lab_add_clip before anything else works. lab_continuity_check rejects an empty timeline with 400. Returns the sequence record including its `id`.

  Paramètres, retour & exemple (2)

  Paramètres

  • title · string · optionnel
    Sequence title. Defaults to 'Main Sequence' on the backend
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string

  Exemple d'appel

  {"name": "lab_create_sequence", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_delete_location≈ 213 tokens

  DELETE a location board permanently. There is no undo and no soft-archive — the row is removed. Images and clips that were generated with this `location_id` keep their already-rendered prompt, but the board they point at is gone: nothing can be re-anchored to it, and lab_get_location will 404. Confirm with the user before calling this. Use lab_restyle_location if you only want the place to look different.

  Paramètres, retour & exemple (1)

  Paramètres

  • loc_id · string · requis
    Location board id to delete permanently (from lab_list_locations)

  Exemple d'appel

  {"name": "lab_delete_location", "arguments": {"loc_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_depth_map≈ 593 tokens

  Create or read a depth map for a project video in FilmLab: use it for fog, depth of field, relighting or occlusion. Near is white, like Resolve's Depth Map. Free on our own CPU, no credits; processing takes minutes. modell: v2 (default) is Depth Anything V2, sharpest edges. vda is Video Depth Anything: steadier over time (no brightness pumping across the shot, slightly less flicker), softer edges, about 2x slower than v2 (on our server ~0.5 s per frame for v2, ~1.1 s for vda), only for 16:9 landscape or 9:16 portrait videos (16:10 and 1.85:1 are fine, 4:3 and 2.39:1 are not). Each modell keeps its own map; always pass the same modell when reading again (engine in the answer says which one). Reuses the existing map or running job by default; neu: true starts a new job. Returns status and job_id; when done, tiefe_url is FFV1 gray16 and vorschau_url is a playable H.264 grayscale preview, both signed for download without a browser session. wait_s waits at most 15 seconds (default 0). If still running, call this tool again with the same project_id, video_id and modell, neu: false. Once done, use resolve_ergebnis_an_timeline with vorschau_url to put the preview as a matte above the original clip in Resolve.

  Paramètres, retour & exemple (6)

  Paramètres

  • neu · boolean · optionnel
    Start a new depth job instead of reusing the existing map or running job (default false)
  • modell · string · optionnel · v2 | vda
    Depth engine: v2 (default, sharpest) or vda (steady over time, 16:9 or 9:16 only)
  • wait_s · number · optionnel
    Wait up to this many seconds for completion (default 0, maximum 15)
  • video_id · integer · requis
    Completed video id belonging to this project
  • nur_lesen · boolean · optionnel
    Only read: never create a job. Without an existing job the answer is status 'keine' (default false)
  • project_id · string · requis
    Project id (from lab_list_projects)

  Exemple d'appel

  {"name": "lab_depth_map", "arguments": {"video_id": 1, "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_diagnose≈ 225 tokens

  Is everything wired? Backend reachability and latency, identity, credit check, catalog age, last error of this account, host widget support. Traffic light plus one sentence per point. Read-only, free.

  Paramètres, retour & exemple (1)

  Paramètres

  • problem_report · boolean · optionnel
    Return the same findings as one block of text to paste into a bug report. This covers the MCP side only — server version, backend health, last failed job of this account. The Resolve bridge log lives on the user's machine and cannot be read from here: have them press ‚Problem-Report kopieren‘ in the bridge panel for bridge version, Resolve build, Python and the last 200 log lines.

  Exemple d'appel

  {"name": "lab_diagnose", "arguments": {"problem_report": true}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_dossier≈ 471 tokens

  Build a dossier of a project's takes: one ZIP with an offline index.html (no external resources) plus the media files, named Project_SceneNN_YYYYMMDD-Tnn.ext. modus 'kunde' is for a client and NEVER shows seed or costs, whatever the switches say; 'intern' shows everything that helps to rebuild a take. Both modes carry the AI disclosure (EU AI Act Art. 50) on the page and in the image files. Free (no credits). Runs as a job — poll lab_get_dossier.

  Paramètres, retour & exemple (6)

  Paramètres

  • modus · string · optionnel · kunde | intern
    kunde (default) or intern
  • auswahl · string · optionnel · gewaehlt | alle
    gewaehlt (default): the selected take per scene, plus every take without a scene (e.g. a series) that is not rejected; alle: every take that is not rejected. Stars/favourites do not count as a selection.
  • bild_ids · array · optionnel
    Exactly these image ids (overrides auswahl)
  • schalter · object · optionnel
    Switches: prompt, referenzen, aufloesung_dauer, datum, modell, seed, kosten, audio, mini_proxies (480p video proxies). Unknown keys are ignored.
  • video_ids · array · optionnel
    Exactly these video ids (overrides auswahl)
  • project_id · string · requis
    Project id

  Exemple d'appel

  {"name": "lab_dossier", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_dub≈ 1109 tokens

  Dub a sequence into another language: either a ready audio track (en_audio_url — e.g. the one lab_dub_tts just produced) OR a cloned voice reading a line of text (voice_id + dub_text), then a controlled visual lipsync runs over the sequence's own footage (ROI-crop + composite for a long static talking-head shot, or the full-frame veed_v2 path for multi-shot sequences and shots where the mouth is partly hidden). ASYNCHRONOUS: returns a job_id immediately: poll lab_job_status until it completes. Needs a cloned voice first — lab_voice_clone makes one, lab_list_voices shows what a project already has.

  Paramètres, retour & exemple (11)

  Paramètres

  • seq_id · string · requis
    Sequence id (from lab_create_sequence/lab_list_sequences) — positive integer as string
  • backend · string · optionnel · replicate | inhouse | veed_v2
    Lipsync engine. Omit to use the backend default (replicate — ROI-crop, best for one long static talking-head shot). veed_v2 renders the full frame instead and is the pick for multi-shot sequences or a partly hidden mouth. 'inhouse' shares replicate's ROI-crop path.
  • dub_text · string · optionnel
    The line(s) this cloned voice should read, in the target `language`. Required together with voice_id.
  • get_cost · boolean · optionnel
    `true` reports the price and your balance WITHOUT starting a dub and without spending quota. The number is computed by the same function that later charges you, from THIS sequence: a sound rate per video clip, plus the chosen lipsync engine's own rate over the sequence's running time, plus a surcharge for the cloned-voice reading. `preisbasis` in the answer breaks it into those parts, so you can see which switch moves which share — turning the lipsync pass off removes its whole item. Not drawn from the lab_list_models catalog (that covers image and video models only; the lipsync engine is chosen with `backend` here, and dub has no catalog entry).
  • language · string · requis
    Target language for the dub, e.g. 'de', 'fr', 'es' — drives the cloned voice's TTS. Required: there is no silent default here.
  • voice_id · string · optionnel
    A cloned voice's id (lab_cloned_voices.id, from lab_voice_clone or lab_list_voices) — positive integer as string. Required together with dub_text, and mutually exclusive with en_audio_url.
  • einwilligung · boolean · optionnel
    Consent of the person whose mouth this dub re-syncs, when there is no Likeness Register id for them yet. Required together with einwilligung_notiz if likeness_ref is not given — a dub always alters a real person's mouth in existing footage, so one of the two consent forms is mandatory, checked before anything is spent. This is a caller attestation, not a registry check like likeness_ref — logged, not verified against likeness.thefilmradar.com. Do not set it to be rid of the error — set it because the consent exists.
  • en_audio_url · string · optionnel
    URL of a READY dub track to lay under the sequence — typically the audio_url lab_dub_tts just returned. Mutually exclusive with voice_id+dub_text: a dub has exactly one audio source, and picking one silently would throw away the other after it was paid for.
  • likeness_ref · string · optionnel
    A Likeness Register consent id (likeness.thefilmradar.com) for the person whose mouth this dub re-syncs. Checked live against the register before anything is spent; a revoked or unknown id refuses the call. Mutually exclusive with einwilligung+einwilligung_notiz — one form of consent is required, not both.
  • enable_lipsync · boolean · optionnel
    Whether to run the visual lipsync pass at all. Omit to use the backend default (on). Off only swaps the audio track and skips the mouth-sync render entirely.
  • einwilligung_notiz · string · optionnel
    Free text: who consented, when, and for what — required together with einwilligung. Goes on record with the generated clip.

  Exemple d'appel

  {"name": "lab_dub", "arguments": {"seq_id": "texte", "language": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_dub_tts≈ 450 tokens

  Generate the EN-dub audio track for a sequence via ElevenLabs TTS — SYNCHRONOUS, returns a ready audio_url immediately, no job_id and nothing to poll. Optionally pads the track with silence up to the sequence's own length so a shorter reading doesn't shorten the final cut. Feed the resulting audio_url into lab_dub's en_audio_url to lipsync the sequence to this track.

  Paramètres, retour & exemple (5)

  Paramètres

  • text · string · requis
    The line(s) to speak. Kept short — very long text is rejected by the backend before anything is spent.
  • seq_id · string · requis
    Sequence id (from lab_create_sequence/lab_list_sequences) — positive integer as string
  • get_cost · boolean · optionnel
    `true` reports the price and your balance WITHOUT generating anything and without spending quota. This one is billed flat, one sound rate per run — the length of your text does not change it. Not drawn from the lab_list_models catalog (that covers image and video models only): the TTS voice is picked with `voice_id`, and the price does not follow the voice.
  • voice_id · string · optionnel
    An ElevenLabs voice id, from lab_dub_voices. Omit to use the backend's configured default voice — NOT a lab_cloned_voices id.
  • pad_to_video · boolean · optionnel
    Pad the generated track with silence up to the sequence's own duration if the reading comes out shorter. Omit to use the backend default (on).

  Exemple d'appel

  {"name": "lab_dub_tts", "arguments": {"text": "texte", "seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_dub_voices≈ 154 tokens

  List the ElevenLabs TTS voices available for lab_dub_tts's `voice_id` — this is the EN-dub-track text-to-speech voice list, NOT a project's cloned voices (those are lab_list_voices). Reads only — no state changes, no credits. If ELEVENLABS_API_KEY isn't configured on the backend the list comes back empty and `configured` is false.

  Paramètres, retour & exemple (0)

  Exemple d'appel

  {"name": "lab_dub_voices", "arguments": {}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_enrich_location_prefix≈ 266 tokens

  Append context to a board's `prompt_prefix_en` (plain string concatenation server-side — no AI call, no quota). Idempotent: context already present in the prefix is not duplicated. This does NOT rewrite or regenerate the prefix — for a board whose prefix is empty, too thin or a raw field dump, use lab_restyle_location (it rewrites prompt_prefix_en with an AI call, costs credits — exact price via get_cost: true) instead of recreating the board.

  Paramètres, retour & exemple (2)

  Paramètres

  • loc_id · string · requis
    Location board id (from lab_list_locations)
  • context · string · requis
    What to add or sharpen, e.g. 'late 1970s West Berlin, nicotine-stained walls'

  Exemple d'appel

  {"name": "lab_enrich_location_prefix", "arguments": {"loc_id": "texte", "context": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_export_profiles≈ 199 tokens

  List the available export delivery profiles (web, social_vertical, social_youtube, streaming_hdr, cinema, master, alpha_prores4444, alpha_png_sequence) and quality presets (draft, standard, high). Call this before lab_start_export to pick a valid profile/quality. The two alpha profiles keep transparency (ProRes 4444, or one RGBA PNG per frame delivered as a zip) and are REFUSED unless the sequence actually carries an alpha source — a cut-out layer element, or a Switch X transform whose alpha track was kept.

  Paramètres, retour & exemple (0)

  Exemple d'appel

  {"name": "lab_export_profiles", "arguments": {}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_fassungen≈ 678 tokens

  Use when the person asks about earlier states of a cut, wants to go back to a previous version, compare versions, name a version, or create a second cut (e.g. a short version next to the long one). The history and the versions of ONE cut (sequence). Every timeline write (lab_timeline_apply, the editor, the Resolve bridge) first saves the state it replaces; this tool reads those saved states and works with them. Costs nothing. aktion 'liste' (default): the saved states, newest first, with `marke` (a name a person gave a state), plus where this sequence was branched from (`ursprung`, with what changed since the branch point) and which versions were branched from it (`abgezweigt`). 'markieren': give a state a name (`marke`); a named state is never cleaned up — states without a name are capped per sequence. Empty `marke` removes the name. 'vergleichen': what changed since a state — against the current cut, or against another state (`gegen`), clip by clip. 'zurueckholen': write a state back as the current cut; the cut it replaces is saved first, so this is undoable. 'abzweigen': make a NEW sequence (a version — e.g. a broadcast cut next to the festival cut) from a state, or from the current cut without `checkpoint_id`. The new sequence keeps the clip ids and the shot layer, knows its origin, and the branch point gets a name so it stays. There is no merging back: a version is its own cut from then on. Edit it with lab_timeline_apply on the returned sequence id.

  Paramètres, retour & exemple (6)

  Paramètres

  • gegen · integer · optionnel
    vergleichen: a second state instead of the current cut
  • marke · string · optionnel
    markieren: the name. Empty removes it
  • titel · string · optionnel
    abzweigen: the name of the new version
  • aktion · string · optionnel · liste | markieren | vergleichen | zurueckholen | abzweigen
    What to do. Default 'liste'
  • seq_id · string · requis
    Sequence id (from lab_list_sequences) — positive integer as string
  • checkpoint_id · integer · optionnel
    The state (id from 'liste'). Needed for markieren, vergleichen, zurueckholen; optional for abzweigen (without: the current cut)

  Exemple d'appel

  {"name": "lab_fassungen", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_feedback≈ 458 tokens

  Tell the FilmLab team about a bug or a missing feature — it reaches the people who can fix it, the chat does not. Use art 'fehler' when a tool returned something wrong, failed without a clear reason, or contradicted its own description; 'wunsch' when a step you needed does not exist. Write what you called, what you expected and what came back; put ids, arguments and the error text into `kontext` (no secrets, no personal data of third parties). One report per problem. Do not report a refused request that was correct (e.g. 'Project not found' for someone else's project). Needs an account. Free.

  Paramètres, retour & exemple (6)

  Paramètres

  • art · string · requis · fehler | wunsch
    fehler = something is broken; wunsch = something is missing
  • text · string · requis
    What you called, what you expected, what happened — in a few sentences
  • titel · string · requis
    One line, e.g. 'lab_capture: black frame for an image clip'
  • kontext · object · optionnel
    Machine-readable details: ids, arguments, error text. Max ~8000 characters as JSON
  • werkzeug · string · optionnel
    The tool it is about, e.g. 'lab_timeline_apply'
  • project_id · string · optionnel
    Your project it happened in (only your own projects are accepted)

  Exemple d'appel

  {"name": "lab_feedback", "arguments": {"art": "fehler", "text": "texte", "titel": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_fertigstellen≈ 348 tokens

  Finish an accepted DRAFT (a lab_reference_motion run with draft: true) in 1080p — same motion, same seed, same sound, sharper picture. A NEW video row comes back; the draft stays. Works only while the draft is valid and only through the account that ordered it; otherwise the backend refuses with a named reason (entwurf_abgelaufen, entwurf_anderes_konto, entwurf_fehlt, bereits_fertiggestellt) before anything is charged. Never download and re-upload a draft to get here: that is a new run, not this draft. Costs credits when called without get_cost.

  Paramètres, retour & exemple (3)

  Paramètres

  • get_cost · boolean · optionnel
    Preflight: return the price in credits and the draft's expiry WITHOUT finishing it and without spending anything. Do this first and let the human confirm.
  • video_id · string · requis
    Id of the DRAFT video row (from lab_reference_motion's answer or lab_job_status) — positive integer as string.
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string.

  Exemple d'appel

  {"name": "lab_fertigstellen", "arguments": {"video_id": "texte", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_flow_angebot≈ 529 tokens

  Use when the person wants a saved flow, pipeline or multi-step workflow priced, costed, calculated or checked against the balance BEFORE anything runs. Price a whole Flow (Pipeline) before running it: one quote over every node, checked against the credit balance and the project's cost cap. `workflow` is a FilmOS workflow in schema v1 (vault/workflows/_schema.md): nodes of type `lab.tool` call FilmLab tools by name, `{{node_id.field}}` passes one node's result into the next, `parallel` and `condition` are supported, `foreach` and `workflow.invoke` not yet. Every node whose tool costs money is priced with that tool's own get_cost preflight; a paid tool without a preflight, or a price that cannot be determined, rejects the whole quote by name — nothing is estimated. Nothing is generated and nothing is charged. Returns `angebot_id` (valid 24 h, for exactly this workflow, these inputs and this project), the total, one line per node, the balance and what the cap still allows. A node whose price only exists once its input exists (lab_upscale fed by a clip from another node) is listed with `preis_folgt: true` and is NOT in the total: the run stops before it, names the exact price and continues only after lab_flow_fortsetzen — tell the person so when you name the total.

  Paramètres, retour & exemple (3)

  Paramètres

  • inputs · object · optionnel
    Values for the workflow's `inputs`, referenced as {{name}}
  • workflow · object · requis
    The Flow (Pipeline) as a FilmOS workflow object, schema_version "1"
  • project_id · string · requis
    Project id (from lab_list_projects) — every node runs in this project

  Exemple d'appel

  {"name": "lab_flow_angebot", "arguments": {"workflow": {}, "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_flow_fortsetzen≈ 330 tokens

  Use when a flow/pipeline run is waiting for approval or a price confirmation and the person gives the go-ahead to continue. Resume a Flow (Pipeline) run that stopped and waits (status 'wartet' with a reason like 'Wartet auf Freigabe'). A run stops when a clip node needs a start image the person has not approved yet — approve the image first (lab_review_asset, verdict accepted), then resume. A run also stops before a node whose price only exists once its input exists (lab_upscale after a clip — the quote listed it as `preis_folgt`): the reason starts with 'Wartet auf Preisbestätigung' and names the exact credits. Resuming IS the confirmation of that price — ask the person first. The confirmed amount travels as max_credits; if the price rises before the run, nothing is charged and the run stops again with the new price. The waiting nodes are tried again; nothing that already ran is repeated.

  Paramètres, retour & exemple (1)

  Paramètres

  • lauf_id · string · requis
    From lab_flow_starten

  Exemple d'appel

  {"name": "lab_flow_fortsetzen", "arguments": {"lauf_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_flow_starten≈ 424 tokens

  Use when the person has seen the quote for a flow/pipeline and says to run, start or execute it. Run a Flow (Pipeline) that was quoted with lab_flow_angebot. Pass the SAME workflow and inputs plus the angebot_id — a changed workflow, an expired quote (24 h) or a quote that was already used is refused; get a new quote then. Only after the person confirmed the price. Returns right away with `lauf_id`; the run continues on the server without anyone watching. Follow it with lab_flow_status. Each node calls its FilmLab tool under your account; every tool's own gates still apply (approved keyframe before a paid clip, cost cap of the project). If the cost cap is hit, the whole run stops and nothing after it starts. The quoted price is also the run's own hard cap (auto_lauf_id): every node reserves against it, failed nodes keep their share, and a run whose retries would cost more than the quote stops with budget_exceeded instead of spending more.

  Paramètres, retour & exemple (3)

  Paramètres

  • inputs · object · optionnel
    Exactly the inputs that were quoted
  • workflow · object · requis
    Exactly the workflow that was quoted
  • angebot_id · string · requis
    From lab_flow_angebot

  Exemple d'appel

  {"name": "lab_flow_starten", "arguments": {"workflow": {}, "angebot_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_flow_status≈ 277 tokens

  Use when the person asks how far a flow/pipeline run is, whether it finished, why it stopped or hangs, or what a step returned. State of a Flow (Pipeline) run started with lab_flow_starten: the run's status (wartet, laeuft, fertig, fehlgeschlagen, abgebrochen) and, per node, its status, attempts, result and error. A node's result is exactly what its tool returned — ids from there go into the next tools. With `angebot_id` instead of `lauf_id` it finds the run started from that offer — `gefunden: false` means no run was created from it, so nothing was charged for it.

  Paramètres, retour & exemple (2)

  Paramètres

  • lauf_id · string · optionnel
    From lab_flow_starten
  • angebot_id · string · optionnel
    From lab_flow_angebot — finds the run started from this offer (when lab_flow_starten's answer was lost)

  Exemple d'appel

  {"name": "lab_flow_status", "arguments": {"lauf_id": "texte", "angebot_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_freigeben≈ 385 tokens

  Release a paused PERSON-reference run (lab_reference_motion with use_depth: 'personen') after the human has looked at its mask preview: this starts the paid model run. Until now only the mask was charged. Show the preview (metadata.personen_referenz_url of the paused clip) first — holes in hair or hands cost a full run if released. A NEW video row comes back; the paused row stays as the record of the mask. The backend refuses with a named reason (nicht_wartend, bereits_freigegeben) before anything is charged. Costs credits when called without get_cost.

  Paramètres, retour & exemple (4)

  Paramètres

  • job_id · string · optionnel
    Alternatively the job id from lab_reference_motion's answer — resolved to its video row. Give this or video_id.
  • get_cost · boolean · optionnel
    Preflight: return the price of the run WITHOUT starting it and without spending anything. Do this first and let the human confirm.
  • video_id · string · optionnel
    Id of the PAUSED video row (from lab_reference_motion's answer or lab_job_status) — positive integer as string. Give this or job_id.
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string.

  Exemple d'appel

  {"name": "lab_freigeben", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_generate≈ 2418 tokens

  Generate an image on the production pipeline (fal.ai, quota-tracked, persisted to the project's gallery). Waits up to `wait_s` seconds (default 45) for the image and then answers with the finished rows — image_url set, inline previews attached, so the picture is in the answer like lab_job_status with preview. Pass `wait_s: 0` to return right away with rows in status 'pending' (poll lab_job_status with id + project_id then). If the budget runs out, the rows come back as they are and `fertig: false` says so. Default tool is 'flux_pro'; use 'nano_banana_pro' (Gemini 3 Pro Image) for the Papercut-style look. Pass seed_image_url to run img-to-img guided by an existing image URL. `get_cost: true` preflights credits — it returns the price without generating anything. FOR A PERSON WHO MUST LOOK THE SAME across several images, do not re-describe them per prompt: get an id from lab_list_characters (or build one with lab_create_character + lab_generate_character_reference) and pass it as `character_refs`.

  Paramètres, retour & exemple (19)

  Paramètres

  • seed · integer · optionnel
    Seed for a repeatable run. Omit it and the project's stored seed applies (POST /api/lab/projects/{id}/einstellungen), and without that the provider picks one. The seed that actually rendered comes back in lab_job_status as `seed` with `seed_quelle` ('provider' = read from the provider's answer, 'gesetzt' = the one sent, null = the model tells no seed). Models whose endpoint has no seed field do not drop a given seed silently: the run proceeds and the row carries `seed_hinweis: seed_nicht_unterstuetzt` — some models tell their seed but take none, others take one but tell none.
  • tool · string · optionnel
    Image model id — copy it verbatim from lab_list_models (kind: image). Omit to use the default. Every model has its own resolutions, aspect handling and price; the catalog is the only place those live, this text deliberately names none.
  • aspect · array · optionnel
    Frame as [width, height], e.g. [9, 16]. Overrides the project's pose_state — pass it when the Pose-Director's blockout is set but not yet saved. Measured 2026-07-31: without it a 9:16 blockout came back as 16:9, because pose_state was still NULL.
  • prompt · string · requis
    What to generate (required)
  • wait_s · number · optionnel
    Seconds to wait for the finished image before answering (default 45, max 80). 0 = answer immediately with pending rows.
  • anker_id · string · optionnel
    Look anchor id (positive integer string) whose CHOSEN image guides this generation as img-to-img. An anchor is a look imported from Midjourney: a handful of images plus the grammar of the old `--profile` code, stored per project. It resolves to exactly ONE image — the one the anchor's `gewaehlt` points at — because the provider payload carries one reference, not a set. So this is MUTUALLY EXCLUSIVE with seed_image_url (two sources for one field), and character_refs still wins over both: identity beats look. Build one from imported images with lab_umzug {anker}; list anchors with GET /api/lab/projects/<id>/umzug/anker.
  • get_cost · boolean · optionnel
    Preflight: return the price in credits and your balance WITHOUT generating, reading the same catalog as lab_list_models. Do this before a batch or when the user wants to see the cost. For a card the user confirms, use lab_propose instead.
  • metadata · object · optionnel
    Free-form JSON stored alongside the image (e.g. { parent_id, note }). Not interpreted by the pipeline.
  • variants · integer · optionnel
    How many variants to generate (default 1, max 5)
  • scene_ref · string · optionnel
    Scene label (e.g. 'SZ 04'). Stored on the row, so results can be matched back to a shot list and reviewed per scene with lab_review_queue. Omit it and the image is an orphan.
  • apply_lens · boolean · optionnel
    Defaults to TRUE on the backend: the project's lens_state UrPrompt is appended to the prompt. Pass false only to deliberately opt out for this one call.
  • project_id · string · requis
    Project id (from lab_list_projects) — generation is always project-scoped
  • resolution · string · optionnel
    Resolution tier, exactly as listed for the model in lab_list_models. Omit for the model's default; the aspect ratio still comes from the project's pose_state — this only sets the area. Some models have no resolution field at all — then leave it out.
  • location_id · string · optionnel
    Location board id (from lab_list_locations). Anchors the shot: the board's `prompt_prefix_en` is appended to your prompt as 'Location: …' before generation, so every image of the same place stays in the same place. Check the prefix with lab_list_locations first — a board WITHOUT a prefix anchors nothing and fails silently.
  • aspect_ratio · string · optionnel
    Aspect ratio as W:H (e.g. 16:9, 9:16). Must be one of the model's aspect_ratios where the model has an enum; models without an enum accept any W:H. Omit to use the project's camera aspect.
  • costume_refs · array · optionnel
    The costume plate of these characters goes along as an extra reference image — the outfit on an invisible mannequin, NO person, so it carries the costume, never the face. Every id must also be in character_refs. Needs a model whose max_references covers characters + plates (lab_list_models); otherwise rejected before any quota is spent. Each plate is one more reference and may cost credits; get_cost prices it.
  • character_refs · array · optionnel
    Character ids (positive integer strings) whose reference images lock the cast's identity. Routes the call to img-to-img and sends EVERY listed character's reference image, in the order given, up to the max_references (lab_list_models) of the model that actually runs. WITH A CHARACTER, flux_pro — the default — RUNS AS flux_2_pro (FLUX.2 [pro] edit), which takes up to 9 references: the answer names the switch in `umgeschaltet` (von/nach), and get_cost prices flux_2_pro. flux_pro's own img-to-img variant (redux) only varies its source image and dropped the scene in every measured case; it is still used for seed_image_url without characters, where the source's composition is wanted. A model that takes fewer references than you name: naming more with that tool explicitly is rejected before any quota is spent; without an explicit tool the image is made with the first max_references and the answer names the rest in `referenz_warnung` and `referenzen.nicht_gesendet` — nothing is dropped silently. Each additional reference may cost credits; get_cost with character_refs prices exactly that. This OVERRIDES seed_image_url: the characters fill the reference slots, and identity wins over composition. A character without a generated reference image is rejected before any quota is spent. GET IDS FROM lab_list_characters, or create one with lab_create_character followed by lab_generate_character_reference. Prefer character_refs over seed_image_url whenever a person must stay the same across images: seed_image_url holds identity only for the single call that passes it, character_refs is a register entry that every later call can name. SCENE AND LIGHT FOLLOW THE PROMPT: the reference holds the person, not the shot — harbour at night, stairwell under a top light, neon in the rain all came out as asked with the face kept (measured 2026-10-05 on flux_2_pro). What the reference does NOT change is the character's condition: it always shows the BASE state. For a wet, injured or otherwise changed character pass character_states instead of describing it in the prompt (lab_get_character_sheet returns the state keys and the descriptors behind them); to hold the outfit itself, add its costume plate with costume_refs.
  • seed_image_url · string · optionnel
    Optional: run img-to-img guided by this existing image URL (e.g. a prior generation's url). For a PERSON who must look the same across several images, use character_refs instead — this URL binds one call, a register entry binds all of them.
  • character_states · object · optionnel
    Which STATE each character is in for this image, as { characterId: stateKey } — e.g. { "12": "wet" }. A state is its own asset with its own full descriptor (clean / soaked / bloodied are three assets, not one with a note), and it is the ONLY way that descriptor reaches a generation: the reference image always carries the BASE state, so without this field you get dry Cal in a scene where he just came out of the Thames — and the image looks correct. Get the keys from lab_get_character_sheet; create one with the character state endpoint. Every id here must also appear in character_refs (who is not in the frame is not described), and an unknown key is rejected before any quota is spent.

  Exemple d'appel

  {"name": "lab_generate", "arguments": {"prompt": "texte", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_generate_character_reference≈ 879 tokens

  Generate the reference sheet for a character — six core views rendered from the sheet's `prompt_prefix_en`: detail (three-quarter close-up, the identity anchor), frontal (frontal close-up), profile, fullbody (front), fullbody_back (back view: hair and the back of the costume) and costume (the outfit on an invisible mannequin, NO person — use it where the costume is meant, never as a face reference). Back view and costume are derived from fullbody, everything else from detail. The poses pose_sitting, pose_walking, pose_action are optional extras for blocking — not part of the default run and not used as references for image or video models. A seventh view, 'detail_smile', is NOT in the default set and must be asked for: the same close-up with the mouth open and the teeth visible. Render it for every character who SPEAKS — otherwise the model invents the teeth and the jaw the first time they laugh, and the smile arrives as somebody else's mouth. It is an extra view for the mouth, never an identity anchor: a smiling reference carries its smile into every shot, funerals included. MEASURED 2026-09-15 (n=10, criterion fixed beforehand): the teeth land 10/10, but the PERSON only holds in about 4 of 10 even with the anchor active — two runs were plainly a different man. Generate it, then LOOK before you rely on it; the failure is obvious to the eye (a stranger's mouth on your character), not silent. THIS IS WHAT MAKES A SHEET USABLE: until it has run, lab_generate rejects the id as `character_refs`. Step 2 of 2 after lab_create_character. COSTS CREDITS — one provider call per view; the default run is six for humans, five for tier/kreatur (no costume). Pass `views` to render fewer, and get the exact price first with get_cost: true (free). Takes about 25 s PER VIEW (the tool requests them one by one, anchor first), so a full run is 2–3 minutes. If a single request times out, the answer says `noch_in_arbeit` instead of failing: that view is still rendering and already paid for — check it with lab_get_character_sheet, do NOT re-run it. The sheet needs a `prompt_prefix_en`; the backend regenerates one on demand but only best-effort, and answers 400 if that fails too. Views whose image could not be mirrored to R2 are deliberately NOT saved and come back in `nicht_gespiegelt` — those views are missing, not broken, and a re-run renders only what you ask for.

  Paramètres, retour & exemple (3)

  Paramètres

  • views · array · optionnel
    Which views to render. Omit for the core views (six for humans, five without costume for tier/kreatur). Allowed: detail, frontal, profile, fullbody, fullbody_back, costume, pose_sitting, pose_walking, pose_action. Fewer views = fewer credits; `detail` and `fullbody` alone are usually enough to lock an identity.
  • get_cost · boolean · optionnel
    Free: the exact price of this run (per view and total, anchor and edit rate included) — nothing is rendered or charged. Name it to the person before the real run.
  • character_id · string · requis
    Character sheet id (from lab_list_characters or lab_create_character) — positive integer as string

  Exemple d'appel

  {"name": "lab_generate_character_reference", "arguments": {"character_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_generate_location_variants≈ 273 tokens

  Generate time-of-day reference images for a location board (costs credits per variant — check the price with get_cost first). Without `variants` the backend renders all four. The images are what makes a board usable as a visual reference.

  Paramètres, retour & exemple (3)

  Paramètres

  • loc_id · string · requis
    Location board id (from lab_list_locations)
  • get_cost · boolean · optionnel
    Free: the exact price of this run (per variant and total) — nothing is rendered or charged. Name it to the person before the real run.
  • variants · array · optionnel
    Which time-of-day variants to render. Allowed: day, night, golden_hour, rain. Omit for all of them. Fewer variants = fewer credits.

  Exemple d'appel

  {"name": "lab_generate_location_variants", "arguments": {"loc_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_generate_music≈ 762 tokens

  Generate a MUSIC track for a project — the first step of the rhythm chain, and the only one that costs credits. Default engine: ElevenLabs Music v2.5 (produced, contemporary instrumental beds, 3-300 s, priced per second). Stable Audio stays selectable with tool 'stable_audio' (flat per run, up to 190 s, noticeably dated sound). ElevenLabs refuses prompts that name artists, bands or song lyrics; the failed row then carries its suggested rewording in metadata.error. ASYNCHRONOUS: the call returns immediately with a row whose `audio_url` is null and `metadata.status` is 'pending'. Nothing is playable and nothing can be bound yet. Poll lab_list_audio (audio_type 'music') until that row's status is 'completed' and audio_url is set — usually under a minute, and the backend gives up after five (status turns 'failed', metadata.error carries the reason, and the credits are refunded). PUT THE TEMPO IN THE PROMPT if you intend to cut on the beat. This is measured, not assumed: a soft swing track measured at confidence 0.164 (unusable), an ordered hard pulse ('techno, 128 bpm, four-on-the-floor') at 0.621. The tempo detector is autocorrelation over an onset envelope — it finds a hard pulse and shrugs at drone, ambient and rubato. Then: lab_bind_audio, lab_beatgrid, lab_apply_rhythm.

  Paramètres, retour & exemple (6)

  Paramètres

  • tool · string · optionnel · elevenlabs_music | stable_audio
    Music engine. Default 'elevenlabs_music' (ElevenLabs Music v2.5, per second, 3-300 s). 'stable_audio' is the older flat-priced engine (1-190 s)
  • prompt · string · requis
    What the music should be. Name genre, instrumentation, mood AND the tempo in bpm if the cut is supposed to sit on the beat — e.g. 'driving techno, four-on-the-floor kick, 128 bpm, no vocals'. A prompt without a stated pulse is the usual reason lab_beatgrid comes back unreliable
  • get_cost · boolean · optionnel
    `true` preflights the credit price and your balance WITHOUT generating anything and without spending quota.
  • scene_ref · string · optionnel
    Optional scene label, stored on the row. Useful to tell several tracks of one project apart
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string
  • duration_seconds · number · optionnel
    Track length in seconds (default 30). ElevenLabs takes 3-300 s (shorter is raised to 3), Stable Audio up to 190 s. Make it at least as long as the sequence you want to cut — lab_apply_rhythm computes durations for the clips that exist and neither adds nor deletes any, so a short track under a long timeline stays a short track

  Exemple d'appel

  {"name": "lab_generate_music", "arguments": {"prompt": "texte", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_get_character≈ 326 tokens

  Get ONE character sheet in full — every descriptive field plus the three that decide what you can do with it. `prompt_prefix_en` is the text block describing this person; it is what the backend prepends wherever the sheet is used. `reference_images` decides whether the sheet is usable at all: lab_generate REJECTS a character_refs entry without one, before any quota is spent — if it is empty, run lab_generate_character_reference first. `states` carries the state sheets against character drift (costume, light, physical condition); lab_get_character_sheet renders them agent-readable.

  Paramètres, retour & exemple (2)

  Paramètres

  • preview · boolean · optionnel
    Attach the reference images themselves, downscaled to 512px. `reference_images` decides whether the sheet is usable at all — seeing them is the check, counting them is not: a sheet can carry a URL to a picture of the wrong person.
  • character_id · string · requis
    Character sheet id (from lab_list_characters) — positive integer as string

  Exemple d'appel

  {"name": "lab_get_character", "arguments": {"character_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_get_character_sheet≈ 412 tokens

  The character sheet PREPARED FOR PROMPTING: base prefix, the state sheets by name, which reference views exist, and the ready-made sentence to paste into a lab_generate prompt. Same source as lab_get_character, different shape — use this one when you are about to generate, and lab_get_character when you want the raw record. State sheets exist against character drift: one sheet per costume, light or physical-condition change, so a person stays the same person when the situation changes. THIS IS THE ANSWER to 'same person, different light': character_refs alone routes to i2i and drags the reference's lighting along, so a drastically different light fights the reference. A state sheet puts the change into the TEXT, where the prompt can win. Free.

  Paramètres, retour & exemple (3)

  Paramètres

  • state · string · optionnel
    Render the snippet for THIS state key (from `states[].key`) instead of the base state
  • preview · boolean · optionnel
    Attach the reference views themselves, downscaled to 512px. `usable_as_character_ref` only says a URL exists — the picture says whether it is the right person, in the right view. That check is the whole point of a character sheet.
  • character_id · string · requis
    Character sheet id (from lab_list_characters) — positive integer as string

  Exemple d'appel

  {"name": "lab_get_character_sheet", "arguments": {"character_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_get_context≈ 166 tokens

  Read the accumulated context/output for one pipeline module of a project (e.g. the IDEE, STORYBOARD or SHOTS stage). Needs project_id and module name.

  Paramètres, retour & exemple (2)

  Paramètres

  • module · string · requis
    Pipeline module/stage id, e.g. 'idee', 'storyboard', 'shots'
  • project_id · string · requis
    The FilmLab project id

  Exemple d'appel

  {"name": "lab_get_context", "arguments": {"module": "texte", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_get_dossier≈ 167 tokens

  Poll a dossier job by job_id (from lab_dossier). status is queued|processing|done|failed. When done, result.archiv_url is a signed https link to the ZIP that loads WITHOUT a login and expires after 24 h — call again for a fresh one. result.fehlend lists takes that could not be loaded.

  Paramètres, retour & exemple (1)

  Paramètres

  • job_id · string · requis
    The dossier job id returned by lab_dossier

  Exemple d'appel

  {"name": "lab_get_dossier", "arguments": {"job_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_get_export≈ 393 tokens

  Poll an export render job by job_id (from lab_start_export). status is queued|processing|done|failed; when done, the result (output url) is included. Call repeatedly until done|failed. NB: this is the EXPORT poll — different from lab_get_generation. Where the address sits depends on the profile: a rendered film is in video_url, but profile alpha_png_sequence delivers a ZIP of RGBA PNGs and therefore leaves video_url null and puts the address in archiv_url — a .zip under a key called video_url would read as something playable to every client. download_url carries the address in both cases and is the safe one to hand to a user. All result addresses — video_url, download_url, archiv_url and the provenance record herkunft.pdf_url / herkunft.json_url — are signed https links that load WITHOUT a login and expire after 24 h; call lab_get_export again for fresh ones. view_url is the short session-bound form for the web app only. A finished result also carries zielmarkt_checkliste: per target market of the project (see lab_zielgruppe) what the customer must observe when delivering there — empty without markets. Pass it on to the person with the download; it is not legal advice.

  Paramètres, retour & exemple (1)

  Paramètres

  • job_id · string · requis
    The export job id returned by lab_start_export

  Exemple d'appel

  {"name": "lab_get_export", "arguments": {"job_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_get_job≈ 263 tokens

  Get the status of a background job by job_id (status is queued|processing|done|failed). Poll this after starting a long-running generate/export. Returns the job record; its payload and result are objects (for a clip chain: result.zusammenfassung, result.ketten, result.clips). For an Umzug import (lab_umzug): result.bildzeilen (image_id, datei), result.gesperrt (datei, grund), result.ungeprueft. Pass wait_s (up to 80) to wait inside the call until the job is done or failed instead of polling in quick succession.

  Paramètres, retour & exemple (2)

  Paramètres

  • job_id · string · requis
    The job id returned by a generate/export tool
  • wait_s · integer · optionnel
    Wait up to this many seconds (max 80) for done/failed; the answer says gewartet_s

  Exemple d'appel

  {"name": "lab_get_job", "arguments": {"job_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_get_location≈ 203 tokens

  Get ONE location board in full — all descriptive fields plus its reference images and `prompt_prefix_en`. Use it to check what a board actually anchors before generating with it.

  Paramètres, retour & exemple (2)

  Paramètres

  • loc_id · string · requis
    Location board id (from lab_list_locations) — positive integer as string
  • preview · boolean · optionnel
    Attach the board's reference images themselves, downscaled to 512px — the fastest way to check whether a board anchors the place you mean before spending quota on it.

  Exemple d'appel

  {"name": "lab_get_location", "arguments": {"loc_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_get_project≈ 156 tokens

  Use when the person asks where a project stands: its current stage, what is finished, what comes next, or wants the project's state before continuing. Get a single FilmLab project with its full stage state. Needs the project_id (from lab_list_projects).

  Paramètres, retour & exemple (1)

  Paramètres

  • project_id · string · requis
    The FilmLab project id

  Exemple d'appel

  {"name": "lab_get_project", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_get_sequence≈ 168 tokens

  Get ONE sequence in full — timeline (the shots in order), audio_tracks, transitions, duration_seconds and render status. Check `timeline` here before starting a continuity pass: an empty one is the single most common reason the pass refuses.

  Paramètres, retour & exemple (1)

  Paramètres

  • seq_id · string · requis
    Sequence id (from lab_create_sequence/lab_list_sequences) — positive integer as string

  Exemple d'appel

  {"name": "lab_get_sequence", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_get_state≈ 142 tokens

  One call, the whole picture: account (tier, credits, reset), default models with price, jobs in flight, catalog freshness, project count. Pass project_id for that project's sequences, assets and review-queue length. Read-only, free.

  Paramètres, retour & exemple (1)

  Paramètres

  • project_id · string · optionnel
    Add a project view

  Exemple d'appel

  {"name": "lab_get_state", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_grade≈ 1330 tokens

  Apply a deterministic colour grade to an image already in the project gallery — no re-generation, no provider, no credits. The look is computed pixel-exact (exposure, saturation, hue, lightness, contrast, film grain) and lands as a new gallery image the sequencer and export pick up. For full control the recipe fields are open too: levels and curves per channel (rgb, r, g, b — values 0..255), a gradient map (luminance → colour ramp), exposure offset/gamma and grain seed/colour. Fixed order, like a node stack: exposure → levels → curves → hue/saturation → look (LUT) → gradient map → grain. The same recipe on the same image always yields the same result (grain is fixed-seed), so a look is reproducible across every still. Set from_colorist to start from the project's colorist crew brief (look, contrast, grain) and tune with the sliders on top. At least one adjustment OR from_colorist is required. Synchronous — the graded image_url comes straight back, no polling.

  Paramètres, retour & exemple (18)

  Paramètres

  • hue · number · optionnel
    Hue rotation in degrees; zero neutral
  • look · string · optionnel
    Named look from the bundle catalogue (e.g. filmlab-neutral, filmlab-warm, filmlab-cool, filmlab-soft, filmlab-punch) — a hand-authored LUT, applied on top of the sliders. The server resolves the name; a path is never accepted.
  • grain · number · optionnel
    Film grain amount; zero is none, monochrome
  • curves · object · optionnel
    Curves per channel as [x, y] points 0..255, x strictly increasing (smooth monotone curve through them). Example warm highlights: {"r": [[0,0],[192,205],[255,255]], "b": [[0,0],[192,180],[255,255]]}. Not together with contrast on the rgb channel
  • levels · object · optionnel
    Levels per channel (rgb = all three, r/g/b single), values 0..255: input black/white point, gamma (above 1 brightens midtones), output black/white. Example: {"rgb": {"black": 12, "white": 240, "gamma": 1.1}}
  • contrast · string · optionnel · high | low
    Contrast curve: high is an S-curve, low flattens it
  • exposure · number · optionnel
    Exposure in stops; positive brightens, zero is neutral
  • image_id · string · requis
    Id of the source image in the project gallery (from lab_list_assets / lab_generate)
  • lightness · number · optionnel
    Lightness; negative darkens, zero neutral
  • grain_mono · boolean · optionnel
    Grain in black and white (default true); false gives colour grain
  • grain_seed · integer · optionnel
    Seed of the grain pattern (default 0) — same seed, same grain
  • project_id · string · requis
    Project id (from lab_list_projects)
  • saturation · number · optionnel
    Colour saturation; minimum is greyscale, zero neutral
  • gradient_map · object · optionnel
    Gradient map: luminance 0..1 → colour ramp, blended with opacity (default 1). Example teal-orange: {"stops": [[0, "#0b2a33"], [0.5, "#7a7a72"], [1, "#ffd9a8"]], "opacity": 0.3}
  • look_opacity · number · optionnel
    Blend of the named look, 0..1 (default 1)
  • from_colorist · boolean · optionnel
    Start from the project's colorist crew brief (look/contrast/grain), then apply the sliders on top
  • exposure_gamma · number · optionnel
    Exposure gamma; 1 neutral, above 1 brightens midtones
  • exposure_offset · number · optionnel
    Exposure offset added after the stops (lifts or crushes blacks); zero neutral

  Exemple d'appel

  {"name": "lab_grade", "arguments": {"image_id": "texte", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_grade_clip≈ 852 tokens

  Set the colour grade of ONE clip in the edit (Murnau), or of the whole programme with `programm: true`. It is the same grade a colourist sets in Murnau's colour workspace, and the export uses it: Murnau bakes the export LUTs when you set it. Only the fields you send change (`zuruecksetzen: true` starts from neutral). Fields and ranges, as the sliders: exposure in stops (−5..5); contrast, saturation, temperature, tint −100..100; hue −180..180; lift/gamma/gain/offset as {x, y, master}, each −1..1 (x/y move the colour wheel); log as {shadow|midtone|highlight: {x, y, master}} — the Log wheels in ACEScct, each acting only on its range of brightness (shadows below ~4 % linear, highlights above ~50 %), master ±1 ≈ ±2 stops there; schritte as a list (≤ 8) of further grades with the same fields (plus name), applied in series after this grade — serial nodes; creative and sek stay on the grade itself; hdr as {dark|shadow|light|highlight: {x, y, master}} — HDR zone wheels centred −3/−1/+1/+3 stops around 18 % grey, master ±1 ≈ ±1.5 stops; curves as {master|r|g|b: [[x,y],…]} 0..1; boost, shadows, highlights −100..100; intensity 0..100 (0 = original). Per clip also `sek` — a secondary correction: {qualifier: {hueCenter, hueWidth, satLow, satHigh, lumLow, lumHigh, softness, invert}, fenster: [{form: kreis|rechteck|verlauf|polygon|bezier, cx, cy, rx, ry, winkel, weich, invert, modus: add|sub, punkte (polygon/bezier only: 3–16 resp. 3–12 [x, y] in the window's own unit space, scaled by rx/ry and turned by winkel — bezier draws a smooth closed curve through them)}], grade: {saturation, exposure, temperature, tint, hue, schutz}} — schutz 0..100 takes the clip's and the programme's grade back inside the selection (100 = ungraded there, e.g. to protect skin); `sek: null` removes it. Any level also takes `warper` — the Color Warper: {huesat|chromalum: {res: 6|12|24, punkte: [[i, j, dx, dy], …]}}; node (row i, column j) sits at (j/res, i/res) and is moved by (dx, dy) in −1..1. huesat plane: x = 0.5 + 0.5·sat·cos(hue), y = 0.5 + 0.5·sat·sin(hue) (lightness kept); chromalum plane: x = sat, y = 1 − lightness (hue kept). Only moved nodes; `warper: null` removes it. Call WITHOUT `grade` to list the clips (clip_id, start/end, current grade, input profile) and the programme grade. Measure first and after with lab_scopes — its `vorschlag.grade` is a computed correction you can pass here as `grade`. Writes state, costs nothing.

  Paramètres, retour & exemple (5)

  Paramètres

  • grade · object · optionnel
    Fields to set — see description; omit to list clips and grades
  • seq_id · string · requis
    Sequence id — positive integer as string (lab_list_sequences)
  • clip_id · string · optionnel
    The clip to grade (from the listing); omit with programm:true
  • programm · boolean · optionnel
    Grade the whole programme instead of one clip
  • zuruecksetzen · boolean · optionnel
    Start from a neutral grade before applying `grade`

  Exemple d'appel

  {"name": "lab_grade_clip", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_grade_from_resolve≈ 284 tokens

  Suggest a FilmLab grade look from a Resolve LUT name or path — read-only, no cost. First call resolve_node_graph_lesen on the local FilmLab bridge (filmlab_bruecke_mcp.py), a SEPARATE MCP server, and pass its lut field here. The agent connects these two calls: this Cloudflare Worker cannot reach the bridge at 127.0.0.1 on the user's computer or fetch the name itself. Only the name is matched; the Resolve LUT file is neither read nor imported, and its exact grade is not reproduced. Returns look, reason, alternatives and sicher (false means the name was not confidently recognised). Apply with lab_grade(look: …) only once the user agrees.

  Paramètres, retour & exemple (1)

  Paramètres

  • lut · string · requis
    LUT name or path from the lut field returned by resolve_node_graph_lesen on the local FilmLab bridge

  Exemple d'appel

  {"name": "lab_grade_from_resolve", "arguments": {"lut": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_grade_suggest≈ 214 tokens

  Suggest a grade look for a project — read-only, no cost. With image_id, includes the image prompt; without it, uses only the colorist crew brief. Returns a recommended look name with a reason and alternatives; apply it with lab_grade(look: …) once the user agrees.

  Paramètres, retour & exemple (2)

  Paramètres

  • image_id · integer · optionnel
    Generated image id belonging to the project; includes its prompt in the suggestion
  • project_id · string · requis
    Project id (from lab_list_projects)

  Exemple d'appel

  {"name": "lab_grade_suggest", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_herkunft≈ 268 tokens

  Declare or list where a project's material comes from: 'eigen' (made by people) or 'ki' (AI-generated or AI-altered). Exports decide the EU AI Act Art. 50 disclosure per clip from this — undeclared material counts as AI. With asset_key + herkunft: declare (the file is checked for an AI mark; one found keeps it AI and the answer says why). With project_id only: list every declaration with its effect (`wirksam`).

  Paramètres, retour & exemple (3)

  Paramètres

  • herkunft · string · optionnel · eigen | ki
    Required together with asset_key
  • asset_key · string · optionnel
    Storage key of the file (from lab_add_media or lab_list_assets). Omit to list
  • project_id · string · requis
    Project id — positive integer as string

  Exemple d'appel

  {"name": "lab_herkunft", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_identitaet_pruefen≈ 402 tokens

  Check whether still images of a project show the SAME character as its character sheet — before paid clips are made from them. Each image is compared against the sheet's detail and fullbody views. It judges identity (species, build, colouring, head shape, large markings), NOT style, light, pose, place or props — and deliberately NOT micro details like an ear notch or the number of fingers, which no image model holds reliably. Free. Runs in the BACKGROUND: returns a `job_id` with HTTP 202 — poll it with lab_get_job until status is done|failed; the result lists per image passt, sicherheit, abweichungen, begruendung (or error). Up to 16 images per call, all completed images of this project. The sheet needs a reference image (lab_generate_character_reference).

  Paramètres, retour & exemple (3)

  Paramètres

  • image_ids · array · requis
    Completed image ids of this project (from lab_generate/lab_auto_storyboard) — positive integer strings, no duplicates
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string
  • character_id · string · requis
    Character sheet id the images should show — positive integer as string

  Exemple d'appel

  {"name": "lab_identitaet_pruefen", "arguments": {"image_ids": [], "project_id": "texte", "character_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_job_status≈ 898 tokens

  Poll the status of an image or video generation started by lab_generate/lab_animate. There is no single-item status endpoint on the backend — this fetches the project's full image/video list and filters by id, so it needs BOTH project_id and id (the id alone is not enough). status inside the returned item's metadata is 'pending'|'completed'|'failed'; when completed, image_url/video_url is populated. When the run is done, the answer may additionally carry schritte (the step trail of this run) and review (a machine check against the confirmed brief, present once for a run that went through lab_propose/lab_run_proposal — absent for a still-pending run, a run started outside a proposal, or a repeat poll after the one-time check already ran): abweichung lists every field that came back different from what was confirmed, possibly empty; tool means the provider fallback chain degraded the run; bild means a vision check found the result contradicting an explicit statement of the brief (free for the user, once per run; bild_review says why it was skipped). A failed or degraded proposal run may also carry plan_b: alternatives with checked prices and proposal IDs, offered once. Present them to the human; never start them yourself. Call lab_run_proposal only after the human confirms an alternative.For a run that carried a kamerapfad, metadata.kamerapfad says what arrived and, as `angewandt`, WHICH form of it was actually sent — als_text (prose), als_regiebefehle (bracketed director commands, MiniMax/Hailuo), eigene_regie (the prompt already carried bracketed commands, so the path was deliberately NOT added next to them — eigene_regiebefehle lists them) or nicht_ableitbar (nothing of the path reached the prompt, with the reason). `sprache` next to it names the family rule and the source it rests on. For a reference-motion run, metadata.referenz_masse is the reference trail: one row per reference with what it measured (original_px) and, if the backend had to scale it to the model's limits, what it became (angepasst_px) and the address that was actually sent. Look there when a result ignores a reference or looks softer than the source — a silently rescaled reference looks like a badly generated one.

  Paramètres, retour & exemple (5)

  Paramètres

  • id · string · requis
    The id returned by lab_generate (image) or lab_animate (video)
  • type · string · requis · image | video
    Whether the id refers to a generated image or a generated video
  • wait_s · integer · optionnel
    Wait up to this many seconds (max 80) until the result is rendered AND its prompt check (abgleich) is in, or it failed — instead of polling in quick succession. The answer says gewartet_s. tool_id is the catalog id even after tool_used switched to the display label.
  • preview · boolean · optionnel
    Attach the image itself, downscaled to 512px, so it can be LOOKED at instead of described. Costs one extra fetch and adds roughly 15-25 KB to the answer. Videos carry no still and return no picture — that needs a contact sheet, which is not built yet. Without this flag the answer is unchanged.
  • project_id · string · requis
    Project id — required, since there is no global id lookup

  Exemple d'appel

  {"name": "lab_job_status", "arguments": {"id": "texte", "type": "image", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_jobs_inflight≈ 508 tokens

  Are any FilmLab generations running RIGHT NOW, across ALL projects? Use this before anything that restarts the backend (a deploy recreates the container and kills running jobs, losing paid credits), or to answer 'is the lab busy?'. Unlike lab_job_status/lab_batch_status this needs no id — it lists every job in queued/processing PLUS every direct image/video/audio/vfx generation currently within its own grace window (lab_generate/lab_animate write straight to their result tables, never to the job queue — omitting job_type covers both; naming one job_type narrows to the job queue only, since a direct generation's type vocabulary differs). Returns {busy, warm[], stale_count, stale[]}: `warm` are jobs that actually progressed within stale_after_seconds and are the ones a restart would destroy; `stale` are queue jobs stuck longer than that (a crashed worker leaves rows in 'processing' forever) — they are reported but do NOT make busy true, otherwise one zombie would block every future deploy. A direct generation is never 'stale' here — past its own grace window it stops being reported by the backend entirely and becomes the orphan sweep's job, not this check's. Carries no prompts or payloads: this view crosses project boundaries, so it returns only type, state and age.

  Paramètres, retour & exemple (2)

  Paramètres

  • job_type · string · optionnel
    Only this job type, e.g. 'video_generate', from the JOB QUEUE. Omit to see everything, including direct generations — for a pre-deploy check, omitting is usually right.
  • stale_after_seconds · integer · optionnel
    How long without progress before a job counts as a zombie rather than running. Default 1800, same threshold as the deploy guard in scripts/deploy_backend.sh.

  Exemple d'appel

  {"name": "lab_jobs_inflight", "arguments": {"job_type": "texte", "stale_after_seconds": 1}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_layers≈ 792 tokens

  Produce ONE element on a transparent background: generated, then cut out and stored as an alpha PNG in the project's gallery. This is the counter-move to the one-shot lottery — cast, props and foreground pieces are made SEPARATELY, arranged as a set afterwards and only then unified, so a wrong hand or a wrong lamp is re-made alone instead of re-rolling the whole frame. The element is deliberately optics-neutral: no lens or camera suffix travels with it, because the look is decided later on the finished comp and every layer is meant to inherit the same focal length and bokeh. ASYNCHRONOUS: the row comes back with status pending and image_url null; poll lab_job_status (type 'image') with its id until the url is populated — that url IS the cut-out. Costs credits when called without get_cost.

  Paramètres, retour & exemple (6)

  Paramètres

  • prompt · string · requis
    What the element shows — the OBJECT or the PERSON, not the scene around them. The backend appends an isolation clause (single subject, plain seamless background, even light) so the cut-out has a clean edge; describing a set as well fights that clause and produces an element that cannot be freed.
  • get_cost · boolean · optionnel
    Preflight: return the price in credits and your balance WITHOUT generating and without spending anything. There is no model to pick on this path — the cut-out runs on the house image model and is billed at the plain image rate, so lab_list_models has no entry that would change this number; it comes from the same cost endpoint as everywhere else.
  • metadata · object · optionnel
    Free-form JSON stored alongside the element (e.g. { note, parent_id }). Merged into the row's metadata next to the fields the pipeline sets itself (kind, layer_type, status) — not interpreted.
  • scene_ref · string · optionnel
    Scene label (e.g. 'SZ 04'). Stored on the row, so the element can be matched back to a shot list and reviewed per scene with lab_review_queue. Omit it and the element is an orphan in the gallery.
  • layer_type · string · optionnel · cast | prop | foreground | background | stage | crowd
    Which kind of element this is — it picks the isolation clause: 'cast' full-body person, 'prop' single object, 'foreground' a foreground piece, 'background' a wide backdrop plate WITHOUT people, 'crowd' one background performer head to feet. 'stage' is accepted by the backend but has no clause of its own and falls back to the generic one. Omit for the backend default ('prop').
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string. Travels in the URL; the element is filed in this project's gallery.

  Exemple d'appel

  {"name": "lab_layers", "arguments": {"prompt": "texte", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_letzter_frame≈ 231 tokens

  Extract the LAST frame of a finished clip as a new image (returns image_id, image_url, zu_dunkel). Use it as source_image_id to continue one unbroken take, or as a still. A frame that is too dark (zu_dunkel: true) makes a bad start image — say so instead of animating from black. Free (no credits). Chains (lab_verkettung) do this themselves for uebergang=durchgehend.

  Paramètres, retour & exemple (2)

  Paramètres

  • video_id · string · requis
    A finished clip (positive integer as string)
  • scene_ref · string · optionnel
    Scene for the new image; default: the clip's

  Exemple d'appel

  {"name": "lab_letzter_frame", "arguments": {"video_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_list_assets≈ 358 tokens

  List a project's media assets (image/video/audio) with their URLs. Optionally filter by asset_type. Returns up to 20 with a total count. Each row carries its address as `url` (with `type` and `key`). Project assets come back as SIGNED addresses on https://thefilmradar.com/api/lab/assets/abruf/… — valid for 24 h, loadable without a session and with any User-Agent. Only older rows may still point at media.andresmarder.com, whose CDN WAF answers some non-browser User-Agents (e.g. curl's default) with 403 — prefer a browser UA there, or hand the URL to the user.

  Paramètres, retour & exemple (3)

  Paramètres

  • preview · boolean · optionnel
    Attach the pictures themselves, downscaled to 512px, so you can look at them without fetching anything (older media.andresmarder.com addresses answer a non-browser User-Agent with 403). The worker fetches with a browser UA. At most 4 per call; audio and video rows carry no picture and are named in preview.notes.
  • asset_type · string · optionnel · image | video | audio
    Filter by asset type (optional)
  • project_id · string · requis
    Project id (from lab_list_projects)

  Exemple d'appel

  {"name": "lab_list_assets", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_list_audio≈ 429 tokens

  List a project's generated audio rows, newest first — this is the POLL for lab_generate_music. Read two fields: `metadata.status` ('pending' | 'completed' | 'failed') and `audio_url`. A pending row has no url, and nothing downstream works with it: lab_bind_audio silently leaves the track empty (resolve-stems only takes rows that carry a url) and lab_beatgrid has no file to open. A failed row carries `metadata.error` and its credits were refunded. Reads only — no state changes, no credits.

  Paramètres, retour & exemple (4)

  Paramètres

  • limit · integer · optionnel
    How many rows to FETCH from the backend (default 50). At most 20 are SHOWN; `total` is what the fetch found, so a total of exactly `limit` means there may be more
  • scene_ref · string · optionnel
    Filter by the scene label passed at generation time
  • audio_type · string · optionnel · music | sfx | ambience | dialog | voiceover | foley | denoise | split
    Filter by kind. Pass 'music' when polling a lab_generate_music call — that is the kind the music track binds. The repair kinds (denoise, split, isolation) come from lab_sfx and hold cleaned-up versions of recordings you already had; a 'split' run leaves one row per stem, each naming its part
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string

  Exemple d'appel

  {"name": "lab_list_audio", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_list_characters≈ 410 tokens

  List the character sheets in the FilmLab cast register (id, name, age, gender, project_name, prompt_prefix_en). Call this BEFORE lab_generate whenever a person must look the same across several images: pass the id you find here as `character_refs` instead of re-describing the person in every prompt. Optional `search` matches name or project name (substring, case-insensitive). It shows YOUR OWN characters plus the public catalog (sheets explicitly made public and bound to no project). Characters of other accounts' projects never appear — projects can be confidential. New characters are private. The register returns at most 50 sheets, newest first, and offers NO paging — 20 are shown here. `total` therefore counts at most 50: with more than 50 sheets it understates, and `search` is the only way to reach the older ones. Nobody there yet? Create a sheet with lab_create_character.

  Paramètres, retour & exemple (2)

  Paramètres

  • search · string · optionnel
    Substring of the character name or project name (case-insensitive)
  • preview · boolean · optionnel
    Attach each sheet's reference portrait, downscaled to 512px. A cast list read as text is a list of names; seen as faces it is a cast. At most 4 per call. A sheet WITHOUT a reference image shows none — and that is the same emptiness lab_generate rejects, so an absent picture here is a finding, not a glitch.

  Exemple d'appel

  {"name": "lab_list_characters", "arguments": {"search": "texte", "preview": true}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_list_exports≈ 157 tokens

  List past export jobs for a project (each with job_id, status, profile). Returns up to 20 with a total count. Finished rows carry the same signed, login-free result addresses as lab_get_export (download_url, herkunft.pdf_url, …; valid 24 h).

  Paramètres, retour & exemple (1)

  Paramètres

  • project_id · string · requis
    Project id (from lab_list_projects)

  Exemple d'appel

  {"name": "lab_list_exports", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_list_location_scans≈ 226 tokens

  List a project's location scans with their reconstruction state — this is the POLL for lab_location_recon and the place the scan ids come from. Read `status`: 'pending' (clip uploaded, nothing reconstructed yet), 'reconstructing', 'done' (splat_url/glb_url/board_url are filled), 'failed' (error says why). Listing is what ADVANCES a running reconstruction from the outside world into the row, so calling this is how the state moves at all. Reads only — no credits.

  Paramètres, retour & exemple (1)

  Paramètres

  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string

  Exemple d'appel

  {"name": "lab_list_location_scans", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_list_locations≈ 334 tokens

  List location boards, newest first — START HERE to find a `location_id` for lab_generate / lab_animate. Each entry carries its `prompt_prefix_en`: that is the exact text appended to your prompt as 'Location: …', so you can judge whether the board fits BEFORE spending quota. A board with an EMPTY prefix anchors nothing — it will silently do nothing. Fix it with lab_enrich_location_prefix or pick another board. Only public boards are returned, max 50 from the backend and 20 shown here; if your place is not listed that is a limit, not a failure — create it with lab_create_location.

  Paramètres, retour & exemple (2)

  Paramètres

  • search · string · optionnel
    Filter by board name or project name (substring, case-insensitive)
  • preview · boolean · optionnel
    Attach each board's reference picture, downscaled to 512px. A location board is a PLACE — its prefix text says what was written down, the picture says what the board actually anchors, and those two disagree more often than the text admits. At most 4 per call; narrow with `search` rather than expecting more.

  Exemple d'appel

  {"name": "lab_list_locations", "arguments": {"search": "texte", "preview": true}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_list_models≈ 444 tokens

  The model catalog: what every video or image model can do — resolutions, durations, aspect ratios, audio, reference limits, price per second or per image — grouped by capability class with a one-line explanation per group. Read this before choosing a `tool` for lab_generate/lab_animate/lab_propose; copy ids verbatim. Cached briefly; `stand` says how fresh. Without `klasse` the answer is COMPACT (one line per model, cheapest first, plus `klassen` with every valid class name); with `klasse` or `voll: true` every field. Filter to answer the usual question directly: `aufloesung`, `dauer_s`, `ton` (ohne = models that can run silent, including switchable audio). A model with switchable audio is listed under the class with AND without sound (i2v_ton and i2v).

  Paramètres, retour & exemple (6)

  Paramètres

  • ton · string · optionnel · mit | ohne
    ohne = can run without sound (audio nie or schaltbar); mit = can make sound
  • kind · string · requis · video | image
    Which catalog
  • voll · boolean · optionnel
    Every field of every model even without klasse — large, use a filter with it
  • klasse · string · optionnel
    Only one capability class — the valid names are listed under `klassen` in every answer
  • dauer_s · number · optionnel
    Only models that can render this duration in seconds
  • aufloesung · string · optionnel
    Only models offering this resolution, e.g. 540p

  Exemple d'appel

  {"name": "lab_list_models", "arguments": {"kind": "video"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_list_project_locations≈ 186 tokens

  Location boards bound to ONE project. Narrower and more correct than lab_list_locations when you already know the project: it cannot leak boards from a different project with the same title. Boards created before the project binding existed (project_id NULL) deliberately do NOT appear here — use lab_list_locations for those.

  Paramètres, retour & exemple (1)

  Paramètres

  • project_id · string · requis
    Project id (from lab_list_projects)

  Exemple d'appel

  {"name": "lab_list_project_locations", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_list_projects≈ 148 tokens

  List FilmLab projects (id, title, current pipeline stage). Call this first to find a project_id for the other tools. Shows up to 20 items; `total` counts your active projects (up to 200) and `truncated: true` means the list is cut off — sorted by last change, so older projects drop out of the shown window first.

  Paramètres, retour & exemple (0)

  Exemple d'appel

  {"name": "lab_list_projects", "arguments": {}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_list_sequences≈ 136 tokens

  List a project's sequences, newest first. Use it to find a `seq_id` instead of creating a second sequence for the same cut.

  Paramètres, retour & exemple (1)

  Paramètres

  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string

  Exemple d'appel

  {"name": "lab_list_sequences", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_list_voices≈ 286 tokens

  List a project's cloned voices (lab_voice_clone results) — id, label, voice house, sample and preview URLs. This is where a `voice_id` for lab_voice_tts or lab_dub comes from, and where you look up which house a voice belongs to before pricing it. Both houses are listed unless you narrow it. Reads only — no state changes, no credits.

  Paramètres, retour & exemple (2)

  Paramètres

  • provider · string · optionnel · minimax | fish_audio
    Narrow the list to one voice house. Omit it and both come back, which is the normal case — a project can hold voices from either. An unknown value is refused rather than answered with an empty list: 'none found' and 'no such house' are different answers. What the houses can do: lab_list_models.
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string

  Exemple d'appel

  {"name": "lab_list_voices", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_location_panorama≈ 276 tokens

  Generate a 360° equirectangular HDRI panorama of a place (costs credits — exact price via get_cost: true). Pass loc_id to persist it on that board, so the viewer finds it again; without loc_id it is a one-off.

  Paramètres, retour & exemple (5)

  Paramètres

  • mood · string · optionnel
    Mood/atmosphere (default 'neutral')
  • intent · string · optionnel
    What the place is — the panorama prompt
  • loc_id · string · optionnel
    Persist the panorama on this location board (from lab_list_locations)
  • get_cost · boolean · optionnel
    Free: the exact price of this operation; nothing is rendered or charged. Name it to the person before the real run.
  • camera_height · number · optionnel
    Camera height in metres (default 1.6, roughly eye level)

  Exemple d'appel

  {"name": "lab_location_panorama", "arguments": {"mood": "texte", "intent": "texte", "loc_id": "texte", "get_cost": true, "camera_height": 1}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_location_recon≈ 586 tokens

  Reconstruct a real place in 3D from a scan clip: keyframes are pulled from the clip server-side and turned into a point cloud / splat on the location board, so a scouted room can be looked at from angles nobody filmed. THE SCAN IS NOT MADE HERE — it is a walk-around clip uploaded by the FilmLab camera app together with the phone's lens data. This tool takes one that already exists; lab_list_location_scans gives you the ids. SLOW AND NOT A JOB ROW: the answer comes back as 'reconstructing', and the finished state is picked up ONLY by lab_list_location_scans — lab_job_status and lab_get_job will never show this one finish. If the call times out, the reconstruction normally keeps running on the server: list the scans instead of firing it again. Re-running is allowed from any state that is not done.

  Paramètres, retour & exemple (4)

  Paramètres

  • engine · string · optionnel · fal-sam3d | vggt | vggt-splat
    Which reconstruction path. Omit for the backend default. 'vggt' is scene-scale and fast but gives a point cloud; 'vggt-splat' trains a walkable Gaussian splat from the same scan (minutes on a GPU, not seconds). Both need their own model configured on the backend — where it is not, the answer says so instead of falling back silently.
  • image_id · string · requis
    Id of the SCAN row (from lab_list_location_scans) — positive integer as string. It is a row in the image gallery whose tool is the location scanner; a normal generated image with that id is rejected, not reconstructed.
  • max_photos · integer · optionnel
    How many keyframes are pulled from the clip and handed to the reconstruction. Omit to let the engine use its own count — more frames mean a wider parallax baseline and a slower run.
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string. The scan must belong to it; a scan of another project is not found rather than borrowed.

  Exemple d'appel

  {"name": "lab_location_recon", "arguments": {"image_id": "texte", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_look_in_post≈ 339 tokens

  Read or set a project's 'look in post' flag. Use it when the person grades in DaVinci Resolve with the FilmLab Look plugin and wants the lens and film look applied there instead of baked into the generated pictures. With project_id only: read. With look_in_post true, image and video prompts of the project no longer ask for grain, halation, vignette, chromatic aberration or soft edges — the plugin adds them in Resolve; false puts them back. It takes effect only while a LensLab lens set is chosen for the project (Pose Director / camera panel in the FilmLab app); without one the flag is stored but changes nothing. The answer always carries look_in_post, optik (the chosen lens set or null), wirkt (whether it takes effect now) and a sentence to pass on.

  Paramètres, retour & exemple (2)

  Paramètres

  • project_id · string · requis
    Project id (from lab_list_projects)
  • look_in_post · boolean · optionnel
    true: leave the look terms out of prompts and let the Resolve plugin add them; false: keep them in the prompt. Omit to only read

  Exemple d'appel

  {"name": "lab_look_in_post", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_look_match≈ 481 tokens

  Check the colour CONTINUITY of a scene in the edit (Murnau): every shot is compared with the scene's reference shot (the first, or `referenz_clip_id`) at the SAME scene points — found by feature matching (ORB + homography) between the two frames, each rendered through its export path. Image-wide statistics would measure the framing, not the grade (measured: up to 5000 K apart with no grade change). At those points: white point (Kelvin and mired), lightness (L*), colour distance (ΔE). Over the threshold (8 mired, L* 4, ΔE 3) a shot gets a `befund` with the number (e.g. '150 K wärmer als die Szene (13 Mired)') and a `vorschlag.grade`: a clip grade fitted so the shot's source colours land on the reference colours, with the deviation expected afterwards. Pass it to lab_grade_clip, then run lab_look_match again. Shots without enough shared content (reverse shot, different subject) come back as `vergleichbar: false` with the reason — nothing is guessed. Scenes come from the sequence's shots (lab_shots); without them give the shots as `clip_ids`. At most 24 shots per call. Writes nothing, costs nothing.

  Paramètres, retour & exemple (4)

  Paramètres

  • szene · string · optionnel
    Only this scene (scene_ref from lab_shots); default: every scene with two or more shots
  • seq_id · string · requis
    Sequence id — positive integer as string
  • clip_ids · array · optionnel
    Compare exactly these shots instead of the scenes from lab_shots
  • referenz_clip_id · string · optionnel
    The shot the others are matched to; default the first of the scene

  Exemple d'appel

  {"name": "lab_look_match", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_mix≈ 772 tokens

  Set the sound mix of a sequence: per track `volume_db`, `pan`, `mute`, `solo` and `effects`. Every field you send is rendered — the backend rejects what it cannot render (422 with the reason), so a saved mix is the mix you hear. Tracks are the stems `dialog`, `music`, `sfx`, `atmo`, plus `master` (effects only: eq, compressor, limiter). Only the fields you send change; `effects` replaces that track's whole effect list. Effects: gate, eq, deesser, compressor, reverb, limiter — fixed order, one of each per track; give a `preset` (with its written reasoning), a one-knob `knopf` (0–1) or explicit values. Ducking is an effect too: {type:'ducking', quelle:'dialog', amount_db, attack_ms, release_ms} lowers this track while `quelle` is active. `naht_ms` (0–500) fades every seam between the clips of a stem with an equal-power fade — against clicks and room jumps at the cuts of a stem built from pieces; 0 = hard edges. The sfx stem of lab_ton_durchlauf comes with 30. Volume `automation` replaces the track's breakpoints {t_s, db}, in seconds from the sequence start, interpolated linearly in dB; [] clears it, and master does not support it. Call with `katalog: true` (and no tracks) to get every effect, its ranges and the presets with their reasoning. Any change discards the rendered mixdown. Changes state, costs nothing. Next: lab_mix_render, then lab_mix_messen.

  Paramètres, retour & exemple (3)

  Paramètres

  • seq_id · string · requis
    Sequence id — positive integer as string
  • tracks · array · optionnel
    Tracks to change — only the given fields are written
  • katalog · boolean · optionnel
    Return the effect catalogue instead of changing anything

  Exemple d'appel

  {"name": "lab_mix", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_mix_messen≈ 316 tokens

  Measure the RENDERED mix: integrated loudness (LUFS), true peak (dBTP) and loudness range (LU) of the master, measured on the mixdown file itself. Per stem the same values, speech-gated (under the dialog / in its pauses), and how many LU each stem sits under (or over) the dialog in dialog passages — exact. A stem's level inside the master is an estimate (stem plus the gain the master applied) and is labelled as such. Needs a current render whose stems are still the ones it was made from: any change with lab_mix discards it, and a newer audio file in a stem makes it stale (409 then — render first). Runs as a BACKGROUND JOB: you get a job_id at once; poll lab_get_job until done — the measurement is in job.result. Measure before and after a change to prove what it did. Writes nothing, costs nothing.

  Paramètres, retour & exemple (1)

  Paramètres

  • seq_id · string · requis
    Sequence id — positive integer as string

  Exemple d'appel

  {"name": "lab_mix_messen", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_mix_render≈ 442 tokens

  Render the sequence's mixdown, normalised to a loudness target: `broadcast` (EBU R128), `web` or `youtube`. With `auto_preset` it runs the AUTO-MIX instead: it measures every stem speech-gated (under the dialog vs. in its pauses), sets faders, ducking and a master limiter by the preset (`spielfilm`: music clearly under the dialog; `doku_vo`: the narrator leads), renders, and measures the result. Every auto-mix decision comes back as one sentence with its number, plus missed lower loudness bounds — read them, they are the reasoning you can pass on. Runs as a BACKGROUND JOB: the answer is a job_id at once; poll lab_get_job until status is done (the result — mixdown, measured loudness, the auto-mix report — is in job.result) or failed (job.result.status and detail say why: 422 solo on / dialog muted / no speech, 409 the tracks were edited meanwhile — nothing was overwritten). If a render of the same kind is already running for this sequence, you get THAT job_id back instead of a second render. Costs nothing. Next: lab_get_job, then lab_mix_messen.

  Paramètres, retour & exemple (3)

  Paramètres

  • seq_id · string · requis
    Sequence id — positive integer as string
  • target · string · optionnel · broadcast | web | youtube
    Loudness target, default broadcast
  • auto_preset · string · optionnel · spielfilm | doku_vo
    Run the auto-mix with this preset instead of rendering the mix as set

  Exemple d'appel

  {"name": "lab_mix_render", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_playbook≈ 250 tokens

  The rules of one working surface, generated from the code: what the surface is, what an agent can trigger itself, what exists but only by hand, and what does not exist at all. Call this BEFORE answering what is possible on a surface — the three lists come from a table with a code reference per entry, checked in every PR, not from memory. Saying "that does not exist" about something the editor can do is the failure this tool prevents. Surfaces: edit, vfx, audio, idea, script, axis, location, crew, cast, pose, capture.

  Paramètres, retour & exemple (1)

  Paramètres

  • flaeche · string · requis · edit | vfx | audio | idea | script | axis | location | crew
    The working surface

  Exemple d'appel

  {"name": "lab_playbook", "arguments": {"flaeche": "edit"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_prompt_transform≈ 1649 tokens

  Turn a loose idea into a production-ready image or video prompt — the same Dreamer engine the FilmLab web UI uses (modes: beautify, storyboard, polish, format, shorten, expand, simplify, custom, stiluebernahme). beautify GENERATES (a 50-character thought comes back as a full prompt); polish/format/shorten/expand/simplify PRESERVE what is there. medium=video plus depth=skeleton yields the 15-block production prompt; depth only applies to video. anlass only applies to beautify. custom and stiluebernahme require instruction. For video the answer carries clip_duration_seconds — hand THAT number to lab_animate(duration_seconds), otherwise a prompt timed to 12s gets rendered as lab_animate's 5s default. In an Apps-capable host this opens as a form you can adjust and re-run; elsewhere it answers with the prompt as plain text. Pass `tool` (the registry key you will hand to lab_animate/lab_generate) and the finished prompt is laid out in the skeleton of that model family — location, camera, lens and light land where that family reads them, worded the way it reads them; families without a measured rule keep them appended as before, and the answer says so (prompt_skelett).

  Paramètres, retour & exemple (15)

  Paramètres

  • mode · string · optionnel · beautify | storyboard | polish | format | shorten | expand | simplify | custom
    Default beautify (generates). beautify: Aus der Idee einen vollständigen Prompt bauen — ergänzt Licht, Optik, Kamera, Stimmung | storyboard: Szene in 4–8 nummerierte Panels zerlegen — je Panel ein eigenständiger Bild-Prompt | polish: Wortwahl polieren, Flow verbessern, Redundanz entfernen — Länge bleibt | format: In // Subject // Lighting // Camera Sektionen ordnen, Wortlaut bleibt | shorten: ~30% kürzer, jedes Wort muss Gewicht tragen | expand: Texturen, Lichtreflexe, atmosphärische Details | simplify: Direkt und klar, weniger Fachjargon | custom: Eigene Anweisung — z.B. 'Mach es düsterer' | stiluebernahme: Licht, Optik und Look aus einer Beschreibung — Motiv und Bildaufbau bleiben wörtlich
  • tool · string · optionnel
    Optional: the model you will render with, as the registry key from lab_list_models. Decides which family skeleton lays out camera, lens and light — and whether it is a measured rule or the plain appended form.
  • depth · string · optionnel · sketch | skeleton
    video only: sketch (5 blocks, default) or skeleton (15 blocks)
  • anlass · string · optionnel · frei | interview | szene | portrait | street | editorial | handy
    beautify only: what the image is FOR. Default frei
  • medium · string · optionnel · photo | video
    photo (default) or video — decides the section layout
  • prompt · string · requis
    The text to work on — a loose thought is enough for beautify
  • winkel · string · optionnel
    Optional: change the camera angle of the EXISTING prompt — a key such as augen, unter, auf, vogel, frosch, schraeg, ots, pov, profil. Implies mode=custom and needs no instruction; combinable with groesse.
  • familie · string · optionnel
    Optional, instead of tool: the model family by name when no registry key is at hand. Medium decides whether the image or the video skeleton applies.
  • groesse · string · optionnel
    Optional: change the shot size of the EXISTING prompt, keeping subject, light and place — a key such as ews, ws, mws, ms, mcu, cu, ecu, macro. Implies mode=custom and needs no instruction. An unknown key is rejected with the known ones.
  • techniken · array · optionnel
    Up to three directing technique keys from lab_regie_techniken. Their prompt fragments are appended verbatim after the transform, ordered angle, framing, composition, movement. One angle and one movement at most; movement only with medium=video.
  • project_id · integer · optionnel
    Optional: the project this prompt is for. With tool or familie, its Lens Lab optics, Pose Director framing and gaffer light are laid into the prompt. If the project has look_in_post on and a Lens Lab set chosen, grain, halation, vignetting, chromatic aberration and edge softness are left out — the FilmLab Look plugin adds them in Resolve; the answer lists what was removed.
  • referenzen · array · optionnel
    The references the prompt may point at, IN THE ORDER you will pass them to lab_animate/lab_propose. Write @bild1, @video1, @ton1 in your prompt and they come back as the markers the model actually reads (@Image1, @Video2, @Audio1) — the reference clip itself is @Video1, so the first video reference is @Video2. A mention with no matching reference is rejected instead of being left in the text, where it would reach the model as a word.
  • instruction · string · optionnel
    Required for custom (an order, e.g. 'make it darker') and stiluebernahme (a style description)
  • location_id · integer · optionnel
    Optional, only with tool or familie: the location board whose prompt prefix becomes the place block — the same board you will hand to lab_animate/lab_generate.
  • duration_seconds · integer · optionnel
    video only: the clip length in seconds the ACTION TIMING beats are written to. Default 5 (what lab_animate renders without an explicit duration). Rejected for medium=photo.

  Exemple d'appel

  {"name": "lab_prompt_transform", "arguments": {"prompt": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_propose≈ 1590 tokens

  Propose a generation for the user to confirm: validates the parameters against the catalog, computes the price, and shows a card (widget hosts) or returns the same object as text. NOTHING runs until lab_run_proposal is called with the returned vorschlag_id — by the card's button, or by you after the user said yes. Without a measured price there is no vorschlag_id and no button: the answer then says so instead of offering an estimate as if it were a quote. Free.

  Paramètres, retour & exemple (24)

  Paramètres

  • kind · string · requis · video | image
    Which kind of generation to propose
  • tool · string · optionnel
    Model id, copied verbatim from lab_list_models. Omit to use the default for this kind — the card names it and prices it either way.
  • in_sec · number · optionnel
    Video: start of the excerpt cut out of the reference clip, in seconds. Only together with out_sec and source_video_id.
  • intent · string · optionnel
    Video intent from the routing rules. Used to choose a model when tool is omitted and retained for Plan B; an explicit tool wins.
  • prompt · string · requis
    What to generate. The user can edit it on the card; lab_run_proposal takes the edited text as prompt_override without a new proposal.
  • familie · string · optionnel · seedance-2.0 | seedance-2.5
    Video: pick the model ('seedance-2.0', 'seedance-2.5') instead of a route — the card then names and prices the route the server takes for this account, and the run is PINNED to it (a card promises one price, so no silent fallback). Mutually exclusive with tool and intent.
  • out_sec · number · optionnel
    Video: end of the excerpt in the reference clip, in seconds. Must lie behind in_sec.
  • variants · integer · optionnel
    Image: how many variants (default 1). Multiplies the price — the card shows the multiplication.
  • audio_url · string · optionnel
    Video: URL of an existing audio track to lay under the clip. Independent of generate_audio.
  • scene_ref · string · optionnel
    Scene label (e.g. 'SZ 04'). Stored on the row, so the result can be matched back to a shot list.
  • project_id · string · requis
    Project id (from lab_list_projects)
  • referenzen · array · optionnel
    Video, clip path (source_video_id): typed references. The position IS the address — first image @Image1, first extra clip @Video2, first sound @Audio1. Image references are measured before sending and scaled up to the model's minimum rather than rejected.
  • resolution · string · optionnel
    Resolution tier, exactly as listed for the model in lab_list_models. Omit for the model's default.
  • location_id · string · optionnel
    Location board id (from lab_list_locations) — anchors the shot in the same place.
  • aspect_ratio · string · optionnel
    Image: aspect ratio as W:H, from the model's aspect_ratios in lab_list_models.
  • costume_refs · array · optionnel
    The costume plate of these characters goes along as an extra reference image — the outfit on an invisible mannequin, NO person. Every id must also be in character_refs. Needs a model whose max_references covers characters + plates. Each plate is one more reference and may cost credits.
  • end_image_id · string · optionnel
    Video: the completed image to land the clip on (last frame). Only where lab_list_models says supports_end_frame.
  • camera_motion · string · optionnel · dolly_in | dolly_out | dolly_left | dolly_right | jib_up | jib_down | static | focus_shift
    Video: Structured camera move sent to the model itself — only models whose lab_list_models entry lists camera_motions. Prefer this over prose when a keyframe chain must MOVE rather than cross-fade.
  • character_refs · array · optionnel
    Character ids (from lab_list_characters) whose reference image locks the cast's identity. Counted against the model's max_references and shown on the card by name.
  • generate_audio · boolean · optionnel
    Video: ask for the model's native audio. Only meaningful where lab_list_models says audio: schaltbar.
  • seed_image_url · string · optionnel
    Image: run img-to-img guided by this existing image URL. Shown on the card as the 'before'.
  • source_image_id · string · optionnel
    Video: the completed image to animate (positive integer as string). Required for a video proposal — unless source_video_id proposes a clip instead.
  • source_video_id · string · optionnel
    Video: propose a run FROM A CLIP instead of a still — a generated video id (lab_animate/lab_job_status) or an asset key (lab_list_assets). Mutually exclusive with source_image_id; only for models that take a video reference (lab_list_models says v2v).
  • duration_seconds · number · optionnel
    Video: clip length in seconds, inside the model's duration grid from lab_list_models. The card shows the DELIVERED seconds and says so when the provider snaps.

  Exemple d'appel

  {"name": "lab_propose", "arguments": {"kind": "video", "prompt": "texte", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_reference_motion≈ 3719 tokens

  Render a new clip FROM the motion of an existing one: your reference clip leads (camera move, blocking, timing), the model restyles what happens in it. Pass the clip's URL directly — the one you already have from lab_list_assets (asset_type 'video'), lab_job_status or lab_review_queue; nothing is looked up. Reference images bind cast, place and look; in_sec/out_sec cut the reference server-side before it ever reaches the provider, so you pay for the excerpt, not the source. Same backend path as lab_animate's source_video_id, with the fields that only exist there. Costs credits when called without get_cost. WITHOUT a reference clip (leave reference_video_url out), the images and sounds in `referenzen` alone guide the run — only for models whose lab_list_models entry says referenzen_ohne_video: true, and only FACELESS references (ort, stil, bild, stimme, ton): Seedance 2.5 rejects faces as reference images, even invented characters (measured 2026-09-27), so `figur` is refused before anything is charged. For a person, build a still with them first and animate it with lab_animate. Name the references in the prompt as 'reference only, never shown on screen', and avoid the word 'static' for short shots — it tends to return frozen frames.

  Paramètres, retour & exemple (25)

  Paramètres

  • ton · string · optionnel · quelle | generiert | keiner
    Which sound the result carries. quelle: the reference clip's own audio is laid back under the new picture after generation — the way to keep a spoken take, since models that regenerate audio replace the voice. generiert: keep the model's sound (needs generate_audio: true). keiner: no sound. Omitted: quelle when a reference clip is given and generate_audio is off, generiert when generate_audio is on, keiner otherwise. The finished run reports in metadata what actually lies underneath (ton) and how far picture and sound differ in length (ton_drift_s).
  • task · string · optionnel · reference | editing
    reference (default): the references guide a new clip. editing: the picture of the reference clip stays and only what the prompt names changes — e.g. 'keep the picture, generate matching sound effects, no music' with generate_audio: true. Needs a reference clip. Edit verbs in the prompt are expected here, not refused.
  • tool · string · optionnel
    Video model id — copy it verbatim from lab_list_models (kind: video), and only models the catalog marks v2v take a reference clip at all. Omit to let the backend use its own default for this path. Durations, resolutions and price live in the catalog, this text names none.
  • draft · boolean · optionnel
    Render a cheap DRAFT first (Seedance 2.5 and wan_vace only — other models refuse it before anything is charged). On Seedance 2.5 the draft is 480p, priced at that tier, and carries a draft_id that stays valid for 7 days and only for the account that ordered it. Finish an accepted draft in 1080p ONLY with lab_fertigstellen — never by downloading and re-uploading it: that is a new run with new motion, not the draft. Any `resolution` you pass is ignored for a draft, and the answer says so.
  • in_sec · number · optionnel
    Cut the reference clip server-side before it reaches the provider: start of the excerpt, in seconds from the clip's beginning. Only together with out_sec.
  • prompt · string · requis
    What the new clip should show. Describe it — do NOT phrase it as an instruction to edit or extend the reference; some models classify the run by the verb and then reject the aspect ratio and duration after queueing.
  • out_sec · number · optionnel
    End of the excerpt in the reference clip, in seconds. Must lie behind in_sec; both are set together or neither.
  • get_cost · boolean · optionnel
    Preflight: return the price in credits and your balance WITHOUT generating and without spending anything, reading the same catalog as lab_list_models. Do this before a long take or when the user should confirm the cost.
  • use_depth · ? · optionnel
    Condition the run on a depth pass of the reference clip. Defaults to ON (true = 'voll': depth of the whole frame); pass false to opt out. Models that do not have a depth stage ignore it — the answer says so rather than pretending it happened. 'personen': depth ONLY on the people, the original footage around them — the model stops copying build, hair and clothing of the original performers and the room keeps its colours. With 'personen' the run PAUSES after the mask: only the mask (SAM) is charged, the answer carries cost (mask) and cost_lauf (the run), and the clip waits as wartet_auf_freigabe until the human has looked at the preview (metadata.personen_referenz_url) and you call lab_freigeben. Needs a reference clip and a model with a depth stage; not together with face masks or task='editing'. To RE-FILM a take from new camera angles, pass false: a depth pass locks the geometry of the reference, and the new angles cannot happen. task='editing' ignores it anyway.
  • kamerapfad · object · optionnel
    The camera move as INPUT instead of prose: an object following shared/kamerapfad/schema.json — poses over time (position, look-at or quaternion, metres, Y up) from the Kadrage terrain flight or drawn by hand, or motion phases as lab_kamerafahrt reads them from a clip (its answer carries a ready `kamerapfad`). The backend validates it, derives phases, and adds the move as a paragraph after your prompt, before the reference markers (the reference clip still leads the motion as the first video reference). WHICH FORM that paragraph takes depends on the model: prose for most families, bracketed director commands for the MiniMax/Hailuo family, which parses them. NO MODEL RECEIVES THE POSES TODAY — the answer says which form went out (kamerapfad.angewandt = als_text or als_regiebefehle), names the family rule and the source it rests on (kamerapfad.sprache), and lists what that form could not carry. If your own prompt already carries bracketed commands, the path is NOT sent on top of them (angewandt = eigene_regie, with kamerapfad.eigene_regiebefehle naming what it found). A `zusammenfassung` inside the path is display only and is NEVER sent — the move is always rebuilt from the phases; if nothing can be built, the answer says angewandt = nicht_ableitbar with the reason, and nothing of the path is in the prompt. Mutually exclusive with kamerapfad_url.
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string. On this path it travels in the request BODY, not in the URL, but it is just as required: the new clip is filed under this project.
  • referenzen · array · optionnel
    The typed successor of character_ref_urls: each reference says WHAT it is, so a place or a look no longer has to travel disguised as a character. Since 2026-09-03 it carries all three channels, not just images: motion references ride alongside the reference clip, sound references go into the model's audio slots. The position IS the address — the images are @Image1..n, the reference clip is @Video1 and the extra motion references follow it, the sounds are @Audio1..n. Image references are MEASURED before they are sent and scaled up to the model's minimum if they fall below it; a reference is never rejected for being small. Mutually exclusive with character_ref_urls — two sources for one list means one of them silently loses. What a model takes per channel is in lab_list_models (referenz_grenzen).
  • resolution · string · optionnel
    Render resolution on this path, copied verbatim from the model's resolutions in lab_list_models. The run is priced at the resolution you choose — the low tier costs a fraction of the default — so pass it for sound-only or test runs. Omitted, the model's default applies.
  • wechsel_von · string · optionnel
    The model id this call switches AWAY from (as listed in lab_list_models), with the same references as before. The answer then carries `wechsel`: which references the switch cuts off and why, and which ones the new model picks up. Nothing is sent to the old model; the field only names the comparison.
  • aspect_ratio · string · optionnel
    Output aspect ratio on this path, written as width:height or 'auto'. Only models whose lab_list_models entry takes it on the reference path accept it; for any other model the backend refuses it before anything is charged, and the refusal lists the allowed values. Omitted, the model's fixed default applies.
  • ton_fuehrung · string · optionnel · voll | stimme | keine
    What the model HEARS as guidance while it renders — not what the result carries (that is `ton`). voll (default, same as omitting it): unchanged behaviour. stimme: the backend splits the reference excerpt (after in_sec/out_sec) with demucs and sends ONLY the vocal stem, unchanged, as the single audio reference @Audio1 — so a speaking or singing performer moves the lips without the music bed dragging along. The stem is never pitch-shifted or altered in any way. The demucs split is charged per second of the excerpt and shows up in get_cost (ton_fuehrung.cost); it is cached per clip and in/out, a repeat costs nothing. Needs a reference clip and a model with an audio slot; not together with sound references in `referenzen`. keine: no audio reference at all. With ton='quelle' the original mix of the clip — not the stem — is laid back under the result.
  • generate_audio · boolean · optionnel
    Let the model generate sound with the clip — only models whose lab_list_models entry can output audio take it on this path. Omitted = no generated sound. Generated audio REPLACES any voice in the reference — to keep a spoken take, leave it off.
  • kamerapfad_url · string · optionnel
    Address of a kamerapfad JSON instead of the object — the url of a file in THIS project (lab_list_assets), e.g. the kamerapfad JSON that Kadrage writes next to its flight video. Fetched by the backend under the same ownership rule as every reference: a file of another project is a named rejection before anything is charged. Mutually exclusive with kamerapfad.
  • last_frame_url · string · optionnel
    Guiding frame for the END of the new clip (image URL). Same rule as first_frame_url: wan_vace only, rejected elsewhere rather than dropped.
  • first_frame_url · string · optionnel
    Guiding frame for the START of the new clip (image URL). Only the wan_vace path binds guiding frames to the provider — with any other model the backend REJECTS this field instead of swallowing it, because a swallowed guiding frame means paying for a run identical to the one without it.
  • duration_seconds · number · optionnel
    Length of the NEW clip. Must lie inside the chosen model's duration grid from lab_list_models — the per-model ceiling is enforced by the backend and rejected rather than silently clamped.
  • raum_beschreiben · boolean · optionnel
    With depth on, a vision call describes ONLY the room of a still from the reference (place, light, colours, materials — no people) and adds it as a paragraph to the prompt, so a depth run does not come back grey. ON by default; false switches it off. The setting is remembered per project — omit it to use the project's last choice. Skipped automatically when an `ort` reference is given. The answer reports raum.angewandt and the text; metadata.prompt_gesendet holds the prompt as sent.
  • rechte_bestaetigt · boolean · optionnel
    REQUIRED when the reference clip or a character image was uploaded (not made in FilmLab), including characters whose sheet comes from an uploaded photo. It stands for this statement by the HUMAN: 'Ich habe die Rechte an Bild und Ton dieses Clips und die Einwilligung der gezeigten Personen.' Never set it on your own — show the human the statement and pass true only after they agreed. Without it the backend refuses with rechte_fehlen before anything is charged; get_cost tells you up front (rechte_noetig).
  • character_ref_urls · array · optionnel
    Ready image URLs that bind the cast's identity. The name says URLs on purpose: lab_animate's `character_refs` takes character sheet IDS, this path takes ADDRESSES, and the two are not interchangeable. Get them from lab_get_character_sheet. Omit to let the backend use the project's world-bible characters. Mutually exclusive with `referenzen`.
  • reference_video_url · string · optionnel
    URL of the clip whose motion is taken. Use the url/video_url a previous answer gave you (lab_list_assets with asset_type 'video', lab_job_status, lab_review_queue) — never a hand-built address: the bucket is not guessable and a wrong one renders and bills into a 404. Leave it out to run on `referenzen` alone (at least one image reference, no `figur`, no in_sec/out_sec, no depth) — the models that allow it carry referenzen_ohne_video in lab_list_models.

  Exemple d'appel

  {"name": "lab_reference_motion", "arguments": {"prompt": "texte", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_referenz_aus_bild≈ 502 tokens

  Attach an existing project image (an image_id from lab_umzug, lab_get_job result.bildzeilen or lab_generate) as reference: `ziel: 'figur'` makes it a view of a character (default view 'detail', the face anchor). `personenbezug` is REQUIRED for a character and has no default: 'keine_reale_person' or 'reale_person' — the latter needs a likeness_ref from the Likeness Register and turns the character into a digital double, checked before every later generation. `ziel: 'location'` stores it as the location's reference (viewer, continuity check). It does NOT steer generation — only the description does; `beschreibung_ableiten: true` derives the description from the image (does not overwrite an existing one unless `ersetzen`). An occupied character view answers 409 unless `ersetzen: true`. Free, except the description derivation (one vision call).

  Paramètres, retour & exemple (8)

  Paramètres

  • view · string · optionnel · detail | frontal | profile | fullbody | fullbody_back | costume
  • ziel · string · requis · figur | location
  • ziel_id · string · requis
    Character id or location id
  • ersetzen · boolean · optionnel
  • image_id · string · requis
    Image id from lab_umzug {bilder}, lab_get_job result.bildzeilen or lab_generate
  • likeness_ref · string · optionnel
    Character + reale_person only: Likeness Register id
  • personenbezug · string · optionnel · keine_reale_person | reale_person
    Character only, REQUIRED there: does the image show a real person?
  • beschreibung_ableiten · boolean · optionnel
    Location only

  Exemple d'appel

  {"name": "lab_referenz_aus_bild", "arguments": {"ziel": "figur", "ziel_id": "texte", "image_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_regie_techniken≈ 432 tokens

  Use when the person asks HOW to stage or shoot a feeling or effect (which angle, movement, framing or light makes a scene feel tense, tender, triumphant, uneasy) or wants directing options for a shot. Directing techniques: camera angle, framing, composition, movement and lighting, each with the emotional effect it creates (wirkung), when to use it (zweck_de), when it backfires (vermeiden_de) and a model-neutral prompt fragment (prompt_en). Search by effect (e.g. wirkung=bedrohung, isolation, sehnsucht) to find the ways to get there, then pass up to three `schluessel` to lab_prompt_transform(techniken) — the fragments are appended verbatim, not rewritten. One angle, one movement and one lighting setup per shot; framing and composition stack. With handwerk=true it also returns the camera craft: how to state a shot so a model renders it (rules), look-alike pairs with a check sentence each (verwechslungen — e.g. low angle vs Dutch angle, OTS vs POV), focal lengths and the frame boundary of every shot size. Read-only, free.

  Paramètres, retour & exemple (3)

  Paramètres

  • gruppe · string · optionnel · winkel | kadrage | komposition | bewegung | licht
    Only one group
  • wirkung · string · optionnel
    Only techniques with this effect key — the answer lists all keys under `wirkungen`
  • handwerk · boolean · optionnel
    Also return the camera craft (rules, look-alike pairs, focal lengths, frame boundaries)

  Exemple d'appel

  {"name": "lab_regie_techniken", "arguments": {"gruppe": "winkel", "wirkung": "texte", "handwerk": true}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_render_frames≈ 466 tokens

  See the DELIVERED film: up to 12 frames from the finished export (lab_start_export → lab_get_export status done), tiled into one image and shown. This is the rendered picture WITH everything the render adds — lens/grade, lower thirds, title cards and the AI badge — so use it to check the result, e.g. 'is the lower third readable at 7 s, does the badge cover anything'. lab_capture shows the cut BEFORE rendering (computed from the timeline, without those layers); this tool shows what was actually delivered. Give `sekunden` (seconds into the exported film) or `verteilt` (n frames spread evenly; default 6 when both are missing). A second past the end is an error with the film's length, not a silently clipped frame. Only finished exports with a video (not archive/PNG-sequence profiles). Free (no credits).

  Paramètres, retour & exemple (5)

  Paramètres

  • job_id · string · requis
    Export job id from lab_start_export / lab_list_exports — positive integer as string
  • preview · boolean · optionnel
    Show the image inline (default true)
  • sekunden · array · optionnel
    Seconds into the exported film, e.g. [0.5, 7.0]. Order is kept (4 per row)
  • verteilt · integer · optionnel
    Instead of sekunden: this many frames spread evenly over the film
  • kachel_breite · integer · optionnel
    Width of one frame in px (default 480)

  Exemple d'appel

  {"name": "lab_render_frames", "arguments": {"job_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_restyle_location≈ 288 tokens

  Restyle an existing board towards a wish (costs credits — exact price via get_cost: true) — same place, different look, e.g. 'the same flat, twenty years later'. Changes the board itself, so images generated afterwards follow the new style. Also the repair path for a board whose prompt_prefix_en is a raw field dump (lab_create_location returned prefix_generated: false): restyle it with a wish like 'keep the place, write a proper image prompt'.

  Paramètres, retour & exemple (3)

  Paramètres

  • wish · string · optionnel
    The desired change, in prose
  • loc_id · string · requis
    Location board id (from lab_list_locations)
  • get_cost · boolean · optionnel
    Free: the exact price of this operation; nothing is rendered or charged. Name it to the person before the real run.

  Exemple d'appel

  {"name": "lab_restyle_location", "arguments": {"loc_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_review_asset≈ 435 tokens

  Review generated assets: set verdict (accepted|rejected|pending) and/or selected. Pass ONE id, or `ids` for a bulk review — after a generation run there are usually dozens to sort, and clicking through them one by one is why the review fields went unused. Rejected assets drop out of the default listings and become prunable. Note: single-id calls make `selected` exclusive per scene (one chosen variant per scene_ref); bulk calls do NOT, because a bulk over one scene would keep resetting itself and only the last id would stay selected.

  Paramètres, retour & exemple (6)

  Paramètres

  • id · string · optionnel
    Single asset id (positive integer as string). Use this for the per-scene selection
  • ids · array · optionnel
    Many asset ids for a bulk review (max 200). Mutually exclusive with `id`
  • reason · string · optionnel
    Why — stored as verdict_reason, useful when reviewing a rejection later
  • verdict · string · optionnel · accepted | rejected | pending
    Acceptance verdict. Feeds the acceptance telemetry (which provider/mode/price actually produced usable shots)
  • selected · boolean · optionnel
    Mark as the chosen variant
  • reference_type · string · requis · video | image
    What kind of asset these ids refer to

  Exemple d'appel

  {"name": "lab_review_asset", "arguments": {"reference_type": "video"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_review_queue≈ 740 tokens

  Browse GENERATED rows (images or videos) — newest first, each with the INPUTS it ran on. Every row carries `inputs[]` (start/reference images, reference videos, character refs — role + url) and `params` (model, mode, resolution, seed…). Read those before comparing two runs: a run without its inputs is a claim with a picture attached, and a comparison described as one-variable has more than once turned out to differ in three. An input whose URL was never recorded appears as `origin: 'unrecorded'` — that is a gap in the write path, NOT a text-to-* run. Two modes. PER PROJECT (pass project_id + type): adds the review filters — verdict, selected_only, scene_ref — and carries `selected`. ACROSS PROJECTS (omit project_id, or pass since/until/tool_used/cursor): the time-range view for 'what ran on August 3rd?'. The review filters do not exist there and are rejected rather than silently dropped. Page with `next_cursor`.

  Paramètres, retour & exemple (12)

  Paramètres

  • type · string · optionnel · image | video
    Which generated rows. Required per project; across projects, omit for both
  • limit · integer · optionnel
    Max rows (per project default 50). Across projects the page is capped at 20 so next_cursor stays exact
  • since · string · optionnel
    ACROSS PROJECTS. created_at >= this ISO-8601 timestamp (e.g. 2026-08-03T00:00:00Z)
  • until · string · optionnel
    ACROSS PROJECTS. created_at <= this ISO-8601 timestamp
  • cursor · string · optionnel
    ACROSS PROJECTS. The next_cursor of the previous page. Opaque — do not build one by hand
  • preview · boolean · optionnel
    Attach the pictures themselves, downscaled to 512px, so a generation run can be SORTED by looking instead of by reading prompts. At most 4 per call — narrow the list with scene_ref/limit rather than expecting more. Rows without an image URL (all videos) are named in preview.notes, not silently dropped.
  • verdict · string · optionnel · accepted | rejected | pending
    PER PROJECT ONLY. Exact verdict filter. Omit to get everything except rejected
  • scene_ref · string · optionnel
    PER PROJECT ONLY. Only this scene
  • tool_used · string · optionnel
    ACROSS PROJECTS. Exact tool/provider name, e.g. seedance-2.5
  • project_id · string · optionnel
    Project id (from lab_list_projects). Omit to search across all projects
  • selected_only · boolean · optionnel
    PER PROJECT ONLY. Only the chosen variants
  • include_rejected · boolean · optionnel
    PER PROJECT ONLY. Include rejected in the default listing

  Exemple d'appel

  {"name": "lab_review_queue", "arguments": {"type": "image", "limit": 1, "since": "texte", "until": "texte", "cursor": "texte", "preview": true}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_rezept_montage≈ 896 tokens

  The Montage recipe: one recurring character in 8–16 independent everyday gags, cut on the beat into a 9:16 reel of about 6–11 seconds with a music bed. It runs the existing steps in order — gags (lab_situationen), stills with the character and the phone-flash look (auto-storyboard 9:16), identity check with ONE retry per deviating still, a STOP until the human accepts the stills (lab_review_asset), music, sequence, beat grid and rhythm, beat-length clips, placing them, export (social_vertical). If the export contains a synthetic PERSON or VOICE, it needs a release only a signed-in human can give: the recipe STOPS with stopp freigabe_noetig — the human exports that sequence with social_vertical in the web app and confirms the wording; the next weiter takes over that export and checks it. Each call with aktion weiter does exactly ONE step and stores the state in the project, so an interrupted run continues where it stopped; call it again until phase is fertig. MONEY: aktion preis (or get_cost) returns the expected and the maximum price per item and a recommended cap — free. Paid steps run only inside a released lab_auto_lauf (lauf_id) and the recipe checks its free amount before every paid step. The character must already have a sheet with a reference image (lab_create_character with gattung, then lab_generate_character_reference) — it is not part of the price. aktion stand shows the state, abbrechen deletes it (generated material stays).

  Paramètres, retour & exemple (10)

  Paramètres

  • bpm · integer · optionnel
    Start only: tempo written into the default music prompt (default 120)
  • thema · string · optionnel
    Start only: theme or setting for the gags, e.g. 'big city at night'
  • aktion · string · requis · preis | weiter | stand | abbrechen
    preis: price per item; weiter: one step; stand: show state; abbrechen: delete the state
  • anzahl · integer · optionnel
    Number of gags and shots, 8–16 (default 10)
  • lauf_id · string · optionnel
    Released auto run (lab_auto_lauf) whose cap pays for the steps — required for paid steps
  • figur_id · string · optionnel
    Start only: character sheet id with a reference image — positive integer as string
  • get_cost · boolean · optionnel
    Same as aktion preis — nothing is generated or charged
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string
  • situationen · array · optionnel
    Start only: your own gags instead of suggested ones (e.g. picked from lab_situationen)
  • musik_prompt · string · optionnel
    Start only: music prompt; default is an instrumental groove with a steady beat

  Exemple d'appel

  {"name": "lab_rezept_montage", "arguments": {"aktion": "preis", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_run_module≈ 262 tokens

  Run ONE pipeline module for a project (context is injected from upstream modules + crew agents). SYNCHRONOUS and LLM-heavy: light modules return in seconds; heavy ones can exceed ~55s and then time out (504) — run those in the FilmLab web app instead. Pass an invalid module name to get the list of valid module keys. Returns the module output.

  Paramètres, retour & exemple (3)

  Paramètres

  • module · string · requis
    Pipeline module/stage key, e.g. mod_concept, mod_storyboard, mod_shotlist, mod_script
  • message · string · requis
    Your instruction/prompt for this module (the user turn in the module chat)
  • project_id · string · requis
    Project id (from lab_list_projects)

  Exemple d'appel

  {"name": "lab_run_module", "arguments": {"module": "texte", "message": "texte", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_run_proposal≈ 448 tokens

  Run a proposal exactly as shown — same model, same parameters, same price. Called by the card's button, or by you after the user confirmed. Single use: the proposal is consumed BEFORE the run, so a second call is refused instead of paying twice. Valid 15 minutes, for the account that created it. Costs credits. The run is checked against what you confirmed only when it FINISHES; poll lab_job_status and read review there. This answer carries review only if the run completed synchronously.

  Paramètres, retour & exemple (3)

  Paramètres

  • vorschlag_id · string · requis
    The id from lab_propose or plan_b in lab_job_status. Do not construct one — an unknown id answers 'vorschlag_abgelaufen', not an error you can work around.
  • ohne_keyframe · boolean · optionnel
    Skip the keyframe checkpoint on purpose. By default a paid clip only starts from a start image the user has approved (lab_review_asset verdict: accepted) — look at the frame first, then spend on the clip. Set true only when the user explicitly asked to skip the frame check.
  • prompt_override · string · optionnel
    Replace ONLY the prompt text of the stored proposal. Every other parameter — model, resolution, duration, references — and the price stay exactly as shown. This is the path for a prompt the user edited on the card: the price does not depend on the text, so no new proposal is needed. Standbild-Bewegung uses no model prompt; confirm that proposal unchanged.

  Exemple d'appel

  {"name": "lab_run_proposal", "arguments": {"vorschlag_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_schnitt_export≈ 344 tokens

  Export ONE sequence as an editing file for DaVinci Resolve, Premiere or Final Cut, so the cut can be finished there. Costs nothing. fcpxml (recommended for Resolve): V1 as the main storyline with gaps, the sequence's transitions as centered cross dissolves (dropped where the next clip has no head or at a gap), audio stems and V2+ as connected clips. otio: OpenTimelineIO JSON (video and gaps, speed; no audio, no transitions). edl: CMX 3600 (video plus up to 4 audio channels; no transitions). The answer carries the whole file in `inhalt` and a file name — write it to disk for the person. Media are referenced by their FilmLab URLs: in Resolve, File > Import > Timeline, then relink offline clips by file name.

  Paramètres, retour & exemple (2)

  Paramètres

  • format · string · requis · fcpxml | otio | edl
    fcpxml for Resolve/Final Cut (carries transitions), otio for OpenTimelineIO tools, edl as the lowest common denominator
  • seq_id · string · requis
    Sequence id (from lab_list_sequences/lab_get_sequence) — positive integer as string

  Exemple d'appel

  {"name": "lab_schnitt_export", "arguments": {"format": "fcpxml", "seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_scopes≈ 393 tokens

  Measure ONE clip of the edit as numbers instead of a picture: a frame is rendered through the clip's export path (input profile, grade LUT, secondary correction) and measured — luma percentiles (P1/P50/P99, Rec.709), mean R/G/B, green excess (G minus the mean of R and B: >0 green cast, <0 magenta), vectorscope centroid (Cb, Cr), clipped highlights and crushed shadows. `befund` says what is off in words with the number; `vorschlag.grade` is a correction computed on a sample of the source through the clip's full grade (gamma wheel master first, then exposure, temperature, tint, gain wheel) towards median luma 0.42 and no cast WITHOUT pushing highlights into clipping, with the values it expects — pass it to lab_grade_clip, then measure again. When nothing more is gained, `vorschlag.grade` is null and `grund` says why. Give clip_id (from lab_grade_clip without grade) or zeit_s (seconds on the timeline); default is the middle of the clip. Writes nothing, costs nothing.

  Paramètres, retour & exemple (3)

  Paramètres

  • seq_id · string · requis
    Sequence id — positive integer as string
  • zeit_s · number · optionnel
    Timeline position in seconds (picks the clip there; within a clip_id: the frame)
  • clip_id · string · optionnel
    Clip to measure

  Exemple d'appel

  {"name": "lab_scopes", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_search_catalog≈ 139 tokens

  Search the FilmLab universe catalog of AI tools, news and companies. Query must be at least 2 characters. Returns up to 20 matches with a total count.

  Paramètres, retour & exemple (1)

  Paramètres

  • q · string · requis
    Search query, min 2 characters

  Exemple d'appel

  {"name": "lab_search_catalog", "arguments": {"q": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_sfx≈ 1394 tokens

  Generate or CLEAN UP a SOUND track other than music — sound effects, ambience/atmosphere, dialog, a voiceover, FOLEY scored to an existing clip, or the repair kinds that take an EXISTING recording apart instead of inventing one: denoise (take the noise out), split (separate it into stems), isolation (keep the voice, drop the rest). All of it goes through the same audio pipeline as lab_generate_music. ASYNCHRONOUS: the call returns immediately with a row whose `audio_url` is null and `metadata.status` is 'pending'. Nothing is playable yet. Poll lab_list_audio (matching audio_type) until that row's status is 'completed' and audio_url is set; a failed row refunds its credits and carries metadata.error. The backend picks the provider for the chosen `art` on its own — there is no `tool` parameter here.

  Paramètres, retour & exemple (10)

  Paramètres

  • art · string · requis · sfx | ambience | dialog | voiceover | foley | denoise | split | isolation
    Kind of track — sfx (a single sound effect), ambience (a continuous atmosphere/soundscape), dialog (a spoken line), voiceover (narration), foley (sound derived FROM an existing clip and synced to what happens in it — needs `video_id`, ignores `duration_seconds`, and takes its length from the source). The repair kinds work on a recording you already have and need exactly one source (`audio_id`, `video_id` or `audio_url`), never a prompt: denoise (take out hiss, hum and room noise), split (separate the recording into stems — one audio row per stem), isolation (keep only the voice, drop room, noise and music). Their length follows the source, so `duration_seconds` is ignored. Not 'music' — that stays lab_generate_music, it binds a different stem
  • stems · array · optionnel
    SPLIT ONLY: which parts to separate out. Left out, you get the voice and the rest of the recording, each part as its own audio row. Asking for a subset drops what you leave out — there is no combined everything-but-the-voice file, that would be a mixdown the provider never made.
  • prompt · string · optionnel
    What the sound should be. For sfx/ambience: name the source and character of the sound. For dialog/voiceover: the line or text to speak. Required for every art EXCEPT foley — foley watches the clip, so leaving it empty means 'take what you see', and a prompt merely steers it
  • audio_id · string · optionnel
    REPAIR KINDS ONLY, and the best of the three ways to name a source: an existing audio row of this project (from lab_list_audio), which has an owner and an address that belongs to us. Chain it — denoise a row, then split the result. The row must already carry an audio_url; a pending one has no file yet.
  • get_cost · boolean · optionnel
    `true` reports the price and your balance WITHOUT generating anything and without spending quota. Not drawn from the lab_list_models catalog (that covers image/video models only) — audio pricing follows the provider FilmLab picks for `art`, and each kind is billed by its own unit: per run, per second, or per character. For the spoken kinds the price follows the length of your text, which the cost endpoint cannot take: the answer then names the provider and your balance and reports `cost_generations` as null rather than inventing a number — the real amount comes back with the call.
  • video_id · string · optionnel
    The clip to work from. For FOLEY it is required to RUN one; for the repair kinds it is one of the three ways to name a source, and the backend extracts the audio track from it. From lab_list_assets or the row an animate call returned; the clip must belong to this project. The backend measures its length and rejects sources it will not process, before anything is charged. A price question (`get_cost: true`) does NOT need it — the price follows a length, not a particular clip.
  • audio_url · string · optionnel
    REPAIR KINDS ONLY, and the last resort: a bare address of a sound file. It carries no owner, so nothing can be checked against the project — prefer `audio_id` or `video_id`. A provider address is copied into our own storage first, and if that fails the call is refused rather than stored with a deadline.
  • scene_ref · string · optionnel
    Optional scene label, stored on the row. Useful to tell several tracks of one project apart
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string
  • duration_seconds · number · optionnel
    Desired length in seconds. The backend clamps this to what the chosen provider actually supports for this `art` — dialog/voiceover ignore it entirely, the length follows the text, and foley ignores it too, its length follows the clip. The repair kinds ignore it as well: you clean up a file, not a stretch of it. One exception, and only for asking: in a `get_cost` query on foley or a repair kind, naming it prices THAT length instead of the ceiling. There is no lab_list_models entry for audio: the provider isn't a choice you make here, it's picked automatically per `art`.

  Exemple d'appel

  {"name": "lab_sfx", "arguments": {"art": "sfx", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_shots≈ 400 tokens

  Read the SHOT layer of a sequence — which clips form one shot, which scene it plays in, who is in it, and what the continuity pass found. This is the layer above the timeline: lab_get_sequence gives you clips in a row, this one gives you the cut. Costs nothing, writes nothing. Use it before changing a cut: a shot binds clip_ids, so the times come out of the timeline and a shot whose clips you shorten simply gets shorter. Read `clips_ohne_shot` as well — it says how far the meaning lags behind the timeline, and an empty `shots` list usually means nobody has derived them yet (lab_shots_ableiten does that, for free). Every shot reports `clips_verwaist` (clip_ids that no longer exist in the timeline) and `zusammenhaengend` (false when another shot's clip sits between this one's): a torn shot is allowed — one location cut into twice — but it says so, instead of showing a duration longer than the sum of its clips.

  Paramètres, retour & exemple (2)

  Paramètres

  • rung · string · optionnel · shot | movement
    Which level to read. 'shot' (the default) is one take; 'movement' groups shots into arcs. They are independent layers over the same clips — reading one never shows the other
  • seq_id · string · requis
    Sequence id (from lab_create_sequence/lab_list_sequences) — positive integer as string

  Exemple d'appel

  {"name": "lab_shots", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_shots_ableiten≈ 354 tokens

  Derive the shot layer from what the clips already say about themselves — consecutive clips of the same scene become one shot, and a scene that returns later becomes a second one (one location cut into twice is two shots). Costs nothing: it groups rows and reads titles, it generates nothing. Titles come from the project's shotlist where the scene is in there, so this is more than a regrouping — it fetches meaning the pipeline already produced. SHOTS YOU SET BY HAND SURVIVE. Only derived ones are replaced, and clips already held by a manual shot are left out of the grouping entirely — a derivation does not take handwork's material away. Read `clips_ohne_szene` in the answer: those clips say nothing about where they belong, so each became its own shot. That number is a job for the pipeline, not a fault of this call — and grouping two nameless clips would be a claim about connection that nobody made.

  Paramètres, retour & exemple (1)

  Paramètres

  • seq_id · string · requis
    Sequence id (from lab_create_sequence/lab_list_sequences) — positive integer as string

  Exemple d'appel

  {"name": "lab_shots_ableiten", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_shots_setzen≈ 741 tokens

  State the shot cut yourself: which clips form one shot, what it is called, which scene it plays in. This is the counterpart to lab_shots_ableiten — that one groups by the scene the clips already name, this one is for the judgement no field carries. Costs nothing. Use it where derivation cannot reach: ingested footage has no shotlist by nature, and a sequence whose clips name no scene would come out of a derivation as one shot per clip — the timeline under another name. It is also the ONLY way to build the 'movement' layer (arcs over shots); the derivation only ever writes 'shot'. REPLACES the whole level in one go: every shot of this `rung` that you do not list is gone. The other level is untouched — recutting shots does not throw the arcs away. Refusals happen BEFORE anything is written: an unknown clip_id, or the same clip in two shots of one level. A half-set shot list looks like a result and is none. Read lab_shots first and send its clip_ids back — a shot binds clip identities, not time ranges, so shortening a clip later simply shortens the shot. What you set here counts as handwork: a later lab_shots_ableiten leaves these shots alone and does not touch their clips.

  Paramètres, retour & exemple (3)

  Paramètres

  • rung · string · optionnel · shot | movement
    Which level to replace. 'shot' (the default) is one take; 'movement' groups shots into arcs. Independent layers over the same clips — writing one never touches the other
  • shots · array · requis
    The whole level, in order. The order here IS the order of the shots
  • seq_id · string · requis
    Sequence id (from lab_create_sequence/lab_list_sequences) — positive integer as string

  Exemple d'appel

  {"name": "lab_shots_setzen", "arguments": {"shots": [], "seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_situationen≈ 302 tokens

  Suggest independent visual gags for a character and theme. Free text generation, no images or credits spent. Returns anzahl entries with titel, bild_en and bewegung_en: one moment and one strong action each, no story sequence or references between entries. figur accepts a character-sheet id (uses its prompt_prefix_en) or a free-text character description. Select 8–16 suggestions for lab_auto_storyboard with figur_id.

  Paramètres, retour & exemple (3)

  Paramètres

  • figur · ? · requis
    Existing character-sheet id or free-text character description
  • thema · string · requis
    Theme or setting for the independent gags
  • anzahl · integer · optionnel
    Number of suggestions, default 20

  Exemple d'appel

  {"name": "lab_situationen", "arguments": {"figur": "texte", "thema": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_start_export≈ 1079 tokens

  Start an ASYNC export render of a project sequence. Returns a job_id immediately (status 'queued') — does NOT block. Then poll lab_get_export with that job_id until status is done|failed. Needs the sequence_id to render (an integer from the project's sequences). `derivatives` asks for extra cut-downs of the SAME render (portrait for social) alongside the main file — their URLs come back in the finished job's `derivatives`. The finished job also carries `zielmarkt_checkliste` (delivery checklist per target market, set with lab_zielgruppe).

  Paramètres, retour & exemple (11)

  Paramètres

  • profile · string · optionnel · web | social_vertical | social_youtube | streaming_hdr | cinema | master | alpha_prores4444 | alpha_png_sequence
    Delivery profile (default 'web'). See lab_export_profiles. 'alpha_prores4444' and 'alpha_png_sequence' keep transparency and are refused with an explanation unless a clip in the sequence really carries an alpha channel.
  • quality · string · optionnel · draft | standard | high
    Quality preset (default 'standard')
  • project_id · string · requis
    Project id (from lab_list_projects)
  • derivatives · array · optionnel
    Extra cut-downs rendered from the FINISHED export, on top of the main file. '9x16' is a deterministic crop of the wide render into portrait — what falls outside the portrait frame is gone, not filled in. Their URLs arrive in the completed job's `derivatives`.
  • sequence_id · string · requis
    Sequence id to render (positive integer as string, e.g. '27')
  • ohne_clipton · boolean · optionnel
    Leave the clips' OWN audio out of the export (e.g. a video model whose sound is always on) — the film then sounds only from the bound stems and the mixdown (music bed, narrator). Default false: the clips' own audio is mixed under the bed as before.
  • include_stems · boolean · optionnel
    Also export audio stems separately (default false)
  • ki_kennzeichnung · string · optionnel · minimal | durchgehend | anfang | abspann | leitfaden
    How the visible AI disclosure (EU AI Act Art. 50(4)) appears when the sequence contains AI material. Default 'minimal': a small 'KI' mark in the corner for the whole film. 'durchgehend': the larger 'KI-verändert' box. 'leitfaden': an 'AI' mark top right for the whole film, as in the German regulator's (Bundesnetzagentur) transparency guide. 'anfang': the mark for the first 4 s plus a 4 s end card. 'abspann': only the 4 s end card. 'anfang' and 'abspann' require werk_kuenstlerisch=true; there is no option without any disclosure.
  • derivative_region · string · optionnel · center | left | right
    Which part of the wide frame the portrait crop keeps. Default 'center' — pick 'left' or 'right' when the subject stands off to one side, otherwise the crop cuts it in half.
  • werk_kuenstlerisch · boolean · optionnel
    Confirm the work is artistic, fictional or satirical — only then may the disclosure be limited to the opening or the end card. Set it only when that is true; the choice is recorded with the export.
  • kennzeichnung_umfang · string · optionnel · film | abschnitte
    For a film that mixes people-made material ('eigen', see lab_herkunft) with AI material: 'film' (default) marks the whole film; 'abschnitte' shows the mark only while an AI or undeclared clip is on screen. Only with ki_kennzeichnung minimal, durchgehend or leitfaden. Audio counts too: an AI or undeclared sound track (bed, stems, mixdown) runs under the whole film, so the export then marks the whole film and reports umfang_bestellt. Declare own music or dialogue with lab_add_media(herkunft) or lab_herkunft. A film with no AI clip at all carries no mark either way. The choice and the clip-by-clip origin are recorded in the provenance record.

  Exemple d'appel

  {"name": "lab_start_export", "arguments": {"project_id": "texte", "sequence_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_stems_export≈ 342 tokens

  Hand the sound over to whoever mixes next (Resolve/Fairlight, Pro Tools, a dubbing studio): every stem of the sequence (dialog, music, sfx, atmo) as a 24-bit / 48 kHz stereo WAV, rendered the way it goes into the mix — effects, fader, pan and ducking baked in — plus an M&E file (music + effects + atmo WITHOUT the ducking on the dialog, for dubbed versions). All files start at the start of the sequence and are exactly the same length, so they line up at 00:00 in any DAW. Delivered as ONE zip with stems.json (format, length in samples, loudness/true peak per file) and LIESMICH.txt. The master (EQ/compressor/limiter) and the loudness normalisation are NOT in the stems: their sum is the mix before the master. Needs bound stems (lab_bind_audio). Runs as a BACKGROUND JOB: poll lab_get_job — stems_zip_url is in job.result. Changes nothing in the mix, costs nothing. Picture handover is lab_schnitt_export.

  Paramètres, retour & exemple (1)

  Paramètres

  • seq_id · string · requis
    Sequence id — positive integer as string

  Exemple d'appel

  {"name": "lab_stems_export", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_suggest_durations≈ 303 tokens

  Ask what clip durations the project's cutting preset WOULD give a sequence — and change nothing (`angewendet: false`). Use it to see the consequence before lab_apply_rhythm writes it, or to size a sequence that has no clips yet (pass `anzahl`). It knows nothing about the measured beat grid: the tempo it uses is the text from the preset's music brief ('mittel bis schnell, 100–128'), which is a promise, not a measurement. Only lab_apply_rhythm reaches for the grid that lab_beatgrid measured. Reads only — no state, no credits.

  Paramètres, retour & exemple (2)

  Paramètres

  • anzahl · integer · optionnel
    How many shots to distribute. Omit to use the sequence's existing clip count — required if the timeline is still empty, which otherwise answers 400
  • seq_id · string · requis
    Sequence id (from lab_create_sequence/lab_list_sequences) — positive integer as string

  Exemple d'appel

  {"name": "lab_suggest_durations", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_timeline_apply≈ 1505 tokens

  Write a WHOLE cut into a sequence in one call — clips in order with their lengths, an optional dissolve between them, an optional bed underneath. This is the counterpart to lab_get_sequence: that one reads the timeline, this one writes it. Prefer it over a chain of lab_add_clip calls whenever you already know the whole cut: a chain that breaks in the middle leaves half a sequence behind, this either applies or refuses. Costs nothing — it validates and writes rows, it generates nothing. Every video_id is checked against the project BEFORE anything is written, so a wrong id is a refusal here and not a gap in the cut nobody notices. Pass `sequence_id` to write into THAT sequence; omit it and a new one is created. Pass `sequence_id` WITHOUT a manifest to read back the stored cut as a manifest — for an agent that already has the sequence_id and wants to see what is in there before changing it. (The Resolve bridge does NOT go through here: it talks to the FilmLab server directly with its own bridge key and does not know this MCP.) Reworking a cut you read back? Keep each clip's `clip_id`. A clip that comes back with its identity keeps its track, its in-point in the source and its scene, and the shots bound to it stay bound; a clip without one is treated as new and gets a fresh identity, which orphans whatever pointed at the old one. Two honest limits: the Resolve bridge applies the clips but reports `uebergang` and the bed's level/fade as not applied (its scripting API has neither a transition call nor a clip volume property). The FilmLab sequence render applies the bed with its level and fade, but NOT `uebergang` yet — dissolves are stored and render as hard cuts (checked 2026-10-03).

  Paramètres, retour & exemple (5)

  Paramètres

  • title · string · optionnel
    Title for the sequence created when `sequence_id` is omitted
  • manifest · object · optionnel
    The cut as one object. Omit it only together with a `sequence_id`, to read back what is stored
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string
  • sequence_id · string · optionnel
    Sequence to write into (from lab_create_sequence/lab_list_sequences). Omit to create a new one. Given WITHOUT a manifest, the stored manifest is read back instead of written
  • erwartete_revision · string · optionnel
    The `revision` you read (from lab_get_sequence or this tool's read-back). The cut is written only if the sequence still has exactly that content — otherwise nothing is written and you get `revision_veraltet` with the current revision: read again, merge, write again. Without it this tool still protects the moment between its own read and write, but not the time since YOU read the sequence.

  Exemple d'appel

  {"name": "lab_timeline_apply", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_ton_durchlauf≈ 517 tokens

  Generate SOUND EFFECTS for a whole sequence, shot by shot — Simon Meyer's pass: every shot is muted, padded with black frames up to the model's minimum length, re-rendered by Seedance 2.5 in editing mode at its low resolution with sound on, and only the generated sound is kept, stretched back to the original timing (the black padding is the sync marker) and laid at the shot's position. The result is ONE sfx track in sequence length, bound to the sequence's sfx stem; the other stems stay as they are. Each piece and its offset are listed in the audio row's metadata (stuecke). Shots come from the sequence itself, in export order and export length — no cut detection. Costs credits, priced per shot over the seconds actually sent (the padding counts); call with get_cost first. ASYNCHRONOUS: returns a job_id; poll the job until done. A shot that fails is refunded on its own and named in fehlende_einstellungen; if the whole run fails, all of it is refunded. The model is told: keep the picture, diegetic sound only, no music, no dialogue, no voices — `hinweis` adds a setting line for every shot.

  Paramètres, retour & exemple (3)

  Paramètres

  • seq_id · string · requis
    Sequence id (from lab_create_sequence/lab_list_sequences) — positive integer as string
  • hinweis · string · optionnel
    One line about the setting that applies to every shot, e.g. 'kitchen, wooden floor, rain on the window'. Helps the model pick the right room sound. Leave it out if the shots differ too much.
  • get_cost · boolean · optionnel
    Return the price in credits WITHOUT starting anything — per shot over the seconds actually sent, at the rate lab_list_models lists for the model. Do this first; long sequences add up.

  Exemple d'appel

  {"name": "lab_ton_durchlauf", "arguments": {"seq_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_transform≈ 774 tokens

  Relight and restyle an EXISTING clip while the performance stays untouched (Beeble Switch X): lighting, background and props change, the subject and its motion do not. The source is the clip of a generated-video row — or, with asset_id, an uploaded file that stands in for it. in_sec/out_sec cut the source server-side first, so a long take can be transformed in pieces. ASYNCHRONOUS: a new video row comes back as pending; poll it with lab_job_status. Costs credits when called without get_cost.

  Paramètres, retour & exemple (8)

  Paramètres

  • in_sec · number · optionnel
    Cut the source server-side before it reaches the provider: start of the excerpt, in seconds. Only together with out_sec. What is billed is the MEASURED length of the cut, not out_sec minus in_sec.
  • out_sec · number · optionnel
    End of the excerpt, in seconds. Must lie behind in_sec; both are set together or neither.
  • asset_id · string · optionnel
    R2 asset key of an uploaded video (the `key` from lab_list_assets, asset_type 'video') to transform INSTEAD of the row's own clip. The row from video_id still supplies project and scene; only the pixels come from the asset. The key must belong to that same project.
  • get_cost · boolean · optionnel
    `true` returns the published rate per unit and your balance WITHOUT transforming and without spending anything — NOT a total. Switch X charges by the MEASURED length of the source, which only the server knows before the run, and it is not priced from the lab_list_models catalog (that covers generation models). The real amount comes back with the actual call.
  • video_id · string · requis
    Generated-video id (from lab_animate/lab_job_status/lab_review_queue) — positive integer as string. ALWAYS required, also together with asset_id: this row anchors the run (project, scene, billing) and the backend answers 404 without it.
  • alpha_mode · string · optionnel · auto | fill | custom | select
    How the subject is cut out from its background. Omit to let the backend decide ('auto'); the other modes fill, take a supplied matte, or work on a selection.
  • resolution · string · optionnel · 720p | 1080p
    Output tier of the transform. This is Switch X's OWN tier list, not one of the video-model resolutions in lab_list_models — that catalog covers generation models and has no entry for this path. The tier drives the price; omit it for the backend default.
  • transformation_prompt · string · requis
    What the clip should look like afterwards — light, place, props. The subject and its performance are preserved by the model; describing them again does not help.

  Exemple d'appel

  {"name": "lab_transform", "arguments": {"video_id": "texte", "transformation_prompt": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_umzug≈ 703 tokens

  Bring Midjourney exports into a project (FilmLab calls this 'Umzug'). Midjourney has no API, so the person downloads their images or ZIP and this tool carries them on. Give EXACTLY ONE of: `dateien` (names/types/sizes of local files → signed PUT addresses with a ready curl line; PUT the raw bytes, then call again with `quellen` from `weiter`), `quellen` (after the PUT: starts the import job → job_id; poll lab_get_job — result.bildzeilen lists image_id and datei per image (the prompt per image comes with `bilder: true`), result.gesperrt names refused images with the reason, result.ungeprueft images whose check was unreachable), `prompts` (pasted Midjourney prompts, one per line → parameters split and what does not carry over, e.g. --sref codes; free, no job), `anker` ({name, image_ids ≤ 12} → a look anchor for lab_generate's anker_id; images of real people are refused) or `bilder: true` (the project's imported images with image_id and prompt). Every imported image is declared AI material (EU AI Act Art. 50) — no herkunft question. An image_id works directly in lab_animate (source_image_id), as a seed in lab_generate and in lab_referenz_aus_bild. Uploading is free.

  Paramètres, retour & exemple (6)

  Paramètres

  • anker · object · optionnel
    Build a look anchor from imported images
  • bilder · boolean · optionnel
    true: list the project's imported images
  • dateien · array · optionnel
    Local files to upload: ZIP archives or single PNG/JPG/WEBP
  • prompts · string · optionnel
    Pasted Midjourney prompts, one per line
  • quellen · array · optionnel
    After the PUT: exactly the `quellen` from the previous answer's weiter.argumente
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string

  Exemple d'appel

  {"name": "lab_umzug", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_upscale≈ 584 tokens

  Enlarge an EXISTING clip (Topaz, passed through fal): same shot, same length, same sound — more pixels. There is no prompt here; nothing is re-imagined, the frames are scaled. The source is the clip of a generated-video row. Both the length and the source height are measured server-side before anything is charged, and a source too tall for the larger factor is refused rather than run. ASYNCHRONOUS: a new video row comes back as pending; poll it with lab_job_status. Costs credits when called without get_cost.

  Paramètres, retour & exemple (4)

  Paramètres

  • faktor · string · optionnel · 2 | 4
    How many times larger, per side. Omit for the smaller one. Whichever you pick, the RESULT has to stay inside the published rate tiers — a source too tall for the factor you asked for is refused by name, with the ceiling in the message, instead of billing a run nobody can price. What the tier costs is in lab_list_models and in the preflight, not here.
  • get_cost · boolean · optionnel
    `true` returns what upscaling THIS clip costs (`cost_generations`, measured server-side from its length and the height of the RESULT, exactly what the run would charge) plus the published rate per output second per tier and your balance — WITHOUT scaling and without spending anything. For a clip that is still pending there is no total yet: then `cost_generations` is null and `preis_grund` says why. Which tiers are measured and which are catalog values is the same distinction lab_list_models makes.
  • video_id · string · requis
    Generated-video id (from lab_animate/lab_job_status/lab_review_queue) — positive integer as string. The row must already have its clip; a run still pending is refused, and nothing is charged for asking.
  • max_credits · integer · optionnel
    The most you agree to pay — pass the amount from get_cost that the person confirmed. If the measured price is higher when the run starts, it is refused before anything is charged.

  Exemple d'appel

  {"name": "lab_upscale", "arguments": {"video_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_verkettung≈ 1180 tokens

  Render several clips as CHAINS: within a scene one after another (continuity), across scenes in parallel (speed) — the plan follows scene_ref of each job in order. aktion: plan (free: shows the chains) · preis (free: same checks as a real start; returns preis_geschaetzt_credits, preis_hoechstens_credits (with every allowed retry) and `reicht` against balance, project cap and an active auto run, plus startbilder_offen when a chain's first start image is not approved yet — nothing is created) · starten (COSTS CREDITS, ONLY after the person confirmed the price from aktion=preis). Each clip is charged when it starts; an active lab_auto_lauf cap applies. The FIRST clip of every chain needs an approved start image (keyframe checkpoint, as in lab_animate) unless ohne_keyframe; later clips derive from the chain. Sending starten twice returns the running chain (wiederverwendet: true) instead of paying twice. Transition between clips of a chain (uebergang): schnitt (default) = hard cut to a NEW camera angle — the next clip does NOT start from the last frame; its prompt begins with the previous clip's end state (wardrobe, props, place, light), characters and location come from each job's own character_refs/location_id. A schnitt follow-up clip is TEXT-TO-VIDEO: without character_refs/location_id the person and place hang on one sentence of text — give them for real continuity. CONTINUITY CHECK: in a chain with more than one clip every clip is checked against its prompt BEFORE the next one starts (status pruefen, wartet_auf: abgleich while the check runs — that is not a hung job). On mismatch the clip is re-rendered at most neuversuche times (default 1, prompt led by the failed claims, charged like the clip); if it still deviates the chain STOPS before the next clip is paid (chain status abgebrochen, clip status abweichung, issues and verworfen at the clip). The last clip of a chain gets its retry too but the chain then ends fertig with the verdict at the clip. Single clips are only checked in the background. durchgehend = the last frame becomes the start image — only for one unbroken take. Follow a started chain with lab_get_job(job_id): result.zusammenfassung (laeuft/fertig/abgebrochen), result.ketten (status and grund per chain) and result.clips (keyed by clip index: video_id, status, fehler_klasse). Job status done only means nothing runs any more — check result.zusammenfassung.abgebrochen before reporting success. A failure stops only its own chain. Dispatch rule: continuous scene → one chain with schnitt; one unbroken motion → a single clip ≤ 15 s, else durchgehend; separate scenes, time jumps, costume changes or montage → separate scenes (parallel). Over ~3 minutes total: suggest narrowing the scope first.

  Paramètres, retour & exemple (7)

  Paramètres

  • jobs · array · requis
    One entry per clip, IN ORDER — the same fields as lab_animate (prompt, scene_ref, tool, duration_seconds, resolution, character_refs, location_id, source_image_id …). scene_ref decides the chains: consecutive clips with the same scene_ref chain, a clip without scene_ref stands alone.
  • modus · string · optionnel · hybrid | parallel | sequenziell
    hybrid (default): chain within scenes; parallel: every clip alone; sequenziell: one chain over everything
  • aktion · string · requis · plan | preis | starten
    plan and preis are free; starten costs credits
  • uebergang · string · optionnel · schnitt | durchgehend
    Transition at each cut inside a chain; default schnitt
  • project_id · string · requis
    Project id (from lab_list_projects)
  • neuversuche · integer · optionnel
    Retries per clip after a failed continuity check: 1 (default) or 0 (stop at the first deviation). Name preis_hoechstens_credits to the person before starten.
  • ohne_keyframe · boolean · optionnel
    Skip the keyframe checkpoint on purpose. By default a paid clip only starts from a start image the user has approved (lab_review_asset verdict: accepted) — look at the frame first, then spend on the clip. Set true only when the user explicitly asked to skip the frame check.

  Exemple d'appel

  {"name": "lab_verkettung", "arguments": {"jobs": [], "aktion": "plan", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_vfx≈ 817 tokens

  Run a VFX operation on an image already in the project gallery — the same pipeline the Resolve bridge uses. inpaint (clean plate: what is inside the box disappears, the surroundings close over it) · replace (same path, other intent: something new goes into the box) · relight (no box — the light changes across the whole frame; by default the scene stays exactly as it is, licht_weg 'iclight' instead repaints the background and may change the scenery) · mask (no box — you describe what should be cut out and get the matte back). inpaint/replace need `box` AND `prompt`; relight needs `light_preset` or `prompt` and REJECTS a box; mask needs `prompt` and REJECTS a box too. `box` is given in FRACTIONS of the image (0..1), not pixels — the worker builds the mask. inpaint/replace start at 5 credits per run on the reference area (larger areas cost more); relight costs 4 flat per image (licht_weg 'iclight': from 9, by area); mask costs 1, flat per request. Returns immediately with an operation_id; poll lab_vfx_status until status is done|failed. NOT offered here: composite, move, color_grade — the server knows them and has no consumer for them.

  Paramètres, retour & exemple (10)

  Paramètres

  • box_x · number · optionnel
    Box left edge as a fraction of image width (0..1)
  • box_y · number · optionnel
    Box top edge as a fraction of image height (0..1)
  • prompt · string · optionnel
    inpaint/replace: what should be seen there instead — required. mask: what should be cut out (e.g. 'the red toolbox') — required. relight: optional, replaces the preset
  • image_id · string · requis
    Id of the source image in the project gallery (from lab_list_assets / lab_generate)
  • box_hoehe · number · optionnel
    Box height as a fraction of image height
  • licht_weg · string · optionnel · kontext | iclight
    relight only. kontext (default): only the light changes, scene, people and framing stay. iclight: the background is repainted from the light description — the scenery may change
  • operation · string · requis · inpaint | replace | relight | mask
    inpaint: Die rote Werkzeugkiste wird durch eine Holzkiste auf der Werkbank ersetzt. | replace: Derselbe Weg, andere Absicht: in die Box kommt etwas Neues. | relight: Keine Box: die Lichtrichtung wandert über das ganze Bild. | mask: Keine Box: du beschreibst, was heraus soll, und bekommst die Maske.
  • box_breite · number · optionnel
    Box width as a fraction of image width
  • project_id · string · requis
    Project id (from lab_list_projects)
  • light_preset · string · optionnel · left | right | top | golden_hour | blue_night
    relight only. There is no 'bottom' — the server does not carry one

  Exemple d'appel

  {"name": "lab_vfx", "arguments": {"image_id": "texte", "operation": "inpaint", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_vfx_preset≈ 374 tokens

  Run a video VFX preset on a whole clip. Today only 'gesichter_verpixeln' (pixelate every face) is live. Costs credits per frame — call with dry_run=true first to see the price. With rerender_from (a finished job_id) it re-renders for free with other settings, e.g. exceptions: object ids that stay sharp. Tell the person: "Automatisch verpixelt, ohne Garantie — vor Veröffentlichung prüfen." Poll lab_vfx_preset_status until done|failed.

  Paramètres, retour & exemple (7)

  Paramètres

  • effekt · string · optionnel · mosaik | weich | schwarz
  • preset · string · optionnel · gesichter_verpixeln
  • dry_run · boolean · optionnel
    Only return the price
  • ausnahmen · array · optionnel
    Object ids to leave unpixelated (rerender only)
  • video_url · string · optionnel
    HTTPS URL of the clip (project asset)
  • project_id · string · requis
    Project id
  • rerender_from · string · optionnel
    job_id of a finished run to re-render for free

  Exemple d'appel

  {"name": "lab_vfx_preset", "arguments": {"project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_vfx_preset_status≈ 183 tokens

  Poll a video VFX preset job. status is queued|proxy|spur|render|done|failed; progress shows frames done. When done: result_url is the finished clip (give it to the person as karte_ansehen), kontakt_url is the review contact sheet, spur.objekte lists detected faces with ids usable as exceptions in lab_vfx_preset(rerender_from, ausnahmen).

  Paramètres, retour & exemple (1)

  Paramètres

  • job_id · string · requis
    job_id returned by lab_vfx_preset

  Exemple d'appel

  {"name": "lab_vfx_preset_status", "arguments": {"job_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_vfx_status≈ 150 tokens

  Poll a VFX operation started with lab_vfx. status is pending|processing|done|failed; when done, result_url carries the finished image. Call repeatedly until done|failed — an image run usually takes under 30 seconds.

  Paramètres, retour & exemple (1)

  Paramètres

  • operation_id · string · requis
    The operation_id returned by lab_vfx

  Exemple d'appel

  {"name": "lab_vfx_status", "arguments": {"operation_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_voice_clone≈ 806 tokens

  Clone a voice from real audio or video material into a project (fal.ai minimax voice-clone) — the source for lab_voice_tts and for lab_dub's voice_id+dub_text path. SYNCHRONOUS: the clone runs inside the request and can take a while to return; there is no job_id to poll. The source needs a clean speech track of workable length — too short or silent material is rejected before anything is spent. Voice cloning from real material is consent-sensitive: only clone voices you have the right to use, and the Fish Audio path requires you to say so explicitly.

  Paramètres, retour & exemple (7)

  Paramètres

  • name · string · requis
    A label for this cloned voice, shown in lab_list_voices — needed to tell several clones of one project apart later.
  • get_cost · boolean · optionnel
    `true` reports the price and your balance WITHOUT cloning anything and without spending quota. A clone is billed per clone (a MiniMax clone costs far more than a Fish clone — ask with get_cost) — the length of the source material does not change it, and the clone is then reusable for as many readings as you like. Not drawn from the lab_list_models catalog (that covers image and video models only); there is no model to pick here.
  • provider · string · optionnel · minimax | fish_audio
    Which voice house clones it. Omit to stay on the default path — an existing workflow does not change vendor just because another one exists. The choice sticks to the voice: whichever house made it is the one that later speaks with it, so lab_voice_tts has no say in this. What each house can do and what it charges is not stated here — lab_list_models carries that.
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string
  • einwilligung · boolean · optionnel
    Consent of the person whose voice is being uploaded. Required on the fish_audio path, which refuses without it before anything is charged. This is not the moderation gate: that one reads the label for abuse, this one asserts you are allowed to use this person's voice at all. Do not set it to be rid of the error — set it because the consent exists. Provider capabilities and prices: lab_list_models.
  • likeness_ref · string · optionnel
    Consent id from the Likeness Register (LK-XXXXX-XXXXX-XXXXX-XXXXX) for the person whose voice this is. When set, the register is checked live (active, purpose voice_synthesis, the project's target markets) and the clone is refused if the consent does not hold. Needed for a real person's voice in a project for children or young people.
  • sample_audio_url · string · requis
    URL of the source audio or video the voice is cloned from. Needs a real, sufficiently long speech track — material without one is rejected before anything is spent.

  Exemple d'appel

  {"name": "lab_voice_clone", "arguments": {"name": "texte", "project_id": "texte", "sample_audio_url": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_voice_tts≈ 496 tokens

  Speak text in a project's cloned voice (via lab_voice_clone) — SYNCHRONOUS, returns a ready audio_url, no job_id. The voice house is whichever one cloned this voice; you do not pick it here. Consent-sensitive like the clone itself: only speak text you have the right to put in that voice's mouth.

  Paramètres, retour & exemple (5)

  Paramètres

  • text · string · requis
    The line(s) to speak in this voice.
  • get_cost · boolean · optionnel
    Price this call instead of running it: returns the estimate and the balance, charges nothing, produces no audio. Worth doing before a long passage, because both houses bill by the size of the text, not per run — so the same tool can cost wildly different amounts depending on what you hand it. The rates behind the estimate are not repeated here; lab_list_models carries them.
  • provider · string · optionnel · minimax | fish_audio
    Cross-check, not a choice: the house that cloned this voice is the one that speaks with it, because a voice id from one house means nothing to the other. Pass it only to assert what you believe the voice is; a mismatch is refused before anything is charged. Omit it and the stored voice decides. Which house a voice belongs to: lab_list_voices. What each house can do: lab_list_models.
  • voice_id · string · requis
    A cloned voice's id (lab_cloned_voices.id, from lab_voice_clone or lab_list_voices) — positive integer as string, NOT the raw provider voice id.
  • project_id · string · requis
    Project id (from lab_list_projects) — positive integer as string

  Exemple d'appel

  {"name": "lab_voice_tts", "arguments": {"text": "texte", "voice_id": "texte", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

• lab_wellenform≈ 351 tokens

  Read the sound of a clip (video_id), an audio track (audio_id) or an uploaded file (project_id + asset_key from lab_add_media) as numbers: peak level 0..1 per channel, 16 values per second, up to 60 s per page. Use it to find where music or speech starts, where silence is (below `stille_unter`), and whether a cut lands on a beat or mid-word — before you move cut points. Continue with `weiter_von_s` for the next page. Read-only, free.

  Paramètres, retour & exemple (6)

  Paramètres

  • bis_s · number · optionnel
    End of the page; at most 60 s after von_s
  • von_s · number · optionnel
    Start of the page in seconds (default 0)
  • audio_id · string · optionnel
    Audio track id (from lab_list_audio). Give exactly one of video_id, audio_id, asset_key
  • video_id · string · optionnel
    Generated video id — its own soundtrack. Give this OR audio_id
  • asset_key · string · optionnel
    Storage key of an uploaded sound or video file (from lab_add_media). Needs project_id
  • project_id · string · optionnel
    Project the asset_key belongs to — required with asset_key

  Exemple d'appel

  {"name": "lab_wellenform", "arguments": {"bis_s": 1, "von_s": 1, "audio_id": "texte", "video_id": "texte", "asset_key": "texte", "project_id": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}]}

+ 7 autres outils (affichage limité à 120).

C'est votre serveur ?

Revendiquez-le sur l'espace créateur (preuve GitHub, domaine ou npm) pour afficher le badge « propriétaire vérifié » et lancer un pentest comportemental à la demande afin d'obtenir le badge « Vérifié ».

Créer un compte / revendiquer →

Source

https://mcp-lab.thefilmradar.com/mcp