Lightning AI

1 graded endpoint serving gemma-4-31b · back to the matrix

Findings affecting Lightning AI

• yellow harness Tool results replayed out of order are mis-paired on most providers
  The chat dialect's contract is that a tool message is matched to its call by tool_call_id, in any order. After two parallel calls, replaying the results reversed swaps the data between them on these providers — the...
• yellow harness Lightning leaks template reasoning markers into content on truncation
  At tight max_tokens, literal template markers appear in content; unconstrained budgets come back clean. Output is polluted exactly when the response is cut short.