The API supports multimodal inputs, including images, audio, and video, with a context window of up to 256,000 tokens. Developers can use the resulting confidence scores to determine when an application should proceed automatically or refer uncertain cases for further review.
Google said the API delivers end-to-end latency of 150 to 250 milliseconds in tests involving contexts of up to 16,000 tokens, with performance remaining relatively stable across one to 100 questions.
The company has priced the API at $0.10 per million input tokens, without additional output-token charges. “Your shared input is billed once per request no matter how many questions you evaluate (each question adds only its own instruction and criteria tokens),” Google said in its announcement.
