chore: import upstream snapshot with attribution
Continuous Integration / Pre-commit Linter (push) Has been cancelled
Continuous Integration / Mypy Check (Python 3.10) (push) Has been cancelled
Continuous Integration / Mypy Check (Python 3.11) (push) Has been cancelled
Continuous Integration / Mypy Check (Python 3.12) (push) Has been cancelled
Continuous Integration / Mypy Check (Python 3.13) (push) Has been cancelled
Continuous Integration / Unit Tests (Python 3.10) (push) Has been cancelled
Continuous Integration / Unit Tests (Python 3.11) (push) Has been cancelled
Continuous Integration / Unit Tests (Python 3.12) (push) Has been cancelled
Continuous Integration / Unit Tests (Python 3.13) (push) Has been cancelled
Continuous Integration / Unit Tests (Python 3.14) (push) Has been cancelled
Continuous Integration / A2A v0.3 Tests (Python 3.10) (push) Has been cancelled
Continuous Integration / A2A v0.3 Tests (Python 3.11) (push) Has been cancelled
Continuous Integration / A2A v0.3 Tests (Python 3.12) (push) Has been cancelled
Copybara PR Handler / close-imported-pr (push) Has been cancelled
Continuous Integration / A2A v0.3 Tests (Python 3.13) (push) Has been cancelled
Continuous Integration / A2A v0.3 Tests (Python 3.14) (push) Has been cancelled
Continuous Integration / Pre-commit Linter (push) Has been cancelled
Continuous Integration / Mypy Check (Python 3.10) (push) Has been cancelled
Continuous Integration / Mypy Check (Python 3.11) (push) Has been cancelled
Continuous Integration / Mypy Check (Python 3.12) (push) Has been cancelled
Continuous Integration / Mypy Check (Python 3.13) (push) Has been cancelled
Continuous Integration / Unit Tests (Python 3.10) (push) Has been cancelled
Continuous Integration / Unit Tests (Python 3.11) (push) Has been cancelled
Continuous Integration / Unit Tests (Python 3.12) (push) Has been cancelled
Continuous Integration / Unit Tests (Python 3.13) (push) Has been cancelled
Continuous Integration / Unit Tests (Python 3.14) (push) Has been cancelled
Continuous Integration / A2A v0.3 Tests (Python 3.10) (push) Has been cancelled
Continuous Integration / A2A v0.3 Tests (Python 3.11) (push) Has been cancelled
Continuous Integration / A2A v0.3 Tests (Python 3.12) (push) Has been cancelled
Copybara PR Handler / close-imported-pr (push) Has been cancelled
Continuous Integration / A2A v0.3 Tests (Python 3.13) (push) Has been cancelled
Continuous Integration / A2A v0.3 Tests (Python 3.14) (push) Has been cancelled
This commit is contained in:
@@ -0,0 +1,15 @@
|
||||
# Copyright 2026 Google LLC
|
||||
#
|
||||
# Licensed under the Apache License, Version 2.0 (the "License");
|
||||
# you may not use this file except in compliance with the License.
|
||||
# You may obtain a copy of the License at
|
||||
#
|
||||
# http://www.apache.org/licenses/LICENSE-2.0
|
||||
#
|
||||
# Unless required by applicable law or agreed to in writing, software
|
||||
# distributed under the License is distributed on an "AS IS" BASIS,
|
||||
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
||||
# See the License for the specific language governing permissions and
|
||||
# limitations under the License.
|
||||
|
||||
from . import agent
|
||||
@@ -0,0 +1,145 @@
|
||||
# Copyright 2026 Google LLC
|
||||
#
|
||||
# Licensed under the Apache License, Version 2.0 (the "License");
|
||||
# you may not use this file except in compliance with the License.
|
||||
# You may obtain a copy of the License at
|
||||
#
|
||||
# http://www.apache.org/licenses/LICENSE-2.0
|
||||
#
|
||||
# Unless required by applicable law or agreed to in writing, software
|
||||
# distributed under the License is distributed on an "AS IS" BASIS,
|
||||
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
||||
# See the License for the specific language governing permissions and
|
||||
# limitations under the License.
|
||||
|
||||
import asyncio
|
||||
from typing import AsyncGenerator
|
||||
|
||||
from google.adk.agents import LiveRequestQueue
|
||||
from google.adk.agents.llm_agent import Agent
|
||||
from google.adk.tools.function_tool import FunctionTool
|
||||
from google.genai import types as genai_types
|
||||
|
||||
|
||||
async def monitor_stock_price(stock_symbol: str) -> AsyncGenerator[str, None]:
|
||||
"""This function will monitor the price for the given stock_symbol in a continuous, streaming and asynchronously way."""
|
||||
print(f"Start monitor stock price for {stock_symbol}!")
|
||||
|
||||
# Let's mock stock price change.
|
||||
await asyncio.sleep(4)
|
||||
price_alert1 = f"the price for {stock_symbol} is 300"
|
||||
yield price_alert1
|
||||
print(price_alert1)
|
||||
|
||||
await asyncio.sleep(4)
|
||||
price_alert1 = f"the price for {stock_symbol} is 400"
|
||||
yield price_alert1
|
||||
print(price_alert1)
|
||||
|
||||
await asyncio.sleep(20)
|
||||
price_alert1 = f"the price for {stock_symbol} is 900"
|
||||
yield price_alert1
|
||||
print(price_alert1)
|
||||
|
||||
await asyncio.sleep(20)
|
||||
price_alert1 = f"the price for {stock_symbol} is 500"
|
||||
yield price_alert1
|
||||
print(price_alert1)
|
||||
|
||||
|
||||
# for video streaming, `input_stream: LiveRequestQueue` is required and reserved key parameter for ADK to pass the video streams in.
|
||||
async def monitor_video_stream(
|
||||
input_stream: LiveRequestQueue,
|
||||
) -> AsyncGenerator[str, None]:
|
||||
"""Monitor how many people are in the video streams."""
|
||||
from google.genai import Client
|
||||
|
||||
print("start monitor_video_stream!")
|
||||
from google.genai import Client
|
||||
|
||||
client = Client(enterprise=False)
|
||||
prompt_text = (
|
||||
"Count the number of people in this image. Just respond with a numeric"
|
||||
" number."
|
||||
)
|
||||
last_count = None
|
||||
while True:
|
||||
last_valid_req = None
|
||||
print("Start monitoring loop")
|
||||
|
||||
# use this loop to pull the latest images and discard the old ones
|
||||
while input_stream._queue.qsize() != 0:
|
||||
live_req = await input_stream.get()
|
||||
|
||||
if live_req.blob is not None and live_req.blob.mime_type == "image/jpeg":
|
||||
last_valid_req = live_req
|
||||
|
||||
# If we found a valid image, process it
|
||||
if last_valid_req is not None:
|
||||
print("Processing the most recent frame from the queue")
|
||||
|
||||
# Create an image part using the blob's data and mime type
|
||||
image_part = genai_types.Part.from_bytes(
|
||||
data=last_valid_req.blob.data, mime_type=last_valid_req.blob.mime_type
|
||||
)
|
||||
|
||||
contents = genai_types.Content(
|
||||
role="user",
|
||||
parts=[image_part, genai_types.Part.from_text(text=prompt_text)],
|
||||
)
|
||||
|
||||
# Call the model to generate content based on the provided image and prompt
|
||||
response = client.models.generate_content(
|
||||
contents=contents,
|
||||
config=genai_types.GenerateContentConfig(
|
||||
system_instruction=(
|
||||
"You are a helpful video analysis assistant. You can count"
|
||||
" the number of people in this image or video. Just respond"
|
||||
" with a numeric number."
|
||||
)
|
||||
),
|
||||
)
|
||||
if not last_count:
|
||||
last_count = response.candidates[0].content.parts[0].text
|
||||
elif last_count != response.candidates[0].content.parts[0].text:
|
||||
last_count = response.candidates[0].content.parts[0].text
|
||||
yield response
|
||||
print("response:", response)
|
||||
|
||||
# Wait before checking for new images
|
||||
await asyncio.sleep(0.5)
|
||||
|
||||
|
||||
# Use this exact function to help ADK stop your streaming tools when requested.
|
||||
# for example, if we want to stop `monitor_stock_price`, then the agent will
|
||||
# invoke this function with stop_streaming(function_name=monitor_stock_price).
|
||||
def stop_streaming(function_name: str):
|
||||
"""Stop the streaming
|
||||
|
||||
Args:
|
||||
function_name: The name of the streaming function to stop.
|
||||
"""
|
||||
pass
|
||||
|
||||
|
||||
root_agent = Agent(
|
||||
# Find supported models in Vertex here: https://docs.cloud.google.com/vertex-ai/generative-ai/docs/live-api
|
||||
model="gemini-live-2.5-flash-native-audio", # Vertex
|
||||
# Find supported models in Gemini API here: https://ai.google.dev/gemini-api/docs/models
|
||||
# model='gemini-2.5-flash-native-audio-preview-12-2025', # Gemini API
|
||||
name="video_streaming_agent",
|
||||
instruction="""
|
||||
You are a monitoring agent. You can do video monitoring and stock price monitoring
|
||||
using the provided tools/functions.
|
||||
When users want to monitor a video stream,
|
||||
You can use monitor_video_stream function to do that. When monitor_video_stream
|
||||
returns the alert, you should tell the users.
|
||||
When users want to monitor a stock price, you can use monitor_stock_price.
|
||||
Don't ask too many questions. Don't be too talkative.
|
||||
""",
|
||||
tools=[
|
||||
monitor_video_stream,
|
||||
monitor_stock_price,
|
||||
FunctionTool(stop_streaming),
|
||||
],
|
||||
)
|
||||
@@ -0,0 +1,19 @@
|
||||
This is only supported in streaming(live) agents/api.
|
||||
|
||||
Streaming tools allows tools(functions) to stream intermediate results back to agents and agents can respond to those intermediate results.
|
||||
For example, we can use streaming tools to monitor the changes of the stock price and have the agent react to it. Another example is we can have the agent monitor the video stream, and when there is changes in video stream, the agent can report the changes.
|
||||
|
||||
To define a streaming tool, you must adhere to the following:
|
||||
|
||||
1. **Asynchronous Function:** The tool must be an `async` Python function.
|
||||
1. **AsyncGenerator Return Type:** The function must be typed to return an `AsyncGenerator`. The first type parameter to `AsyncGenerator` is the type of the data you `yield` (e.g., `str` for text messages, or a custom object for structured data). The second type parameter is typically `None` if the generator doesn't receive values via `send()`.
|
||||
|
||||
We support two types of streaming tools:
|
||||
|
||||
- Simple type. This is a one type of streaming tools that only take non video/audio streams(the streams that you feed to adk web or adk runner) as input.
|
||||
- Video streaming tools. This only works in video streaming and the video stream(the streams that you feed to adk web or adk runner) will be passed into this function.
|
||||
|
||||
Here are some sample queries to test:
|
||||
|
||||
- Help me monitor the stock price for $XYZ stock.
|
||||
- Help me monitor how many people are there in the video stream.
|
||||
Reference in New Issue
Block a user