Stream Analyzer

Action Reference

If you want to analyze your live camera feed from one or multiple cameras you can call llmvision.stream_analyzer.

Action Reference

service: llmvision.stream_analyzer
data:
  provider: 01J99F4T99PA1XGQ4CTQS3CP8H  # Select in UI dropdown
  model: gpt-4o-mini
  message: What is happening around the house?
  max_tokens: 1000
  image_entity: |-
    camera.front_door
    camera.garage
  duration: 10 # Record for 10 seconds
  max_frames: 5 # Analyze the 5 most relevant frames
  target_width: 1280
  include_filename: true # Include camera name in request

The provider id will not be the same for you. Switch to UI mode and select one of your configurations. If you don't see any, you need to set up at least one provider!

For all available models see: Choosing the right model

Parameter Reference

Parameter	Required	Description	Default
provider	Yes	The AI provider configuration
model	No	Model used for processing the image(s).
message	Yes	The prompt to send along with the image(s).
remember	No	Remember the analyzed event	false
use_memory	No	Use information stored in memory to provide additional context. Memory must be set up.	false
image_entity	Yes	Camera entity to stream
duration	Yes	For how many seconds to capture and analyze stream.	5
max_frames	No	How many frames to analyze. Will pick the most relevant frames (most motion)	3
include_filename	Yes	Include camera name in request	false
target_width	No	Width to downscale the image to before encoding.	1280
max_tokens	Yes	The maximum number of response tokens to generate.	1000
generate_title	No	Generate a title and return it in the response. (Used for notifications and remembered events)	false
expose_images	No	Save key frame to /config/media/llmvision/snapshots. File path is included in response as key_frame. If used together with remember images will be deleted after retention_time set in Timeline. Otherwise this folder will use a lot of disk space!	false