microsoft--promptflow/docs/reference/tools-reference/aoai-gpt4-turbo-vision.md

Azure OpenAI GPT-4 Turbo with Vision

Introduction

Azure OpenAI GPT-4 Turbo with Vision tool enables you to leverage your AzureOpenAI GPT-4 Turbo with Vision model deployment to analyze images and provide textual responses to questions about them.

Prerequisites

• Create AzureOpenAI resources

  Create Azure OpenAI resources with instruction

• Create a GPT-4 Turbo with Vision deployment

  Browse to Azure OpenAI Studio and sign in with the credentials associated with your Azure OpenAI resource. During or after the sign-in workflow, select the appropriate directory, Azure subscription, and Azure OpenAI resource.

  Under Management select Deployments and Create a GPT-4 Turbo with Vision deployment by selecting model name: gpt-4 and model version vision-preview.

Connection

Setup connections to provisioned resources in prompt flow.

Type	Name	API KEY	API Type	API Version
AzureOpenAI	Required	Required	Required	Required

Inputs

Name	Type	Description	Required
connection	AzureOpenAI	the AzureOpenAI connection to be used in the tool	Yes
deployment_name	string	the language model to use	Yes
prompt	string	The text prompt that the language model will use to generate it's response.	Yes
max_tokens	integer	the maximum number of tokens to generate in the response. Default is 512.	No
temperature	float	the randomness of the generated text. Default is 1.	No
stop	list	the stopping sequence for the generated text. Default is null.	No
top_p	float	the probability of using the top choice from the generated tokens. Default is 1.	No
presence_penalty	float	value that controls the model's behavior with regards to repeating phrases. Default is 0.	No
frequency_penalty	float	value that controls the model's behavior with regards to generating rare phrases. Default is 0.	No
detail	string	configure how the model interprets and processes images, default is "auto". Read more	No

Outputs

Return Type	Description
string	The text of one response of conversation