Configure Business Component User Properties for Multimodal AI

To configure Business Component User Properties: Use Case 1

1. Required Seed Data changes:

   1. Click on Sitemap.
   2. Navigate to Administration- Application > Views.
   3. Navigate to Generative AI Configuration List View and create a new record as per the following table:

      Prompt Name	Prompt Value
      ClosingSummaryPrompt	Given below is a transcript of a customer support interaction. The customer support interaction can contain an attached image or document as well. Please holistically summarize the entire text and the image data. The summary should highlight the main issue, the exact device or account details, and the actions undertaken to resolve it. Do mandatorily summarize the image or document if present. Ensure that the summary maintains the contextual history accurately and does not infer or create any conclusions about the customer's state of mind or satisfaction unless explicitly stated by the customer. Strictly avoid adding any information that is not clearly present in the interaction. Please look for the image or document attachment. The textual data is given below:
      TransferSummaryPrompt	Given below is a transcript of a customer support interaction. The customer support interaction can contain an attached image or document as well. Please holistically summarize the entire text and the image data. The summary should highlight the main issue, the remaining or pending concern, the exact device or account details, and the actions undertaken to resolve it. Do mandatorily summarize the image or document if present. Ensure that the summary maintains the contextual history accurately and does not infer or create any conclusions about the customer's state of mind or satisfaction unless explicitly stated by the customer. Strictly avoid adding any information that is not clearly present in the interaction. Please look for the image or document attachment.

2. Required Repository Changes:

   1. Create Business Component User Properties.

   2. Add following Business Component User Properties while using the LLAMA (meta.llama-3.2-90b-vision-instruct) LLM:

      BC User Property Name	BC User Property Value
      SummarizeChatText_Param_1	compartmentId:ocid1.tenancy.oc1..XXXXXXXXXX
      SummarizeChatText_Param_2	servingMode:ON_DEMAND
      SummarizeChatText_Param_3	lovInfo:BC_FIELD=Type;LOV_TYPE=TODO_TYPE;LOV_LIC=CLOSING SUMMARY,TRANSFER SUMMARY
      SummarizeChatText_Param_4	input:FIELD=Description
      SummarizeChatText_Param_5	inputFromOtherBC:BUSCOMP=Service Request,FIELD=Abstract;BUSCOMP=Order Entry - Orders,FIELD=Order Priority,Account
      SummarizeChatText_Param_6	output:FIELD=Description;MAX_FIELD_LENGTH=250
      SummarizeChatText_Param_7	prompt:CLOSING SUMMARY=ClosingSummaryPrompt;TRANSFER SUMMARY=TransferSummaryPrompt
      SummarizeChatText_Param_8	minimumInputCharLength:250
      SummarizeChatText_Param_9	runtimeType:LLAMA
      SummarizeChatText_Param_10	imageUrl:BUSCOMP=Service Request Attachment,FIELD=ActivityFileName,SORT_SPEC=ActivityFileDate(DESC)

      Note: SummarizeChatText_Param (1-8) are available out of the box. Whereas, SummarizeChatText_Param (9-10) requires configuration.
3. Modify ociconfig.properties file, make the following entry in the [GENAI] section:

   multimodal_image_type = png,jpg,jpeg
   multimodal_max_image_size = 5242880
   multimodal_image_for_summarize = true

To configure Business Component User Properties: Use Case 2

1. Required Seed Data changes:

   1. Click on Sitemap.
   2. Navigate to Administration- Application > Views.
   3. Navigate to Generative AI Configuration List View and create a new record as per the following table:

      Prompt Name

      Prompt Value

      ExtractImagePrompt

      Analyze the provided image and extract the address details. Extract the mentioned Address, City, State, Zip Code and the Country from the image. Do not extract any information which is not present in the image. The response should contain only the address, city, state, zip code and the country details. Display the attribute name, followed by a colon and its value and then leave a line space after each attribute. Do not include any other text in the response.

2. Required Repository Changes:

   1. Create Business Component User Properties for Service Request Attachment.

      BC User Property Name	BC User Property Value
      ExtractImageChat_Param_1	compartmentId:ocid1.tenancy.oc1..XXXXXXXXXX
      ExtractImageChat_Param_2	servingMode:ON_DEMAND
      ExtractImageChat_Param_3	prompt:ExtractImagePrompt
      ExtractImageChat_Param_4	imageUrl:BUSCOMP=Service Request Attachment,FIELD=ActivityFileName
      ExtractImageChat_Param_5	runtimeType:LLAMA
      ExtractImageChat_Param_6	outputToOtherBC:BUSCOMP=GenAI Image Extract Response BC,FIELD=Address Maint - New Addr Line 1:Address,Address Maint - New City:City,Address Maint - New Country:Country,Address Maint - New State:State,Address Maint - New Zip Code:Zip Code;
      Named Method 1	"Extract", "INVOKESVC", "Service Request Attachment", "SiebelOCIAIService", "InvokeOCIAI", "'Context'", "'GenAI:ExtractImageChat'"

3. Modify ociconfig.properties file, make the following entry in the [GENAI] section:

   multimodal_image_type = png,jpg,jpeg
   multimodal_max_image_size = 5242880
   multimodal_image_for_summarize = true