{ "cells": [ { "cell_type": "markdown", "metadata": { "id": "yuurmT9VeEbZ" }, "source": [ "### **If you are using Colab for free, we highly recommend you active the T4 GPU hardware accelerator. Our models are designed to run with at least 16GB of RAM, activating T4 will grant the notebook 16GB of GDDR6 RAM as opposed to the 13GB Colab gives automatically.**\n", "### **To active T4:**\n", "### **1. click on the \"Runtime\" tab**\n", "### **2. click on \"Change runtime type\"**\n", "### **3. select T4 GPU under Hardware Accelerator**\n", "### **NOTE: there is a weekly usage limit on using T4 for free**" ] }, { "cell_type": "markdown", "metadata": { "id": "p-3xdQQReK1R" }, "source": [ "# **Fast Start Example 8 - Agents** #\n", "This example shows how to build locally-running Agents deploying multiple small specialized function-calling models as tools with an integrated work management, process and journaling capability using the LLMfx class.\n", "\n", "This example shows a workflow receiving a customer transcript, and having an agent run through a series of analytical and classification steps.\n", "\n", " 1. Create an agent using the LLMfx class.\n", " 2. Load multiple specialized tools for the agent.\n", " 3. Execute a series of function-calls.\n", " 4. Generate a consolidated automatic dictionary report.\n" ] }, { "cell_type": "markdown", "metadata": { "id": "ZZeZz22aaxI0" }, "source": [ "# Create agent and load tools" ] }, { "cell_type": "code", "execution_count": 1, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "a4nBJr5SdVi6", "outputId": "2612cc14-1e33-4964-ac7f-89bce5fdfc83" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Collecting llmware\n", " Downloading llmware-0.3.3-py3-none-any.whl (56.0 MB)\n", "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m56.0/56.0 MB\u001b[0m \u001b[31m12.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", "\u001b[?25hCollecting boto3>=1.24.53 (from llmware)\n", " Downloading boto3-1.34.146-py3-none-any.whl (139 kB)\n", "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m139.2/139.2 kB\u001b[0m \u001b[31m1.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", "\u001b[?25hRequirement already satisfied: huggingface-hub>=0.19.4 in /usr/local/lib/python3.10/dist-packages (from llmware) (0.23.5)\n", "Requirement already satisfied: numpy>=1.23.2 in /usr/local/lib/python3.10/dist-packages (from llmware) (1.25.2)\n", "Collecting pymongo>=4.7.0 (from llmware)\n", " Downloading pymongo-4.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB)\n", "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m1.2/1.2 MB\u001b[0m \u001b[31m26.4 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", "\u001b[?25hRequirement already satisfied: tokenizers>=0.15.0 in /usr/local/lib/python3.10/dist-packages (from llmware) (0.19.1)\n", "Collecting psycopg-binary==3.1.17 (from llmware)\n", " Downloading psycopg_binary-3.1.17-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB)\n", "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m3.3/3.3 MB\u001b[0m \u001b[31m48.4 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", "\u001b[?25hCollecting psycopg==3.1.17 (from llmware)\n", " Downloading psycopg-3.1.17-py3-none-any.whl (178 kB)\n", "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m178.0/178.0 kB\u001b[0m \u001b[31m23.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", "\u001b[?25hCollecting pgvector==0.2.4 (from llmware)\n", " Downloading pgvector-0.2.4-py2.py3-none-any.whl (9.6 kB)\n", "Collecting colorama==0.4.6 (from llmware)\n", " Downloading colorama-0.4.6-py2.py3-none-any.whl (25 kB)\n", "Requirement already satisfied: librosa>=0.10.0 in /usr/local/lib/python3.10/dist-packages (from llmware) (0.10.2.post1)\n", "Requirement already satisfied: typing-extensions>=4.1 in /usr/local/lib/python3.10/dist-packages (from psycopg==3.1.17->llmware) (4.12.2)\n", "Collecting botocore<1.35.0,>=1.34.146 (from boto3>=1.24.53->llmware)\n", " Downloading botocore-1.34.146-py3-none-any.whl (12.4 MB)\n", "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m12.4/12.4 MB\u001b[0m \u001b[31m39.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", "\u001b[?25hCollecting jmespath<2.0.0,>=0.7.1 (from boto3>=1.24.53->llmware)\n", " Downloading jmespath-1.0.1-py3-none-any.whl (20 kB)\n", "Collecting s3transfer<0.11.0,>=0.10.0 (from boto3>=1.24.53->llmware)\n", " Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB)\n", "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m82.7/82.7 kB\u001b[0m \u001b[31m9.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", "\u001b[?25hRequirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from huggingface-hub>=0.19.4->llmware) (3.15.4)\n", "Requirement already satisfied: fsspec>=2023.5.0 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub>=0.19.4->llmware) (2023.6.0)\n", "Requirement already satisfied: packaging>=20.9 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub>=0.19.4->llmware) (24.1)\n", "Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub>=0.19.4->llmware) (6.0.1)\n", "Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from huggingface-hub>=0.19.4->llmware) (2.31.0)\n", "Requirement already satisfied: tqdm>=4.42.1 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub>=0.19.4->llmware) (4.66.4)\n", "Requirement already satisfied: audioread>=2.1.9 in /usr/local/lib/python3.10/dist-packages (from librosa>=0.10.0->llmware) (3.0.1)\n", "Requirement already satisfied: scipy>=1.2.0 in /usr/local/lib/python3.10/dist-packages (from librosa>=0.10.0->llmware) (1.11.4)\n", "Requirement already satisfied: scikit-learn>=0.20.0 in /usr/local/lib/python3.10/dist-packages (from librosa>=0.10.0->llmware) (1.2.2)\n", "Requirement already satisfied: joblib>=0.14 in /usr/local/lib/python3.10/dist-packages (from librosa>=0.10.0->llmware) (1.4.2)\n", "Requirement already satisfied: decorator>=4.3.0 in /usr/local/lib/python3.10/dist-packages (from librosa>=0.10.0->llmware) (4.4.2)\n", "Requirement already satisfied: numba>=0.51.0 in /usr/local/lib/python3.10/dist-packages (from librosa>=0.10.0->llmware) (0.58.1)\n", "Requirement already satisfied: soundfile>=0.12.1 in /usr/local/lib/python3.10/dist-packages (from librosa>=0.10.0->llmware) (0.12.1)\n", "Requirement already satisfied: pooch>=1.1 in /usr/local/lib/python3.10/dist-packages (from librosa>=0.10.0->llmware) (1.8.2)\n", "Requirement already satisfied: soxr>=0.3.2 in /usr/local/lib/python3.10/dist-packages (from librosa>=0.10.0->llmware) (0.3.7)\n", "Requirement already satisfied: lazy-loader>=0.1 in /usr/local/lib/python3.10/dist-packages (from librosa>=0.10.0->llmware) (0.4)\n", "Requirement already satisfied: msgpack>=1.0 in /usr/local/lib/python3.10/dist-packages (from librosa>=0.10.0->llmware) (1.0.8)\n", "Collecting dnspython<3.0.0,>=1.16.0 (from pymongo>=4.7.0->llmware)\n", " Downloading dnspython-2.6.1-py3-none-any.whl (307 kB)\n", "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m307.7/307.7 kB\u001b[0m \u001b[31m29.7 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", "\u001b[?25hRequirement already satisfied: python-dateutil<3.0.0,>=2.1 in /usr/local/lib/python3.10/dist-packages (from botocore<1.35.0,>=1.34.146->boto3>=1.24.53->llmware) (2.8.2)\n", "Requirement already satisfied: urllib3!=2.2.0,<3,>=1.25.4 in /usr/local/lib/python3.10/dist-packages (from botocore<1.35.0,>=1.34.146->boto3>=1.24.53->llmware) (2.0.7)\n", "Requirement already satisfied: llvmlite<0.42,>=0.41.0dev0 in /usr/local/lib/python3.10/dist-packages (from numba>=0.51.0->librosa>=0.10.0->llmware) (0.41.1)\n", "Requirement already satisfied: platformdirs>=2.5.0 in /usr/local/lib/python3.10/dist-packages (from pooch>=1.1->librosa>=0.10.0->llmware) (4.2.2)\n", "Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests->huggingface-hub>=0.19.4->llmware) (3.3.2)\n", "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests->huggingface-hub>=0.19.4->llmware) (3.7)\n", "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests->huggingface-hub>=0.19.4->llmware) (2024.7.4)\n", "Requirement already satisfied: threadpoolctl>=2.0.0 in /usr/local/lib/python3.10/dist-packages (from scikit-learn>=0.20.0->librosa>=0.10.0->llmware) (3.5.0)\n", "Requirement already satisfied: cffi>=1.0 in /usr/local/lib/python3.10/dist-packages (from soundfile>=0.12.1->librosa>=0.10.0->llmware) (1.16.0)\n", "Requirement already satisfied: pycparser in /usr/local/lib/python3.10/dist-packages (from cffi>=1.0->soundfile>=0.12.1->librosa>=0.10.0->llmware) (2.22)\n", "Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.10/dist-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.146->boto3>=1.24.53->llmware) (1.16.0)\n", "Installing collected packages: psycopg-binary, psycopg, pgvector, jmespath, dnspython, colorama, pymongo, botocore, s3transfer, boto3, llmware\n", "Successfully installed boto3-1.34.146 botocore-1.34.146 colorama-0.4.6 dnspython-2.6.1 jmespath-1.0.1 llmware-0.3.3 pgvector-0.2.4 psycopg-3.1.17 psycopg-binary-3.1.17 pymongo-4.8.0 s3transfer-0.10.2\n" ] } ], "source": [ "!pip install llmware" ] }, { "cell_type": "code", "execution_count": 2, "metadata": { "id": "mYZw-HAr3HjW" }, "outputs": [], "source": [ "from llmware.agents import LLMfx" ] }, { "cell_type": "code", "execution_count": 3, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "4CqHWBz83I_x", "outputId": "d71f2b76-3421-4227-ef45-59560a9d894c" }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "INFO:llmware.agents:Agent - Setting up LLMWare Workspace.\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "update: Launching LLMfx process\n", "step - \t1 - \tcreating object - ready to start processing.\n", "step - \t2 - \tloading new processing text - 1 new entries\n" ] }, { "data": { "text/plain": [ "[{'text': 'My name is Michael Jones, and I am a long-time customer. The Mixco product is not working currently, and it is having a negative impact on my business, as we can not deliver our products while it is down. This is the fourth time that I have called. My account number is 93203, and my user name is mjones. Our company is based in Tampa, Florida.',\n", " 'file_source': 'NA',\n", " 'page_num': 'NA'}]" ] }, "execution_count": 3, "metadata": {}, "output_type": "execute_result" } ], "source": [ "agent = LLMfx()\n", "\n", "customer_transcript = \"My name is Michael Jones, and I am a long-time customer. \" \\\n", " \"The Mixco product is not working currently, and it is having a negative impact \" \\\n", " \"on my business, as we can not deliver our products while it is down. \" \\\n", " \"This is the fourth time that I have called. My account number is 93203, and \" \\\n", " \"my user name is mjones. Our company is based in Tampa, Florida.\"\n", "\n", "agent.load_work(customer_transcript)" ] }, { "cell_type": "markdown", "metadata": { "id": "QuPgiTmKD8Hm" }, "source": [ "Load individual SLIM tool or multiple tools list" ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 1000, "referenced_widgets": [ "c50e606ff8ea41bfb369f6ccf368d238", "dc19d0fc37b44551b09347ad98bcd854", "ce2dd158480e4e3e9228298e1e344183", "a35431bd675a45e8ab6600f8b30241eb", "30b37ee7444147c296aab9f6bebd38c2", "50a28bb5c8bb4b4bb23648d4ce2efd1e", "599f350babe24f0e855b6641b02ce382", "01383b4d8b0e497889209bca3cdf4003", "c02ef09824b34a40a83a02964437c4e1", "083747ed0b384578907784bdc484ebec", "bed52dd2e4b44da3a46ae1fa0aef8b4a", "649f1a0e43e040249cfaaece29a921eb", "43788bb08f5142539ab8f41027eaf542", "9eb0944256a84d988d5165aa36766492", "c608cc815d46489b9b76b99241a27187", "77cc7502d21740b4aa92102284b109e5", "2f6e2ee4a0e7462ea511a684d456b715", "20f4709ff0d540abb087cb014d7b39e6", "af7cc17cdce0495c86c4ef469dce280d", "1c507f2394d8401f9ff96a7e0f4b04bf", "ce87e78b4bad496998f17d3810ab4803", "80abe9b8eb6b40e4ab51ddb158666e38", "8903cd5eab8848ccacb4f2483af6fe09", "109f72250d48480d9716035056c3c5b6", "a3f49a5b7077483d8ab6b3df787a8f69", "efaf53eee00e464d8b7516347c487b6c", "6bf4800a104f496580551d7780663d91", "0ebc0da55c864ddf95063d6a7d7b6c86", "28ff17a9582e4c7ea3041d4541d72722", "09c1201403e4414290828f192b11da1b", "367057b5187e45f48c6f00d04bb43924", "e8b65730fd5e40a89bacefd21dae5c59", "76198af1695046078f0f9d5d6499a521", "db49ca4e13f146c9a4e13e3fb7a12de0", "5975818abffd49c1bfbb6b6d5045f8a1", "0fd5e50810a94130a6c73f8d2eb04da4", "6e292e9a36ac4d2f8ee1a4e8c8aa6a55", "f133541bdafb409b8640173e35e92b9c", "6e69b8cebff345538a2c962c1b26b544", "d6e3a7c11e22444197dddf924f8755c0", "a1504d98f5d7417593213f4ae38bbf82", "e30c239447a045e5b465c74b84e36c81", "359ef70913224e53897ade5c8190fbc3", "1cf37abf4371432799adbca77e14113f", "2c2dc9b09f204508a6f0f6f2e2b74997", "b47da6f3bd63408f866fc31b136fa108", "655e60d0a1aa4c0991e2ad32429ed723", "ee725a2e933244c29e4482214a6d878c", "86d4560216d2498691872d4cc31b0a54", "1633223262a543099a7c123486c10cae", "c597d598ae1b4dc682ca706bff7b003f", "9f02204392e445a9996415243a5df73e", "1a7fe6874ca14a3eb8c1edde86e9ab2a", "e8e094d25f14436a8bb34094c98be4c9", "864b12898ab843318fe4fc17d135a57c", "e36ee9b5bd324c01a69aec529d8d93a7", "b5c29069f20349c49f24c15b904112a8", "c108d6a2f8a9432181f9e0fb97101d79", "337d812587574da6bc27cb2b93f8d77c", "5d7842d6a44547198cd517541ac70081", "d78a01c19bdd452ea4f7776cefaa528d", "03af8419720d47f0b2f0bf8dfe210694", "5403d9016ad24b4f984950b6dab7293c", "88c0e26f6782457596acf7dad841da82", "89bce38dec4b46e3ba0fc5b83b4dd2c8", "8606065d14a641e6a4436d6b47e37e1d", "9038edccd14948b4b38c07d92c963053", "4597036facca4fdb92c749c5e8f4c388", "0941e5f976aa4e2b8a1c61982e899f1e", "73e4aaf3f5404d1e8e55d3efcd91f546", "136f274c30844df9a35dc0f0949ce5d8", "63768f1fd5344d6e8807db52f321e9e1", "2f8aab95ad134805bbaaa89d008f8a8f", "f3fcf2e21c0c4343a549f9b8830d75b9", "85e32aa9ee7e448b9530194dbf8e2a9a", "88c98e0ca9654e85ac5d9ee7a14e0616", "bf6f6246d6ea4612b8a4d3999c5e7e27", "cb3b917992324c0dadbeb84f5355327a", "b18959ab077748c3a31f5bf891855861", "6ed368d8f4504f0f8eab2c03f5d39bf6", "1ae20d77c85b443fb38ac4c65052e789", "c8062d1b311d49b6b4c1356b7947f666", "88d4399c661d4e959df822cad1c40c0d", "da7437930c694188a39e87ed9485f5f2", "c6b1aded975149df8b2ecb9179d40e01", "84c9cfc683b448dba8f2938dbc26cc92", "2c307284c72c4ed1b80b35f868de531e", "8126cc9154df405a8ffb0ccc39c55a6e", "289163c444ca410591a39e4d58ce66c3", "cd378d4353f44183a5a973498d57a3a3", "f51ca89d7d4e48edb248e105855c00f4", "63a55875b5d1414dac0b23aa0d6aa41e", "cfaa01fedbb24ddc8ed37d8e6ea2d7b5", "2fdbd88668014b19afbf709eaac9d475", "45c15728aa5c4c218c141dd04f6982c1", "787c0c854443491e96a6022b674cd036", "d06bbebd55de4b3e897cff863df52f0c", "9dc5cfc801e64609b5df0a5c786cc4f6", "29fb62eadfc348149d66fc1878e959b6", "7b147f5fe70642f3aab7440ca3cb6f81", "df33745d88f44a0fb2e1c9c4d50d78ab", "1e79c8ab538c464e955fd96e04828679", "88647704de064f30a6b6231e7847e9d2", "eaaebde00dde4d6faba200a2d6e1e108", "c70a4b8757144004b03168988e616740", "ca7491e180de4ebb945298d738e9e859", "fcc1cb133f814268aea4e5d5819a2be5", "5a1de5963b864ca588cdd1b117ab78c6", "63d5e43596f940318eeb5af70cd23021", "0c24cd383c7c4b40a516b06b1f318d8e", "9d4bee213c2d49b9bb7b368fbb0de8fc", "89400541c03e4d02b2a58e07cb638e3b", "92282a9f42e54123b1c1846ad3bbf397", "17dcff78eb7d43a8ad7eefbc857efb3a", "f12674ee3b52473baa7ac580ab1bf065", "0559ecc4bf03490796ff449a7b09a1b0", "496122e633af408095ad54c5cbbe1719", "f86c6cb2baa543aea923984f1a602f3f", "133ea734ecd849d4bb0d1ec493536ef4", "91014b8fa7db440f934b804625c1da50", "5a8c55971a1d4cf5b4781a3b1ba13387", "557f25962c71458fac4ed58c5f7b47aa", "c030db45bee4459a8959e4be3cd2bf06", "48f5e8b463bc404fbe06f6402a14c32e", "6df51addbd994dbcbce1db5e441ab818", "96bd9b0b906646bf8724ab71222911dd", "41c9990095c74b9bb953db6f3156d8f3", "87de6ed49f3349268d5cc126a17da00f", "7ec64f24665741199ea6babb98e6bd20", "2741d44c8e0f49898b91ade95a02c406", "f5ea37958ddc439d9961851c2135b155", "fda529c056fc48b5bd9aa9d63ffaffbf", "c32c4eeb2dac41a7a3af225004e26ee9", "6e65dd613d824cddad36a5886d2cdfc2", "1cf420542fd24204bbf045614375a658", "f44edc0e3b34470681d0cc5d5f0638ff", "d1f83250aeb5489abf43329d00aae2a0", "64a5ff269d68481a82459eae447a51b1", "fc44fb1b74644e42b53125ec1b5ab88a", "68c26624971a43f4951d291d187744fe", "5cf4e2a351094a8897f747a6c5be35a4", "9d270fc14a7543d2b1e11c0029d1d4b7", "8a44d2a1039e44bc95cc57e22092b764", "20049e23b6fd428684bb285e7ace9cdb", "c8aca1b8769640158f1434a8757a4f87", "848b7ca874c04cb18304a7910883d2c7", "af0e6056aa6a4959ad0f16f96556e0a1", "a94e1a3df0fc444b8768662d5972c413", "8707c21348f14e7da8107b946eb34522", "dfb65319911c45f987718305f5694e31", "19a4792b33af4a9a9c80de1703e02867", "8657cc269cca4345a58ea35e57639d79", "811d696c5d7b4967bf48cbe697826009", "c189361845264711b0d0c79fad45af0d", "b65402522dcd4ec7972c1592674450f4", "b5d7c4471a874e10a0f1b693c93bcc82", "bf942a11949b42f8a07ae6809c899e14", "547175aa6ba74dc49e4863fa899b4ac1", "5e70cc17655346f4a7ed3743a3866699", "4ce0a312b50f4fb691ede750a43a5fd1", "a16906eb30c348de908be9d89395e9f7", "7ac47395c1c74f0095ead32802394a00", "59d3f0608e5740b68c2d3935ab8511a3", "b9866abf84cf4176976f79ee98bf3f98", "3c692b6b6ffa45f7b404e436f701a672", "fb2ea20cf5ed4f6f9e1d57defa8b9119", "b31881c5eae84e1a818839e002ecfc56", "60ac52ed40ca4472852a87837a7d5d5e", "c86a78582dc046da816a0a28d1ee4933", "0e001faa2c9140e0a14d6d6d525063c7", "07ace54eb4324caaa433bc5543eda0b8", "ab0076031aa3469ba3f54b3134f37ed7", "219b600056884dcaa45253ef77ac7153", "0c425fe90f6a4086b917183867a68516", "ea2f95784b2a4f6ea7de27e890d76666", "fc4ff33590b84dceb28a2324da5a6500", "0cf2636cff904136a5b34d32c880b665", "c0d4c095ce8c49a58aff2cbb5c03ae61", "e1fe568017974b31a324ae9ea0dc529a", "9b502e1f6656406696d6b6076b052c22", "77e957d0ae8f409a878747140352d2bc", "46951a4442c64006ab20647685e99789", "a6dad63db3ae4aeb84505091d6050fd4", "388a2f1a60a9452392a0839edc1adbdb", "30732727e3ed4312b39fc027878016fe", "f0727ffb1a6243ea96f3d4a6773ee4a8", "3f1952a542c34a0d912c92df0d55c2f8", "f923e8ca320547d5b0d060e48d5ecdd6", "8a52fa45be4441cc8c13647dcd6fde08", "8ccc83dbf7764f7db5372d939b3747f4", "979731627bba4d7d8435fc4427ae1251", "14800a935ff9444f9162a4c44e944599", "55b68f9645b34fe08528cfb3eded7b2b", "cbcbe9299f2b4cdf8b9e51f84e28a658", "86cdf293240d4d24beab7b6712abfa84", "0bf7089ae8234aa4af896a61ed6cf92d", "bb1d8f781b6c4d1da5ede823771e349c", "56f53277381d4ebeb566bee317ba25b0", "d3a97e8eb12046bb80331910dcca903d", "e2f5e9c6b1e5423f966dd13314089bc0", "2c89ed461d4943c0af077dd4b7139926", "3a7c34a67fdd4cecae4441809498e236", "965fbaeb5c9f4906af6ab4b1a56ad3ec", "9fc0563a97c048d4b54ea9d3ef82bfdf", "1cbe32437d924ff9a68d04563e325ca6", "3d1d2e6c5c9f4d25b21e51d3baaf9cdc", "2911204997a24959b2ed735476a9db72", "e60a003012a74122bee07c2fde184550", "1c269e0188ee4d77826f88943dcb0494", "7e454cf9ec174950a1f03462d61c6be6", "52589be29d8842f6a4d6c4f122262be4", "066c745e209a4fae913ac5f0ce2467cb", "396684b6151945f2a342cf359faff93b", "62be8d9d7a974d9e9a55e9cd482614d1", "179d25136b38425fb7e91ae9a0ee1edf", "582f76ea328b4961ab82185bdcb3b8c3", "9595616827e546288de274c4195feabf", "21cf764713c843ca96da432a7525a020", "9c618665ceb34b83858531b1193ce473", "ccf39efe6a2c43449e76eedc81b16681", "db1f23e7ce1c447e9cf0a6ab7e2e114f", "6830256eb96e42888fe327c12414631b", "b57c56b169f14695aa6df072aea3ff55", "5acbebadb7ae41b9bf03b9f4822ae67d", "db85257e697243dba93a3c3b8f150802", "780b6721eb984f88aca4fd2388e0cdfe", "41c44704b7664d05805fea083e546745", "a1fce0b5541048e0940c376c340f3c80", "278249a83e13459284de6883a5b7e512", "1a8083a67b564bb4b34fe997d8b15207", "49dcd00a0892437fad81cc402240eba1", "206dd102490d416cb9b16c72ed0f12ff", "63398c2bd80f41fd9c3dd2c2386983e1", "f89c46290e2d40b1a27633871fea1034", "f5b538f368d544d98edf75669d2d6ee8", "3363da2edd94464490db9c91b1408b89", "22421464b4974f48b32bb7c84c767070", "5abfdca4ec7a471e9d1a794eb3ad7260", "75242ff85af0400499a5e7619c0fa7ce", "9ba31d8f0b104927bbd7c2f276c8dcbd", "3d23fafc164e4f6d89d3fc9ed5ff3e41", "a3098eb16db3407392b619e4148c655a", "8c4b5d738e3f42dcb6c007891441593e", "143b90073e1e4e568889c8d06e835a4d", "bd25df9538214c03b61c044c9ac052ba", "580d312a73154d3f93b5d140d8763ae0", "f66e68b5ff504e17b6d6a27b6a6ec108", "6c6e6ab12e23422f889185a11b05f4b4", "923e5a8d5bf14f1598b4821119ee4f9b", "169cbc5706cf4070b2b34da61a8d8550", "dfb58c209a234fc29291c05151586812", "8bb72ecb3b264d448f9a1ed58e63173d", "4f41490b36324765ba601b9eea1be8a8", "b4b7776484b4488993bc980caa955065", "89d9ea79d89e49c0aabceb0ace57e5db", "4653dac509a942ee8c2dfedefc38b839", "d7c51e1cd394459ba1d3d4f939b1c50b", "b10b36366ab243299b12bcb78979069f", "da8e160081584fef98bed42763663476", "16e628ac719642eda967ce0fb79f6870", "c898c6941f8b45cfa5016b0358b2ff19", "15450fe2ce004e9aa6b9006205a99575", "cf30d63d859c45c5b93de26a910254ef", "b469e4270fe34073890289b0aeca206e", "c6a8151d21fd4bd7bf44e98734536e88", "6d36a1f1c7454703a899656ae02f4168", "a5132399be1e40998e6492c536901282", "61fad31a93834cc88f233a7f6da121af", "d8030ef670fb4e9d8d1510eebc443f1c", "d2b343a815cc4d4f923249efdcef879e", "b21e804d4383489eb60529c141f419f8", "d7a97685fcff45edbfc4c4e86b64dce9", "52a3043c0dec4844abef63728639d7aa", "8acc6bf0c1fd492d82abb2fe942932f1", "dc8abff41b1b42f38a1c8f851143dbdc", "c649b4585e8e4384834b80c1d15e092c", "1258202491504db19b18186f5051b97b", "cd80389212a7495a88d5ea742bfca334", "b052fd6d31cb4c3b877404280245fe09", "4f2a35feaca549b9808b914c92ae5fe9", "b90123f569174977b48deeabf961b0a1", "fbcd6954a7754619aa8c280077b087cb", "5803140078c44c3f84fb510cfcd8e866", "7d0c1ce5f9854afab627747c1e78d8f1", "6d1e44acd775451f969e29b4c3d5da20", "51d09c1428ab470db4719c7e43c1ada2", "9f596894527c40b2896333c7b6d2c79d", "d1fc2d891fda4f2fa882c9cbd09f2164", "be219bc6f11848c2802a5022fde5b1bf", "b736a65868cc49969b31915c94ed7a1a", "1699b0ccc8c14b95ab0b7b9d2e54c63f", "35ebf54909894e2ba4c65815a771cb75", "dd7d0f10db694ed1aea5580e9d5e964f", "e54d069a0f4c4d5fb2b3aec94f19b88c", "5be3dc01548c45c2959868b32f225093", "c660fa94c7d04d9fbfd7ff4040412bbc", "387f754f5437408289142ee215616b43", "dc31e7a57a5440edbca3f90cf0da6ccc", "68274fad39cb401d813e6e78aaa4740f", "a1a6d69f3c294a7485b573d5982120b9", "f079c93148824cacb472b522ba67da1b", "ba2d84ed0e8a4732bb3f54b771c611fd", "981040ad5099471f9e44bf290d45ef6f", "8f019332a7844cc0a9d1fbd45562de2d", "d7382fbdce804a109049d38accfcde12", "d807c20c3e64421496cd4cba34ff292d", "fd0887829e0048abbf67dbcee604ae66", "dd696398cd5e4fac8df58f7e1c7c5fdc", "47f736072db04c78942260a46adf5aea", "e22bbab17a1942489ac1890876f3c70a", "ea962db709014d56a380e64cf844cca2", "bdcb3c8138c342f9bc750f6fe59a82aa", "d0f1db3a304448748dfcb9ec58dd0635", "c152bb8dae1f4a418d7312248648dfb3", "b9a5d226da6d4a5488da1e32ce2b2e82", "8cf4d25afcf4436fbfe335e393977fe6", "419511a48638436c8cc0d671c059e437", "925036c3cad345f79797488e138408eb", "44ef1cc85aed44c88fdc9e1148fa9ef7", "8a71cdbbb57c472c80ddb1b039ec727f", "433b30e1478a497b833961e1e2cb4d5a", "9701a264390f4ee0a5c6353f75a07275", "215b4f54d7ba45abb329f1cf191df3b8", "a4da84606c2d4a03b2d837c5162cd9d8", "856b49936d4f4729896b2bfad40cbc43", "368d790dd7d04c54a382d4fa312061ab", "efd1517f79244069b90a81e746bf184f", "7beb7ca3c3ee4b8aa50ad73e165eefbf", "3d035e5b2b984f0da1f62cd8d0696f8c", "ff82f55ff94e4948a566308bc211c2b5", "577cc7116f07412f90140568819b7b75", "b14a6c48596747f690185bf5862d17c2", "b93020f8b46247019ce70c854023e0b0", "bcfbfe5ebb024a98a33bed4fd80e768f", "d46f7450a0564c82a8747be1fe51f8fa", "5ca1910b18c14abaae243d29c9067d47", "9e8f80d73307479682d5c830c196199f", "51a6acd4d2734081882f2e37cc7ddc6b", "b2dac98d38fd4165ae7d28665fd67b3d", "adda65dea2f54861b77e518ab2117d4b", "6d625be6ade44881a8f6100f09b333e9", "06ad1a71c8a0417998f10b636dd9cd91", "bdf6be73541c45d588360ace6fc7870c", "a400db2a2f3f46519b6c8a422b8af0b2", "41fc2202d34f42bab11bf0bcfd482add", "c151201e7e724a33ab1d2d8ddac5b2a9", "60748a3fc069456195e170945d2c5352", "2c2391a2b4514d2881c3b3ec8648c5b4", "62471169942648a9b4495eda0c70a55f", "15a235b13c68404bac71c9e50545a711", "2b7bec28af6b407f9f8560a3b5a6c84b", "89f3f28a59d44e3b8ecb28951cc5d4b1", "08f67e915bd94d06a963fb78f43b233d", "39b2f1186d334f588f9b15c87d198b2d", "490d4e5072fa43c58b3b6986b56fe5fd", "8b6e6db8b24444f395ceba53979e22cc", "e6b58c576ba249aba51a21b45f35e4d8", "5abd31cd8f4b41d488f105f7baf18c3e", "30378eeb1d064c41b1c194ab0bd17543", "a4fd5d9b21444e72b7ee7c1d5d7ef2f7", "5fb5d7d4b8d34189a71426e40abfc401", "beeb09740d91458a95a3eacc3de64c9c", "1909748b3b6d4d2787c7aa93e02cb7a2", "def65225ded24775b7041ed2978dbeee", "21e780899ec14dfe8d18272799c45ca6", "5e34b06a9ea34690bbd1a6eb985c8699", "9d2c517e52554769bdb69dc2a9b1b823", "290c5dc1c2434280afc1b885ad332970", "2175f1a46b7c45f089fc58b570350de5", "2de499432804475f8f40687548fb63eb", "758a42c106d2447897f800a4dbfa54fb", "6c8ac0513e724d65b964ac810d0890d8", "270f2342d7714c6baf72c1d4b0ce66d5", "cea0fc4eb1654b02b4bb5a2c2c1c3afd", "fda01e5fff3f4de49201dc6ab49bab68", "8330d90195b143b580b9713fd4b7c927", "bbb9ea224d34469ca2a32bf77dbfb309", "f795810c5a044226aca068e071191bff", "62c6883ce8a140889fe702ed11269596", "aa94bfdd25e64d568b64efdde1f8e02d", "ab03e8512dd54306a1d5fc616b273a1e", "df805580e6cb46218a76f2a3d3188a47", "12cf762493394fc79ecabf9f41ededc2", "74e92d1ad4b34d82b018ab187c4e9e36", "0cfe213d17014f868af9670cbce251a6", "6eae20c34cc94a45aecc2f9bad71ad94", "d4d8c52b87e44a548653403400339692", "1404acc1ce084d0bb52bbd46d7888e44", "efd49a29bbd641b189a90f9110add92f", "094310cd34484656a0e77245b153bf99", "b5d7e3e7b1a34ddd8ee35250216721df", "2fa8891967fe4b89ae9588251b91f168", "c02c15ea36d64418816cc75b216514ad", "226720a7855d4baa9c78340d11ef7ce0", "661b197428ec4f9ead3c026316016774", "edc7479694e141caa14239028d6d6928", "ec4405e0d3854a248e37c6cfb40c98ff", "2799e52583a54f7a947f0a0846b62d51", "3b83f024ce1b4071882f8a0ec0eded2c", "24fc173d42bb4d7abb795304b7304fd8", "66867ac4973245799ac1f1e82a149ce3", "c5fbe71a84a5461787fae98964613022", "966e68735f2b46fea111affe1f8f1320", "f00738dd223d4d2d8cad9b99a42cea4f", "6f5b186f60ed4244a4b32f52c8616ec9", "4a6c90d511d04f6d8222422c215faa40", "8d3e3122ac6249718a79f866a5cb3a33", "d81d7cae6d1e42e3a6e049b4655c892e", "1ae5937e5c78451ea5188a843b79c050", "a64f887cfc7b4ca2836e760414bf2d85", "e74806f4ca6149668b7c6f952a866fb7", "bb7a24d59bdf456a98af83ae5406b71e", "4c6cb2b32c0a492e8e290587a6b41ed6", "a4460aacba4e4530a891dc74a0772000", "7264b115983e4e9cb5b220141eaa7f42", "6365d35fe5c84384908a955ba9f656ad", "35fb8881c1bb485fba095d4db5d1bac4", "ae6ade70349f4cee9cea3fff09b4aaf4", "c03d7cd927e242999e4b7a6736bd22ef", "2e612d85bcba41ea921cbf6df52b61fc", "221aa135e2e7401fbe1ba38f42716378", "c41a4793b7b74ae097faef919cf61a70", "1a784c09a999423daede6f7eaa636dde", "efdbd0835b1142029521f4e330a37c99", "d4b4051e7b8e4fecb9ed79c08dab4d7e", "791bdd214d724280aebb0379fd756495", "0f20d82d76d94d8ab69b544ed2f9289f", "0e5aaae852904e65bb4a53cc0b401319", "0939a52140064a4ba8fb3768d3868dc2", "b84b4be62bda46d2b9c2e1f13cf65638", "b54c55fed6724027a33f716928b2c24f", "62f0e021814945018275ecc4a70c0bbd", "8ce8c907ebc54090b825584438af92be", "0b6fa7ade10f45c99baadfa202b03797", "2df0ce4207864d46aa69f95a9c4551f2", "f61ece76017c47e185784df85f15bb8a", "c886b1aad38b4a1090934425bd9fbc7e", "18b60891f53b4d75b69f927305420295", "b26443fcac344b80a9a9395bf9f8e027", "15cf861836694d6bbeb3f28faeb621e8" ] }, "id": "kYaaIJ3pD1jE", "outputId": "351c5309-3545-4737-e91c-c0daf96229ab" }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "WARNING:llmware.models:ModelCatalog - load_model - fetching model - slim-sentiment-tool - from remote repository using pull_snapshot_from_hf - this may take a couple of minutes the first time.\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "step - \t3 - \tloading tool - sentiment\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/usr/local/lib/python3.10/dist-packages/huggingface_hub/utils/_token.py:89: UserWarning: \n", "The secret `HF_TOKEN` does not exist in your Colab secrets.\n", "To authenticate with the Hugging Face Hub, create a token in your settings tab (https://huggingface.co/settings/tokens), set it as secret in your Google Colab and restart your session.\n", "You will be able to reuse this secret in all of your notebooks.\n", "Please note that authentication is recommended but still optional to access public models or datasets.\n", " warnings.warn(\n", "/usr/local/lib/python3.10/dist-packages/huggingface_hub/file_download.py:1194: UserWarning: `local_dir_use_symlinks` parameter is deprecated and will be ignored. The process to download files to a local folder has been updated and do not rely on symlinks anymore. You only need to pass a destination folder as`local_dir`.\n", "For more details, check out https://huggingface.co/docs/huggingface_hub/main/en/guides/download#download-files-to-local-folder.\n", " warnings.warn(\n" ] }, { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "c50e606ff8ea41bfb369f6ccf368d238", "version_major": 2, "version_minor": 0 }, "text/plain": [ "Fetching 4 files: 0%| | 0/4 [00:00" ] }, "execution_count": 4, "metadata": {}, "output_type": "execute_result" } ], "source": [ "agent.load_tool(\"sentiment\")\n", "agent.load_tool(\"ner\")\n", "\n", "agent.load_tool_list([\"emotions\", \"topics\", \"intent\", \"tags\", \"ratings\", \"answer\"])" ] }, { "cell_type": "markdown", "metadata": { "id": "Pzi2QDb4ahJJ" }, "source": [ "# Deploy tools and run analysis" ] }, { "cell_type": "markdown", "metadata": { "id": "U9AvagPPbGsL" }, "source": [ "Assess \"soft skills\"" ] }, { "cell_type": "code", "execution_count": 5, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 641, "referenced_widgets": [ "6e8c017741b94c4991efd41a2d049f5e", "af1e6c37f2654cf2a492357174e52333", "fe8dec363a754b089390b5c674c3abef", "c05a5349a5134d10882e1a3fd23ef0ad", "28b24e3acdd6465eb3c6bdd6b6fe9091", "b452f05bdeb74b9c994b41e5c7dd66a1", "e907a49e3eb84a0fb0521fdea9e8283f", "0ff642fa936342e0b252a5ba462a568a", "099a0e7a05c94a0d9a9208442d8b1ae6", "fb3908d3a26a41da874bbd8f12491067", "d23552be1c5f4a43802148f4dcfb70a8" ] }, "id": "kxIk32w0ahUj", "outputId": "2774cae4-8435-4d09-c41f-619ff41a6ea1" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "step - \t11 - \texecuting function call - deploying - sentiment \n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "INFO:llmware.models:update: LocalTokenizer - need to fetch tokenizer - tokenizer_tl.json\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "step - \t12 - \texecuting function call - getting response - sentiment\n", "\t\t\t\t -- llm_response - {'sentiment': ['negative']}\n", "\t\t\t\t -- output type - dict\n", "\t\t\t\t -- usage - {'input': 107, 'output': 8, 'total': 115, 'metric': 'tokens', 'processing_time': 1.458883285522461, 'type': 'dict'}\n" ] }, { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "6e8c017741b94c4991efd41a2d049f5e", "version_major": 2, "version_minor": 0 }, "text/plain": [ "tokenizer_tl.json: 0%| | 0.00/1.84M [00:00