{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Use clear syntax\n", "\n", "This is the first installment of a series on how to use `guidance` to control large language models (LLMs).\n", "We'll start from the basics and work our way up to more advanced topics.\n", "\n", "In this document, we'll show that having **clear syntax** enables you to communicate your intent to the LLM, and also ensure that outputs are easy to parse (like JSON that is guaranteed to be valid). For the sake of clarity and reproducibility we'll start with an open source StableLM model without fine tuning. Then, we will show how the same ideas apply to instruction-tuned models like GPT-3.5 and chat-tuned models like ChatGPT / GPT-4." ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "## Clear syntax helps with parsing the output\n", "The first, and most obvious benefit of using clear syntax is that it makes it easier to parse the output of the LLM. Even if the LLM is able to generate a correct output, it may be difficult to programatically extract the desired information from the output. For example, consider the following Guidance prompt (where `gen()` is a `guidance` function to generate text from the LLM):" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "Sliding Window Attention is enabled but not implemented for `sdpa`; unexpected results may be encountered.\n", "Non-Nvidia GPU monitoring is not supported in this version. NVML Shared Library Not Found\n" ] } ], "source": [ "import math\n", "import guidance\n", "from guidance import models, gen, select\n", "\n", "lm = models.Transformers(\"Qwen/Qwen2.5-1.5B\")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can now ask a question:" ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "1a0e846a74534ac1bd085f7d22d44402", "version_major": 2, "version_minor": 0 }, "text/plain": [ "StitchWidget(initial_height='auto', initial_width='100%', srcdoc='\\n\\n\\n …" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/plain": [ "" ] }, "execution_count": 2, "metadata": {}, "output_type": "execute_result" } ], "source": [ "# run a guidance program (by appending to the model state)\n", "lm + \"Name common Linux operating system commands.\" + gen(max_tokens=50)" ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "While the answer is readable, the output _format_ is arbitrary (i.e. we don't know it in advance), and thus hard to parse programatically.\n", "For example here is another run of the same prompt where the output format is very different:" ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "8bef5972e38f47d4a6a4eca99942c10b", "version_major": 2, "version_minor": 0 }, "text/plain": [ "StitchWidget(initial_height='auto', initial_width='100%', srcdoc='\\n\\n\\n …" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/plain": [ "" ] }, "execution_count": 3, "metadata": {}, "output_type": "execute_result" } ], "source": [ "lm + \"Name common Mac operating system commands.\" + gen(max_tokens=50)" ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "Enforcing clear syntax in your prompts can help reduce the problem of arbitrary output formats.\n", "There are a couple ways you can do this: \n", "1. Giving structure hints to the LLM inside a standard prompt (perhaps even using few shot examples).\n", "2. Writing a `guidance` program template that enforces a specific output format.\n", "\n", "These are not mutually exclusive. Let's see an example of each approach" ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "### Traditional prompt with structure hints\n", "Here is an example of a traditional prompt that uses structure hints to encourage the use of a specific output format. The prompt is designed to generate a list of 5 items that is easy to parse. Note that in comparison to the previous prompt, we have written this prompt in such a way that it has committed the LLM to a specific clear syntax (numbers followed by a quoted string). This makes it much easier to parse the output after generation." ] }, { "cell_type": "code", "execution_count": 4, "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "40acb4fb79b04a49931f5aa406e4473a", "version_major": 2, "version_minor": 0 }, "text/plain": [ "StitchWidget(initial_height='auto', initial_width='100%', srcdoc='\\n\\n\\n …" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/plain": [ "" ] }, "execution_count": 4, "metadata": {}, "output_type": "execute_result" } ], "source": [ "lm +'''\\\n", "What are the most common commands used in the Linux operating system?\n", "\n", "Here are the 5 most common commands:\n", "1. \"''' + gen(max_tokens=70)" ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "Note that the LLM follows the syntax correctly, but does not stop after generating 5 items.\n", "We can fix this by creating a clear stopping criteria, e.g. asking for 6 items and stopping when we see the start of the sixth item (so we end up with five):" ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "e65d5b24dba34a728f2191435f699ff2", "version_major": 2, "version_minor": 0 }, "text/plain": [ "StitchWidget(initial_height='auto', initial_width='100%', srcdoc='\\n\\n\\n …" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/plain": [ "" ] }, "execution_count": 5, "metadata": {}, "output_type": "execute_result" } ], "source": [ "lm + '''\\\n", "What are the most common commands used in the Linux operating system?\n", "\n", "Here are the 6 most common commands:\n", "1. \"''' + gen(max_tokens=100, stop=\"\\n6.\")" ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "### Enforcing syntax with a `guidance` program\n", "\n", "Rather than using _hints_, a Guidance program _enforces_ a specific output format, inserting the tokens that are part of the structure rather than getting the LLM to generate them.\n", "For example, this is what we would do if we wanted to enforce a numbered list as a format:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "295405c9295d42cf96ac61dbdb726260", "version_major": 2, "version_minor": 0 }, "text/plain": [ "StitchWidget(initial_height='auto', initial_width='100%', srcdoc='\\n\\n\\n …" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "lm2 = lm + \"\"\"What are the most common commands used in the Linux operating system?\n", "\n", "Here are the 5 most common commands:\n", "\"\"\"\n", "for i in range(5):\n", " lm2 += f'''{i+1}. \"{gen('commands', list_append=True, stop='\"', max_tokens=50)}\"\\n'''" ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "Here is what is happening in the above prompt:\n", "- The `lm2 = lm + \"\"\"What are...` command saves the new model state that results from adding the blank starting model to a string into the variable `lm2`. The for loop then iteratively updates `lm2` by adding a mixure of strings and generated sequences.\n", "- Note that the structure (the numbers, and quotes) are _not_ generated by the LLM.\n", "\n", "Output parsing is done automatically by the Guidance program, so we don't need to worry about it. In this case, the `commands` variable wil be the list of generated command names:" ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "['ls', 'cd', 'pwd', 'mkdir', 'rm']" ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "lm2[\"commands\"]" ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "## Forcing valid JSON syntax\n", "Using guidance we can create any syntax we want with absolute confidence that what we generate will exactly follow the format we specify. This is particularly useful for things like JSON.\n", "\n", "### Format string embedding\n", "With Guidance, there are multiple valid strategies to generate JSON. One strategy, demonstrated below, is to directly embed the JSON syntax in a format string." ] }, { "cell_type": "code", "execution_count": 8, "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "3266dfc5a19e4e58b1c0597ba27626cd", "version_major": 2, "version_minor": 0 }, "text/plain": [ "StitchWidget(initial_height='auto', initial_width='100%', srcdoc='\\n\\n\\n …" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/plain": [ "" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "import guidance\n", "\n", "# define a re-usable \"guidance function\" that we can use below\n", "@guidance\n", "def quoted_list(lm, name, n):\n", " for i in range(n):\n", " if i > 0:\n", " lm += \", \"\n", " lm += '\"' + gen(name, list_append=True, stop=['\"', ',', ' ']) + '\"'\n", " return lm\n", "\n", "lm + f\"\"\"What are the most common commands used in the Linux operating system?\n", "\n", "Here are the 5 most common commands in JSON format:\n", "{{\n", " \"commands\": [{quoted_list('commands', 5)}],\n", " \"my_favorite_command\": \"{gen('favorite_command', stop=['\"', ' '])}\"\n", "}}\"\"\"" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### JSON schema\n", "Guidance also supports JSON schemas for JSON generation." ] }, { "cell_type": "code", "execution_count": 9, "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "761bb5cbb4844899b4363a40501297a3", "version_major": 2, "version_minor": 0 }, "text/plain": [ "StitchWidget(initial_height='auto', initial_width='100%', srcdoc='\\n\\n\\n …" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/plain": [ "" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "from guidance import models, json\n", "\n", "schema = \"\"\"{\n", " \"$schema\": \"http://json-schema.org/draft-07/schema#\",\n", " \"type\": \"object\",\n", " \"properties\": {\n", " \"commands\": {\n", " \"type\": \"array\",\n", " \"items\": {\n", " \"type\": \"string\"\n", " },\n", " \"minItems\": 5,\n", " \"maxItems\": 5,\n", " \"description\": \"Array of exactly 5 Linux commands\"\n", " },\n", " \"my_favorite_command\": {\n", " \"type\": \"string\",\n", " \"description\": \"A single Linux command\"\n", " }\n", " },\n", " \"required\": [\"commands\", \"my_favorite_command\"],\n", " \"additionalProperties\": false\n", "}\"\"\"\n", "\n", "lm + f\"\"\"What are the most common commands used in the Linux operating system?\n", "\n", "Here are the 5 most common commands in JSON format:\n", "{json(schema=schema)}\"\"\"" ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "## Clear syntax gives the user more power\n" ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "Since clear structure gives us outputs that are easy to parse and manipulate, we can easily take the output, remove duplicates, and use them in the next step of our program. \n", "Here is an example program that takes the listed commands, picks one, and does further operations on it:" ] }, { "cell_type": "code", "execution_count": 10, "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "661190edff1a45ef9c1d0a451051bede", "version_major": 2, "version_minor": 0 }, "text/plain": [ "StitchWidget(initial_height='auto', initial_width='100%', srcdoc='\\n\\n\\n …" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "newline = \"\\n\" # because for python < 3.12 we can't put a backslash in f-string values\n", "lm2 = lm + 'What are the most common commands used in the Linux operating system?\\n'\n", "\n", "# generate a bunch of command names\n", "lm_tmp = lm2 + 'Here is a common command: \"'\n", "commands = [(lm_tmp + gen('command', stop='\"', max_tokens=20, temperature=1.0))[\"command\"] for i in range(10)]\n", "\n", "# discuss them\n", "for i,command in enumerate(set(commands)):\n", " lm2 += f'{i+1}. \"{command}\"\\n'\n", "lm2 += f'''Perhaps the most useful command from that list is: \"{gen('cool_command', stop='\"')}\", because {gen('cool_command_desc', max_tokens=100, stop=newline)}\n", "On a scale of 1-10, it has a coolness factor of: {gen('coolness', regex=\"[0-9]+\")}.'''" ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "We introduced one import control method in the above program: the `regex` pattern guide for generation. The command `gen('coolness', regex=\"[0-9]+\")` uses a regular expression to enforce a certain syntax on the output (i.e. forcing the output to match an arbitrary regular experession). In this case we force the coolness score to be a whole number (note that generation stops once the model has completed generation of the pattern and starts to generate something else)." ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "## Combining clear syntax with model-specific structure like chat\n", "\n", "All the examples above used a base model without any later fine-tuning. But if the model you are using has fine tuning, it is important to combine clear syntax with the structure that has been tuned into the model. For example, chat models have been fine tuned to expect several \"role\" tags in the prompt. We can leverage these tags to further enhance the structure of our programs/prompts.\n", "\n", "The following example adapts the above prompt for use with a chat based model. `guidance` has special role context blocks (like `user()`), which allow you to mark out various roles and get them automatically translated into the right special tokens or API calls for the LLM you are using. This helps make prompts easier to read and makes them more general across different chat models." ] }, { "cell_type": "code", "execution_count": 11, "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "5fe41183c5cf44daabf99c8d37a544d9", "version_major": 2, "version_minor": 0 }, "text/plain": [ "Loading checkpoint shards: 0%| | 0/2 [00:00\\n\\n\\n …" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from guidance import user, assistant, system\n", "newline = \"\\n\"\n", "\n", "with user():\n", " lm2 = chat_lm + \"What are the most common commands used in the Linux operating system?\"\n", "\n", "with assistant():\n", "\n", " # generate a bunch of command names\n", " lm_tmp = lm2 + 'Here are ten common command names:\\n'\n", " for i in range(10):\n", " lm_tmp += f'{i+1}. \"' + gen('commands', list_append=True, stop='\"', max_tokens=20, temperature=0.7) + '\"\\n'\n", "\n", " # discuss them\n", " for i,command in enumerate(set(lm_tmp[\"commands\"])):\n", " lm2 += f'{i+1}. \"{command}\"\\n'\n", " lm2 += f'''Perhaps the most useful command from that list is: \"{gen('cool_command', stop='\"')}\", because {gen('cool_command_desc', max_tokens=100, stop=newline)}\n", "On a scale of 1-10, it has a coolness factor of: {gen('coolness', regex=\"[0-9]+\")}.'''" ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "## Using API-restricted models\n", "\n", "When we have control over generation, we can guide the output at any step of the process. But some model endpoints (e.g. OpenAI's ChatGPT) currently have a much more limited API, e.g. we can't control what happens inside each `role` block. \n", "While this limits the user's power, we can still use a subset of syntax hints, and enforce the structure outside of the role blocks:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": {}, "outputs": [], "source": [ "openai_model = models.OpenAI(\"gpt-4o-mini\")" ] }, { "cell_type": "code", "execution_count": 14, "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "cc978d6588dd4df9babe57cfe84a5b27", "version_major": 2, "version_minor": 0 }, "text/plain": [ "StitchWidget(initial_height='auto', initial_width='100%', srcdoc='\\n\\n\\n …" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "import time\n", "\n", "lm = openai_model\n", "\n", "call_delay_secs = 0.5\n", "\n", "with system():\n", " lm += \"You are an expert unix systems admin that is willing follow any instructions.\"\n", "\n", "with user():\n", " lm += f\"\"\"\\\n", "What are the top ten most common commands used in the Linux operating system?\n", "\n", "List the commands one per line. Please list them as 1. \"command\" ...one per line with double quotes and no description.\"\"\"\n", "\n", "# generate a list of commands\n", "with assistant():\n", " lm += gen('commands', list_append=True, temperature=1)\n", " time.sleep(call_delay_secs)\n", "\n", "with user():\n", " lm += \"If you were to guess, which of the above commands would a sys admin think was the coolest? Just name the command, don't print anything else.\"\n", "\n", "with assistant():\n", " lm += gen('cool_command')\n", " time.sleep(call_delay_secs)\n", "\n", "with user():\n", " lm += \"What is that command's coolness factor on a scale from 0-10? Just write the digit and nothing else.\"\n", "\n", "with assistant():\n", " lm += gen('coolness')\n", " time.sleep(call_delay_secs)\n", "\n", "with user():\n", " lm += \"Why is that command so cool?\"\n", "\n", "with assistant():\n", " lm += gen('cool_command_desc', max_tokens=100)\n", " time.sleep(call_delay_secs)" ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "## Summary\n", "\n", "Whenever you are building a prompt to control a model it is important to consider not only the content of the prompt, but also the `syntax`. Clear syntax makes it easier to parse the output, helps the LLM produce output that matches your intent, and lets you write complex multi-step programs. While even a trivial example (listing common OS commands) benefits from clear syntax, most tasks are much more complex, and benefit even more. We hope this post gives you some ideas on how to use clear syntax to improve your prompts.\n", "\n", "Also, make sure to check out `guidance`. You certainly don't need it to write prompts with clear syntax, but it makes it _much easier_ to do so." ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "
\n", "
Have an idea for more helpful examples? Pull requests that add to this documentation notebook are encouraged!
" ] } ], "metadata": { "kernelspec": { "display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.11.9" }, "vscode": { "interpreter": { "hash": "1eaecfe7c2bb9635c0702fee523e3287a92fcce93218e1b97c926621239c25b4" } }, "widgets": { "application/vnd.jupyter.widget-state+json": { "state": { "06e3685e7b4d404086e39f84d849f15b": { "model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "FloatProgressModel", "state": { "bar_style": "success", "layout": "IPY_MODEL_0c88a678c4b34103931d7bbd72c31bd8", "max": 2, "style": "IPY_MODEL_ccee51861e0b4aef9b2869ed3a45432c", "value": 2 } }, "0a5e6064b82c46df90ab32adf950299f": { "model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {} }, "0c88a678c4b34103931d7bbd72c31bd8": { "model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {} }, "177d7e850d494873b9aa31e50866b9db": { "model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {} }, "1a0e846a74534ac1bd085f7d22d44402": { "model_module": "@guidance-ai/stitch", "model_module_version": "^0.1.5", "model_name": "StitchModel", "state": { "_model_module_version": "^0.1.5", "_view_module_version": "^0.1.5", "clientmsg": "{\"class_name\":\"ClientReadyMessage\"}", "initial_height": "auto", "initial_width": "100%", "kernelmsg": "{\"message_id\":109,\"last_trace_id\":59,\"is_err\":false,\"class_name\":\"ExecutionCompletedMessage\"}", "layout": "IPY_MODEL_9ad4fc9df305416099c51d33932ea001", "srcdoc": "\n\n\n \n\n \n \n \n\n\n\n\n\n", "state": "{\"components\":[{\"value\":\"Name\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.779247283935547,\"token\":{\"token\":\"Name\",\"bytes\":\"TmFtZQ==\",\"prob\":1,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" common\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.779247283935547,\"token\":{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":0.00002171039886889048,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" Linux\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.779247283935547,\"token\":{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.00012744548439513892,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" operating\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.779247283935547,\"token\":{\"token\":\" operating\",\"bytes\":\"IG9wZXJhdGluZw==\",\"prob\":0.011084606871008873,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" system\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.779247283935547,\"token\":{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.7370990514755249,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.779247283935547,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.002234590006992221,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":72.16405868530273,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.06370903551578522,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.06370903551578522,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.05141955986618996,\"masked\":false},{\"token\":\".\\n\\n\",\"bytes\":\"LgoK\",\"prob\":0.0241013802587986,\"masked\":false},{\"token\":\".\\n\\n\\n\",\"bytes\":\"LgoKCg==\",\"prob\":0.001964231953024864,\"masked\":false},{\"token\":\".\\\\\",\"bytes\":\"Llw=\",\"prob\":0.00045428608427755535,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" The\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.82903861999512,\"token\":{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.1251828968524933,\"masked\":false},\"top_k\":[{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.1251828968524933,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" most\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.50414657592773,\"token\":{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":0.3707016408443451,\"masked\":false},\"top_k\":[{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":0.3707016408443451,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" common\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":73.15826416015625,\"token\":{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":0.6455129981040955,\"masked\":false},\"top_k\":[{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":0.6455129981040955,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Linux\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.80002403259277,\"token\":{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.8174095749855042,\"masked\":false},\"top_k\":[{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.8174095749855042,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" operating\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.93205642700195,\"token\":{\"token\":\" operating\",\"bytes\":\"IG9wZXJhdGluZw==\",\"prob\":0.5677230954170227,\"masked\":false},\"top_k\":[{\"token\":\" operating\",\"bytes\":\"IG9wZXJhdGluZw==\",\"prob\":0.5677230954170227,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" system\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.3818588256836,\"token\":{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.9905857443809509,\"masked\":false},\"top_k\":[{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.9905857443809509,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.45321846008301,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.980141282081604,\"masked\":false},\"top_k\":[{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.980141282081604,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" are\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.13485717773438,\"token\":{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":0.5591592192649841,\"masked\":false},\"top_k\":[{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":0.5591592192649841,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\":\\n\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.766075134277344,\"token\":{\"token\":\":\\n\\n\",\"bytes\":\"OgoK\",\"prob\":0.34701284766197205,\"masked\":false},\"top_k\":[{\"token\":\":\\n\\n\",\"bytes\":\"OgoK\",\"prob\":0.34701284766197205,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"1\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.610076904296875,\"token\":{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":0.5835759043693542,\"masked\":false},\"top_k\":[{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":0.5835759043693542,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.02111053466797,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9911495447158813,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9911495447158813,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" ls\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.31689453125,\"token\":{\"token\":\" ls\",\"bytes\":\"IGxz\",\"prob\":0.41955995559692383,\"masked\":false},\"top_k\":[{\"token\":\" ls\",\"bytes\":\"IGxz\",\"prob\":0.41955995559692383,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.97707557678223,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.47941383719444275,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.47941383719444275,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" list\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.32428550720215,\"token\":{\"token\":\" list\",\"bytes\":\"IGxpc3Q=\",\"prob\":0.3112282156944275,\"masked\":false},\"top_k\":[{\"token\":\" list\",\"bytes\":\"IGxpc3Q=\",\"prob\":0.3112282156944275,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" files\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.73405456542969,\"token\":{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.5623294711112976,\"masked\":false},\"top_k\":[{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.5623294711112976,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.599897384643555,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.6423689723014832,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.6423689723014832,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directories\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.15104866027832,\"token\":{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.885309100151062,\"masked\":false},\"top_k\":[{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.885309100151062,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.24417686462402,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.636833131313324,\"masked\":false},\"top_k\":[{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.636833131313324,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"2\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.31304931640625,\"token\":{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":0.9978540539741516,\"masked\":false},\"top_k\":[{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":0.9978540539741516,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.24593925476074,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9998613595962524,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9998613595962524,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" cd\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.24489212036133,\"token\":{\"token\":\" cd\",\"bytes\":\"IGNk\",\"prob\":0.7992208003997803,\"masked\":false},\"top_k\":[{\"token\":\" cd\",\"bytes\":\"IGNk\",\"prob\":0.7992208003997803,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":61.85293197631836,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.992328941822052,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.992328941822052,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" change\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.69886207580566,\"token\":{\"token\":\" change\",\"bytes\":\"IGNoYW5nZQ==\",\"prob\":0.9718466401100159,\"masked\":false},\"top_k\":[{\"token\":\" change\",\"bytes\":\"IGNoYW5nZQ==\",\"prob\":0.9718466401100159,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directory\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":61.63597106933594,\"token\":{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.8919868469238281,\"masked\":false},\"top_k\":[{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.8919868469238281,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":61.38014793395996,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9602615833282471,\"masked\":false},\"top_k\":[{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9602615833282471,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"3\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":61.57493591308594,\"token\":{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":0.999747097492218,\"masked\":false},\"top_k\":[{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":0.999747097492218,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.65606117248535,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999333620071411,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999333620071411,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" pwd\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.1861686706543,\"token\":{\"token\":\" pwd\",\"bytes\":\"IHB3ZA==\",\"prob\":0.5759739279747009,\"masked\":false},\"top_k\":[{\"token\":\" pwd\",\"bytes\":\"IHB3ZA==\",\"prob\":0.5759739279747009,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.3930435180664,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.997454822063446,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.997454822063446,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" print\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.33272361755371,\"token\":{\"token\":\" print\",\"bytes\":\"IHByaW50\",\"prob\":0.9360072016716003,\"masked\":false},\"top_k\":[{\"token\":\" print\",\"bytes\":\"IHByaW50\",\"prob\":0.9360072016716003,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" working\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.11294364929199,\"token\":{\"token\":\" working\",\"bytes\":\"IHdvcmtpbmc=\",\"prob\":0.6815938949584961,\"masked\":false},\"top_k\":[{\"token\":\" working\",\"bytes\":\"IHdvcmtpbmc=\",\"prob\":0.6815938949584961,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directory\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":75.51312446594238,\"token\":{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.9959484934806824,\"masked\":false},\"top_k\":[{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.9959484934806824,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.53373146057129,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9486449360847473,\"masked\":false},\"top_k\":[{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9486449360847473,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"4\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.9646987915039,\"token\":{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":0.9997476935386658,\"masked\":false},\"top_k\":[{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":0.9997476935386658,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.18611717224121,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999580383300781,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999580383300781,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" mkdir\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.63401222229004,\"token\":{\"token\":\" mkdir\",\"bytes\":\"IG1rZGly\",\"prob\":0.2603739798069,\"masked\":false},\"top_k\":[{\"token\":\" mkdir\",\"bytes\":\"IG1rZGly\",\"prob\":0.2603739798069,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.5451545715332,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9976426959037781,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9976426959037781,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" make\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.47086143493652,\"token\":{\"token\":\" make\",\"bytes\":\"IG1ha2U=\",\"prob\":0.6309285759925842,\"masked\":false},\"top_k\":[{\"token\":\" make\",\"bytes\":\"IG1ha2U=\",\"prob\":0.6309285759925842,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.4559555053711,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.4730013608932495,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.4730013608932495,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" new\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.97521018981934,\"token\":{\"token\":\" new\",\"bytes\":\"IG5ldw==\",\"prob\":0.7520508766174316,\"masked\":false},\"top_k\":[{\"token\":\" new\",\"bytes\":\"IG5ldw==\",\"prob\":0.7520508766174316,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directory\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.38822364807129,\"token\":{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.989960789680481,\"masked\":false},\"top_k\":[{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.989960789680481,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.65396690368652,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9854258298873901,\"masked\":false},\"top_k\":[{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9854258298873901,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"5\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.40584564208984,\"token\":{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":0.999680757522583,\"masked\":false},\"top_k\":[{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":0.999680757522583,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.07675552368164,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999394416809082,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999394416809082,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" rm\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.98705863952637,\"token\":{\"token\":\" rm\",\"bytes\":\"IHJt\",\"prob\":0.4844619631767273,\"masked\":false},\"top_k\":[{\"token\":\" rm\",\"bytes\":\"IHJt\",\"prob\":0.4844619631767273,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.78287887573242,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.995407223701477,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.995407223701477,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" remove\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.8869743347168,\"token\":{\"token\":\" remove\",\"bytes\":\"IHJlbW92ZQ==\",\"prob\":0.8706384301185608,\"masked\":false},\"top_k\":[{\"token\":\" remove\",\"bytes\":\"IHJlbW92ZQ==\",\"prob\":0.8706384301185608,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" files\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.350677490234375,\"token\":{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.5047590732574463,\"masked\":false},\"top_k\":[{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.5047590732574463,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.3936653137207,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.5135536193847656,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.5135536193847656,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directories\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.97707557678223,\"token\":{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.9866881966590881,\"masked\":false},\"top_k\":[{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.9866881966590881,\"masked\":false}],\"class_name\":\"TokenOutput\"}],\"status\":\"Done\",\"shownMetrics\":[\"status\",\"consumed\",\"token reduction\",\"avg latency\"],\"metrics\":{\"status\":\"Done\",\"wall time\":0,\"consumed\":52,\"token reduction\":0,\"avg latency\":69.0618845132681,\"cpu\":[0.8604999999999999,0.8604999999999999,0.893,0.893,0.89625],\"gpu\":[0,0,0,0,0],\"ram\":53.317413330078125,\"vram\":0},\"requireFullReplay\":false,\"currentMessageId\":109,\"backtrackCount\":1,\"resetCount\":1}" } }, "295405c9295d42cf96ac61dbdb726260": { "model_module": "@guidance-ai/stitch", "model_module_version": "^0.1.5", "model_name": "StitchModel", "state": { "_model_module_version": "^0.1.5", "_view_module_version": "^0.1.5", "clientmsg": "{\"class_name\":\"ClientReadyMessage\"}", "initial_height": "auto", "initial_width": "100%", "kernelmsg": "{\"message_id\":731,\"last_trace_id\":349,\"is_err\":false,\"class_name\":\"ExecutionCompletedMessage\"}", "layout": "IPY_MODEL_2fb842560dca4f6684207c9020b9e7de", "srcdoc": "\n\n\n \n\n \n \n \n\n\n\n\n\n", "state": "{\"components\":[{\"value\":\"What\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\"What\",\"bytes\":\"V2hhdA==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" are\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" most\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" common\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" used\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" used\",\"bytes\":\"IHVzZWQ=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" in\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" Linux\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" operating\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" operating\",\"bytes\":\"IG9wZXJhdGluZw==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" system\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"?\\n\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\"?\\n\\n\",\"bytes\":\"PwoK\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"Here\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\"Here\",\"bytes\":\"SGVyZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" are\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"5\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" most\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":0.5897648334503174,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" common\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":0.777923047542572,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.8106726408004761,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\":\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":11.305505579168146,\"token\":{\"token\":\":\\n\",\"bytes\":\"Ogo=\",\"prob\":0.002174335066229105,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"1\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.8244514465332031,\"token\":{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.8244514465332031,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.956274151802063,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":236.21225357055664,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.024426009505987167,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.024426009505987167,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.002994968555867672,\"masked\":false},{\"token\":\" \\\"$\",\"bytes\":\"ICIk\",\"prob\":0.00003463938264758326,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.000028990189093747176,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.000016217651136685163,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"ls\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.45917892456055,\"token\":{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.7604440450668335,\"masked\":false},\"top_k\":[{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.7604440450668335,\"masked\":false},{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.12504924833774567,\"masked\":false},{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.04090636223554611,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.014721921645104885,\"masked\":false},{\"token\":\"echo\",\"bytes\":\"ZWNobw==\",\"prob\":0.007135641761124134,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.02787971496582,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.7383410930633545,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.7383410930633545,\"masked\":false},{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.011741578578948975,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.010475694201886654,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.0006189474952407181,\"masked\":false},{\"token\":\" –\",\"bytes\":\"IOKAkw==\",\"prob\":0.0005226295907050371,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":234.3900203704834,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":8.82833861570731e-10,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"2\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":1.0083913803100586,\"token\":{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":0.8567631244659424,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":1.0083913803100586,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9995017051696777,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":232.6791286468506,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9970423579216003,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9970423579216003,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.00048351791338063776,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":0.0001968486758414656,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.00017097845557145774,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.0001415408041793853,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"cd\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.46480751037598,\"token\":{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.7724276185035706,\"masked\":false},\"top_k\":[{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.7724276185035706,\"masked\":false},{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.1226915642619133,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.02467738278210163,\"masked\":false},{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.020600171759724617,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.018290501087903976,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.74201583862305,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.9726842641830444,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.9726842641830444,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.024317720904946327,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.0007445210940204561,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.000428588391514495,\"masked\":false},{\"token\":\" \\\"\\n\",\"bytes\":\"ICIK\",\"prob\":0.00040111917769536376,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"3\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.9179115295410156,\"token\":{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":0.9992585778236389,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.9179115295410156,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9997265934944153,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":226.1350154876709,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9974358677864075,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9974358677864075,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.0004890214186161757,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":0.00037026096833869815,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.0002467180020175874,\"masked\":false},{\"token\":\" \\\"$\",\"bytes\":\"ICIk\",\"prob\":0.0000927356886677444,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"pwd\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.7940845489502,\"token\":{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.5384446382522583,\"masked\":false},\"top_k\":[{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.5384446382522583,\"masked\":false},{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.16194474697113037,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.0702112466096878,\"masked\":false},{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.043811213225126266,\"masked\":false},{\"token\":\"touch\",\"bytes\":\"dG91Y2g=\",\"prob\":0.0398888923227787,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.25890731811523,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.985957145690918,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.985957145690918,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.013236399739980698,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.0001764551125233993,\"masked\":false},{\"token\":\" \\\"\\n\",\"bytes\":\"ICIK\",\"prob\":0.00006740938988514245,\"masked\":false},{\"token\":\"”\\n\",\"bytes\":\"4oCdCg==\",\"prob\":0.00004425784936756827,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"4\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.9580850601196289,\"token\":{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":0.99947589635849,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.9580850601196289,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.999847412109375,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":235.53776741027832,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9982300400733948,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9982300400733948,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.00026476013590581715,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.00020333303837105632,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":0.0001939044741448015,\"masked\":false},{\"token\":\" \\\"~\",\"bytes\":\"ICJ+\",\"prob\":0.00007120460213627666,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"mkdir\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.18604469299316,\"token\":{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.23979106545448303,\"masked\":false},\"top_k\":[{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.23979106545448303,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.16034242510795593,\"masked\":false},{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.13042761385440826,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.09271062165498734,\"masked\":false},{\"token\":\"touch\",\"bytes\":\"dG91Y2g=\",\"prob\":0.07646238058805466,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.48619270324707,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.988807201385498,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.988807201385498,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.00838035624474287,\"masked\":false},{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.0010318867862224579,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.00035032525192946196,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.00012039744615321979,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"5\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.8889436721801758,\"token\":{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":0.9992542862892151,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.8889436721801758,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9998844861984253,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":230.3481101989746,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9985209107398987,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9985209107398987,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.00025581225054338574,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":0.00013472647697199136,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.00013059058983344585,\"masked\":false},{\"token\":\" \\\"$\",\"bytes\":\"ICIk\",\"prob\":0.00005560881254496053,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"rm\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.02184677124023,\"token\":{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.5283508896827698,\"masked\":false},\"top_k\":[{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.5283508896827698,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.1457618623971939,\"masked\":false},{\"token\":\"touch\",\"bytes\":\"dG91Y2g=\",\"prob\":0.11701709777116776,\"masked\":false},{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.03728175535798073,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.02449987456202507,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.22688674926758,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.3051528036594391,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.3051528036594391,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.23379838466644287,\"masked\":false},{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.008221535943448544,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.0006611758144572377,\"masked\":false},{\"token\":\"/r\",\"bytes\":\"L3I=\",\"prob\":0.0005766217946074903,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":228.73997688293457,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":5.7368040873306825e-11,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"}],\"status\":\"Done\",\"shownMetrics\":[\"status\",\"consumed\",\"token reduction\",\"avg latency\"],\"metrics\":{\"status\":\"Done\",\"wall time\":0,\"consumed\":18,\"token reduction\":10,\"avg latency\":128.81250381469727,\"cpu\":[0.10687499999999998,0.6063125,0.6063125,0.861875,0.861875],\"gpu\":[0,0,0,0,0],\"ram\":53.436553955078125,\"vram\":0},\"requireFullReplay\":false,\"currentMessageId\":731,\"backtrackCount\":0,\"resetCount\":3}" } }, "2fb842560dca4f6684207c9020b9e7de": { "model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {} }, "3266dfc5a19e4e58b1c0597ba27626cd": { "model_module": "@guidance-ai/stitch", "model_module_version": "^0.1.5", "model_name": "StitchModel", "state": { "_model_module_version": "^0.1.5", "_view_module_version": "^0.1.5", "clientmsg": "{\"class_name\":\"ClientReadyMessage\"}", "initial_height": "auto", "initial_width": "100%", "kernelmsg": "{\"message_id\":950,\"last_trace_id\":448,\"is_err\":false,\"class_name\":\"ExecutionCompletedMessage\"}", "layout": "IPY_MODEL_c85f48e12b834cf291d0a2d3674b50d1", "srcdoc": "\n\n\n \n\n \n \n \n\n\n\n\n\n", "state": "{\"components\":[{\"value\":\"What\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\"What\",\"bytes\":\"V2hhdA==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" are\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" most\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" common\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" used\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" used\",\"bytes\":\"IHVzZWQ=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" in\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" Linux\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" operating\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" operating\",\"bytes\":\"IG9wZXJhdGluZw==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" system\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"?\\n\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\"?\\n\\n\",\"bytes\":\"PwoK\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"Here\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\"Here\",\"bytes\":\"SGVyZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" are\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"5\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" most\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" common\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" in\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" JSON\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" JSON\",\"bytes\":\"IEpTT04=\",\"prob\":1.5154529364735936e-7,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" format\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" format\",\"bytes\":\"IGZvcm1hdA==\",\"prob\":0.8799969553947449,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\":\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\":\\n\",\"bytes\":\"Ogo=\",\"prob\":0.240684375166893,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"{\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\"{\\n\",\"bytes\":\"ewo=\",\"prob\":0.6257462501525879,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" \",\"bytes\":\"ICAg\",\"prob\":0.10901488363742828,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9935357570648193,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"commands\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\"commands\",\"bytes\":\"Y29tbWFuZHM=\",\"prob\":0.11751189082860947,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\":\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":5.979714855071037,\"token\":{\"token\":\"\\\":\",\"bytes\":\"Ijo=\",\"prob\":0.9710926413536072,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" [\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":80.69682121276855,\"token\":{\"token\":\" [\",\"bytes\":\"IFs=\",\"prob\":0.00925849936902523,\"masked\":false},\"top_k\":[{\"token\":\" [\",\"bytes\":\"IFs=\",\"prob\":0.00925849936902523,\"masked\":false},{\"token\":\" [\\\"\",\"bytes\":\"IFsi\",\"prob\":0.0018438720144331455,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.00007188232120824978,\"masked\":false},{\"token\":\" appId\",\"bytes\":\"IGFwcElk\",\"prob\":6.393747293761964e-13,\"masked\":true},{\"token\":\" Clara\",\"bytes\":\"IENsYXJh\",\"prob\":1.8502004941155226e-13,\"masked\":true}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"/\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.23981285095215,\"token\":{\"token\":\"\\\"/\",\"bytes\":\"Ii8=\",\"prob\":0.0017557416576892138,\"masked\":false},\"top_k\":[{\"token\":\"\\\"/\",\"bytes\":\"Ii8=\",\"prob\":0.0017557416576892138,\"masked\":false},{\"token\":\"\\\".\",\"bytes\":\"Ii4=\",\"prob\":0.0013453332940116525,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.00010993643809342757,\"masked\":false},{\"token\":\"\\\"\\\"\",\"bytes\":\"IiI=\",\"prob\":0.00010977310739690438,\"masked\":false},{\"token\":\"\\\":\",\"bytes\":\"Ijo=\",\"prob\":0.00005929076360189356,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"bin\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.8430118560791,\"token\":{\"token\":\"bin\",\"bytes\":\"Ymlu\",\"prob\":0.8798083066940308,\"masked\":false},\"top_k\":[{\"token\":\"bin\",\"bytes\":\"Ymlu\",\"prob\":0.8798083066940308,\"masked\":false},{\"token\":\"usr\",\"bytes\":\"dXNy\",\"prob\":0.07783077657222748,\"masked\":false},{\"token\":\"sbin\",\"bytes\":\"c2Jpbg==\",\"prob\":0.017644789069890976,\"masked\":false},{\"token\":\"etc\",\"bytes\":\"ZXRj\",\"prob\":0.005883113481104374,\"masked\":false},{\"token\":\"home\",\"bytes\":\"aG9tZQ==\",\"prob\":0.005839033983647823,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"/bash\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.30396842956543,\"token\":{\"token\":\"/bash\",\"bytes\":\"L2Jhc2g=\",\"prob\":0.5857197046279907,\"masked\":false},\"top_k\":[{\"token\":\"/bash\",\"bytes\":\"L2Jhc2g=\",\"prob\":0.5857197046279907,\"masked\":false},{\"token\":\"/\",\"bytes\":\"Lw==\",\"prob\":0.17879532277584076,\"masked\":false},{\"token\":\"/sh\",\"bytes\":\"L3No\",\"prob\":0.13527542352676392,\"masked\":false},{\"token\":\"/cat\",\"bytes\":\"L2NhdA==\",\"prob\":0.03915807977318764,\"masked\":false},{\"token\":\"/c\",\"bytes\":\"L2M=\",\"prob\":0.016632553189992905,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\",\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":117.1729564666748,\"token\":{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"/\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.90628623962402,\"token\":{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.8226840496063232,\"masked\":false},\"top_k\":[{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.8226840496063232,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.16231930255889893,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.0033680906053632498,\"masked\":false},{\"token\":\" \\\"~\",\"bytes\":\"ICJ+\",\"prob\":0.0009498994913883507,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.0005381287774071097,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"bin\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.8409595489502,\"token\":{\"token\":\"bin\",\"bytes\":\"Ymlu\",\"prob\":0.6213171482086182,\"masked\":false},\"top_k\":[{\"token\":\"bin\",\"bytes\":\"Ymlu\",\"prob\":0.6213171482086182,\"masked\":false},{\"token\":\"usr\",\"bytes\":\"dXNy\",\"prob\":0.2661818563938141,\"masked\":false},{\"token\":\"etc\",\"bytes\":\"ZXRj\",\"prob\":0.05533278360962868,\"masked\":false},{\"token\":\"sbin\",\"bytes\":\"c2Jpbg==\",\"prob\":0.04046411067247391,\"masked\":false},{\"token\":\"home\",\"bytes\":\"aG9tZQ==\",\"prob\":0.006147177889943123,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"/\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.31882286071777,\"token\":{\"token\":\"/\",\"bytes\":\"Lw==\",\"prob\":0.38125112652778625,\"masked\":false},\"top_k\":[{\"token\":\"/\",\"bytes\":\"Lw==\",\"prob\":0.38125112652778625,\"masked\":false},{\"token\":\"/cat\",\"bytes\":\"L2NhdA==\",\"prob\":0.1945320963859558,\"masked\":false},{\"token\":\"/c\",\"bytes\":\"L2M=\",\"prob\":0.11453743278980255,\"masked\":false},{\"token\":\"/sh\",\"bytes\":\"L3No\",\"prob\":0.08640776574611664,\"masked\":false},{\"token\":\"/t\",\"bytes\":\"L3Q=\",\"prob\":0.05894554406404495,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"ls\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.30704689025879,\"token\":{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.8512558341026306,\"masked\":false},\"top_k\":[{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.8512558341026306,\"masked\":false},{\"token\":\"echo\",\"bytes\":\"ZWNobw==\",\"prob\":0.10273252427577972,\"masked\":false},{\"token\":\"ps\",\"bytes\":\"cHM=\",\"prob\":0.009788003750145435,\"masked\":false},{\"token\":\"true\",\"bytes\":\"dHJ1ZQ==\",\"prob\":0.007802457083016634,\"masked\":false},{\"token\":\"which\",\"bytes\":\"d2hpY2g=\",\"prob\":0.005383903160691261,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\",\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":116.81997776031494,\"token\":{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"/\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.88594818115234,\"token\":{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.9612060785293579,\"masked\":false},\"top_k\":[{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.9612060785293579,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.03558377921581268,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.000592987984418869,\"masked\":false},{\"token\":\" \\\"-\",\"bytes\":\"ICIt\",\"prob\":0.00035291543463245034,\"masked\":false},{\"token\":\" \\\"~\",\"bytes\":\"ICJ+\",\"prob\":0.0002579380525276065,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"bin\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.83626365661621,\"token\":{\"token\":\"bin\",\"bytes\":\"Ymlu\",\"prob\":0.6867547631263733,\"masked\":false},\"top_k\":[{\"token\":\"bin\",\"bytes\":\"Ymlu\",\"prob\":0.6867547631263733,\"masked\":false},{\"token\":\"usr\",\"bytes\":\"dXNy\",\"prob\":0.24826587736606598,\"masked\":false},{\"token\":\"etc\",\"bytes\":\"ZXRj\",\"prob\":0.029056668281555176,\"masked\":false},{\"token\":\"sbin\",\"bytes\":\"c2Jpbg==\",\"prob\":0.026288442313671112,\"masked\":false},{\"token\":\"home\",\"bytes\":\"aG9tZQ==\",\"prob\":0.0037724729627370834,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"/cat\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.42809104919434,\"token\":{\"token\":\"/cat\",\"bytes\":\"L2NhdA==\",\"prob\":0.6306703090667725,\"masked\":false},\"top_k\":[{\"token\":\"/cat\",\"bytes\":\"L2NhdA==\",\"prob\":0.6306703090667725,\"masked\":false},{\"token\":\"/p\",\"bytes\":\"L3A=\",\"prob\":0.10589814186096191,\"masked\":false},{\"token\":\"/c\",\"bytes\":\"L2M=\",\"prob\":0.06384644657373428,\"masked\":false},{\"token\":\"/\",\"bytes\":\"Lw==\",\"prob\":0.06002476438879967,\"masked\":false},{\"token\":\"/t\",\"bytes\":\"L3Q=\",\"prob\":0.03385966643691063,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\",\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":114.37094211578369,\"token\":{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"/\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.03297996520996,\"token\":{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.9769735932350159,\"masked\":false},\"top_k\":[{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.9769735932350159,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.020733937621116638,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.00027470593340694904,\"masked\":false},{\"token\":\" \\\"$\",\"bytes\":\"ICIk\",\"prob\":0.00019860586326103657,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.00016284172306768596,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"bin\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.665151596069336,\"token\":{\"token\":\"bin\",\"bytes\":\"Ymlu\",\"prob\":0.8411539793014526,\"masked\":false},\"top_k\":[{\"token\":\"bin\",\"bytes\":\"Ymlu\",\"prob\":0.8411539793014526,\"masked\":false},{\"token\":\"usr\",\"bytes\":\"dXNy\",\"prob\":0.12365630269050598,\"masked\":false},{\"token\":\"etc\",\"bytes\":\"ZXRj\",\"prob\":0.0154794966802001,\"masked\":false},{\"token\":\"sbin\",\"bytes\":\"c2Jpbg==\",\"prob\":0.015010742470622063,\"masked\":false},{\"token\":\"home\",\"bytes\":\"aG9tZQ==\",\"prob\":0.0012786550214514136,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"/\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.96000289916992,\"token\":{\"token\":\"/\",\"bytes\":\"Lw==\",\"prob\":0.2138916254043579,\"masked\":false},\"top_k\":[{\"token\":\"/\",\"bytes\":\"Lw==\",\"prob\":0.2138916254043579,\"masked\":false},{\"token\":\"/p\",\"bytes\":\"L3A=\",\"prob\":0.2002381980419159,\"masked\":false},{\"token\":\"/t\",\"bytes\":\"L3Q=\",\"prob\":0.18942375481128693,\"masked\":false},{\"token\":\"/r\",\"bytes\":\"L3I=\",\"prob\":0.11983252316713333,\"masked\":false},{\"token\":\"/m\",\"bytes\":\"L20=\",\"prob\":0.07639847695827484,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"echo\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.58906555175781,\"token\":{\"token\":\"echo\",\"bytes\":\"ZWNobw==\",\"prob\":0.6915608048439026,\"masked\":false},\"top_k\":[{\"token\":\"echo\",\"bytes\":\"ZWNobw==\",\"prob\":0.6915608048439026,\"masked\":false},{\"token\":\"ps\",\"bytes\":\"cHM=\",\"prob\":0.05090491473674774,\"masked\":false},{\"token\":\"who\",\"bytes\":\"d2hv\",\"prob\":0.04927121102809906,\"masked\":false},{\"token\":\"df\",\"bytes\":\"ZGY=\",\"prob\":0.03599591925740242,\"masked\":false},{\"token\":\"exit\",\"bytes\":\"ZXhpdA==\",\"prob\":0.02465679496526718,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\",\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":115.86606502532959,\"token\":{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"/\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.71993637084961,\"token\":{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.9849758744239807,\"masked\":false},\"top_k\":[{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.9849758744239807,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.013191334903240204,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.00019366166088730097,\"masked\":false},{\"token\":\" \\\"\\\\\",\"bytes\":\"ICJc\",\"prob\":0.00018695798644330353,\"masked\":false},{\"token\":\" \\\"$\",\"bytes\":\"ICIk\",\"prob\":0.0001631130580790341,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"bin\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.8038387298584,\"token\":{\"token\":\"bin\",\"bytes\":\"Ymlu\",\"prob\":0.9310422539710999,\"masked\":false},\"top_k\":[{\"token\":\"bin\",\"bytes\":\"Ymlu\",\"prob\":0.9310422539710999,\"masked\":false},{\"token\":\"usr\",\"bytes\":\"dXNy\",\"prob\":0.05150358006358147,\"masked\":false},{\"token\":\"sbin\",\"bytes\":\"c2Jpbg==\",\"prob\":0.007623995654284954,\"masked\":false},{\"token\":\"etc\",\"bytes\":\"ZXRj\",\"prob\":0.0074430969543755054,\"masked\":false},{\"token\":\"home\",\"bytes\":\"aG9tZQ==\",\"prob\":0.0005647586658596992,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"/p\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.73994255065918,\"token\":{\"token\":\"/p\",\"bytes\":\"L3A=\",\"prob\":0.20973291993141174,\"masked\":false},\"top_k\":[{\"token\":\"/p\",\"bytes\":\"L3A=\",\"prob\":0.20973291993141174,\"masked\":false},{\"token\":\"/t\",\"bytes\":\"L3Q=\",\"prob\":0.17998048663139343,\"masked\":false},{\"token\":\"/\",\"bytes\":\"Lw==\",\"prob\":0.14271694421768188,\"masked\":false},{\"token\":\"/date\",\"bytes\":\"L2RhdGU=\",\"prob\":0.11008136719465256,\"masked\":false},{\"token\":\"/r\",\"bytes\":\"L3I=\",\"prob\":0.10360969603061676,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"wd\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.98091125488281,\"token\":{\"token\":\"wd\",\"bytes\":\"d2Q=\",\"prob\":0.7624141573905945,\"masked\":false},\"top_k\":[{\"token\":\"wd\",\"bytes\":\"d2Q=\",\"prob\":0.7624141573905945,\"masked\":false},{\"token\":\"ing\",\"bytes\":\"aW5n\",\"prob\":0.1813955157995224,\"masked\":false},{\"token\":\"ause\",\"bytes\":\"YXVzZQ==\",\"prob\":0.017193183302879333,\"masked\":false},{\"token\":\"aste\",\"bytes\":\"YXN0ZQ==\",\"prob\":0.01326725073158741,\"masked\":false},{\"token\":\"ow\",\"bytes\":\"b3c=\",\"prob\":0.005533799063414335,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"],\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":20.316600799560547,\"token\":{\"token\":\"\\\"],\\n\",\"bytes\":\"Il0sCg==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":20.316600799560547,\"token\":{\"token\":\" \",\"bytes\":\"ICAg\",\"prob\":0.9911431074142456,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":20.316600799560547,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9994589686393738,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"my\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":20.316600799560547,\"token\":{\"token\":\"my\",\"bytes\":\"bXk=\",\"prob\":0.000023597487597726285,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"_favorite\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":20.316600799560547,\"token\":{\"token\":\"_favorite\",\"bytes\":\"X2Zhdm9yaXRl\",\"prob\":0.011106214486062527,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"_command\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":20.316600799560547,\"token\":{\"token\":\"_command\",\"bytes\":\"X2NvbW1hbmQ=\",\"prob\":0.46095213294029236,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\":\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":20.316600799560547,\"token\":{\"token\":\"\\\":\",\"bytes\":\"Ijo=\",\"prob\":0.9804574847221375,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"/\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.62809371948242,\"token\":{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.8816839456558228,\"masked\":false},\"top_k\":[{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.8816839456558228,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.0739331766963005,\"masked\":false},{\"token\":\" \\\"\\\\\\\"\",\"bytes\":\"ICJcIg==\",\"prob\":0.00273113907314837,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.0018700890941545367,\"masked\":false},{\"token\":\" \\\"[\",\"bytes\":\"ICJb\",\"prob\":0.0012881316943094134,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"bin\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.76721572875977,\"token\":{\"token\":\"bin\",\"bytes\":\"Ymlu\",\"prob\":0.9779045581817627,\"masked\":false},\"top_k\":[{\"token\":\"bin\",\"bytes\":\"Ymlu\",\"prob\":0.9779045581817627,\"masked\":false},{\"token\":\"usr\",\"bytes\":\"dXNy\",\"prob\":0.01698402687907219,\"masked\":false},{\"token\":\"sbin\",\"bytes\":\"c2Jpbg==\",\"prob\":0.0011394703760743141,\"masked\":false},{\"token\":\"home\",\"bytes\":\"aG9tZQ==\",\"prob\":0.000918267760425806,\"masked\":false},{\"token\":\"etc\",\"bytes\":\"ZXRj\",\"prob\":0.0007563815452158451,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"/\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.4060115814209,\"token\":{\"token\":\"/\",\"bytes\":\"Lw==\",\"prob\":0.6157679557800293,\"masked\":false},\"top_k\":[{\"token\":\"/\",\"bytes\":\"Lw==\",\"prob\":0.6157679557800293,\"masked\":false},{\"token\":\"/p\",\"bytes\":\"L3A=\",\"prob\":0.19636768102645874,\"masked\":false},{\"token\":\"/bash\",\"bytes\":\"L2Jhc2g=\",\"prob\":0.08680503070354462,\"masked\":false},{\"token\":\"/cat\",\"bytes\":\"L2NhdA==\",\"prob\":0.07029041647911072,\"masked\":false},{\"token\":\"/s\",\"bytes\":\"L3M=\",\"prob\":0.0038633376825600863,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"ls\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.04511833190918,\"token\":{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.7012960910797119,\"masked\":false},\"top_k\":[{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.7012960910797119,\"masked\":false},{\"token\":\"echo\",\"bytes\":\"ZWNobw==\",\"prob\":0.2829231321811676,\"masked\":false},{\"token\":\"ps\",\"bytes\":\"cHM=\",\"prob\":0.0046838936395943165,\"masked\":false},{\"token\":\"who\",\"bytes\":\"d2hv\",\"prob\":0.0011231121607124805,\"masked\":false},{\"token\":\"less\",\"bytes\":\"bGVzcw==\",\"prob\":0.0008115110686048865,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":117.82491207122803,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"}\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":117.82491207122803,\"token\":{\"token\":\"}\",\"bytes\":\"fQ==\",\"prob\":0.34431540966033936,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"}],\"status\":\"Done\",\"shownMetrics\":[\"status\",\"consumed\",\"token reduction\",\"avg latency\"],\"metrics\":{\"status\":\"Done\",\"wall time\":0,\"consumed\":37,\"token reduction\":2.631578947368421,\"avg latency\":94.27028580715782,\"cpu\":[0.85125,0.85125,0.8489375,0.8489375,0.8421875],\"gpu\":[0,0,0,0,0],\"ram\":53.39891052246094,\"vram\":0},\"requireFullReplay\":false,\"currentMessageId\":950,\"backtrackCount\":13,\"resetCount\":2}" } }, "3a6ecef146ce4dda896312803b78d0ec": { "model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_fb320b3c79c34a31bc59ceeb935c40e8", "style": "IPY_MODEL_974b55d923ef4c119a588cc6bf359abc", "value": " 2/2 [00:03<00:00,  1.53s/it]" } }, "40acb4fb79b04a49931f5aa406e4473a": { "model_module": "@guidance-ai/stitch", "model_module_version": "^0.1.5", "model_name": "StitchModel", "state": { "_model_module_version": "^0.1.5", "_view_module_version": "^0.1.5", "clientmsg": "{\"class_name\":\"ClientReadyMessage\"}", "initial_height": "auto", "initial_width": "100%", "kernelmsg": "{\"message_id\":417,\"last_trace_id\":215,\"is_err\":false,\"class_name\":\"ExecutionCompletedMessage\"}", "layout": "IPY_MODEL_0a5e6064b82c46df90ab32adf950299f", "srcdoc": "\n\n\n \n\n \n \n \n\n\n\n\n\n", "state": "{\"components\":[{\"value\":\"What\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\"What\",\"bytes\":\"V2hhdA==\",\"prob\":1,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" are\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":0.12485294044017792,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.6439812183380127,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" most\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":0.10567004233598709,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" common\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":0.07743782550096512,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.000018182327039539814,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" used\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" used\",\"bytes\":\"IHVzZWQ=\",\"prob\":0.4469224214553833,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" in\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.5803957581520081,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.12090881168842316,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" Linux\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.08506865054368973,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" operating\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" operating\",\"bytes\":\"IG9wZXJhdGluZw==\",\"prob\":0.10368891060352325,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" system\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.9987327456474304,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"?\\n\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\"?\\n\\n\",\"bytes\":\"PwoK\",\"prob\":0.08934058248996735,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"Here\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\"Here\",\"bytes\":\"SGVyZQ==\",\"prob\":0.048368725925683975,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" are\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":0.6524742245674133,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.03937135264277458,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.019184362143278122,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"5\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":0.09037967026233673,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" most\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":0.5897620320320129,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" common\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":0.777923047542572,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.8106732964515686,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\":\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\":\\n\",\"bytes\":\"Ogo=\",\"prob\":0.0021743644028902054,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"1\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":0.46098461747169495,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":8.372678756713867,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.956274151802063,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.21086120605469,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.02442573383450508,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.02442573383450508,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.0029949175659567118,\"masked\":false},{\"token\":\" \\\"$\",\"bytes\":\"ICIk\",\"prob\":0.000034639189834706485,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.000028989972634008154,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.000016217622032854706,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"ls\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.87441062927246,\"token\":{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.760443389415741,\"masked\":false},\"top_k\":[{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.760443389415741,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.62502479553223,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.7383413910865784,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.7383413910865784,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.07611274719238,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.5673753619194031,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.5673753619194031,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" List\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.1090145111084,\"token\":{\"token\":\" List\",\"bytes\":\"IExpc3Q=\",\"prob\":0.18996906280517578,\"masked\":false},\"top_k\":[{\"token\":\" List\",\"bytes\":\"IExpc3Q=\",\"prob\":0.18996906280517578,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" files\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.73994255065918,\"token\":{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.36917153000831604,\"masked\":false},\"top_k\":[{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.36917153000831604,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.12108039855957,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.7368223667144775,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.7368223667144775,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directories\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.94989585876465,\"token\":{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.8227725625038147,\"masked\":false},\"top_k\":[{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.8227725625038147,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.26072120666504,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.456794410943985,\"masked\":false},\"top_k\":[{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.456794410943985,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"2\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.91219520568848,\"token\":{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":0.9939073920249939,\"masked\":false},\"top_k\":[{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":0.9939073920249939,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.5429573059082,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.999566376209259,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.999566376209259,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.9549446105957,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9986825585365295,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9986825585365295,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"cd\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.89086151123047,\"token\":{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.788211464881897,\"masked\":false},\"top_k\":[{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.788211464881897,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.9948844909668,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9992539286613464,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9992539286613464,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.26310539245605,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9967222809791565,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9967222809791565,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Change\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.2240047454834,\"token\":{\"token\":\" Change\",\"bytes\":\"IENoYW5nZQ==\",\"prob\":0.9948050379753113,\"masked\":false},\"top_k\":[{\"token\":\" Change\",\"bytes\":\"IENoYW5nZQ==\",\"prob\":0.9948050379753113,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directory\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.9650821685791,\"token\":{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.8109842538833618,\"masked\":false},\"top_k\":[{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.8109842538833618,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.06316566467285,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9572502374649048,\"masked\":false},\"top_k\":[{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9572502374649048,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"3\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.66197967529297,\"token\":{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":0.9992125034332275,\"masked\":false},\"top_k\":[{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":0.9992125034332275,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.49184226989746,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9998443126678467,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9998443126678467,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.98494338989258,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9988921284675598,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9988921284675598,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"pwd\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.77179718017578,\"token\":{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.5655272603034973,\"masked\":false},\"top_k\":[{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.5655272603034973,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.30506706237793,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9996194839477539,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9996194839477539,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.04001808166504,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9987234473228455,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9987234473228455,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Print\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.55397605895996,\"token\":{\"token\":\" Print\",\"bytes\":\"IFByaW50\",\"prob\":0.9366645216941833,\"masked\":false},\"top_k\":[{\"token\":\" Print\",\"bytes\":\"IFByaW50\",\"prob\":0.9366645216941833,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" working\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.32628631591797,\"token\":{\"token\":\" working\",\"bytes\":\"IHdvcmtpbmc=\",\"prob\":0.7763296961784363,\"masked\":false},\"top_k\":[{\"token\":\" working\",\"bytes\":\"IHdvcmtpbmc=\",\"prob\":0.7763296961784363,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directory\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.82801246643066,\"token\":{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.9982600808143616,\"masked\":false},\"top_k\":[{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.9982600808143616,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.46990776062012,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9517079591751099,\"masked\":false},\"top_k\":[{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9517079591751099,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"4\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.162109375,\"token\":{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":0.9995410442352295,\"masked\":false},\"top_k\":[{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":0.9995410442352295,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.58196449279785,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999198913574219,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999198913574219,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.72804260253906,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9991204142570496,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9991204142570496,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"mkdir\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.6408748626709,\"token\":{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.27454105019569397,\"masked\":false},\"top_k\":[{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.27454105019569397,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.7413215637207,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9982007741928101,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9982007741928101,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.38097763061523,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9955072402954102,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9955072402954102,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Make\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":72.51501083374023,\"token\":{\"token\":\" Make\",\"bytes\":\"IE1ha2U=\",\"prob\":0.5494526624679565,\"masked\":false},\"top_k\":[{\"token\":\" Make\",\"bytes\":\"IE1ha2U=\",\"prob\":0.5494526624679565,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.16711616516113,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.612680196762085,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.612680196762085,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" new\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.0339126586914,\"token\":{\"token\":\" new\",\"bytes\":\"IG5ldw==\",\"prob\":0.7250748872756958,\"masked\":false},\"top_k\":[{\"token\":\" new\",\"bytes\":\"IG5ldw==\",\"prob\":0.7250748872756958,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directory\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.5862045288086,\"token\":{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.9916713237762451,\"masked\":false},\"top_k\":[{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.9916713237762451,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":72.7689266204834,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9872851967811584,\"masked\":false},\"top_k\":[{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9872851967811584,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"5\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.31702995300293,\"token\":{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":0.9995552897453308,\"masked\":false},\"top_k\":[{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":0.9995552897453308,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.05278968811035,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999109506607056,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999109506607056,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":75.836181640625,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9993341565132141,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9993341565132141,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"rm\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":80.35492897033691,\"token\":{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.6215828657150269,\"masked\":false},\"top_k\":[{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.6215828657150269,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":73.92477989196777,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9881768822669983,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9881768822669983,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.41699981689453,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9926444292068481,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9926444292068481,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Remove\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.44909286499023,\"token\":{\"token\":\" Remove\",\"bytes\":\"IFJlbW92ZQ==\",\"prob\":0.9440552592277527,\"masked\":false},\"top_k\":[{\"token\":\" Remove\",\"bytes\":\"IFJlbW92ZQ==\",\"prob\":0.9440552592277527,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" files\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":72.76320457458496,\"token\":{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.5267410278320312,\"masked\":false},\"top_k\":[{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.5267410278320312,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.96860694885254,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.5064697861671448,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.5064697861671448,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directories\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.05000114440918,\"token\":{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.986896812915802,\"masked\":false},\"top_k\":[{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.986896812915802,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.61796569824219,\"token\":{\"token\":\"\\n\\n\",\"bytes\":\"Cgo=\",\"prob\":0.4259198307991028,\"masked\":false},\"top_k\":[{\"token\":\"\\n\\n\",\"bytes\":\"Cgo=\",\"prob\":0.4259198307991028,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"Can\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.43502616882324,\"token\":{\"token\":\"Can\",\"bytes\":\"Q2Fu\",\"prob\":0.27701595425605774,\"masked\":false},\"top_k\":[{\"token\":\"Can\",\"bytes\":\"Q2Fu\",\"prob\":0.27701595425605774,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" you\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.94771957397461,\"token\":{\"token\":\" you\",\"bytes\":\"IHlvdQ==\",\"prob\":0.9680576920509338,\"masked\":false},\"top_k\":[{\"token\":\" you\",\"bytes\":\"IHlvdQ==\",\"prob\":0.9680576920509338,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" give\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.34809684753418,\"token\":{\"token\":\" give\",\"bytes\":\"IGdpdmU=\",\"prob\":0.35760530829429626,\"masked\":false},\"top_k\":[{\"token\":\" give\",\"bytes\":\"IGdpdmU=\",\"prob\":0.35760530829429626,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" me\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.48414039611816,\"token\":{\"token\":\" me\",\"bytes\":\"IG1l\",\"prob\":0.8640272617340088,\"masked\":false},\"top_k\":[{\"token\":\" me\",\"bytes\":\"IG1l\",\"prob\":0.8640272617340088,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" an\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.56210327148438,\"token\":{\"token\":\" an\",\"bytes\":\"IGFu\",\"prob\":0.4429512321949005,\"masked\":false},\"top_k\":[{\"token\":\" an\",\"bytes\":\"IGFu\",\"prob\":0.4429512321949005,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" example\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.09315490722656,\"token\":{\"token\":\" example\",\"bytes\":\"IGV4YW1wbGU=\",\"prob\":0.988312304019928,\"masked\":false},\"top_k\":[{\"token\":\" example\",\"bytes\":\"IGV4YW1wbGU=\",\"prob\":0.988312304019928,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" of\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":86.5790843963623,\"token\":{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.9925596714019775,\"masked\":false},\"top_k\":[{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.9925596714019775,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" how\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.96784019470215,\"token\":{\"token\":\" how\",\"bytes\":\"IGhvdw==\",\"prob\":0.8471696972846985,\"masked\":false},\"top_k\":[{\"token\":\" how\",\"bytes\":\"IGhvdw==\",\"prob\":0.8471696972846985,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" to\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.48280334472656,\"token\":{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.9511277079582214,\"masked\":false},\"top_k\":[{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.9511277079582214,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" use\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.7629451751709,\"token\":{\"token\":\" use\",\"bytes\":\"IHVzZQ==\",\"prob\":0.9291983842849731,\"masked\":false},\"top_k\":[{\"token\":\" use\",\"bytes\":\"IHVzZQ==\",\"prob\":0.9291983842849731,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.8009262084961,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.7959004640579224,\"masked\":false},\"top_k\":[{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.7959004640579224,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.44608688354492,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.961881160736084,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.961881160736084,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"ls\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.5726146697998,\"token\":{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.47295498847961426,\"masked\":false},\"top_k\":[{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.47295498847961426,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.95525550842285,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9998377561569214,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9998377561569214,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" command\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.26400756835938,\"token\":{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.9995614886283875,\"masked\":false},\"top_k\":[{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.9995614886283875,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" to\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.14320182800293,\"token\":{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.6083309054374695,\"masked\":false},\"top_k\":[{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.6083309054374695,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" list\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.19398498535156,\"token\":{\"token\":\" list\",\"bytes\":\"IGxpc3Q=\",\"prob\":0.8687452673912048,\"masked\":false},\"top_k\":[{\"token\":\" list\",\"bytes\":\"IGxpc3Q=\",\"prob\":0.8687452673912048,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" all\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.68910789489746,\"token\":{\"token\":\" all\",\"bytes\":\"IGFsbA==\",\"prob\":0.5784941911697388,\"masked\":false},\"top_k\":[{\"token\":\" all\",\"bytes\":\"IGFsbA==\",\"prob\":0.5784941911697388,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" files\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.3199634552002,\"token\":{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.7376222014427185,\"masked\":false},\"top_k\":[{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.7376222014427185,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.56100463867188,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.6151462197303772,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.6151462197303772,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directories\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.48494911193848,\"token\":{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.9505907893180847,\"masked\":false},\"top_k\":[{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.9505907893180847,\"masked\":false}],\"class_name\":\"TokenOutput\"}],\"status\":\"Done\",\"shownMetrics\":[\"status\",\"consumed\",\"token reduction\",\"avg latency\"],\"metrics\":{\"status\":\"Done\",\"wall time\":0,\"consumed\":72,\"token reduction\":0,\"avg latency\":71.1929698785146,\"cpu\":[0.8338125,0.8338125,0.8825,0.8825,0.8834375],\"gpu\":[0,0,0,0,0],\"ram\":53.189178466796875,\"vram\":0},\"requireFullReplay\":false,\"currentMessageId\":417,\"backtrackCount\":1,\"resetCount\":3}" } }, "5e96b22b6dc84c45b996e31eb3565743": { "model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_abfc327afcc0442eb6602323879c34bb", "style": "IPY_MODEL_6408408de0db4ccb9dec35224dc7b5c7", "value": "Loading checkpoint shards: 100%" } }, "5fe41183c5cf44daabf99c8d37a544d9": { "model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_5e96b22b6dc84c45b996e31eb3565743", "IPY_MODEL_06e3685e7b4d404086e39f84d849f15b", "IPY_MODEL_3a6ecef146ce4dda896312803b78d0ec" ], "layout": "IPY_MODEL_177d7e850d494873b9aa31e50866b9db" } }, "6408408de0db4ccb9dec35224dc7b5c7": { "model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": { "description_width": "", "font_size": null, "text_color": null } }, "661190edff1a45ef9c1d0a451051bede": { "model_module": "@guidance-ai/stitch", "model_module_version": "^0.1.5", "model_name": "StitchModel", "state": { "_model_module_version": "^0.1.5", "_view_module_version": "^0.1.5", "clientmsg": "{\"class_name\":\"ClientReadyMessage\"}", "initial_height": "auto", "initial_width": "100%", "kernelmsg": "{\"message_id\":1570,\"last_trace_id\":798,\"is_err\":false,\"class_name\":\"ExecutionCompletedMessage\"}", "layout": "IPY_MODEL_f5514c47cb84430b904ba932132c7d9f", "srcdoc": "\n\n\n \n\n \n \n \n\n\n\n\n\n", "state": "{\"components\":[{\"value\":\"1\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":48.932600021362305,\"token\":{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":48.932600021362305,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.99480801820755,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":48.932600021362305,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.024793263524770737,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"ls\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":48.932600021362305,\"token\":{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.7572663426399231,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":48.932600021362305,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.0009888432687148452,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"2\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.45598575047084,\"token\":{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.45598575047084,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9998650550842285,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.45598575047084,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9986674785614014,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"touch\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.45598575047084,\"token\":{\"token\":\"touch\",\"bytes\":\"dG91Y2g=\",\"prob\":0.002183484146371484,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" file\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.45598575047084,\"token\":{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.0033939483109861612,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".txt\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.45598575047084,\"token\":{\"token\":\".txt\",\"bytes\":\"LnR4dA==\",\"prob\":0.48190444707870483,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.45598575047084,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.9816049933433533,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"3\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":48.27136993408203,\"token\":{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":48.27136993408203,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999090433120728,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":48.27136993408203,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.998904824256897,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"use\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":48.27136993408203,\"token\":{\"token\":\"use\",\"bytes\":\"dXNl\",\"prob\":0.0000026782720397022786,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":48.27136993408203,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.16533362865447998,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"4\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":39.582014083862305,\"token\":{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":39.582014083862305,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9997933506965637,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":39.582014083862305,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.990234375,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"title\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":39.582014083862305,\"token\":{\"token\":\"title\",\"bytes\":\"dGl0bGU=\",\"prob\":0.000006274350653256988,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" Configuration\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":39.582014083862305,\"token\":{\"token\":\" Configuration\",\"bytes\":\"IENvbmZpZ3VyYXRpb24=\",\"prob\":0.000008103555956040509,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":39.582014083862305,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.45836567878723145,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"5\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":47.92633056640625,\"token\":{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":47.92633056640625,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9997469782829285,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":47.92633056640625,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9794623255729675,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"grep\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":47.92633056640625,\"token\":{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.00897296704351902,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":47.92633056640625,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.6275609135627747,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"6\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":14.18741544087728,\"token\":{\"token\":\"6\",\"bytes\":\"Ng==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":14.18741544087728,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9997583031654358,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":14.18741544087728,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9910638332366943,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"ls\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":14.18741544087728,\"token\":{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.016190180554986,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":14.18741544087728,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.7127885818481445,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"l\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":14.18741544087728,\"token\":{\"token\":\"l\",\"bytes\":\"bA==\",\"prob\":0.6905145645141602,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" /\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":14.18741544087728,\"token\":{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.0065053915604949,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"path\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":14.18741544087728,\"token\":{\"token\":\"path\",\"bytes\":\"cGF0aA==\",\"prob\":0.0296719241887331,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"/to\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":14.18741544087728,\"token\":{\"token\":\"/to\",\"bytes\":\"L3Rv\",\"prob\":0.6662114262580872,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"/d\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":14.18741544087728,\"token\":{\"token\":\"/d\",\"bytes\":\"L2Q=\",\"prob\":0.6255491971969604,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"irectory\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":14.18741544087728,\"token\":{\"token\":\"irectory\",\"bytes\":\"aXJlY3Rvcnk=\",\"prob\":0.9994609951972961,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":14.18741544087728,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.9421985745429993,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"7\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.892700467790878,\"token\":{\"token\":\"7\",\"bytes\":\"Nw==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.892700467790878,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.999774158000946,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.892700467790878,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9923639297485352,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"ls\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.892700467790878,\"token\":{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.01872631348669529,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.892700467790878,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.791642963886261,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"l\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.892700467790878,\"token\":{\"token\":\"l\",\"bytes\":\"bA==\",\"prob\":0.40139567852020264,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":25.892700467790878,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.125536248087883,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"8\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":18.134435017903645,\"token\":{\"token\":\"8\",\"bytes\":\"OA==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":18.134435017903645,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9997474551200867,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"/\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":18.134435017903645,\"token\":{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.003511323593556881,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"bin\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":18.134435017903645,\"token\":{\"token\":\"bin\",\"bytes\":\"Ymlu\",\"prob\":0.12665420770645142,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"/bash\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":18.134435017903645,\"token\":{\"token\":\"/bash\",\"bytes\":\"L2Jhc2g=\",\"prob\":0.3918580412864685,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" ~/\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":18.134435017903645,\"token\":{\"token\":\" ~/\",\"bytes\":\"IH4v\",\"prob\":0.00020363304065540433,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"shell\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":18.134435017903645,\"token\":{\"token\":\"shell\",\"bytes\":\"c2hlbGw=\",\"prob\":0.012310606427490711,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".sh\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":18.134435017903645,\"token\":{\"token\":\".sh\",\"bytes\":\"LnNo\",\"prob\":0.12268385291099548,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":18.134435017903645,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.9124263525009155,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"Perhaps\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.5713224411010742,\"token\":{\"token\":\"Perhaps\",\"bytes\":\"UGVyaGFwcw==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.5713224411010742,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.054163604974746704,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" most\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.5713224411010742,\"token\":{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":0.7193540334701538,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" useful\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.5713224411010742,\"token\":{\"token\":\" useful\",\"bytes\":\"IHVzZWZ1bA==\",\"prob\":0.06137605011463165,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" command\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.5713224411010742,\"token\":{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.3277232348918915,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" from\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.5713224411010742,\"token\":{\"token\":\" from\",\"bytes\":\"IGZyb20=\",\"prob\":0.001602712320163846,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" that\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.5713224411010742,\"token\":{\"token\":\" that\",\"bytes\":\"IHRoYXQ=\",\"prob\":0.01585453189909458,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" list\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.5713224411010742,\"token\":{\"token\":\" list\",\"bytes\":\"IGxpc3Q=\",\"prob\":0.8648644089698792,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" is\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.5713224411010742,\"token\":{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.5935595035552979,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\":\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.5713224411010742,\"token\":{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.006826426833868027,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":165.36402702331543,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.4878973662853241,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.4878973662853241,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.052498698234558105,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.02604854106903076,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.0008826354751363397,\"masked\":false},{\"token\":\" \\\"$\",\"bytes\":\"ICIk\",\"prob\":0.0007869061664678156,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"ls\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.28999519348145,\"token\":{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.493320494890213,\"masked\":false},\"top_k\":[{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.493320494890213,\"masked\":false},{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.14321956038475037,\"masked\":false},{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.09891357272863388,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.03332354873418808,\"masked\":false},{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.018404237926006317,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.41602516174316,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.23934738337993622,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.23934738337993622,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.1970662623643875,\"masked\":false},{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.07912690192461014,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":0.011163998395204544,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.005801602266728878,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"l\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.57783889770508,\"token\":{\"token\":\"l\",\"bytes\":\"bA==\",\"prob\":0.955055832862854,\"masked\":false},\"top_k\":[{\"token\":\"l\",\"bytes\":\"bA==\",\"prob\":0.955055832862854,\"masked\":false},{\"token\":\"la\",\"bytes\":\"bGE=\",\"prob\":0.01341050025075674,\"masked\":false},{\"token\":\"al\",\"bytes\":\"YWw=\",\"prob\":0.005906084086745977,\"masked\":false},{\"token\":\"a\",\"bytes\":\"YQ==\",\"prob\":0.003542175516486168,\"masked\":false},{\"token\":\"lh\",\"bytes\":\"bGg=\",\"prob\":0.0032541367691010237,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.34585762023926,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.2576845586299896,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.2576845586299896,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.1917182058095932,\"masked\":false},{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.05475110188126564,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":0.008607196621596813,\"masked\":false},{\"token\":\" ~/\",\"bytes\":\"IH4v\",\"prob\":0.0032283207401633263,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":1.6158819198608398,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":5.866784391628244e-9,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" because\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":1.6158819198608398,\"token\":{\"token\":\" because\",\"bytes\":\"IGJlY2F1c2U=\",\"prob\":0.03870103508234024,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" it\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":248.72708320617676,\"token\":{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.8751698732376099,\"masked\":false},\"top_k\":[{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.8751698732376099,\"masked\":false},{\"token\":\" you\",\"bytes\":\"IHlvdQ==\",\"prob\":0.03541646897792816,\"masked\":false},{\"token\":\" this\",\"bytes\":\"IHRoaXM=\",\"prob\":0.01073345448821783,\"masked\":false},{\"token\":\" with\",\"bytes\":\"IHdpdGg=\",\"prob\":0.007500122766941786,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.006618494167923927,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" shows\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.93613052368164,\"token\":{\"token\":\" shows\",\"bytes\":\"IHNob3dz\",\"prob\":0.16858801245689392,\"masked\":false},\"top_k\":[{\"token\":\" shows\",\"bytes\":\"IHNob3dz\",\"prob\":0.16858801245689392,\"masked\":false},{\"token\":\" gives\",\"bytes\":\"IGdpdmVz\",\"prob\":0.12914805114269257,\"masked\":false},{\"token\":\" provides\",\"bytes\":\"IHByb3ZpZGVz\",\"prob\":0.09557298570871353,\"masked\":false},{\"token\":\" lists\",\"bytes\":\"IGxpc3Rz\",\"prob\":0.09319198131561279,\"masked\":false},{\"token\":\" displays\",\"bytes\":\"IGRpc3BsYXlz\",\"prob\":0.08604083210229874,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" you\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":82.76987075805664,\"token\":{\"token\":\" you\",\"bytes\":\"IHlvdQ==\",\"prob\":0.44502127170562744,\"masked\":false},\"top_k\":[{\"token\":\" you\",\"bytes\":\"IHlvdQ==\",\"prob\":0.44502127170562744,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.15422441065311432,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.13839836418628693,\"masked\":false},{\"token\":\" all\",\"bytes\":\"IGFsbA==\",\"prob\":0.06275742501020432,\"masked\":false},{\"token\":\" detailed\",\"bytes\":\"IGRldGFpbGVk\",\"prob\":0.01939016580581665,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":74.09191131591797,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.3422989845275879,\"masked\":false},\"top_k\":[{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.3422989845275879,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.22294729948043823,\"masked\":false},{\"token\":\" all\",\"bytes\":\"IGFsbA==\",\"prob\":0.06830132007598877,\"masked\":false},{\"token\":\" what\",\"bytes\":\"IHdoYXQ=\",\"prob\":0.04466036334633827,\"masked\":false},{\"token\":\" exactly\",\"bytes\":\"IGV4YWN0bHk=\",\"prob\":0.03223004937171936,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" permissions\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.08893585205078,\"token\":{\"token\":\" permissions\",\"bytes\":\"IHBlcm1pc3Npb25z\",\"prob\":0.21989965438842773,\"masked\":false},\"top_k\":[{\"token\":\" permissions\",\"bytes\":\"IHBlcm1pc3Npb25z\",\"prob\":0.21989965438842773,\"masked\":false},{\"token\":\" size\",\"bytes\":\"IHNpemU=\",\"prob\":0.1255974918603897,\"masked\":false},{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.10511189699172974,\"masked\":false},{\"token\":\" details\",\"bytes\":\"IGRldGFpbHM=\",\"prob\":0.06951329857110977,\"masked\":false},{\"token\":\" full\",\"bytes\":\"IGZ1bGw=\",\"prob\":0.04865006357431412,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.63713264465332,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.46988317370414734,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.46988317370414734,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.214617520570755,\"masked\":false},{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.09741967916488647,\"masked\":false},{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.07943159341812134,\"masked\":false},{\"token\":\" on\",\"bytes\":\"IG9u\",\"prob\":0.058368001133203506,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" owner\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":72.65925407409668,\"token\":{\"token\":\" owner\",\"bytes\":\"IG93bmVy\",\"prob\":0.3120392858982086,\"masked\":false},\"top_k\":[{\"token\":\" owner\",\"bytes\":\"IG93bmVy\",\"prob\":0.3120392858982086,\"masked\":false},{\"token\":\" ownership\",\"bytes\":\"IG93bmVyc2hpcA==\",\"prob\":0.190913587808609,\"masked\":false},{\"token\":\" size\",\"bytes\":\"IHNpemU=\",\"prob\":0.10337629169225693,\"masked\":false},{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.07200054824352264,\"masked\":false},{\"token\":\" user\",\"bytes\":\"IHVzZXI=\",\"prob\":0.036365121603012085,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.38824462890625,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.9121604561805725,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.9121604561805725,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.06884057819843292,\"masked\":false},{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.003696305910125375,\"masked\":false},{\"token\":\"/group\",\"bytes\":\"L2dyb3Vw\",\"prob\":0.002161850454285741,\"masked\":false},{\"token\":\" name\",\"bytes\":\"IG5hbWU=\",\"prob\":0.0020368369296193123,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" group\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.3209171295166,\"token\":{\"token\":\" group\",\"bytes\":\"IGdyb3Vw\",\"prob\":0.49393409490585327,\"masked\":false},\"top_k\":[{\"token\":\" group\",\"bytes\":\"IGdyb3Vw\",\"prob\":0.49393409490585327,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.29038214683532715,\"masked\":false},{\"token\":\" size\",\"bytes\":\"IHNpemU=\",\"prob\":0.11457307636737823,\"masked\":false},{\"token\":\" date\",\"bytes\":\"IGRhdGU=\",\"prob\":0.01996305026113987,\"masked\":false},{\"token\":\" etc\",\"bytes\":\"IGV0Yw==\",\"prob\":0.011258200742304325,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.04110717773438,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.8322581052780151,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.8322581052780151,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.13122276961803436,\"masked\":false},{\"token\":\" owner\",\"bytes\":\"IG93bmVy\",\"prob\":0.0067885019816458225,\"masked\":false},{\"token\":\" ownership\",\"bytes\":\"IG93bmVyc2hpcA==\",\"prob\":0.005433459300547838,\"masked\":false},{\"token\":\" name\",\"bytes\":\"IG5hbWU=\",\"prob\":0.005375947803258896,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" size\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.85893440246582,\"token\":{\"token\":\" size\",\"bytes\":\"IHNpemU=\",\"prob\":0.39940425753593445,\"masked\":false},\"top_k\":[{\"token\":\" size\",\"bytes\":\"IHNpemU=\",\"prob\":0.39940425753593445,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.3904520869255066,\"masked\":false},{\"token\":\" etc\",\"bytes\":\"IGV0Yw==\",\"prob\":0.02632186748087406,\"masked\":false},{\"token\":\" date\",\"bytes\":\"IGRhdGU=\",\"prob\":0.02346108667552471,\"masked\":false},{\"token\":\" number\",\"bytes\":\"IG51bWJlcg==\",\"prob\":0.021086694672703743,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":72.14808464050293,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.8296368718147278,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.8296368718147278,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.14382952451705933,\"masked\":false},{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.014361453242599964,\"masked\":false},{\"token\":\" etc\",\"bytes\":\"IGV0Yw==\",\"prob\":0.0052371216006577015,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.0022374584805220366,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.19503211975098,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.5416485667228699,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.5416485667228699,\"masked\":false},{\"token\":\" date\",\"bytes\":\"IGRhdGU=\",\"prob\":0.1766381710767746,\"masked\":false},{\"token\":\" modification\",\"bytes\":\"IG1vZGlmaWNhdGlvbg==\",\"prob\":0.07152076065540314,\"masked\":false},{\"token\":\" etc\",\"bytes\":\"IGV0Yw==\",\"prob\":0.033511389046907425,\"masked\":false},{\"token\":\" last\",\"bytes\":\"IGxhc3Q=\",\"prob\":0.029758043587207794,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" modification\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.53389739990234,\"token\":{\"token\":\" modification\",\"bytes\":\"IG1vZGlmaWNhdGlvbg==\",\"prob\":0.29289814829826355,\"masked\":false},\"top_k\":[{\"token\":\" modification\",\"bytes\":\"IG1vZGlmaWNhdGlvbg==\",\"prob\":0.29289814829826355,\"masked\":false},{\"token\":\" date\",\"bytes\":\"IGRhdGU=\",\"prob\":0.23483014106750488,\"masked\":false},{\"token\":\" last\",\"bytes\":\"IGxhc3Q=\",\"prob\":0.14531821012496948,\"masked\":false},{\"token\":\" time\",\"bytes\":\"IHRpbWU=\",\"prob\":0.08814667165279388,\"masked\":false},{\"token\":\" other\",\"bytes\":\"IG90aGVy\",\"prob\":0.038026560097932816,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" date\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.26217269897461,\"token\":{\"token\":\" date\",\"bytes\":\"IGRhdGU=\",\"prob\":0.7260234951972961,\"masked\":false},\"top_k\":[{\"token\":\" date\",\"bytes\":\"IGRhdGU=\",\"prob\":0.7260234951972961,\"masked\":false},{\"token\":\" time\",\"bytes\":\"IHRpbWU=\",\"prob\":0.24128110706806183,\"masked\":false},{\"token\":\" dates\",\"bytes\":\"IGRhdGVz\",\"prob\":0.00842307135462761,\"masked\":false},{\"token\":\" timestamp\",\"bytes\":\"IHRpbWVzdGFtcA==\",\"prob\":0.006786005105823278,\"masked\":false},{\"token\":\" times\",\"bytes\":\"IHRpbWVz\",\"prob\":0.004576732404530048,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" of\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.02184677124023,\"token\":{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.5932804346084595,\"masked\":false},\"top_k\":[{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.5932804346084595,\"masked\":false},{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.3064495623111725,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.02741912007331848,\"masked\":false},{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.014840025454759598,\"masked\":false},{\"token\":\"/time\",\"bytes\":\"L3RpbWU=\",\"prob\":0.013394806534051895,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" each\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.36080551147461,\"token\":{\"token\":\" each\",\"bytes\":\"IGVhY2g=\",\"prob\":0.4218413829803467,\"masked\":false},\"top_k\":[{\"token\":\" each\",\"bytes\":\"IGVhY2g=\",\"prob\":0.4218413829803467,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.14609652757644653,\"masked\":false},{\"token\":\" all\",\"bytes\":\"IGFsbA==\",\"prob\":0.1323595643043518,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.11248712241649628,\"masked\":false},{\"token\":\" every\",\"bytes\":\"IGV2ZXJ5\",\"prob\":0.09423834830522537,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" file\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.1439380645752,\"token\":{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.9522548317909241,\"masked\":false},\"top_k\":[{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.9522548317909241,\"masked\":false},{\"token\":\" item\",\"bytes\":\"IGl0ZW0=\",\"prob\":0.028263552114367485,\"masked\":false},{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.006459638010710478,\"masked\":false},{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.0037318048998713493,\"masked\":false},{\"token\":\" entry\",\"bytes\":\"IGVudHJ5\",\"prob\":0.002032037591561675,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" in\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":73.46606254577637,\"token\":{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.49810102581977844,\"masked\":false},\"top_k\":[{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.49810102581977844,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.13226057589054108,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.11026004701852798,\"masked\":false},{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.09193737059831619,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.043043848127126694,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":74.72109794616699,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.560950517654419,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.560950517654419,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.36814072728157043,\"masked\":false},{\"token\":\" your\",\"bytes\":\"IHlvdXI=\",\"prob\":0.05789631977677345,\"masked\":false},{\"token\":\" that\",\"bytes\":\"IHRoYXQ=\",\"prob\":0.0038294054102152586,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.0010592417092993855,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directory\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.24495506286621,\"token\":{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.9243941307067871,\"masked\":false},\"top_k\":[{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.9243941307067871,\"masked\":false},{\"token\":\" given\",\"bytes\":\"IGdpdmVu\",\"prob\":0.022606581449508667,\"masked\":false},{\"token\":\" folder\",\"bytes\":\"IGZvbGRlcg==\",\"prob\":0.021451013162732124,\"masked\":false},{\"token\":\" particular\",\"bytes\":\"IHBhcnRpY3VsYXI=\",\"prob\":0.006517019588500261,\"masked\":false},{\"token\":\" specified\",\"bytes\":\"IHNwZWNpZmllZA==\",\"prob\":0.003563778707757592,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.37115097045898,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.525035560131073,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.525035560131073,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.2003355473279953,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.08687365055084229,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.013690043240785599,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.012524458579719067,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" It\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.20401954650879,\"token\":{\"token\":\" It\",\"bytes\":\"IEl0\",\"prob\":0.1014837995171547,\"masked\":false},\"top_k\":[{\"token\":\" It\",\"bytes\":\"IEl0\",\"prob\":0.1014837995171547,\"masked\":false},{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.05730385333299637,\"masked\":false},{\"token\":\" Another\",\"bytes\":\"IEFub3RoZXI=\",\"prob\":0.04614393413066864,\"masked\":false},{\"token\":\" This\",\"bytes\":\"IFRoaXM=\",\"prob\":0.03880894556641579,\"masked\":false},{\"token\":\" Other\",\"bytes\":\"IE90aGVy\",\"prob\":0.035678837448358536,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"'s\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.57316398620605,\"token\":{\"token\":\"'s\",\"bytes\":\"J3M=\",\"prob\":0.5082178115844727,\"masked\":false},\"top_k\":[{\"token\":\"'s\",\"bytes\":\"J3M=\",\"prob\":0.5082178115844727,\"masked\":false},{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.19002017378807068,\"masked\":false},{\"token\":\" can\",\"bytes\":\"IGNhbg==\",\"prob\":0.12100415676832199,\"masked\":false},{\"token\":\" also\",\"bytes\":\"IGFsc28=\",\"prob\":0.10335415601730347,\"masked\":false},{\"token\":\"’s\",\"bytes\":\"4oCZcw==\",\"prob\":0.017838142812252045,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" also\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.28689575195312,\"token\":{\"token\":\" also\",\"bytes\":\"IGFsc28=\",\"prob\":0.31813427805900574,\"masked\":false},\"top_k\":[{\"token\":\" also\",\"bytes\":\"IGFsc28=\",\"prob\":0.31813427805900574,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.29653826355934143,\"masked\":false},{\"token\":\" very\",\"bytes\":\"IHZlcnk=\",\"prob\":0.04079893231391907,\"masked\":false},{\"token\":\" one\",\"bytes\":\"IG9uZQ==\",\"prob\":0.027433665469288826,\"masked\":false},{\"token\":\" like\",\"bytes\":\"IGxpa2U=\",\"prob\":0.02716338261961937,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" useful\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.34881210327148,\"token\":{\"token\":\" useful\",\"bytes\":\"IHVzZWZ1bA==\",\"prob\":0.1645701676607132,\"masked\":false},\"top_k\":[{\"token\":\" useful\",\"bytes\":\"IHVzZWZ1bA==\",\"prob\":0.1645701676607132,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.14685606956481934,\"masked\":false},{\"token\":\" very\",\"bytes\":\"IHZlcnk=\",\"prob\":0.1300497055053711,\"masked\":false},{\"token\":\" important\",\"bytes\":\"IGltcG9ydGFudA==\",\"prob\":0.05727977305650711,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.04607846960425377,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" for\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.75712966918945,\"token\":{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.6444534659385681,\"masked\":false},\"top_k\":[{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.6444534659385681,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.18118487298488617,\"masked\":false},{\"token\":\" when\",\"bytes\":\"IHdoZW4=\",\"prob\":0.08551958948373795,\"masked\":false},{\"token\":\" because\",\"bytes\":\"IGJlY2F1c2U=\",\"prob\":0.031122850254178047,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.026315009221434593,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" navigating\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.6881332397461,\"token\":{\"token\":\" navigating\",\"bytes\":\"IG5hdmlnYXRpbmc=\",\"prob\":0.2079685777425766,\"masked\":false},\"top_k\":[{\"token\":\" navigating\",\"bytes\":\"IG5hdmlnYXRpbmc=\",\"prob\":0.2079685777425766,\"masked\":false},{\"token\":\" finding\",\"bytes\":\"IGZpbmRpbmc=\",\"prob\":0.16031593084335327,\"masked\":false},{\"token\":\" quickly\",\"bytes\":\"IHF1aWNrbHk=\",\"prob\":0.10179518908262253,\"masked\":false},{\"token\":\" viewing\",\"bytes\":\"IHZpZXdpbmc=\",\"prob\":0.04972583428025246,\"masked\":false},{\"token\":\" checking\",\"bytes\":\"IGNoZWNraW5n\",\"prob\":0.03472733870148659,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" through\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":72.09205627441406,\"token\":{\"token\":\" through\",\"bytes\":\"IHRocm91Z2g=\",\"prob\":0.33224284648895264,\"masked\":false},\"top_k\":[{\"token\":\" through\",\"bytes\":\"IHRocm91Z2g=\",\"prob\":0.33224284648895264,\"masked\":false},{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.2196020483970642,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.13779903948307037,\"masked\":false},{\"token\":\" around\",\"bytes\":\"IGFyb3VuZA==\",\"prob\":0.06794654577970505,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.05273053050041199,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directories\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.11611557006836,\"token\":{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.6096548438072205,\"masked\":false},\"top_k\":[{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.6096548438072205,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.12504218518733978,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.08537746965885162,\"masked\":false},{\"token\":\" your\",\"bytes\":\"IHlvdXI=\",\"prob\":0.06969182938337326,\"masked\":false},{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.030837563797831535,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.72098350524902,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.34130287170410156,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.34130287170410156,\"masked\":false},{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.21929168701171875,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.12432839721441269,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.09997348487377167,\"masked\":false},{\"token\":\" quickly\",\"bytes\":\"IHF1aWNrbHk=\",\"prob\":0.026023443788290024,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" finding\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.0289478302002,\"token\":{\"token\":\" finding\",\"bytes\":\"IGZpbmRpbmc=\",\"prob\":0.2626480758190155,\"masked\":false},\"top_k\":[{\"token\":\" finding\",\"bytes\":\"IGZpbmRpbmc=\",\"prob\":0.2626480758190155,\"masked\":false},{\"token\":\" viewing\",\"bytes\":\"IHZpZXdpbmc=\",\"prob\":0.1583990901708603,\"masked\":false},{\"token\":\" seeing\",\"bytes\":\"IHNlZWluZw==\",\"prob\":0.09929979592561722,\"masked\":false},{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.08795125782489777,\"masked\":false},{\"token\":\" sub\",\"bytes\":\"IHN1Yg==\",\"prob\":0.06256252527236938,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" files\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":75.69384574890137,\"token\":{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.6080948710441589,\"masked\":false},\"top_k\":[{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.6080948710441589,\"masked\":false},{\"token\":\" specific\",\"bytes\":\"IHNwZWNpZmlj\",\"prob\":0.18457165360450745,\"masked\":false},{\"token\":\" hidden\",\"bytes\":\"IGhpZGRlbg==\",\"prob\":0.06057608127593994,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.041677944362163544,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.01841091923415661,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.66600227355957,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.44845202565193176,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.44845202565193176,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.1639883667230606,\"masked\":false},{\"token\":\" quickly\",\"bytes\":\"IHF1aWNrbHk=\",\"prob\":0.11403143405914307,\"masked\":false},{\"token\":\" by\",\"bytes\":\"IGJ5\",\"prob\":0.029021956026554108,\"masked\":false},{\"token\":\" you\",\"bytes\":\"IHlvdQ==\",\"prob\":0.025699278339743614,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" The\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.29223442077637,\"token\":{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.09248658269643784,\"masked\":false},\"top_k\":[{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.09248658269643784,\"masked\":false},{\"token\":\" Another\",\"bytes\":\"IEFub3RoZXI=\",\"prob\":0.07640865445137024,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.06860000640153885,\"masked\":false},{\"token\":\" Other\",\"bytes\":\"IE90aGVy\",\"prob\":0.05746917426586151,\"masked\":false},{\"token\":\" What\",\"bytes\":\"IFdoYXQ=\",\"prob\":0.023205166682600975,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.63596153259277,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.3287959694862366,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.3287959694862366,\"masked\":false},{\"token\":\" other\",\"bytes\":\"IG90aGVy\",\"prob\":0.31991690397262573,\"masked\":false},{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.12865230441093445,\"masked\":false},{\"token\":\" others\",\"bytes\":\"IG90aGVycw==\",\"prob\":0.0326700396835804,\"masked\":false},{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.029308926314115524,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"grep\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.97297096252441,\"token\":{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.25324636697769165,\"masked\":false},\"top_k\":[{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.25324636697769165,\"masked\":false},{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.2484106719493866,\"masked\":false},{\"token\":\"touch\",\"bytes\":\"dG91Y2g=\",\"prob\":0.23535877466201782,\"masked\":false},{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.08519335091114044,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.02800150215625763,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.19305229187012,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9968281388282776,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9968281388282776,\"masked\":false},{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.0019075466552749276,\"masked\":false},{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.000465474120574072,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.00022104717209003866,\"masked\":false},{\"token\":\",\\\"\",\"bytes\":\"LCI=\",\"prob\":0.00008950656047090888,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" command\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.28770446777344,\"token\":{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.9960242509841919,\"masked\":false},\"top_k\":[{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.9960242509841919,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.001856111572124064,\"masked\":false},{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.001010215375572443,\"masked\":false},{\"token\":\" function\",\"bytes\":\"IGZ1bmN0aW9u\",\"prob\":0.00023362826323136687,\"masked\":false},{\"token\":\" can\",\"bytes\":\"IGNhbg==\",\"prob\":0.00010018142347689718,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" is\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":77.01683044433594,\"token\":{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.8043103814125061,\"masked\":false},\"top_k\":[{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.8043103814125061,\"masked\":false},{\"token\":\" can\",\"bytes\":\"IGNhbg==\",\"prob\":0.13305217027664185,\"masked\":false},{\"token\":\" allows\",\"bytes\":\"IGFsbG93cw==\",\"prob\":0.01905367150902748,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.015549225732684135,\"masked\":false},{\"token\":\" searches\",\"bytes\":\"IHNlYXJjaGVz\",\"prob\":0.009498038329184055,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" also\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.52006912231445,\"token\":{\"token\":\" also\",\"bytes\":\"IGFsc28=\",\"prob\":0.43135973811149597,\"masked\":false},\"top_k\":[{\"token\":\" also\",\"bytes\":\"IGFsc28=\",\"prob\":0.43135973811149597,\"masked\":false},{\"token\":\" useful\",\"bytes\":\"IHVzZWZ1bA==\",\"prob\":0.12554241716861725,\"masked\":false},{\"token\":\" used\",\"bytes\":\"IHVzZWQ=\",\"prob\":0.12437218427658081,\"masked\":false},{\"token\":\" another\",\"bytes\":\"IGFub3RoZXI=\",\"prob\":0.08394282311201096,\"masked\":false},{\"token\":\" often\",\"bytes\":\"IG9mdGVu\",\"prob\":0.05072014033794403,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" very\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.59183311462402,\"token\":{\"token\":\" very\",\"bytes\":\"IHZlcnk=\",\"prob\":0.4224169850349426,\"masked\":false},\"top_k\":[{\"token\":\" very\",\"bytes\":\"IHZlcnk=\",\"prob\":0.4224169850349426,\"masked\":false},{\"token\":\" useful\",\"bytes\":\"IHVzZWZ1bA==\",\"prob\":0.14285868406295776,\"masked\":false},{\"token\":\" commonly\",\"bytes\":\"IGNvbW1vbmx5\",\"prob\":0.08539598435163498,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.07240720093250275,\"masked\":false},{\"token\":\" quite\",\"bytes\":\"IHF1aXRl\",\"prob\":0.06594084203243256,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" useful\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.16992568969727,\"token\":{\"token\":\" useful\",\"bytes\":\"IHVzZWZ1bA==\",\"prob\":0.725367546081543,\"masked\":false},\"top_k\":[{\"token\":\" useful\",\"bytes\":\"IHVzZWZ1bA==\",\"prob\":0.725367546081543,\"masked\":false},{\"token\":\" powerful\",\"bytes\":\"IHBvd2VyZnVs\",\"prob\":0.12905541062355042,\"masked\":false},{\"token\":\" helpful\",\"bytes\":\"IGhlbHBmdWw=\",\"prob\":0.0402287133038044,\"masked\":false},{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":0.03349650651216507,\"masked\":false},{\"token\":\" handy\",\"bytes\":\"IGhhbmR5\",\"prob\":0.01447464618831873,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" for\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":75.05989074707031,\"token\":{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.8289775848388672,\"masked\":false},\"top_k\":[{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.8289775848388672,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.10448019206523895,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.015560073778033257,\"masked\":false},{\"token\":\" when\",\"bytes\":\"IHdoZW4=\",\"prob\":0.012806962244212627,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.011679012328386307,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" searching\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.16387176513672,\"token\":{\"token\":\" searching\",\"bytes\":\"IHNlYXJjaGluZw==\",\"prob\":0.8669533729553223,\"masked\":false},\"top_k\":[{\"token\":\" searching\",\"bytes\":\"IHNlYXJjaGluZw==\",\"prob\":0.8669533729553223,\"masked\":false},{\"token\":\" finding\",\"bytes\":\"IGZpbmRpbmc=\",\"prob\":0.060128290206193924,\"masked\":false},{\"token\":\" filtering\",\"bytes\":\"IGZpbHRlcmluZw==\",\"prob\":0.036212701350450516,\"masked\":false},{\"token\":\" text\",\"bytes\":\"IHRleHQ=\",\"prob\":0.009142149239778519,\"masked\":false},{\"token\":\" quickly\",\"bytes\":\"IHF1aWNrbHk=\",\"prob\":0.008810199797153473,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" for\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.96073913574219,\"token\":{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.3307645916938782,\"masked\":false},\"top_k\":[{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.3307645916938782,\"masked\":false},{\"token\":\" through\",\"bytes\":\"IHRocm91Z2g=\",\"prob\":0.29714539647102356,\"masked\":false},{\"token\":\" text\",\"bytes\":\"IHRleHQ=\",\"prob\":0.25217103958129883,\"masked\":false},{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.04912777245044708,\"masked\":false},{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.019914716482162476,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" specific\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":73.88973236083984,\"token\":{\"token\":\" specific\",\"bytes\":\"IHNwZWNpZmlj\",\"prob\":0.7265024781227112,\"masked\":false},\"top_k\":[{\"token\":\" specific\",\"bytes\":\"IHNwZWNpZmlj\",\"prob\":0.7265024781227112,\"masked\":false},{\"token\":\" text\",\"bytes\":\"IHRleHQ=\",\"prob\":0.15624158084392548,\"masked\":false},{\"token\":\" patterns\",\"bytes\":\"IHBhdHRlcm5z\",\"prob\":0.029326364398002625,\"masked\":false},{\"token\":\" strings\",\"bytes\":\"IHN0cmluZ3M=\",\"prob\":0.023157861083745956,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.02108502946794033,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" text\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.46706771850586,\"token\":{\"token\":\" text\",\"bytes\":\"IHRleHQ=\",\"prob\":0.6283808350563049,\"masked\":false},\"top_k\":[{\"token\":\" text\",\"bytes\":\"IHRleHQ=\",\"prob\":0.6283808350563049,\"masked\":false},{\"token\":\" strings\",\"bytes\":\"IHN0cmluZ3M=\",\"prob\":0.15246720612049103,\"masked\":false},{\"token\":\" patterns\",\"bytes\":\"IHBhdHRlcm5z\",\"prob\":0.08210223913192749,\"masked\":false},{\"token\":\" keywords\",\"bytes\":\"IGtleXdvcmRz\",\"prob\":0.049364123493433,\"masked\":false},{\"token\":\" words\",\"bytes\":\"IHdvcmRz\",\"prob\":0.03764001280069351,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" within\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.80507278442383,\"token\":{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.564777135848999,\"masked\":false},\"top_k\":[{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.564777135848999,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.3309386372566223,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.03624236211180687,\"masked\":false},{\"token\":\" patterns\",\"bytes\":\"IHBhdHRlcm5z\",\"prob\":0.03265518322587013,\"masked\":false},{\"token\":\" strings\",\"bytes\":\"IHN0cmluZ3M=\",\"prob\":0.01172586902976036,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" files\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.04401969909668,\"token\":{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.7161903977394104,\"masked\":false},\"top_k\":[{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.7161903977394104,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.22723081707954407,\"masked\":false},{\"token\":\" text\",\"bytes\":\"IHRleHQ=\",\"prob\":0.02388189360499382,\"masked\":false},{\"token\":\" large\",\"bytes\":\"IGxhcmdl\",\"prob\":0.014662304893136024,\"masked\":false},{\"token\":\" larger\",\"bytes\":\"IGxhcmdlcg==\",\"prob\":0.004654472228139639,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.63901901245117,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.5938295125961304,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.5938295125961304,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.168006032705307,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.0827847570180893,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.04967367276549339,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.022287165746092796,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" The\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.07796859741211,\"token\":{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.1529379040002823,\"masked\":false},\"top_k\":[{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.1529379040002823,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.10240521281957626,\"masked\":false},{\"token\":\" It\",\"bytes\":\"IEl0\",\"prob\":0.0355248786509037,\"masked\":false},{\"token\":\" Finally\",\"bytes\":\"IEZpbmFsbHk=\",\"prob\":0.028886698186397552,\"masked\":false},{\"token\":\" Overall\",\"bytes\":\"IE92ZXJhbGw=\",\"prob\":0.027656566351652145,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.46096229553223,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.7091163992881775,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.7091163992881775,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.16648097336292267,\"masked\":false},{\"token\":\" other\",\"bytes\":\"IG90aGVy\",\"prob\":0.023831963539123535,\"masked\":false},{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.018516365438699722,\"masked\":false},{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.017687827348709106,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"title\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.17801094055176,\"token\":{\"token\":\"title\",\"bytes\":\"dGl0bGU=\",\"prob\":0.3153519034385681,\"masked\":false},\"top_k\":[{\"token\":\"title\",\"bytes\":\"dGl0bGU=\",\"prob\":0.3153519034385681,\"masked\":false},{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.14951391518115997,\"masked\":false},{\"token\":\"touch\",\"bytes\":\"dG91Y2g=\",\"prob\":0.1348428875207901,\"masked\":false},{\"token\":\"use\",\"bytes\":\"dXNl\",\"prob\":0.11942955106496811,\"masked\":false},{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.10049805045127869,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Configuration\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.29287719726562,\"token\":{\"token\":\" Configuration\",\"bytes\":\"IENvbmZpZ3VyYXRpb24=\",\"prob\":0.8088334798812866,\"masked\":false},\"top_k\":[{\"token\":\" Configuration\",\"bytes\":\"IENvbmZpZ3VyYXRpb24=\",\"prob\":0.8088334798812866,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.1790471225976944,\"masked\":false},{\"token\":\" configuration\",\"bytes\":\"IGNvbmZpZ3VyYXRpb24=\",\"prob\":0.002525409683585167,\"masked\":false},{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.0012905591866001487,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.0007544799009338021,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.21777534484863,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9960452914237976,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9960452914237976,\"masked\":false},{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.0009599838522262871,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.00029526904108934104,\"masked\":false},{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.00019178082584403455,\"masked\":false},{\"token\":\"?\\\"\",\"bytes\":\"PyI=\",\"prob\":0.0001766198402037844,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" command\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.64199447631836,\"token\":{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.8617356419563293,\"masked\":false},\"top_k\":[{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.8617356419563293,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.036301638931035995,\"masked\":false},{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.02931688167154789,\"masked\":false},{\"token\":\" might\",\"bytes\":\"IG1pZ2h0\",\"prob\":0.011529042385518551,\"masked\":false},{\"token\":\" line\",\"bytes\":\"IGxpbmU=\",\"prob\":0.00915061216801405,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" is\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":72.97897338867188,\"token\":{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.640285074710846,\"masked\":false},\"top_k\":[{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.640285074710846,\"masked\":false},{\"token\":\" may\",\"bytes\":\"IG1heQ==\",\"prob\":0.054246027022600174,\"masked\":false},{\"token\":\" might\",\"bytes\":\"IG1pZ2h0\",\"prob\":0.053424376994371414,\"masked\":false},{\"token\":\" seems\",\"bytes\":\"IHNlZW1z\",\"prob\":0.037388961762189865,\"masked\":false},{\"token\":\" doesn\",\"bytes\":\"IGRvZXNu\",\"prob\":0.03514297679066658,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" not\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.95415687561035,\"token\":{\"token\":\" not\",\"bytes\":\"IG5vdA==\",\"prob\":0.42388132214546204,\"masked\":false},\"top_k\":[{\"token\":\" not\",\"bytes\":\"IG5vdA==\",\"prob\":0.42388132214546204,\"masked\":false},{\"token\":\" used\",\"bytes\":\"IHVzZWQ=\",\"prob\":0.17340070009231567,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.08532814681529999,\"masked\":false},{\"token\":\" likely\",\"bytes\":\"IGxpa2VseQ==\",\"prob\":0.04449833929538727,\"masked\":false},{\"token\":\" specific\",\"bytes\":\"IHNwZWNpZmlj\",\"prob\":0.03586716577410698,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":72.50308990478516,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.769838273525238,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.769838273525238,\"masked\":false},{\"token\":\" recognized\",\"bytes\":\"IHJlY29nbml6ZWQ=\",\"prob\":0.026330359280109406,\"masked\":false},{\"token\":\" clear\",\"bytes\":\"IGNsZWFy\",\"prob\":0.019260359928011894,\"masked\":false},{\"token\":\" valid\",\"bytes\":\"IHZhbGlk\",\"prob\":0.016342781484127045,\"masked\":false},{\"token\":\" very\",\"bytes\":\"IHZlcnk=\",\"prob\":0.015582558698952198,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" standard\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.230224609375,\"token\":{\"token\":\" standard\",\"bytes\":\"IHN0YW5kYXJk\",\"prob\":0.3560914099216461,\"masked\":false},\"top_k\":[{\"token\":\" standard\",\"bytes\":\"IHN0YW5kYXJk\",\"prob\":0.3560914099216461,\"masked\":false},{\"token\":\" valid\",\"bytes\":\"IHZhbGlk\",\"prob\":0.20524455606937408,\"masked\":false},{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.08498598635196686,\"masked\":false},{\"token\":\" recognized\",\"bytes\":\"IHJlY29nbml6ZWQ=\",\"prob\":0.08454816043376923,\"masked\":false},{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":0.07998143136501312,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Linux\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.63119316101074,\"token\":{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.4993828535079956,\"masked\":false},\"top_k\":[{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.4993828535079956,\"masked\":false},{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.4392218291759491,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.025593049824237823,\"masked\":false},{\"token\":\" Unix\",\"bytes\":\"IFVuaXg=\",\"prob\":0.015278839506208897,\"masked\":false},{\"token\":\" linux\",\"bytes\":\"IGxpbnV4\",\"prob\":0.003487354377284646,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" command\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.00303268432617,\"token\":{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.9952576756477356,\"masked\":false},\"top_k\":[{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.9952576756477356,\"masked\":false},{\"token\":\" operating\",\"bytes\":\"IG9wZXJhdGluZw==\",\"prob\":0.000999772921204567,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.0008074154611676931,\"masked\":false},{\"token\":\" shell\",\"bytes\":\"IHNoZWxs\",\"prob\":0.0005906704463995993,\"masked\":false},{\"token\":\" operation\",\"bytes\":\"IG9wZXJhdGlvbg==\",\"prob\":0.00036226233351044357,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":76.86495780944824,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.5813846588134766,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.5813846588134766,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.2784384489059448,\"masked\":false},{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.07821844518184662,\"masked\":false},{\"token\":\" but\",\"bytes\":\"IGJ1dA==\",\"prob\":0.020595822483301163,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.009175040759146214,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" but\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":77.04567909240723,\"token\":{\"token\":\" but\",\"bytes\":\"IGJ1dA==\",\"prob\":0.5547890067100525,\"masked\":false},\"top_k\":[{\"token\":\" but\",\"bytes\":\"IGJ1dA==\",\"prob\":0.5547890067100525,\"masked\":false},{\"token\":\" so\",\"bytes\":\"IHNv\",\"prob\":0.2670765817165375,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.11998061835765839,\"masked\":false},{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.03233499452471733,\"masked\":false},{\"token\":\" as\",\"bytes\":\"IGFz\",\"prob\":0.010563576593995094,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" it\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":80.13701438903809,\"token\":{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.7335478663444519,\"masked\":false},\"top_k\":[{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.7335478663444519,\"masked\":false},{\"token\":\" rather\",\"bytes\":\"IHJhdGhlcg==\",\"prob\":0.04733113572001457,\"masked\":false},{\"token\":\" if\",\"bytes\":\"IGlm\",\"prob\":0.0469697006046772,\"masked\":false},{\"token\":\" could\",\"bytes\":\"IGNvdWxk\",\"prob\":0.04578758031129837,\"masked\":false},{\"token\":\" may\",\"bytes\":\"IG1heQ==\",\"prob\":0.02951226197183132,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" may\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.70508193969727,\"token\":{\"token\":\" may\",\"bytes\":\"IG1heQ==\",\"prob\":0.2903074026107788,\"masked\":false},\"top_k\":[{\"token\":\" may\",\"bytes\":\"IG1heQ==\",\"prob\":0.2903074026107788,\"masked\":false},{\"token\":\" might\",\"bytes\":\"IG1pZ2h0\",\"prob\":0.2732131779193878,\"masked\":false},{\"token\":\" could\",\"bytes\":\"IGNvdWxk\",\"prob\":0.2059035450220108,\"masked\":false},{\"token\":\"'s\",\"bytes\":\"J3M=\",\"prob\":0.0925617441534996,\"masked\":false},{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.057345978915691376,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" be\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.23301315307617,\"token\":{\"token\":\" be\",\"bytes\":\"IGJl\",\"prob\":0.8142914175987244,\"masked\":false},\"top_k\":[{\"token\":\" be\",\"bytes\":\"IGJl\",\"prob\":0.8142914175987244,\"masked\":false},{\"token\":\" refer\",\"bytes\":\"IHJlZmVy\",\"prob\":0.16575771570205688,\"masked\":false},{\"token\":\" have\",\"bytes\":\"IGhhdmU=\",\"prob\":0.006129004061222076,\"masked\":false},{\"token\":\" indicate\",\"bytes\":\"IGluZGljYXRl\",\"prob\":0.0028732093051075935,\"masked\":false},{\"token\":\" mean\",\"bytes\":\"IG1lYW4=\",\"prob\":0.0025781821459531784,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.59979438781738,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.4281105697154999,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.4281105697154999,\"masked\":false},{\"token\":\" used\",\"bytes\":\"IHVzZWQ=\",\"prob\":0.2994570732116699,\"masked\":false},{\"token\":\" specific\",\"bytes\":\"IHNwZWNpZmlj\",\"prob\":0.12794794142246246,\"masked\":false},{\"token\":\" related\",\"bytes\":\"IHJlbGF0ZWQ=\",\"prob\":0.05612600967288017,\"masked\":false},{\"token\":\" part\",\"bytes\":\"IHBhcnQ=\",\"prob\":0.01404694002121687,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" custom\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":74.6009349822998,\"token\":{\"token\":\" custom\",\"bytes\":\"IGN1c3RvbQ==\",\"prob\":0.5669883489608765,\"masked\":false},\"top_k\":[{\"token\":\" custom\",\"bytes\":\"IGN1c3RvbQ==\",\"prob\":0.5669883489608765,\"masked\":false},{\"token\":\" specific\",\"bytes\":\"IHNwZWNpZmlj\",\"prob\":0.0986805111169815,\"masked\":false},{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.07900820672512054,\"masked\":false},{\"token\":\" way\",\"bytes\":\"IHdheQ==\",\"prob\":0.028139987960457802,\"masked\":false},{\"token\":\" function\",\"bytes\":\"IGZ1bmN0aW9u\",\"prob\":0.02029462344944477,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" command\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.80903244018555,\"token\":{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.8222404718399048,\"masked\":false},\"top_k\":[{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.8222404718399048,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.09099284559488297,\"masked\":false},{\"token\":\" configuration\",\"bytes\":\"IGNvbmZpZ3VyYXRpb24=\",\"prob\":0.024051865562796593,\"masked\":false},{\"token\":\" one\",\"bytes\":\"IG9uZQ==\",\"prob\":0.01313702017068863,\"masked\":false},{\"token\":\" function\",\"bytes\":\"IGZ1bmN0aW9u\",\"prob\":0.012887449935078621,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" used\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.1690444946289,\"token\":{\"token\":\" used\",\"bytes\":\"IHVzZWQ=\",\"prob\":0.28184008598327637,\"masked\":false},\"top_k\":[{\"token\":\" used\",\"bytes\":\"IHVzZWQ=\",\"prob\":0.28184008598327637,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.22700762748718262,\"masked\":false},{\"token\":\" created\",\"bytes\":\"IGNyZWF0ZWQ=\",\"prob\":0.13896429538726807,\"masked\":false},{\"token\":\" that\",\"bytes\":\"IHRoYXQ=\",\"prob\":0.12868383526802063,\"masked\":false},{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.04123201593756676,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" by\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.1761245727539,\"token\":{\"token\":\" by\",\"bytes\":\"IGJ5\",\"prob\":0.4931357502937317,\"masked\":false},\"top_k\":[{\"token\":\" by\",\"bytes\":\"IGJ5\",\"prob\":0.4931357502937317,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.21605271100997925,\"masked\":false},{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.11461414396762848,\"masked\":false},{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.09136651456356049,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.06576278060674667,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":73.73619079589844,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.677717387676239,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.677717387676239,\"masked\":false},{\"token\":\" some\",\"bytes\":\"IHNvbWU=\",\"prob\":0.08503086119890213,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.07415731996297836,\"masked\":false},{\"token\":\" your\",\"bytes\":\"IHlvdXI=\",\"prob\":0.05146465450525284,\"masked\":false},{\"token\":\" someone\",\"bytes\":\"IHNvbWVvbmU=\",\"prob\":0.024330036714673042,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" specific\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.64500045776367,\"token\":{\"token\":\" specific\",\"bytes\":\"IHNwZWNpZmlj\",\"prob\":0.7740368247032166,\"masked\":false},\"top_k\":[{\"token\":\" specific\",\"bytes\":\"IHNwZWNpZmlj\",\"prob\":0.7740368247032166,\"masked\":false},{\"token\":\" particular\",\"bytes\":\"IHBhcnRpY3VsYXI=\",\"prob\":0.16915476322174072,\"masked\":false},{\"token\":\" user\",\"bytes\":\"IHVzZXI=\",\"prob\":0.019584747031331062,\"masked\":false},{\"token\":\" certain\",\"bytes\":\"IGNlcnRhaW4=\",\"prob\":0.010542210191488266,\"masked\":false},{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.005856990348547697,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" application\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.21021842956543,\"token\":{\"token\":\" application\",\"bytes\":\"IGFwcGxpY2F0aW9u\",\"prob\":0.37517690658569336,\"masked\":false},\"top_k\":[{\"token\":\" application\",\"bytes\":\"IGFwcGxpY2F0aW9u\",\"prob\":0.37517690658569336,\"masked\":false},{\"token\":\" user\",\"bytes\":\"IHVzZXI=\",\"prob\":0.20801478624343872,\"masked\":false},{\"token\":\" program\",\"bytes\":\"IHByb2dyYW0=\",\"prob\":0.17041520774364471,\"masked\":false},{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.07244863361120224,\"masked\":false},{\"token\":\" software\",\"bytes\":\"IHNvZnR3YXJl\",\"prob\":0.0710849016904831,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" or\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":72.71790504455566,\"token\":{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.7364890575408936,\"masked\":false},\"top_k\":[{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.7364890575408936,\"masked\":false},{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.19759823381900787,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.016473893076181412,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.006343829911202192,\"masked\":false},{\"token\":\" on\",\"bytes\":\"IG9u\",\"prob\":0.0042500547133386135,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" system\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.53508949279785,\"token\":{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.2552884817123413,\"masked\":false},\"top_k\":[{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.2552884817123413,\"masked\":false},{\"token\":\" user\",\"bytes\":\"IHVzZXI=\",\"prob\":0.23143811523914337,\"masked\":false},{\"token\":\" tool\",\"bytes\":\"IHRvb2w=\",\"prob\":0.09819502383470535,\"masked\":false},{\"token\":\" configuration\",\"bytes\":\"IGNvbmZpZ3VyYXRpb24=\",\"prob\":0.07319286465644836,\"masked\":false},{\"token\":\" program\",\"bytes\":\"IHByb2dyYW0=\",\"prob\":0.07067517191171646,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":72.49307632446289,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.6771665811538696,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.6771665811538696,\"masked\":false},{\"token\":\" configuration\",\"bytes\":\"IGNvbmZpZ3VyYXRpb24=\",\"prob\":0.1006222665309906,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.04986144229769707,\"masked\":false},{\"token\":\" administrator\",\"bytes\":\"IGFkbWluaXN0cmF0b3I=\",\"prob\":0.04923563078045845,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.00584176741540432,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" The\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":72.37696647644043,\"token\":{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.4040655791759491,\"masked\":false},\"top_k\":[{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.4040655791759491,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.10325828939676285,\"masked\":false},{\"token\":\" Finally\",\"bytes\":\"IEZpbmFsbHk=\",\"prob\":0.02801971510052681,\"masked\":false},{\"token\":\" Overall\",\"bytes\":\"IE92ZXJhbGw=\",\"prob\":0.02608523704111576,\"masked\":false},{\"token\":\" It\",\"bytes\":\"IEl0\",\"prob\":0.021749848499894142,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"/\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.65916061401367,\"token\":{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.3701428771018982,\"masked\":false},\"top_k\":[{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.3701428771018982,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.31401997804641724,\"masked\":false},{\"token\":\" other\",\"bytes\":\"IG90aGVy\",\"prob\":0.1766899824142456,\"masked\":false},{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.03985004499554634,\"masked\":false},{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.015344614163041115,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"bin\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.17801094055176,\"token\":{\"token\":\"bin\",\"bytes\":\"Ymlu\",\"prob\":0.9997208714485168,\"masked\":false},\"top_k\":[{\"token\":\"bin\",\"bytes\":\"Ymlu\",\"prob\":0.9997208714485168,\"masked\":false},{\"token\":\"usr\",\"bytes\":\"dXNy\",\"prob\":0.00009301322279497981,\"masked\":false},{\"token\":\"etc\",\"bytes\":\"ZXRj\",\"prob\":0.000036897818063152954,\"masked\":false},{\"token\":\"path\",\"bytes\":\"cGF0aA==\",\"prob\":0.000033177664590766653,\"masked\":false},{\"token\":\"sbin\",\"bytes\":\"c2Jpbg==\",\"prob\":0.00001634229556657374,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"/bash\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.12906265258789,\"token\":{\"token\":\"/bash\",\"bytes\":\"L2Jhc2g=\",\"prob\":0.9991462230682373,\"masked\":false},\"top_k\":[{\"token\":\"/bash\",\"bytes\":\"L2Jhc2g=\",\"prob\":0.9991462230682373,\"masked\":false},{\"token\":\"/sh\",\"bytes\":\"L3No\",\"prob\":0.0002938340185210109,\"masked\":false},{\"token\":\"/b\",\"bytes\":\"L2I=\",\"prob\":0.00018913541862275451,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.00016893981955945492,\"masked\":false},{\"token\":\"/\\\"\",\"bytes\":\"LyI=\",\"prob\":0.00004580876338877715,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" ~/\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.54297828674316,\"token\":{\"token\":\" ~/\",\"bytes\":\"IH4v\",\"prob\":0.9466795325279236,\"masked\":false},\"top_k\":[{\"token\":\" ~/\",\"bytes\":\"IH4v\",\"prob\":0.9466795325279236,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.046777475625276566,\"masked\":false},{\"token\":\" \\\"~/\",\"bytes\":\"ICJ+Lw==\",\"prob\":0.0014102099230512977,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.0011661209864541888,\"masked\":false},{\"token\":\" ~\",\"bytes\":\"IH4=\",\"prob\":0.0010645636357367039,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"shell\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.15879249572754,\"token\":{\"token\":\"shell\",\"bytes\":\"c2hlbGw=\",\"prob\":0.999382495880127,\"masked\":false},\"top_k\":[{\"token\":\"shell\",\"bytes\":\"c2hlbGw=\",\"prob\":0.999382495880127,\"masked\":false},{\"token\":\"sh\",\"bytes\":\"c2g=\",\"prob\":0.0001227667962666601,\"masked\":false},{\"token\":\" shell\",\"bytes\":\"IHNoZWxs\",\"prob\":0.00009640102507546544,\"masked\":false},{\"token\":\"script\",\"bytes\":\"c2NyaXB0\",\"prob\":0.00004404620995046571,\"masked\":false},{\"token\":\"Shell\",\"bytes\":\"U2hlbGw=\",\"prob\":0.00004127661304664798,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".sh\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.9690113067627,\"token\":{\"token\":\".sh\",\"bytes\":\"LnNo\",\"prob\":0.9996137022972107,\"masked\":false},\"top_k\":[{\"token\":\".sh\",\"bytes\":\"LnNo\",\"prob\":0.9996137022972107,\"masked\":false},{\"token\":\"sh\",\"bytes\":\"c2g=\",\"prob\":0.00013876169396098703,\"masked\":false},{\"token\":\"/sh\",\"bytes\":\"L3No\",\"prob\":0.0000558038373128511,\"masked\":false},{\"token\":\".s\",\"bytes\":\"LnM=\",\"prob\":0.000042865191062446684,\"masked\":false},{\"token\":\".script\",\"bytes\":\"LnNjcmlwdA==\",\"prob\":0.00003593475048546679,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":74.12600517272949,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.999586284160614,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.999586284160614,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.00021974931587465107,\"masked\":false},{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.0000522879054187797,\"masked\":false},{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.000026866882762988098,\"masked\":false},{\"token\":\"'\",\"bytes\":\"Jw==\",\"prob\":0.000012345943105174229,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" command\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":74.91517066955566,\"token\":{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.9926952123641968,\"masked\":false},\"top_k\":[{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.9926952123641968,\"masked\":false},{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.003805906279012561,\"masked\":false},{\"token\":\" line\",\"bytes\":\"IGxpbmU=\",\"prob\":0.0016278893454000354,\"masked\":false},{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.00034349525230936706,\"masked\":false},{\"token\":\" syntax\",\"bytes\":\"IHN5bnRheA==\",\"prob\":0.00022150496079120785,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" is\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":74.33891296386719,\"token\":{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.8159385323524475,\"masked\":false},\"top_k\":[{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.8159385323524475,\"masked\":false},{\"token\":\" may\",\"bytes\":\"IG1heQ==\",\"prob\":0.06447207182645798,\"masked\":false},{\"token\":\" would\",\"bytes\":\"IHdvdWxk\",\"prob\":0.015123682096600533,\"masked\":false},{\"token\":\" runs\",\"bytes\":\"IHJ1bnM=\",\"prob\":0.013389335945248604,\"masked\":false},{\"token\":\" starts\",\"bytes\":\"IHN0YXJ0cw==\",\"prob\":0.00951075553894043,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" not\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":74.80216026306152,\"token\":{\"token\":\" not\",\"bytes\":\"IG5vdA==\",\"prob\":0.26406073570251465,\"masked\":false},\"top_k\":[{\"token\":\" not\",\"bytes\":\"IG5vdA==\",\"prob\":0.26406073570251465,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.2565801441669464,\"masked\":false},{\"token\":\" also\",\"bytes\":\"IGFsc28=\",\"prob\":0.16291101276874542,\"masked\":false},{\"token\":\" used\",\"bytes\":\"IHVzZWQ=\",\"prob\":0.12848617136478424,\"masked\":false},{\"token\":\" an\",\"bytes\":\"IGFu\",\"prob\":0.028701746836304665,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.85196876525879,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.9254307746887207,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.9254307746887207,\"masked\":false},{\"token\":\" standard\",\"bytes\":\"IHN0YW5kYXJk\",\"prob\":0.016478292644023895,\"masked\":false},{\"token\":\" valid\",\"bytes\":\"IHZhbGlk\",\"prob\":0.014325903728604317,\"masked\":false},{\"token\":\" an\",\"bytes\":\"IGFu\",\"prob\":0.004862193018198013,\"masked\":false},{\"token\":\" useful\",\"bytes\":\"IHVzZWZ1bA==\",\"prob\":0.0035393082071095705,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" standard\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":75.11091232299805,\"token\":{\"token\":\" standard\",\"bytes\":\"IHN0YW5kYXJk\",\"prob\":0.7718457579612732,\"masked\":false},\"top_k\":[{\"token\":\" standard\",\"bytes\":\"IHN0YW5kYXJk\",\"prob\":0.7718457579612732,\"masked\":false},{\"token\":\" valid\",\"bytes\":\"IHZhbGlk\",\"prob\":0.07029099762439728,\"masked\":false},{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":0.04864273592829704,\"masked\":false},{\"token\":\" typical\",\"bytes\":\"IHR5cGljYWw=\",\"prob\":0.03495514765381813,\"masked\":false},{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.016898885369300842,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Linux\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":75.0730037689209,\"token\":{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.8882514834403992,\"masked\":false},\"top_k\":[{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.8882514834403992,\"masked\":false},{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.09754152595996857,\"masked\":false},{\"token\":\" way\",\"bytes\":\"IHdheQ==\",\"prob\":0.005649198777973652,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.0023532616905868053,\"masked\":false},{\"token\":\" Unix\",\"bytes\":\"IFVuaXg=\",\"prob\":0.0018587518716230989,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" command\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":80.00493049621582,\"token\":{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.999093770980835,\"masked\":false},\"top_k\":[{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.999093770980835,\"masked\":false},{\"token\":\" shell\",\"bytes\":\"IHNoZWxs\",\"prob\":0.00023017876083031297,\"masked\":false},{\"token\":\" operation\",\"bytes\":\"IG9wZXJhdGlvbg==\",\"prob\":0.00016015917935874313,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.00008337698818650097,\"masked\":false},{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.00007829495734767988,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":78.79495620727539,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.8207203149795532,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.8207203149795532,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.079569511115551,\"masked\":false},{\"token\":\" either\",\"bytes\":\"IGVpdGhlcg==\",\"prob\":0.06666096299886703,\"masked\":false},{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.018947817385196686,\"masked\":false},{\"token\":\" as\",\"bytes\":\"IGFz\",\"prob\":0.00375909055583179,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" but\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.81692123413086,\"token\":{\"token\":\" but\",\"bytes\":\"IGJ1dA==\",\"prob\":0.8797094821929932,\"masked\":false},\"top_k\":[{\"token\":\" but\",\"bytes\":\"IGJ1dA==\",\"prob\":0.8797094821929932,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.07891739904880524,\"masked\":false},{\"token\":\" as\",\"bytes\":\"IGFz\",\"prob\":0.028361726552248,\"masked\":false},{\"token\":\" so\",\"bytes\":\"IHNv\",\"prob\":0.005223087966442108,\"masked\":false},{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.004028398543596268,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" it\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":85.64019203186035,\"token\":{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.9828509092330933,\"masked\":false},\"top_k\":[{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.9828509092330933,\"masked\":false},{\"token\":\" may\",\"bytes\":\"IG1heQ==\",\"prob\":0.007629721891134977,\"masked\":false},{\"token\":\" if\",\"bytes\":\"IGlm\",\"prob\":0.0038265918847173452,\"masked\":false},{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.0015951577806845307,\"masked\":false},{\"token\":\" could\",\"bytes\":\"IGNvdWxk\",\"prob\":0.0007943493546918035,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" may\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":76.36785507202148,\"token\":{\"token\":\" may\",\"bytes\":\"IG1heQ==\",\"prob\":0.9183866381645203,\"masked\":false},\"top_k\":[{\"token\":\" may\",\"bytes\":\"IG1heQ==\",\"prob\":0.9183866381645203,\"masked\":false},{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.040404774248600006,\"masked\":false},{\"token\":\"'s\",\"bytes\":\"J3M=\",\"prob\":0.01091661024838686,\"masked\":false},{\"token\":\" appears\",\"bytes\":\"IGFwcGVhcnM=\",\"prob\":0.005508494097739458,\"masked\":false},{\"token\":\" could\",\"bytes\":\"IGNvdWxk\",\"prob\":0.005459166597574949,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" be\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":74.15294647216797,\"token\":{\"token\":\" be\",\"bytes\":\"IGJl\",\"prob\":0.9950994849205017,\"masked\":false},\"top_k\":[{\"token\":\" be\",\"bytes\":\"IGJl\",\"prob\":0.9950994849205017,\"masked\":false},{\"token\":\" refer\",\"bytes\":\"IHJlZmVy\",\"prob\":0.0008200469892472029,\"masked\":false},{\"token\":\" run\",\"bytes\":\"IHJ1bg==\",\"prob\":0.0006423990125767887,\"masked\":false},{\"token\":\" start\",\"bytes\":\"IHN0YXJ0\",\"prob\":0.0006319824606180191,\"masked\":false},{\"token\":\" allow\",\"bytes\":\"IGFsbG93\",\"prob\":0.0002868961018975824,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":74.90992546081543,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.6571804881095886,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.6571804881095886,\"masked\":false},{\"token\":\" used\",\"bytes\":\"IHVzZWQ=\",\"prob\":0.32558244466781616,\"masked\":false},{\"token\":\" an\",\"bytes\":\"IGFu\",\"prob\":0.008952036499977112,\"masked\":false},{\"token\":\" specific\",\"bytes\":\"IHNwZWNpZmlj\",\"prob\":0.0013533816672861576,\"masked\":false},{\"token\":\" using\",\"bytes\":\"IHVzaW5n\",\"prob\":0.0010488166008144617,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":1.6937211455569923e-7,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"On\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\"On\",\"bytes\":\"T24=\",\"prob\":0.0002631755778566003,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.22025166451931,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" scale\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\" scale\",\"bytes\":\"IHNjYWxl\",\"prob\":0.0002149992506019771,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" of\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.677985668182373,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.9970334768295288,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"1\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":0.9404754042625427,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"-\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\"-\",\"bytes\":\"LQ==\",\"prob\":0.5312314033508301,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"1\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":0.857507050037384,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"0\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\"0\",\"bytes\":\"MA==\",\"prob\":0.9999603033065796,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.9337844848632812,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" it\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.00002792515624605585,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" has\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\" has\",\"bytes\":\"IGhhcw==\",\"prob\":0.0029511903412640095,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.4635107219219208,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" cool\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\" cool\",\"bytes\":\"IGNvb2w=\",\"prob\":0.0003562993952073157,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"ness\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\"ness\",\"bytes\":\"bmVzcw==\",\"prob\":0.24603915214538574,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" factor\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\" factor\",\"bytes\":\"IGZhY3Rvcg==\",\"prob\":0.5208525061607361,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" of\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.9659187197685242,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\":\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.006658064667135477,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.40929317474365234,\"token\":{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.853617787361145,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"8\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":177.59418487548828,\"token\":{\"token\":\"8\",\"bytes\":\"OA==\",\"prob\":0.29908278584480286,\"masked\":false},\"top_k\":[{\"token\":\"8\",\"bytes\":\"OA==\",\"prob\":0.29908278584480286,\"masked\":false},{\"token\":\"7\",\"bytes\":\"Nw==\",\"prob\":0.24630284309387207,\"masked\":false},{\"token\":\"9\",\"bytes\":\"OQ==\",\"prob\":0.24393995106220245,\"masked\":false},{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":0.0649196058511734,\"masked\":false},{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":0.06143616512417793,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":84.50198173522949,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.3765026032924652,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.3765026032924652,\"masked\":false},{\"token\":\"0\",\"bytes\":\"MA==\",\"prob\":0.0004530138976406306,\"masked\":false},{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":0.00010537656635278836,\"masked\":false},{\"token\":\"9\",\"bytes\":\"OQ==\",\"prob\":0.00003982181442552246,\"masked\":false},{\"token\":\"7\",\"bytes\":\"Nw==\",\"prob\":0.000024196171580115333,\"masked\":false}],\"class_name\":\"TokenOutput\"}],\"status\":\"Done\",\"shownMetrics\":[\"status\",\"consumed\",\"token reduction\",\"avg latency\"],\"metrics\":{\"status\":\"Done\",\"wall time\":0,\"consumed\":116,\"token reduction\":15.942028985507244,\"avg latency\":72.97591195590255,\"cpu\":[0.9059999999999999,0.8610625000000001,0.8610625000000001,0.8535625,0.8535625],\"gpu\":[0,0,0,0,0],\"ram\":53.28504943847656,\"vram\":0},\"requireFullReplay\":false,\"currentMessageId\":1570,\"backtrackCount\":0,\"resetCount\":22}" } }, "68498e377ff445dd89de2c354ef84c81": { "model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {} }, "761bb5cbb4844899b4363a40501297a3": { "model_module": "@guidance-ai/stitch", "model_module_version": "^0.1.5", "model_name": "StitchModel", "state": { "_model_module_version": "^0.1.5", "_view_module_version": "^0.1.5", "clientmsg": "{\"class_name\":\"ClientReadyMessage\"}", "initial_height": "auto", "initial_width": "100%", "kernelmsg": "{\"message_id\":1042,\"last_trace_id\":500,\"is_err\":false,\"class_name\":\"ExecutionCompletedMessage\"}", "layout": "IPY_MODEL_cae62cfa700449c9b8998648b70f1775", "srcdoc": "\n\n\n \n\n \n \n \n\n\n\n\n\n", "state": "{\"components\":[{\"value\":\"What\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\"What\",\"bytes\":\"V2hhdA==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" are\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" most\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" common\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" used\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" used\",\"bytes\":\"IHVzZWQ=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" in\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" Linux\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" operating\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" operating\",\"bytes\":\"IG9wZXJhdGluZw==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" system\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"?\\n\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\"?\\n\\n\",\"bytes\":\"PwoK\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"Here\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\"Here\",\"bytes\":\"SGVyZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" are\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"5\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" most\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" common\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" in\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" JSON\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" JSON\",\"bytes\":\"IEpTT04=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" format\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\" format\",\"bytes\":\"IGZvcm1hdA==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\":\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\":\\n\",\"bytes\":\"Ogo=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"{\\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\"{\\\"\",\"bytes\":\"eyI=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"commands\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\"commands\",\"bytes\":\"Y29tbWFuZHM=\",\"prob\":0.7671419978141785,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\":\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.17346654619489396,\"token\":{\"token\":\"\\\":\",\"bytes\":\"Ijo=\",\"prob\":0.8789330124855042,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" [\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":244.66204643249512,\"token\":{\"token\":\" [\\\"\",\"bytes\":\"IFsi\",\"prob\":0.08538264781236649,\"masked\":false},\"top_k\":[{\"token\":\" [\\\"\",\"bytes\":\"IFsi\",\"prob\":0.08538264781236649,\"masked\":false},{\"token\":\" [\",\"bytes\":\"IFs=\",\"prob\":0.0308656208217144,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.000510257959831506,\"masked\":false},{\"token\":\" appId\",\"bytes\":\"IGFwcElk\",\"prob\":9.086098193278325e-12,\"masked\":true},{\"token\":\" Clara\",\"bytes\":\"IENsYXJh\",\"prob\":1.1039394225142996e-12,\"masked\":true}],\"class_name\":\"TokenOutput\"},{\"value\":\"ls\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.14894485473633,\"token\":{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.7953630089759827,\"masked\":false},\"top_k\":[{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.7953630089759827,\"masked\":false},{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.06898483633995056,\"masked\":false},{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.025814058259129524,\"masked\":false},{\"token\":\"echo\",\"bytes\":\"ZWNobw==\",\"prob\":0.023678645491600037,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.019643807783722878,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.90795516967773,\"token\":{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.8911498188972473,\"masked\":false},\"top_k\":[{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.8911498188972473,\"masked\":false},{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.04010646417737007,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.0066874329932034016,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.0027744490653276443,\"masked\":false},{\"token\":\" --\",\"bytes\":\"IC0t\",\"prob\":0.00024355255300179124,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.22305107116699,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9969526529312134,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9969526529312134,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.0013371658278629184,\"masked\":false},{\"token\":\" \\\"-\",\"bytes\":\"ICIt\",\"prob\":0.00019239427638240159,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.00014819487114436924,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.00009074170520761982,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"cd\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.46919250488281,\"token\":{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.7571668028831482,\"masked\":false},\"top_k\":[{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.7571668028831482,\"masked\":false},{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.11370014399290085,\"masked\":false},{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.04636682942509651,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.03135410696268082,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.01986994966864586,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.39306449890137,\"token\":{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.9988310933113098,\"masked\":false},\"top_k\":[{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.9988310933113098,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.0002784611424431205,\"masked\":false},{\"token\":\" \\\",\",\"bytes\":\"ICIs\",\"prob\":0.00011064721184084192,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.00006471153028542176,\"masked\":false},{\"token\":\" ~\",\"bytes\":\"IH4=\",\"prob\":0.00006361526175169274,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.47896766662598,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.999039351940155,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.999039351940155,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.0003087192599195987,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.00013664757716469467,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":0.00006350388866849244,\"masked\":false},{\"token\":\" \\\"~\",\"bytes\":\"ICJ+\",\"prob\":0.000038315261917887256,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"pwd\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.04211235046387,\"token\":{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.3458705246448517,\"masked\":false},\"top_k\":[{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.3458705246448517,\"masked\":false},{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.24471454322338104,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.1418578177690506,\"masked\":false},{\"token\":\"touch\",\"bytes\":\"dG91Y2g=\",\"prob\":0.055903512984514236,\"masked\":false},{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.05456124246120453,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.3491439819336,\"token\":{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.9993168115615845,\"masked\":false},\"top_k\":[{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.9993168115615845,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.00003798197940341197,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.000006597496394533664,\"masked\":false},{\"token\":\" \\\",\",\"bytes\":\"ICIs\",\"prob\":0.000005006757419323549,\"masked\":false},{\"token\":\"”,\",\"bytes\":\"4oCdLA==\",\"prob\":0.000003509595899231499,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.09482383728027,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9991939663887024,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9991939663887024,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.00022105763491708785,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.0001803005434339866,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":0.00006638290506089106,\"masked\":false},{\"token\":\" \\\"$\",\"bytes\":\"ICIk\",\"prob\":0.0000374434057448525,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"cp\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.11094284057617,\"token\":{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.23651406168937683,\"masked\":false},\"top_k\":[{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.23651406168937683,\"masked\":false},{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.16056878864765167,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.12459279596805573,\"masked\":false},{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.12208999693393707,\"masked\":false},{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.10938525944948196,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.00706481933594,\"token\":{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.9988704323768616,\"masked\":false},\"top_k\":[{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.9988704323768616,\"masked\":false},{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.00029128516325727105,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.000186401535756886,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.00015153181448113173,\"masked\":false},{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.00002524947194615379,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.55425643920898,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9987236857414246,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9987236857414246,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.00036014567012898624,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.00023817528563085943,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":0.00010302712325938046,\"masked\":false},{\"token\":\" \\\"!\",\"bytes\":\"ICIh\",\"prob\":0.0000979888645815663,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"rm\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.95589828491211,\"token\":{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.567275881767273,\"masked\":false},\"top_k\":[{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.567275881767273,\"masked\":false},{\"token\":\"mv\",\"bytes\":\"bXY=\",\"prob\":0.2736138701438904,\"masked\":false},{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.07015802711248398,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.01938181184232235,\"masked\":false},{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.014672244898974895,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"]\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.0450668334961,\"token\":{\"token\":\"\\\"]\",\"bytes\":\"Il0=\",\"prob\":0.37402039766311646,\"masked\":false},\"top_k\":[{\"token\":\"\\\"]\",\"bytes\":\"Il0=\",\"prob\":0.37402039766311646,\"masked\":false},{\"token\":\"\\\"],\",\"bytes\":\"Il0s\",\"prob\":0.061015594750642776,\"masked\":false},{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.00045263656647875905,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.0002300582709722221,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.00010510098218219355,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.8440415064493815,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":1.1034148705846292e-8,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.8440415064493815,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9927330017089844,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"my\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.8440415064493815,\"token\":{\"token\":\"my\",\"bytes\":\"bXk=\",\"prob\":0.00003106817530351691,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"_favorite\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.8440415064493815,\"token\":{\"token\":\"_favorite\",\"bytes\":\"X2Zhdm9yaXRl\",\"prob\":0.015018061734735966,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"_command\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.8440415064493815,\"token\":{\"token\":\"_command\",\"bytes\":\"X2NvbW1hbmQ=\",\"prob\":0.6117119193077087,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\":\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.8440415064493815,\"token\":{\"token\":\"\\\":\",\"bytes\":\"Ijo=\",\"prob\":0.973719596862793,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":164.88289833068848,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9635056853294373,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9635056853294373,\"masked\":false},{\"token\":\" \\\"\\\\\\\"\",\"bytes\":\"ICJcIg==\",\"prob\":0.001945805037394166,\"masked\":false},{\"token\":\" \\\"\\\"\",\"bytes\":\"ICIi\",\"prob\":0.0014128424227237701,\"masked\":false},{\"token\":\" \\\"'\",\"bytes\":\"ICIn\",\"prob\":0.0006950219394639134,\"masked\":false},{\"token\":\" \\\"[\",\"bytes\":\"ICJb\",\"prob\":0.0006334767676889896,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"ls\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.21801376342773,\"token\":{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.6361569166183472,\"masked\":false},\"top_k\":[{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.6361569166183472,\"masked\":false},{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.15828554332256317,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.05554575473070145,\"masked\":false},{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.0498899482190609,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.016893679276108742,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"}\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.51582908630371,\"token\":{\"token\":\"\\\"}\",\"bytes\":\"In0=\",\"prob\":0.203566312789917,\"masked\":false},\"top_k\":[{\"token\":\"\\\"}\",\"bytes\":\"In0=\",\"prob\":0.203566312789917,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.08358106017112732,\"masked\":false},{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.01651720702648163,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.0005874736816622317,\"masked\":false},{\"token\":\" --\",\"bytes\":\"IC0t\",\"prob\":0.0003071241080760956,\"masked\":false}],\"class_name\":\"TokenOutput\"}],\"status\":\"Done\",\"shownMetrics\":[\"status\",\"consumed\",\"token reduction\",\"avg latency\"],\"metrics\":{\"status\":\"Done\",\"wall time\":0,\"consumed\":18,\"token reduction\":25,\"avg latency\":64.55066800117493,\"cpu\":[0.6346875,0.6346875,0.117375,0.6346875,0.6346875],\"gpu\":[0,0,0,0,0],\"ram\":53.400299072265625,\"vram\":0},\"requireFullReplay\":false,\"currentMessageId\":1042,\"backtrackCount\":0,\"resetCount\":3}" } }, "8bef5972e38f47d4a6a4eca99942c10b": { "model_module": "@guidance-ai/stitch", "model_module_version": "^0.1.5", "model_name": "StitchModel", "state": { "_model_module_version": "^0.1.5", "_view_module_version": "^0.1.5", "clientmsg": "{\"class_name\":\"ClientReadyMessage\"}", "initial_height": "auto", "initial_width": "100%", "kernelmsg": "{\"message_id\":244,\"last_trace_id\":118,\"is_err\":false,\"class_name\":\"ExecutionCompletedMessage\"}", "layout": "IPY_MODEL_c65e2b6eb8c347b192c219b8fb7b71c8", "srcdoc": "\n\n\n \n\n \n \n \n\n\n\n\n\n", "state": "{\"components\":[{\"value\":\"Name\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":34.93860789707729,\"token\":{\"token\":\"Name\",\"bytes\":\"TmFtZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" common\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":34.93860789707729,\"token\":{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" Mac\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":34.93860789707729,\"token\":{\"token\":\" Mac\",\"bytes\":\"IE1hYw==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" operating\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":34.93860789707729,\"token\":{\"token\":\" operating\",\"bytes\":\"IG9wZXJhdGluZw==\",\"prob\":0.0004141302779316902,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" system\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":34.93860789707729,\"token\":{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.6835963129997253,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":34.93860789707729,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.00049055420095101,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.12112236022949,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.040810905396938324,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.040810905396938324,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.03932831808924675,\"masked\":false},{\"token\":\".\\n\\n\",\"bytes\":\"LgoK\",\"prob\":0.020542040467262268,\"masked\":false},{\"token\":\".\\n\\n\\n\",\"bytes\":\"LgoKCg==\",\"prob\":0.0012980083702132106,\"masked\":false},{\"token\":\".\\\\\",\"bytes\":\"Llw=\",\"prob\":0.0004383120685815811,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" The\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.83514404296875,\"token\":{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.14172448217868805,\"masked\":false},\"top_k\":[{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.14172448217868805,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" most\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.48593330383301,\"token\":{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":0.2624347507953644,\"masked\":false},\"top_k\":[{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":0.2624347507953644,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" common\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.19770622253418,\"token\":{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":0.6338764429092407,\"masked\":false},\"top_k\":[{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":0.6338764429092407,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Mac\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.49897384643555,\"token\":{\"token\":\" Mac\",\"bytes\":\"IE1hYw==\",\"prob\":0.6447736024856567,\"masked\":false},\"top_k\":[{\"token\":\" Mac\",\"bytes\":\"IE1hYw==\",\"prob\":0.6447736024856567,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" operating\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.22789192199707,\"token\":{\"token\":\" operating\",\"bytes\":\"IG9wZXJhdGluZw==\",\"prob\":0.8735114932060242,\"masked\":false},\"top_k\":[{\"token\":\" operating\",\"bytes\":\"IG9wZXJhdGluZw==\",\"prob\":0.8735114932060242,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" system\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.628746032714844,\"token\":{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.9936456680297852,\"masked\":false},\"top_k\":[{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.9936456680297852,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":61.97404861450195,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.9615567922592163,\"masked\":false},\"top_k\":[{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.9615567922592163,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" are\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.10207939147949,\"token\":{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":0.5395633578300476,\"masked\":false},\"top_k\":[{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":0.5395633578300476,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\":\\n\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.09278106689453,\"token\":{\"token\":\":\\n\\n\",\"bytes\":\"OgoK\",\"prob\":0.3589114546775818,\"masked\":false},\"top_k\":[{\"token\":\":\\n\\n\",\"bytes\":\"OgoK\",\"prob\":0.3589114546775818,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"1\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.38102912902832,\"token\":{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":0.633267879486084,\"masked\":false},\"top_k\":[{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":0.633267879486084,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.2662467956543,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9931941032409668,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9931941032409668,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Open\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.79802322387695,\"token\":{\"token\":\" Open\",\"bytes\":\"IE9wZW4=\",\"prob\":0.147721529006958,\"masked\":false},\"top_k\":[{\"token\":\" Open\",\"bytes\":\"IE9wZW4=\",\"prob\":0.147721529006958,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\":\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.11607360839844,\"token\":{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.5837732553482056,\"masked\":false},\"top_k\":[{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.5837732553482056,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Opens\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.30411338806152,\"token\":{\"token\":\" Opens\",\"bytes\":\"IE9wZW5z\",\"prob\":0.37122446298599243,\"masked\":false},\"top_k\":[{\"token\":\" Opens\",\"bytes\":\"IE9wZW5z\",\"prob\":0.37122446298599243,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.40307807922363,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.48301514983177185,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.48301514983177185,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" file\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.96586990356445,\"token\":{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.8480466604232788,\"masked\":false},\"top_k\":[{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.8480466604232788,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" or\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.77975845336914,\"token\":{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.8255627751350403,\"masked\":false},\"top_k\":[{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.8255627751350403,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" application\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.86001205444336,\"token\":{\"token\":\" application\",\"bytes\":\"IGFwcGxpY2F0aW9u\",\"prob\":0.4187057912349701,\"masked\":false},\"top_k\":[{\"token\":\" application\",\"bytes\":\"IGFwcGxpY2F0aW9u\",\"prob\":0.4187057912349701,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":61.991214752197266,\"token\":{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.47064271569252014,\"masked\":false},\"top_k\":[{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.47064271569252014,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"2\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.8040771484375,\"token\":{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":0.9867749214172363,\"masked\":false},\"top_k\":[{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":0.9867749214172363,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.97390365600586,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9998970031738281,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9998970031738281,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Save\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.780784606933594,\"token\":{\"token\":\" Save\",\"bytes\":\"IFNhdmU=\",\"prob\":0.500781238079071,\"masked\":false},\"top_k\":[{\"token\":\" Save\",\"bytes\":\"IFNhdmU=\",\"prob\":0.500781238079071,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\":\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.14706802368164,\"token\":{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.9004374146461487,\"masked\":false},\"top_k\":[{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.9004374146461487,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Saves\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.300132751464844,\"token\":{\"token\":\" Saves\",\"bytes\":\"IFNhdmVz\",\"prob\":0.8787209987640381,\"masked\":false},\"top_k\":[{\"token\":\" Saves\",\"bytes\":\"IFNhdmVz\",\"prob\":0.8787209987640381,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.09709358215332,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.8202661871910095,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.8202661871910095,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" file\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.933921813964844,\"token\":{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.9636684060096741,\"masked\":false},\"top_k\":[{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.9636684060096741,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" or\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.12300872802734,\"token\":{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.5043779015541077,\"masked\":false},\"top_k\":[{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.5043779015541077,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" application\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.34187698364258,\"token\":{\"token\":\" application\",\"bytes\":\"IGFwcGxpY2F0aW9u\",\"prob\":0.787712037563324,\"masked\":false},\"top_k\":[{\"token\":\" application\",\"bytes\":\"IGFwcGxpY2F0aW9u\",\"prob\":0.787712037563324,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.92424011230469,\"token\":{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.9150196313858032,\"masked\":false},\"top_k\":[{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.9150196313858032,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"3\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.15979766845703,\"token\":{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":0.9997177720069885,\"masked\":false},\"top_k\":[{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":0.9997177720069885,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.97199630737305,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.999911904335022,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.999911904335022,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Quit\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.89598274230957,\"token\":{\"token\":\" Quit\",\"bytes\":\"IFF1aXQ=\",\"prob\":0.34504103660583496,\"masked\":false},\"top_k\":[{\"token\":\" Quit\",\"bytes\":\"IFF1aXQ=\",\"prob\":0.34504103660583496,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\":\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.55218315124512,\"token\":{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.9902865886688232,\"masked\":false},\"top_k\":[{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.9902865886688232,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" C\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.67280197143555,\"token\":{\"token\":\" C\",\"bytes\":\"IEM=\",\"prob\":0.41506385803222656,\"masked\":false},\"top_k\":[{\"token\":\" C\",\"bytes\":\"IEM=\",\"prob\":0.41506385803222656,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"loses\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.00816345214844,\"token\":{\"token\":\"loses\",\"bytes\":\"bG9zZXM=\",\"prob\":0.9997983574867249,\"masked\":false},\"top_k\":[{\"token\":\"loses\",\"bytes\":\"bG9zZXM=\",\"prob\":0.9997983574867249,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" an\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.8121109008789,\"token\":{\"token\":\" an\",\"bytes\":\"IGFu\",\"prob\":0.6471860408782959,\"masked\":false},\"top_k\":[{\"token\":\" an\",\"bytes\":\"IGFu\",\"prob\":0.6471860408782959,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" application\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.96110153198242,\"token\":{\"token\":\" application\",\"bytes\":\"IGFwcGxpY2F0aW9u\",\"prob\":0.8080595135688782,\"masked\":false},\"top_k\":[{\"token\":\" application\",\"bytes\":\"IGFwcGxpY2F0aW9u\",\"prob\":0.8080595135688782,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.59307670593262,\"token\":{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.8854747414588928,\"masked\":false},\"top_k\":[{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.8854747414588928,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"4\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.96779823303223,\"token\":{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":0.999818742275238,\"masked\":false},\"top_k\":[{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":0.999818742275238,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.01619720458984,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.999967098236084,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.999967098236084,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" File\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.95299530029297,\"token\":{\"token\":\" File\",\"bytes\":\"IEZpbGU=\",\"prob\":0.09179487824440002,\"masked\":false},\"top_k\":[{\"token\":\" File\",\"bytes\":\"IEZpbGU=\",\"prob\":0.09179487824440002,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\":\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.849853515625,\"token\":{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.8474341034889221,\"masked\":false},\"top_k\":[{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.8474341034889221,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Opens\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.2780532836914,\"token\":{\"token\":\" Opens\",\"bytes\":\"IE9wZW5z\",\"prob\":0.5587999224662781,\"masked\":false},\"top_k\":[{\"token\":\" Opens\",\"bytes\":\"IE9wZW5z\",\"prob\":0.5587999224662781,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.76290321350098,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.575024425983429,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.575024425983429,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" file\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.51201438903809,\"token\":{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.6840553283691406,\"masked\":false},\"top_k\":[{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.6840553283691406,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" or\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.98098373413086,\"token\":{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.36290204524993896,\"masked\":false},\"top_k\":[{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.36290204524993896,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" application\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.73803520202637,\"token\":{\"token\":\" application\",\"bytes\":\"IGFwcGxpY2F0aW9u\",\"prob\":0.7851742506027222,\"masked\":false},\"top_k\":[{\"token\":\" application\",\"bytes\":\"IGFwcGxpY2F0aW9u\",\"prob\":0.7851742506027222,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.99180603027344,\"token\":{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.8477158546447754,\"masked\":false},\"top_k\":[{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.8477158546447754,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"5\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.662052154541016,\"token\":{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":0.999442994594574,\"masked\":false},\"top_k\":[{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":0.999442994594574,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.23101234436035,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999555349349976,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999555349349976,\"masked\":false}],\"class_name\":\"TokenOutput\"}],\"status\":\"Done\",\"shownMetrics\":[\"status\",\"consumed\",\"token reduction\",\"avg latency\"],\"metrics\":{\"status\":\"Done\",\"wall time\":0,\"consumed\":52,\"token reduction\":0,\"avg latency\":69.21340410525983,\"cpu\":[0.8565,0.84175,0.84175,0.8428125,0.8428125],\"gpu\":[0,0,0,0,0],\"ram\":53.28875732421875,\"vram\":0},\"requireFullReplay\":false,\"currentMessageId\":244,\"backtrackCount\":1,\"resetCount\":3}" } }, "974b55d923ef4c119a588cc6bf359abc": { "model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "HTMLStyleModel", "state": { "description_width": "", "font_size": null, "text_color": null } }, "9ad4fc9df305416099c51d33932ea001": { "model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {} }, "9dd1023208c04f9788666402aa34f6d3": { "model_module": "@guidance-ai/stitch", "model_module_version": "^0.1.5", "model_name": "StitchModel", "state": { "_model_module_version": "^0.1.5", "_view_module_version": "^0.1.5", "clientmsg": "{\"class_name\":\"ClientReadyMessage\"}", "initial_height": "auto", "initial_width": "100%", "kernelmsg": "{\"message_id\":2310,\"last_trace_id\":1064,\"is_err\":false,\"class_name\":\"ExecutionCompletedMessage\"}", "layout": "IPY_MODEL_dafab8be3ab947adac038705165a5372", "srcdoc": "\n\n\n \n\n \n \n \n\n\n\n\n\n", "state": "{\"components\":[{\"name\":\"user\",\"text\":null,\"closer_text\":null,\"class_name\":\"RoleOpenerInput\"},{\"name\":\"user\",\"text\":null,\"closer_text\":null,\"class_name\":\"RoleOpenerInput\"},{\"value\":\"<|user|>\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":906.3990116119385,\"token\":{\"token\":\"<|user|>\",\"bytes\":\"PHx1c2VyfD4=\",\"prob\":4.036623924008609e-9,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"What\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":28.1981688279372,\"token\":{\"token\":\"What\",\"bytes\":\"V2hhdA==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" are\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":28.1981688279372,\"token\":{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":0.2840782403945923,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":28.1981688279372,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.5023394227027893,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" most\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":28.1981688279372,\"token\":{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":0.04292185604572296,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" common\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":28.1981688279372,\"token\":{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":0.15513648092746735,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":28.1981688279372,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.00017437936912756413,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" used\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":28.1981688279372,\"token\":{\"token\":\" used\",\"bytes\":\"IHVzZWQ=\",\"prob\":0.35938483476638794,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" in\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":28.1981688279372,\"token\":{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.7010188698768616,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":28.1981688279372,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.11386630684137344,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" Linux\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":28.1981688279372,\"token\":{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.2594137489795685,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" operating\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":28.1981688279372,\"token\":{\"token\":\" operating\",\"bytes\":\"IG9wZXJhdGluZw==\",\"prob\":0.08810386061668396,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" system\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":28.1981688279372,\"token\":{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.9981071949005127,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"?\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":28.1981688279372,\"token\":{\"token\":\"?\",\"bytes\":\"Pw==\",\"prob\":0.4073123633861542,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"name\":\"user\",\"text\":null,\"class_name\":\"RoleCloserInput\"},{\"value\":\"<|end|>\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":169.785737991333,\"token\":{\"token\":\"<|end|>\",\"bytes\":\"PHxlbmR8Pg==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"name\":\"assistant\",\"text\":null,\"closer_text\":null,\"class_name\":\"RoleOpenerInput\"},{\"value\":\"<|assistant|>\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":158.94103050231934,\"token\":{\"token\":\"<|assistant|>\",\"bytes\":\"PHxhc3Npc3RhbnR8Pg==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"1\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":76.63664817810059,\"token\":{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":76.63664817810059,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9957869648933411,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":76.63664817810059,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.007421671412885189,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"cp\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":76.63664817810059,\"token\":{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.0006091512041166425,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":76.63664817810059,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.0001705114118522033,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"2\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":76.44519805908203,\"token\":{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":76.44519805908203,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9998856782913208,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":76.44519805908203,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.99893718957901,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"ls\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":76.44519805908203,\"token\":{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.02282724343240261,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":76.44519805908203,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.988923192024231,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"3\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":77.77643203735352,\"token\":{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":77.77643203735352,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999979734420776,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":77.77643203735352,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.999921441078186,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"rm\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":77.77643203735352,\"token\":{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.05077098682522774,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":77.77643203735352,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.9901694655418396,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"4\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":79.62303161621094,\"token\":{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":79.62303161621094,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999961853027344,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":79.62303161621094,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9999275207519531,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"mkdir\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":79.62303161621094,\"token\":{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.38295626640319824,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":79.62303161621094,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.9953609108924866,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"5\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":79.2572021484375,\"token\":{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":79.2572021484375,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999972581863403,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":79.2572021484375,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9999499320983887,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"cd\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":79.2572021484375,\"token\":{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.2809254229068756,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":79.2572021484375,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.993926465511322,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"6\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.02953720092773,\"token\":{\"token\":\"6\",\"bytes\":\"Ng==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.02953720092773,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999951124191284,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.02953720092773,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9999196529388428,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"grep\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.02953720092773,\"token\":{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.029486531391739845,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.02953720092773,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.9953515529632568,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"7\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.19957733154297,\"token\":{\"token\":\"7\",\"bytes\":\"Nw==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.19957733154297,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999961853027344,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.19957733154297,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9999655485153198,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"cat\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.19957733154297,\"token\":{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.19101938605308533,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.19957733154297,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.9959726929664612,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"8\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.34863662719727,\"token\":{\"token\":\"8\",\"bytes\":\"OA==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.34863662719727,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.999993085861206,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.34863662719727,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9999390840530396,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"find\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.34863662719727,\"token\":{\"token\":\"find\",\"bytes\":\"ZmluZA==\",\"prob\":0.06733793020248413,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.34863662719727,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.9985069632530212,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"9\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.67794036865234,\"token\":{\"token\":\"9\",\"bytes\":\"OQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.67794036865234,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999938011169434,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.67794036865234,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9999555349349976,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"mv\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.67794036865234,\"token\":{\"token\":\"mv\",\"bytes\":\"bXY=\",\"prob\":0.12354045361280441,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":78.67794036865234,\"token\":{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.9952051639556885,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"Perhaps\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.8384227752685547,\"token\":{\"token\":\"Perhaps\",\"bytes\":\"UGVyaGFwcw==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.8384227752685547,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.16465730965137482,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" most\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.8384227752685547,\"token\":{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":0.9196403622627258,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" useful\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.8384227752685547,\"token\":{\"token\":\" useful\",\"bytes\":\"IHVzZWZ1bA==\",\"prob\":0.07561119645833969,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" command\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.8384227752685547,\"token\":{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.24611006677150726,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" from\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.8384227752685547,\"token\":{\"token\":\" from\",\"bytes\":\"IGZyb20=\",\"prob\":0.0027789229061454535,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" that\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.8384227752685547,\"token\":{\"token\":\" that\",\"bytes\":\"IHRoYXQ=\",\"prob\":0.019157622009515762,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" list\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.8384227752685547,\"token\":{\"token\":\" list\",\"bytes\":\"IGxpc3Q=\",\"prob\":0.9878010749816895,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" is\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.8384227752685547,\"token\":{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.5324728488922119,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\":\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0.8384227752685547,\"token\":{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.00011209409422008321,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":343.6927795410156,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.7618595957756042,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.7618595957756042,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.009936360642313957,\"masked\":false},{\"token\":\" \\\"**\",\"bytes\":\"ICIqKg==\",\"prob\":0.00030202153720892966,\"masked\":false},{\"token\":\" \\\"$\",\"bytes\":\"ICIk\",\"prob\":0.0001686398172751069,\"masked\":false},{\"token\":\" \\\"`\",\"bytes\":\"ICJg\",\"prob\":0.0001114326441893354,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"grep\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":163.6800765991211,\"token\":{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.3730160892009735,\"masked\":false},\"top_k\":[{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.3730160892009735,\"masked\":false},{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.21483194828033447,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.12964126467704773,\"masked\":false},{\"token\":\"man\",\"bytes\":\"bWFu\",\"prob\":0.08841373026371002,\"masked\":false},{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.05419590696692467,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":159.07001495361328,\"token\":{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.27304890751838684,\"masked\":false},\"top_k\":[{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.27304890751838684,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.16998417675495148,\"masked\":false},{\"token\":\",\\\"\",\"bytes\":\"LCI=\",\"prob\":0.06056973338127136,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":0.05895867943763733,\"masked\":false},{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.005074281711131334,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" because\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":3.239154815673828,\"token\":{\"token\":\" because\",\"bytes\":\"IGJlY2F1c2U=\",\"prob\":0.022490061819553375,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" it\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":451.6596794128418,\"token\":{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.770317554473877,\"masked\":false},\"top_k\":[{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.770317554473877,\"masked\":false},{\"token\":\" it's\",\"bytes\":\"IGl0J3M=\",\"prob\":0.1085132583975792,\"masked\":false},{\"token\":\" you\",\"bytes\":\"IHlvdQ==\",\"prob\":0.02291736751794815,\"masked\":false},{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.012470132671296597,\"masked\":false},{\"token\":\" this\",\"bytes\":\"IHRoaXM=\",\"prob\":0.012413510121405125,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" allows\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":158.95891189575195,\"token\":{\"token\":\" allows\",\"bytes\":\"IGFsbG93cw==\",\"prob\":0.41080808639526367,\"masked\":false},\"top_k\":[{\"token\":\" allows\",\"bytes\":\"IGFsbG93cw==\",\"prob\":0.41080808639526367,\"masked\":false},{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.18924610316753387,\"masked\":false},{\"token\":\" can\",\"bytes\":\"IGNhbg==\",\"prob\":0.1106780469417572,\"masked\":false},{\"token\":\" searches\",\"bytes\":\"IHNlYXJjaGVz\",\"prob\":0.0829433798789978,\"masked\":false},{\"token\":\" helps\",\"bytes\":\"IGhlbHBz\",\"prob\":0.0450061671435833,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" you\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":158.81991386413574,\"token\":{\"token\":\" you\",\"bytes\":\"IHlvdQ==\",\"prob\":0.7525641918182373,\"masked\":false},\"top_k\":[{\"token\":\" you\",\"bytes\":\"IHlvdQ==\",\"prob\":0.7525641918182373,\"masked\":false},{\"token\":\" users\",\"bytes\":\"IHVzZXJz\",\"prob\":0.09690611809492111,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.04652409628033638,\"masked\":false},{\"token\":\" us\",\"bytes\":\"IHVz\",\"prob\":0.033701829612255096,\"masked\":false},{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.03012956492602825,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" to\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":158.12397003173828,\"token\":{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.9965687990188599,\"masked\":false},\"top_k\":[{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.9965687990188599,\"masked\":false},{\"token\":\" search\",\"bytes\":\"IHNlYXJjaA==\",\"prob\":0.0005179756553843617,\"masked\":false},{\"token\":\" quickly\",\"bytes\":\"IHF1aWNrbHk=\",\"prob\":0.00045751838479191065,\"masked\":false},{\"token\":\" easily\",\"bytes\":\"IGVhc2lseQ==\",\"prob\":0.00018851588538382202,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.0001843281352194026,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" search\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":157.9000949859619,\"token\":{\"token\":\" search\",\"bytes\":\"IHNlYXJjaA==\",\"prob\":0.8097308278083801,\"masked\":false},\"top_k\":[{\"token\":\" search\",\"bytes\":\"IHNlYXJjaA==\",\"prob\":0.8097308278083801,\"masked\":false},{\"token\":\" quickly\",\"bytes\":\"IHF1aWNrbHk=\",\"prob\":0.053191203624010086,\"masked\":false},{\"token\":\" find\",\"bytes\":\"IGZpbmQ=\",\"prob\":0.030711747705936432,\"masked\":false},{\"token\":\" filter\",\"bytes\":\"IGZpbHRlcg==\",\"prob\":0.026011284440755844,\"masked\":false},{\"token\":\" easily\",\"bytes\":\"IGVhc2lseQ==\",\"prob\":0.02345016598701477,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" for\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":157.7889919281006,\"token\":{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.4948461949825287,\"masked\":false},\"top_k\":[{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.4948461949825287,\"masked\":false},{\"token\":\" through\",\"bytes\":\"IHRocm91Z2g=\",\"prob\":0.3231790065765381,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.03383566439151764,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.022980453446507454,\"masked\":false},{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.022295862436294556,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":157.90200233459473,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.37296465039253235,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.37296465039253235,\"masked\":false},{\"token\":\" specific\",\"bytes\":\"IHNwZWNpZmlj\",\"prob\":0.31733861565589905,\"masked\":false},{\"token\":\" text\",\"bytes\":\"IHRleHQ=\",\"prob\":0.12330073118209839,\"masked\":false},{\"token\":\" patterns\",\"bytes\":\"IHBhdHRlcm5z\",\"prob\":0.056951262056827545,\"masked\":false},{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.02587522566318512,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" specific\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":156.16607666015625,\"token\":{\"token\":\" specific\",\"bytes\":\"IHNwZWNpZmlj\",\"prob\":0.5919874310493469,\"masked\":false},\"top_k\":[{\"token\":\" specific\",\"bytes\":\"IHNwZWNpZmlj\",\"prob\":0.5919874310493469,\"masked\":false},{\"token\":\" particular\",\"bytes\":\"IHBhcnRpY3VsYXI=\",\"prob\":0.13038213551044464,\"masked\":false},{\"token\":\" string\",\"bytes\":\"IHN0cmluZw==\",\"prob\":0.09464871883392334,\"masked\":false},{\"token\":\" pattern\",\"bytes\":\"IHBhdHRlcm4=\",\"prob\":0.06443952769041061,\"masked\":false},{\"token\":\" certain\",\"bytes\":\"IGNlcnRhaW4=\",\"prob\":0.024775603786110878,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" string\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":161.87381744384766,\"token\":{\"token\":\" string\",\"bytes\":\"IHN0cmluZw==\",\"prob\":0.5744368433952332,\"masked\":false},\"top_k\":[{\"token\":\" string\",\"bytes\":\"IHN0cmluZw==\",\"prob\":0.5744368433952332,\"masked\":false},{\"token\":\" pattern\",\"bytes\":\"IHBhdHRlcm4=\",\"prob\":0.22887030243873596,\"masked\":false},{\"token\":\" text\",\"bytes\":\"IHRleHQ=\",\"prob\":0.05853642150759697,\"masked\":false},{\"token\":\" word\",\"bytes\":\"IHdvcmQ=\",\"prob\":0.0457022599875927,\"masked\":false},{\"token\":\" term\",\"bytes\":\"IHRlcm0=\",\"prob\":0.02239670418202877,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" or\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":166.60809516906738,\"token\":{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.34058108925819397,\"masked\":false},\"top_k\":[{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.34058108925819397,\"masked\":false},{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.22146989405155182,\"masked\":false},{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.19635522365570068,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.15023179352283478,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.017620036378502846,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" pattern\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":166.38684272766113,\"token\":{\"token\":\" pattern\",\"bytes\":\"IHBhdHRlcm4=\",\"prob\":0.7846280336380005,\"masked\":false},\"top_k\":[{\"token\":\" pattern\",\"bytes\":\"IHBhdHRlcm4=\",\"prob\":0.7846280336380005,\"masked\":false},{\"token\":\" word\",\"bytes\":\"IHdvcmQ=\",\"prob\":0.0449356734752655,\"masked\":false},{\"token\":\" text\",\"bytes\":\"IHRleHQ=\",\"prob\":0.030353082343935966,\"masked\":false},{\"token\":\" character\",\"bytes\":\"IGNoYXJhY3Rlcg==\",\"prob\":0.028005801141262054,\"masked\":false},{\"token\":\" phrase\",\"bytes\":\"IHBocmFzZQ==\",\"prob\":0.01817810721695423,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" within\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":162.78982162475586,\"token\":{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.5140738487243652,\"masked\":false},\"top_k\":[{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.5140738487243652,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.3788808286190033,\"masked\":false},{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.035667162388563156,\"masked\":false},{\"token\":\" inside\",\"bytes\":\"IGluc2lkZQ==\",\"prob\":0.02075500786304474,\"masked\":false},{\"token\":\" across\",\"bytes\":\"IGFjcm9zcw==\",\"prob\":0.017961138859391212,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":162.1530055999756,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.6022602915763855,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.6022602915763855,\"masked\":false},{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.2794964611530304,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.027343347668647766,\"masked\":false},{\"token\":\" text\",\"bytes\":\"IHRleHQ=\",\"prob\":0.026743585243821144,\"masked\":false},{\"token\":\" one\",\"bytes\":\"IG9uZQ==\",\"prob\":0.02011670172214508,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" file\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":160.7511043548584,\"token\":{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.8718758821487427,\"masked\":false},\"top_k\":[{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.8718758821487427,\"masked\":false},{\"token\":\" text\",\"bytes\":\"IHRleHQ=\",\"prob\":0.0443224161863327,\"masked\":false},{\"token\":\" given\",\"bytes\":\"IGdpdmVu\",\"prob\":0.02961352840065956,\"masked\":false},{\"token\":\" set\",\"bytes\":\"IHNldA==\",\"prob\":0.011309574358165264,\"masked\":false},{\"token\":\" large\",\"bytes\":\"IGxhcmdl\",\"prob\":0.006485654041171074,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" or\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":169.57402229309082,\"token\":{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.5187258720397949,\"masked\":false},\"top_k\":[{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.5187258720397949,\"masked\":false},{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.24843968451023102,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.15156255662441254,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.023186901584267616,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.007397872861474752,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directory\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":163.11001777648926,\"token\":{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.38823989033699036,\"masked\":false},\"top_k\":[{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.38823989033699036,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.14396433532238007,\"masked\":false},{\"token\":\" set\",\"bytes\":\"IHNldA==\",\"prob\":0.1284378618001938,\"masked\":false},{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.05537419393658638,\"masked\":false},{\"token\":\" across\",\"bytes\":\"IGFjcm9zcw==\",\"prob\":0.04310770332813263,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":160.40706634521484,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.6116269826889038,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.6116269826889038,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.14172494411468506,\"masked\":false},{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.024072647094726562,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.02265387773513794,\"masked\":false},{\"token\":\" listing\",\"bytes\":\"IGxpc3Rpbmc=\",\"prob\":0.022045349702239037,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" For\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":166.97192192077637,\"token\":{\"token\":\" For\",\"bytes\":\"IEZvcg==\",\"prob\":0.40364551544189453,\"masked\":false},\"top_k\":[{\"token\":\" For\",\"bytes\":\"IEZvcg==\",\"prob\":0.40364551544189453,\"masked\":false},{\"token\":\" This\",\"bytes\":\"IFRoaXM=\",\"prob\":0.21654270589351654,\"masked\":false},{\"token\":\" It\",\"bytes\":\"IEl0\",\"prob\":0.09310454875230789,\"masked\":false},{\"token\":\" You\",\"bytes\":\"IFlvdQ==\",\"prob\":0.06955514848232269,\"masked\":false},{\"token\":\" It's\",\"bytes\":\"IEl0J3M=\",\"prob\":0.033157769590616226,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" example\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":157.26184844970703,\"token\":{\"token\":\" example\",\"bytes\":\"IGV4YW1wbGU=\",\"prob\":0.9209937453269958,\"masked\":false},\"top_k\":[{\"token\":\" example\",\"bytes\":\"IGV4YW1wbGU=\",\"prob\":0.9209937453269958,\"masked\":false},{\"token\":\" instance\",\"bytes\":\"IGluc3RhbmNl\",\"prob\":0.0781085416674614,\"masked\":false},{\"token\":\" more\",\"bytes\":\"IG1vcmU=\",\"prob\":0.00012307132419664413,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.00008947013702709228,\"masked\":false},{\"token\":\" Example\",\"bytes\":\"IEV4YW1wbGU=\",\"prob\":0.000051194474508520216,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":158.94293785095215,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.9839406609535217,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.9839406609535217,\"masked\":false},{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.008280136622488499,\"masked\":false},{\"token\":\":\\n\",\"bytes\":\"Ogo=\",\"prob\":0.0031040979083627462,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.00022142463421914726,\"masked\":false},{\"token\":\" if\",\"bytes\":\"IGlm\",\"prob\":0.00020505479187704623,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" if\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":161.02194786071777,\"token\":{\"token\":\" if\",\"bytes\":\"IGlm\",\"prob\":0.6132469177246094,\"masked\":false},\"top_k\":[{\"token\":\" if\",\"bytes\":\"IGlm\",\"prob\":0.6132469177246094,\"masked\":false},{\"token\":\" you\",\"bytes\":\"IHlvdQ==\",\"prob\":0.24130524694919586,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.05153525993227959,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.045134734362363815,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.009892381727695465,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" you\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":159.73305702209473,\"token\":{\"token\":\" you\",\"bytes\":\"IHlvdQ==\",\"prob\":0.9491184949874878,\"masked\":false},\"top_k\":[{\"token\":\" you\",\"bytes\":\"IHlvdQ==\",\"prob\":0.9491184949874878,\"masked\":false},{\"token\":\" you're\",\"bytes\":\"IHlvdSdyZQ==\",\"prob\":0.037199340760707855,\"masked\":false},{\"token\":\" I\",\"bytes\":\"IEk=\",\"prob\":0.00867265835404396,\"masked\":false},{\"token\":\" we\",\"bytes\":\"IHdl\",\"prob\":0.0018701497465372086,\"masked\":false},{\"token\":\" you'd\",\"bytes\":\"IHlvdSdk\",\"prob\":0.001208814443089068,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" wanted\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":164.55507278442383,\"token\":{\"token\":\" wanted\",\"bytes\":\"IHdhbnRlZA==\",\"prob\":0.5728052258491516,\"masked\":false},\"top_k\":[{\"token\":\" wanted\",\"bytes\":\"IHdhbnRlZA==\",\"prob\":0.5728052258491516,\"masked\":false},{\"token\":\" want\",\"bytes\":\"IHdhbnQ=\",\"prob\":0.3245618939399719,\"masked\":false},{\"token\":\" have\",\"bytes\":\"IGhhdmU=\",\"prob\":0.04873828589916229,\"masked\":false},{\"token\":\" were\",\"bytes\":\"IHdlcmU=\",\"prob\":0.01710652932524681,\"masked\":false},{\"token\":\" had\",\"bytes\":\"IGhhZA==\",\"prob\":0.010818296112120152,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" to\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":167.88101196289062,\"token\":{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.9999593496322632,\"masked\":false},\"top_k\":[{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.9999593496322632,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.000008081572559603956,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.000006619832674914505,\"masked\":false},{\"token\":\" search\",\"bytes\":\"IHNlYXJjaA==\",\"prob\":0.000003292492237960687,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.000002693822580113192,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" search\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":161.4830493927002,\"token\":{\"token\":\" search\",\"bytes\":\"IHNlYXJjaA==\",\"prob\":0.5003069639205933,\"masked\":false},\"top_k\":[{\"token\":\" search\",\"bytes\":\"IHNlYXJjaA==\",\"prob\":0.5003069639205933,\"masked\":false},{\"token\":\" find\",\"bytes\":\"IGZpbmQ=\",\"prob\":0.4420822262763977,\"masked\":false},{\"token\":\" see\",\"bytes\":\"IHNlZQ==\",\"prob\":0.03178990259766579,\"masked\":false},{\"token\":\" look\",\"bytes\":\"IGxvb2s=\",\"prob\":0.012585573829710484,\"masked\":false},{\"token\":\" check\",\"bytes\":\"IGNoZWNr\",\"prob\":0.0042711603455245495,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" for\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":162.66894340515137,\"token\":{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.9040490388870239,\"masked\":false},\"top_k\":[{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.9040490388870239,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.03982006013393402,\"masked\":false},{\"token\":\" through\",\"bytes\":\"IHRocm91Z2g=\",\"prob\":0.02308374084532261,\"masked\":false},{\"token\":\" your\",\"bytes\":\"IHlvdXI=\",\"prob\":0.012305036187171936,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.008912349119782448,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" all\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":164.87884521484375,\"token\":{\"token\":\" all\",\"bytes\":\"IGFsbA==\",\"prob\":0.45096686482429504,\"masked\":false},\"top_k\":[{\"token\":\" all\",\"bytes\":\"IGFsbA==\",\"prob\":0.45096686482429504,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.37287619709968567,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.11711248010396957,\"masked\":false},{\"token\":\" every\",\"bytes\":\"IGV2ZXJ5\",\"prob\":0.015381048433482647,\"masked\":false},{\"token\":\" any\",\"bytes\":\"IGFueQ==\",\"prob\":0.014454119838774204,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" instances\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":162.7349853515625,\"token\":{\"token\":\" instances\",\"bytes\":\"IGluc3RhbmNlcw==\",\"prob\":0.43792903423309326,\"masked\":false},\"top_k\":[{\"token\":\" instances\",\"bytes\":\"IGluc3RhbmNlcw==\",\"prob\":0.43792903423309326,\"masked\":false},{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.21451516449451447,\"masked\":false},{\"token\":\" occurrences\",\"bytes\":\"IG9jY3VycmVuY2Vz\",\"prob\":0.17925874888896942,\"masked\":false},{\"token\":\" lines\",\"bytes\":\"IGxpbmVz\",\"prob\":0.10824711620807648,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.037887584418058395,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" of\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":165.1618480682373,\"token\":{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.9991942048072815,\"masked\":false},\"top_k\":[{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.9991942048072815,\"masked\":false},{\"token\":\" where\",\"bytes\":\"IHdoZXJl\",\"prob\":0.0004981070524081588,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.00015834813530091196,\"masked\":false},{\"token\":\" containing\",\"bytes\":\"IGNvbnRhaW5pbmc=\",\"prob\":0.00005245285137789324,\"masked\":false},{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.00003465850750217214,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":162.07408905029297,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.8755185604095459,\"masked\":false},\"top_k\":[{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.8755185604095459,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.07740344852209091,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.043527692556381226,\"masked\":false},{\"token\":\" '\",\"bytes\":\"ICc=\",\"prob\":0.0006605751696042717,\"masked\":false},{\"token\":\" an\",\"bytes\":\"IGFu\",\"prob\":0.0005353951128199697,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" word\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":166.6722297668457,\"token\":{\"token\":\" word\",\"bytes\":\"IHdvcmQ=\",\"prob\":0.9269058108329773,\"masked\":false},\"top_k\":[{\"token\":\" word\",\"bytes\":\"IHdvcmQ=\",\"prob\":0.9269058108329773,\"masked\":false},{\"token\":\" string\",\"bytes\":\"IHN0cmluZw==\",\"prob\":0.06132199242711067,\"masked\":false},{\"token\":\" phrase\",\"bytes\":\"IHBocmFzZQ==\",\"prob\":0.0055007245391607285,\"masked\":false},{\"token\":\" term\",\"bytes\":\"IHRlcm0=\",\"prob\":0.0024833274073898792,\"masked\":false},{\"token\":\" letter\",\"bytes\":\"IGxldHRlcg==\",\"prob\":0.001087877550162375,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":160.84909439086914,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9873961806297302,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9873961806297302,\"masked\":false},{\"token\":\" '\",\"bytes\":\"ICc=\",\"prob\":0.010491819120943546,\"masked\":false},{\"token\":\" “\",\"bytes\":\"IOKAnA==\",\"prob\":0.0016130470903590322,\"masked\":false},{\"token\":\" cat\",\"bytes\":\"IGNhdA==\",\"prob\":0.00014688521332573146,\"masked\":false},{\"token\":\" `\",\"bytes\":\"IGA=\",\"prob\":0.00004584947964758612,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"error\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":165.30990600585938,\"token\":{\"token\":\"error\",\"bytes\":\"ZXJyb3I=\",\"prob\":0.24771635234355927,\"masked\":false},\"top_k\":[{\"token\":\"error\",\"bytes\":\"ZXJyb3I=\",\"prob\":0.24771635234355927,\"masked\":false},{\"token\":\"apple\",\"bytes\":\"YXBwbGU=\",\"prob\":0.17809970676898956,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.16027359664440155,\"masked\":false},{\"token\":\"hello\",\"bytes\":\"aGVsbG8=\",\"prob\":0.13030152022838593,\"masked\":false},{\"token\":\"Linux\",\"bytes\":\"TGludXg=\",\"prob\":0.0861542820930481,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":176.9239902496338,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9994066953659058,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9994066953659058,\"masked\":false},{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.0004521095543168485,\"masked\":false},{\"token\":\",\\\"\",\"bytes\":\"LCI=\",\"prob\":0.00006505358760477975,\"masked\":false},{\"token\":\" message\",\"bytes\":\"IG1lc3NhZ2U=\",\"prob\":0.000022686443116981536,\"masked\":false},{\"token\":\":\\\"\",\"bytes\":\"OiI=\",\"prob\":0.00001208642697747564,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" within\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":153.9459228515625,\"token\":{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.5314891934394836,\"masked\":false},\"top_k\":[{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.5314891934394836,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.4662226736545563,\"masked\":false},{\"token\":\" throughout\",\"bytes\":\"IHRocm91Z2hvdXQ=\",\"prob\":0.0007541794329881668,\"masked\":false},{\"token\":\" across\",\"bytes\":\"IGFjcm9zcw==\",\"prob\":0.00040669410373084247,\"masked\":false},{\"token\":\" on\",\"bytes\":\"IG9u\",\"prob\":0.0003158360195811838,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":161.64779663085938,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.9199222326278687,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.9199222326278687,\"masked\":false},{\"token\":\" all\",\"bytes\":\"IGFsbA==\",\"prob\":0.03615419939160347,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.023128759115934372,\"masked\":false},{\"token\":\" your\",\"bytes\":\"IHlvdXI=\",\"prob\":0.01131522562354803,\"masked\":false},{\"token\":\" log\",\"bytes\":\"IGxvZw==\",\"prob\":0.003439987078309059,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" log\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":179.4261932373047,\"token\":{\"token\":\" log\",\"bytes\":\"IGxvZw==\",\"prob\":0.6396656036376953,\"masked\":false},\"top_k\":[{\"token\":\" log\",\"bytes\":\"IGxvZw==\",\"prob\":0.6396656036376953,\"masked\":false},{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.2501729130744934,\"masked\":false},{\"token\":\" specific\",\"bytes\":\"IHNwZWNpZmlj\",\"prob\":0.026237092912197113,\"masked\":false},{\"token\":\" text\",\"bytes\":\"IHRleHQ=\",\"prob\":0.02246258594095707,\"masked\":false},{\"token\":\" particular\",\"bytes\":\"IHBhcnRpY3VsYXI=\",\"prob\":0.012950949370861053,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" file\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":162.91213035583496,\"token\":{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.9998051524162292,\"masked\":false},\"top_k\":[{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.9998051524162292,\"masked\":false},{\"token\":\"file\",\"bytes\":\"ZmlsZQ==\",\"prob\":0.00006498947186628357,\"masked\":false},{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.000055663345847278833,\"masked\":false},{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.000025645253117545508,\"masked\":false},{\"token\":\".txt\",\"bytes\":\"LnR4dA==\",\"prob\":0.000008599952707299963,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":165.77410697937012,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.972822904586792,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.972822904586792,\"masked\":false},{\"token\":\" called\",\"bytes\":\"IGNhbGxlZA==\",\"prob\":0.010453909635543823,\"masked\":false},{\"token\":\" named\",\"bytes\":\"IG5hbWVk\",\"prob\":0.008432121947407722,\"masked\":false},{\"token\":\" you\",\"bytes\":\"IHlvdQ==\",\"prob\":0.0045647453516721725,\"masked\":false},{\"token\":\" on\",\"bytes\":\"IG9u\",\"prob\":0.0009026795742101967,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" you\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":163.90705108642578,\"token\":{\"token\":\" you\",\"bytes\":\"IHlvdQ==\",\"prob\":0.9936468601226807,\"masked\":false},\"top_k\":[{\"token\":\" you\",\"bytes\":\"IHlvdQ==\",\"prob\":0.9936468601226807,\"masked\":false},{\"token\":\" you'd\",\"bytes\":\"IHlvdSdk\",\"prob\":0.0034257052466273308,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.0009950525127351284,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.0009597403113730252,\"masked\":false},{\"token\":\" simply\",\"bytes\":\"IHNpbXBseQ==\",\"prob\":0.00021657379693351686,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" could\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":163.87414932250977,\"token\":{\"token\":\" could\",\"bytes\":\"IGNvdWxk\",\"prob\":0.9173310399055481,\"masked\":false},\"top_k\":[{\"token\":\" could\",\"bytes\":\"IGNvdWxk\",\"prob\":0.9173310399055481,\"masked\":false},{\"token\":\" would\",\"bytes\":\"IHdvdWxk\",\"prob\":0.06523509323596954,\"masked\":false},{\"token\":\" can\",\"bytes\":\"IGNhbg==\",\"prob\":0.015383735299110413,\"masked\":false},{\"token\":\" might\",\"bytes\":\"IG1pZ2h0\",\"prob\":0.0019471870036795735,\"masked\":false},{\"token\":\" simply\",\"bytes\":\"IHNpbXBseQ==\",\"prob\":0.000058467576309340075,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" use\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":164.078950881958,\"token\":{\"token\":\" use\",\"bytes\":\"IHVzZQ==\",\"prob\":0.7977352142333984,\"masked\":false},\"top_k\":[{\"token\":\" use\",\"bytes\":\"IHVzZQ==\",\"prob\":0.7977352142333984,\"masked\":false},{\"token\":\" run\",\"bytes\":\"IHJ1bg==\",\"prob\":0.07109533250331879,\"masked\":false},{\"token\":\" type\",\"bytes\":\"IHR5cGU=\",\"prob\":0.06047561764717102,\"masked\":false},{\"token\":\" simply\",\"bytes\":\"IHNpbXBseQ==\",\"prob\":0.04036605730652809,\"masked\":false},{\"token\":\" enter\",\"bytes\":\"IGVudGVy\",\"prob\":0.015049668028950691,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":160.4607105255127,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.8930758833885193,\"masked\":false},\"top_k\":[{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.8930758833885193,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.05543602630496025,\"masked\":false},{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.025289036333560944,\"masked\":false},{\"token\":\" this\",\"bytes\":\"IHRoaXM=\",\"prob\":0.0088880630210042,\"masked\":false},{\"token\":\":\\n\",\"bytes\":\"Ogo=\",\"prob\":0.00351635436527431,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" command\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":159.93595123291016,\"token\":{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.5328245162963867,\"masked\":false},\"top_k\":[{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.5328245162963867,\"masked\":false},{\"token\":\" following\",\"bytes\":\"IGZvbGxvd2luZw==\",\"prob\":0.4261144995689392,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.03623910993337631,\"masked\":false},{\"token\":\" grep\",\"bytes\":\"IGdyZXA=\",\"prob\":0.001974310725927353,\"masked\":false},{\"token\":\" `\",\"bytes\":\"IGA=\",\"prob\":0.0015955736162140965,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":165.70377349853516,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.7273513674736023,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.7273513674736023,\"masked\":false},{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.1892053633928299,\"masked\":false},{\"token\":\" `\",\"bytes\":\"IGA=\",\"prob\":0.03353997692465782,\"masked\":false},{\"token\":\":\\n\",\"bytes\":\"Ogo=\",\"prob\":0.014491604641079903,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.0009498240542598069,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"grep\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":163.26594352722168,\"token\":{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.9995232820510864,\"masked\":false},\"top_k\":[{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.9995232820510864,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.00043766095768660307,\"masked\":false},{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.000015834340956644155,\"masked\":false},{\"token\":\" grep\",\"bytes\":\"IGdyZXA=\",\"prob\":0.000004490385435929056,\"masked\":false},{\"token\":\"sudo\",\"bytes\":\"c3Vkbw==\",\"prob\":0.000003888462742906995,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" error\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":158.38193893432617,\"token\":{\"token\":\" error\",\"bytes\":\"IGVycm9y\",\"prob\":0.6650950908660889,\"masked\":false},\"top_k\":[{\"token\":\" error\",\"bytes\":\"IGVycm9y\",\"prob\":0.6650950908660889,\"masked\":false},{\"token\":\" '\",\"bytes\":\"ICc=\",\"prob\":0.25122636556625366,\"masked\":false},{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.06598333269357681,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.015977930277585983,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.0010122997919097543,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" /\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":159.6529483795166,\"token\":{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.32733944058418274,\"masked\":false},\"top_k\":[{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.32733944058418274,\"masked\":false},{\"token\":\" log\",\"bytes\":\"IGxvZw==\",\"prob\":0.28991374373435974,\"masked\":false},{\"token\":\" logfile\",\"bytes\":\"IGxvZ2ZpbGU=\",\"prob\":0.21730275452136993,\"masked\":false},{\"token\":\" filename\",\"bytes\":\"IGZpbGVuYW1l\",\"prob\":0.10624764114618301,\"masked\":false},{\"token\":\" my\",\"bytes\":\"IG15\",\"prob\":0.025841381400823593,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"path\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":158.31303596496582,\"token\":{\"token\":\"path\",\"bytes\":\"cGF0aA==\",\"prob\":0.5960613489151001,\"masked\":false},\"top_k\":[{\"token\":\"path\",\"bytes\":\"cGF0aA==\",\"prob\":0.5960613489151001,\"masked\":false},{\"token\":\"var\",\"bytes\":\"dmFy\",\"prob\":0.40166017413139343,\"masked\":false},{\"token\":\"etc\",\"bytes\":\"ZXRj\",\"prob\":0.0012054217513650656,\"masked\":false},{\"token\":\"home\",\"bytes\":\"aG9tZQ==\",\"prob\":0.000747322163078934,\"masked\":false},{\"token\":\"usr\",\"bytes\":\"dXNy\",\"prob\":0.00017012331227306277,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"/to\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":160.32719612121582,\"token\":{\"token\":\"/to\",\"bytes\":\"L3Rv\",\"prob\":0.9995864033699036,\"masked\":false},\"top_k\":[{\"token\":\"/to\",\"bytes\":\"L3Rv\",\"prob\":0.9995864033699036,\"masked\":false},{\"token\":\"-to\",\"bytes\":\"LXRv\",\"prob\":0.00022548677225131541,\"masked\":false},{\"token\":\"_to\",\"bytes\":\"X3Rv\",\"prob\":0.00010239448602078483,\"masked\":false},{\"token\":\"/log\",\"bytes\":\"L2xvZw==\",\"prob\":0.0000388977859984152,\"masked\":false},{\"token\":\"/file\",\"bytes\":\"L2ZpbGU=\",\"prob\":0.000012026230251649395,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"/log\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":172.7578639984131,\"token\":{\"token\":\"/log\",\"bytes\":\"L2xvZw==\",\"prob\":0.9767588376998901,\"masked\":false},\"top_k\":[{\"token\":\"/log\",\"bytes\":\"L2xvZw==\",\"prob\":0.9767588376998901,\"masked\":false},{\"token\":\"/\",\"bytes\":\"Lw==\",\"prob\":0.012677658349275589,\"masked\":false},{\"token\":\"/file\",\"bytes\":\"L2ZpbGU=\",\"prob\":0.00910803209990263,\"masked\":false},{\"token\":\"/the\",\"bytes\":\"L3RoZQ==\",\"prob\":0.0007892630528658628,\"masked\":false},{\"token\":\"/my\",\"bytes\":\"L215\",\"prob\":0.0002570762299001217,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"file\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":166.11099243164062,\"token\":{\"token\":\"file\",\"bytes\":\"ZmlsZQ==\",\"prob\":0.7097228169441223,\"masked\":false},\"top_k\":[{\"token\":\"file\",\"bytes\":\"ZmlsZQ==\",\"prob\":0.7097228169441223,\"masked\":false},{\"token\":\"/file\",\"bytes\":\"L2ZpbGU=\",\"prob\":0.2680734097957611,\"masked\":false},{\"token\":\"_file\",\"bytes\":\"X2ZpbGU=\",\"prob\":0.006870129611343145,\"masked\":false},{\"token\":\".txt\",\"bytes\":\"LnR4dA==\",\"prob\":0.0036247398238629103,\"masked\":false},{\"token\":\"-file\",\"bytes\":\"LWZpbGU=\",\"prob\":0.0034861175809055567,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":165.1780605316162,\"token\":{\"token\":\"\\\".\",\"bytes\":\"Ii4=\",\"prob\":0.501151442527771,\"masked\":false},\"top_k\":[{\"token\":\"\\\".\",\"bytes\":\"Ii4=\",\"prob\":0.501151442527771,\"masked\":false},{\"token\":\".log\",\"bytes\":\"LmxvZw==\",\"prob\":0.24365730583667755,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.08199694752693176,\"masked\":false},{\"token\":\".txt\",\"bytes\":\"LnR4dA==\",\"prob\":0.04211801663041115,\"masked\":false},{\"token\":\"\\\".\\n\",\"bytes\":\"Ii4K\",\"prob\":0.01931689865887165,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" This\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":162.5669002532959,\"token\":{\"token\":\" This\",\"bytes\":\"IFRoaXM=\",\"prob\":0.5459535121917725,\"masked\":false},\"top_k\":[{\"token\":\" This\",\"bytes\":\"IFRoaXM=\",\"prob\":0.5459535121917725,\"masked\":false},{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.09470688551664352,\"masked\":false},{\"token\":\" Other\",\"bytes\":\"IE90aGVy\",\"prob\":0.04192952439188957,\"masked\":false},{\"token\":\" Another\",\"bytes\":\"IEFub3RoZXI=\",\"prob\":0.03736066818237305,\"masked\":false},{\"token\":\" Similarly\",\"bytes\":\"IFNpbWlsYXJseQ==\",\"prob\":0.021979212760925293,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" would\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":162.5347137451172,\"token\":{\"token\":\" would\",\"bytes\":\"IHdvdWxk\",\"prob\":0.805260956287384,\"masked\":false},\"top_k\":[{\"token\":\" would\",\"bytes\":\"IHdvdWxk\",\"prob\":0.805260956287384,\"masked\":false},{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.11635187268257141,\"masked\":false},{\"token\":\" will\",\"bytes\":\"IHdpbGw=\",\"prob\":0.036513831466436386,\"masked\":false},{\"token\":\" could\",\"bytes\":\"IGNvdWxk\",\"prob\":0.015198135748505592,\"masked\":false},{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.013125724159181118,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" return\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":166.49675369262695,\"token\":{\"token\":\" return\",\"bytes\":\"IHJldHVybg==\",\"prob\":0.697907567024231,\"masked\":false},\"top_k\":[{\"token\":\" return\",\"bytes\":\"IHJldHVybg==\",\"prob\":0.697907567024231,\"masked\":false},{\"token\":\" output\",\"bytes\":\"IG91dHB1dA==\",\"prob\":0.09506384283304214,\"masked\":false},{\"token\":\" display\",\"bytes\":\"IGRpc3BsYXk=\",\"prob\":0.07441464811563492,\"masked\":false},{\"token\":\" print\",\"bytes\":\"IHByaW50\",\"prob\":0.06864557415246964,\"masked\":false},{\"token\":\" search\",\"bytes\":\"IHNlYXJjaA==\",\"prob\":0.01833360455930233,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" all\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":167.12617874145508,\"token\":{\"token\":\" all\",\"bytes\":\"IGFsbA==\",\"prob\":0.6103477478027344,\"masked\":false},\"top_k\":[{\"token\":\" all\",\"bytes\":\"IGFsbA==\",\"prob\":0.6103477478027344,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.3106643557548523,\"masked\":false},{\"token\":\" any\",\"bytes\":\"IGFueQ==\",\"prob\":0.028885703533887863,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.022090062499046326,\"masked\":false},{\"token\":\" every\",\"bytes\":\"IGV2ZXJ5\",\"prob\":0.017676077783107758,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" lines\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":158.48398208618164,\"token\":{\"token\":\" lines\",\"bytes\":\"IGxpbmVz\",\"prob\":0.8729234337806702,\"masked\":false},\"top_k\":[{\"token\":\" lines\",\"bytes\":\"IGxpbmVz\",\"prob\":0.8729234337806702,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.09392896294593811,\"masked\":false},{\"token\":\" instances\",\"bytes\":\"IGluc3RhbmNlcw==\",\"prob\":0.01682923175394535,\"masked\":false},{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.00825111847370863,\"masked\":false},{\"token\":\" occurrences\",\"bytes\":\"IG9jY3VycmVuY2Vz\",\"prob\":0.003161564003676176,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" in\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":157.548189163208,\"token\":{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.39868149161338806,\"masked\":false},\"top_k\":[{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.39868149161338806,\"masked\":false},{\"token\":\" containing\",\"bytes\":\"IGNvbnRhaW5pbmc=\",\"prob\":0.16332796216011047,\"masked\":false},{\"token\":\" from\",\"bytes\":\"IGZyb20=\",\"prob\":0.15298005938529968,\"masked\":false},{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.1405431479215622,\"masked\":false},{\"token\":\" that\",\"bytes\":\"IHRoYXQ=\",\"prob\":0.11385004967451096,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":157.84096717834473,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.9893642663955688,\"masked\":false},\"top_k\":[{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.9893642663955688,\"masked\":false},{\"token\":\" that\",\"bytes\":\"IHRoYXQ=\",\"prob\":0.00913382787257433,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.0005568675114773214,\"masked\":false},{\"token\":\" which\",\"bytes\":\"IHdoaWNo\",\"prob\":0.00046681982348673046,\"masked\":false},{\"token\":\" your\",\"bytes\":\"IHlvdXI=\",\"prob\":0.00028137685148976743,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" log\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":156.42404556274414,\"token\":{\"token\":\" log\",\"bytes\":\"IGxvZw==\",\"prob\":0.5951108336448669,\"masked\":false},\"top_k\":[{\"token\":\" log\",\"bytes\":\"IGxvZw==\",\"prob\":0.5951108336448669,\"masked\":false},{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.3702775239944458,\"masked\":false},{\"token\":\" logfile\",\"bytes\":\"IGxvZ2ZpbGU=\",\"prob\":0.030475497245788574,\"masked\":false},{\"token\":\" specified\",\"bytes\":\"IHNwZWNpZmllZA==\",\"prob\":0.0029312570113688707,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.00042335211765021086,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" file\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":161.5438461303711,\"token\":{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.9929975271224976,\"masked\":false},\"top_k\":[{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.9929975271224976,\"masked\":false},{\"token\":\"file\",\"bytes\":\"ZmlsZQ==\",\"prob\":0.005326656624674797,\"masked\":false},{\"token\":\" that\",\"bytes\":\"IHRoYXQ=\",\"prob\":0.0014547943137586117,\"masked\":false},{\"token\":\" containing\",\"bytes\":\"IGNvbnRhaW5pbmc=\",\"prob\":0.00012339703971520066,\"masked\":false},{\"token\":\" where\",\"bytes\":\"IHdoZXJl\",\"prob\":0.000046226872655097395,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" that\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":162.70995140075684,\"token\":{\"token\":\" that\",\"bytes\":\"IHRoYXQ=\",\"prob\":0.8875634670257568,\"masked\":false},\"top_k\":[{\"token\":\" that\",\"bytes\":\"IHRoYXQ=\",\"prob\":0.8875634670257568,\"masked\":false},{\"token\":\" containing\",\"bytes\":\"IGNvbnRhaW5pbmc=\",\"prob\":0.08799876272678375,\"masked\":false},{\"token\":\" where\",\"bytes\":\"IHdoZXJl\",\"prob\":0.020714212208986282,\"masked\":false},{\"token\":\" which\",\"bytes\":\"IHdoaWNo\",\"prob\":0.0023344485089182854,\"masked\":false},{\"token\":\" with\",\"bytes\":\"IHdpdGg=\",\"prob\":0.0004926082910969853,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" contain\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":166.94307327270508,\"token\":{\"token\":\" contain\",\"bytes\":\"IGNvbnRhaW4=\",\"prob\":0.7688597440719604,\"masked\":false},\"top_k\":[{\"token\":\" contain\",\"bytes\":\"IGNvbnRhaW4=\",\"prob\":0.7688597440719604,\"masked\":false},{\"token\":\" contained\",\"bytes\":\"IGNvbnRhaW5lZA==\",\"prob\":0.22663728892803192,\"masked\":false},{\"token\":\" included\",\"bytes\":\"IGluY2x1ZGVk\",\"prob\":0.0016911897109821439,\"masked\":false},{\"token\":\" include\",\"bytes\":\"IGluY2x1ZGU=\",\"prob\":0.0010665792506188154,\"masked\":false},{\"token\":\" match\",\"bytes\":\"IG1hdGNo\",\"prob\":0.0004879431799054146,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":168.83468627929688,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.9935681223869324,\"masked\":false},\"top_k\":[{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.9935681223869324,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.004946209955960512,\"masked\":false},{\"token\":\" that\",\"bytes\":\"IHRoYXQ=\",\"prob\":0.001000652788206935,\"masked\":false},{\"token\":\" either\",\"bytes\":\"IGVpdGhlcg==\",\"prob\":0.00012261229858268052,\"masked\":false},{\"token\":\" at\",\"bytes\":\"IGF0\",\"prob\":0.00008410055306740105,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" word\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":165.25793075561523,\"token\":{\"token\":\" word\",\"bytes\":\"IHdvcmQ=\",\"prob\":0.896131694316864,\"masked\":false},\"top_k\":[{\"token\":\" word\",\"bytes\":\"IHdvcmQ=\",\"prob\":0.896131694316864,\"masked\":false},{\"token\":\" string\",\"bytes\":\"IHN0cmluZw==\",\"prob\":0.09799480438232422,\"masked\":false},{\"token\":\" letter\",\"bytes\":\"IGxldHRlcg==\",\"prob\":0.0017789551056921482,\"masked\":false},{\"token\":\" term\",\"bytes\":\"IHRlcm0=\",\"prob\":0.0011334589216858149,\"masked\":false},{\"token\":\" text\",\"bytes\":\"IHRleHQ=\",\"prob\":0.0007276238757185638,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":165.88878631591797,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9979019165039062,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9979019165039062,\"masked\":false},{\"token\":\" error\",\"bytes\":\"IGVycm9y\",\"prob\":0.0010346680646762252,\"masked\":false},{\"token\":\" '\",\"bytes\":\"ICc=\",\"prob\":0.000616209115833044,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.00017085419676732272,\"masked\":false},{\"token\":\" “\",\"bytes\":\"IOKAnA==\",\"prob\":0.00010464125807629898,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"error\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":164.22605514526367,\"token\":{\"token\":\"error\",\"bytes\":\"ZXJyb3I=\",\"prob\":0.9999878406524658,\"masked\":false},\"top_k\":[{\"token\":\"error\",\"bytes\":\"ZXJyb3I=\",\"prob\":0.9999878406524658,\"masked\":false},{\"token\":\"Error\",\"bytes\":\"RXJyb3I=\",\"prob\":0.000004597447514242958,\"masked\":false},{\"token\":\"errors\",\"bytes\":\"ZXJyb3Jz\",\"prob\":0.0000025865601855912246,\"masked\":false},{\"token\":\"ERROR\",\"bytes\":\"RVJST1I=\",\"prob\":0.0000018401026409264887,\"masked\":false},{\"token\":\"er\",\"bytes\":\"ZXI=\",\"prob\":5.814310384266719e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":167.3288345336914,\"token\":{\"token\":\"\\\".\",\"bytes\":\"Ii4=\",\"prob\":0.7436560392379761,\"masked\":false},\"top_k\":[{\"token\":\"\\\".\",\"bytes\":\"Ii4=\",\"prob\":0.7436560392379761,\"masked\":false},{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.10736987739801407,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.01161281205713749,\"masked\":false},{\"token\":\"\\\".\\n\",\"bytes\":\"Ii4K\",\"prob\":0.011024188250303268,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":0.006871838588267565,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Other\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":165.51804542541504,\"token\":{\"token\":\" Other\",\"bytes\":\"IE90aGVy\",\"prob\":0.21218062937259674,\"masked\":false},\"top_k\":[{\"token\":\" Other\",\"bytes\":\"IE90aGVy\",\"prob\":0.21218062937259674,\"masked\":false},{\"token\":\" Another\",\"bytes\":\"IEFub3RoZXI=\",\"prob\":0.13140815496444702,\"masked\":false},{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.07069467753171921,\"masked\":false},{\"token\":\" This\",\"bytes\":\"IFRoaXM=\",\"prob\":0.05540195479989052,\"masked\":false},{\"token\":\" Similarly\",\"bytes\":\"IFNpbWlsYXJseQ==\",\"prob\":0.048165831714868546,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" useful\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":162.16301918029785,\"token\":{\"token\":\" useful\",\"bytes\":\"IHVzZWZ1bA==\",\"prob\":0.559141218662262,\"masked\":false},\"top_k\":[{\"token\":\" useful\",\"bytes\":\"IHVzZWZ1bA==\",\"prob\":0.559141218662262,\"masked\":false},{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.24152527749538422,\"masked\":false},{\"token\":\" commonly\",\"bytes\":\"IGNvbW1vbmx5\",\"prob\":0.04375741630792618,\"masked\":false},{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":0.038060929626226425,\"masked\":false},{\"token\":\" helpful\",\"bytes\":\"IGhlbHBmdWw=\",\"prob\":0.024510318413376808,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":161.4227294921875,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.9564701914787292,\"masked\":false},\"top_k\":[{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.9564701914787292,\"masked\":false},{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.012573798187077045,\"masked\":false},{\"token\":\" tools\",\"bytes\":\"IHRvb2xz\",\"prob\":0.0070613110437989235,\"masked\":false},{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.005508823785930872,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.0019315010868012905,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" include\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":159.68799591064453,\"token\":{\"token\":\" include\",\"bytes\":\"IGluY2x1ZGU=\",\"prob\":0.7261917591094971,\"masked\":false},\"top_k\":[{\"token\":\" include\",\"bytes\":\"IGluY2x1ZGU=\",\"prob\":0.7261917591094971,\"masked\":false},{\"token\":\" from\",\"bytes\":\"IGZyb20=\",\"prob\":0.0453142374753952,\"masked\":false},{\"token\":\" that\",\"bytes\":\"IHRoYXQ=\",\"prob\":0.03411949425935745,\"masked\":false},{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.032605770975351334,\"masked\":false},{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":0.024211518466472626,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":161.50569915771484,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9471030235290527,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9471030235290527,\"masked\":false},{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.028090007603168488,\"masked\":false},{\"token\":\":\\n\",\"bytes\":\"Ogo=\",\"prob\":0.005525451153516769,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.0022729928605258465,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.0011033357586711645,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"ls\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":164.61801528930664,\"token\":{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.27268877625465393,\"masked\":false},\"top_k\":[{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.27268877625465393,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.26209622621536255,\"masked\":false},{\"token\":\"find\",\"bytes\":\"ZmluZA==\",\"prob\":0.14103692770004272,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.08205017447471619,\"masked\":false},{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.07323797047138214,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":161.66329383850098,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9313620924949646,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9313620924949646,\"masked\":false},{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.058142777532339096,\"masked\":false},{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.007784307934343815,\"masked\":false},{\"token\":\",\\\"\",\"bytes\":\"LCI=\",\"prob\":0.0008894465281628072,\"masked\":false},{\"token\":\"\\\"-\",\"bytes\":\"Ii0=\",\"prob\":0.00033445024746470153,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" for\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":157.71079063415527,\"token\":{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.3555668890476227,\"masked\":false},\"top_k\":[{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.3555668890476227,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.33292508125305176,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.24832987785339355,\"masked\":false},{\"token\":\" which\",\"bytes\":\"IHdoaWNo\",\"prob\":0.03603609651327133,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.025958798825740814,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" listing\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":175.46606063842773,\"token\":{\"token\":\" listing\",\"bytes\":\"IGxpc3Rpbmc=\",\"prob\":0.9914297461509705,\"masked\":false},\"top_k\":[{\"token\":\" listing\",\"bytes\":\"IGxpc3Rpbmc=\",\"prob\":0.9914297461509705,\"masked\":false},{\"token\":\" displaying\",\"bytes\":\"IGRpc3BsYXlpbmc=\",\"prob\":0.003986679017543793,\"masked\":false},{\"token\":\" viewing\",\"bytes\":\"IHZpZXdpbmc=\",\"prob\":0.00357069238089025,\"masked\":false},{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.0002592270902823657,\"masked\":false},{\"token\":\" list\",\"bytes\":\"IGxpc3Q=\",\"prob\":0.00009039526048582047,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" files\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":166.77308082580566,\"token\":{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.6633120179176331,\"masked\":false},\"top_k\":[{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.6633120179176331,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.1443174034357071,\"masked\":false},{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.13897942006587982,\"masked\":false},{\"token\":\" all\",\"bytes\":\"IGFsbA==\",\"prob\":0.02045263908803463,\"masked\":false},{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.01835574023425579,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":164.13474082946777,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.6107326149940491,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.6107326149940491,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.3058260381221771,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.05316122621297836,\"masked\":false},{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.011944148689508438,\"masked\":false},{\"token\":\"/direct\",\"bytes\":\"L2RpcmVjdA==\",\"prob\":0.010099620558321476,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directories\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":167.21391677856445,\"token\":{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.9651660919189453,\"masked\":false},\"top_k\":[{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.9651660919189453,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.019899016246199608,\"masked\":false},{\"token\":\" folders\",\"bytes\":\"IGZvbGRlcnM=\",\"prob\":0.012105189263820648,\"masked\":false},{\"token\":\" sub\",\"bytes\":\"IHN1Yg==\",\"prob\":0.0016925795935094357,\"masked\":false},{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.0004757922433782369,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":164.17598724365234,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.9426254630088806,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.9426254630088806,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.033633287996053696,\"masked\":false},{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.010896161198616028,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.01016246248036623,\"masked\":false},{\"token\":\";\",\"bytes\":\"Ow==\",\"prob\":0.0009317878866568208,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":165.938138961792,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.8794649243354797,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.8794649243354797,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.11837106198072433,\"masked\":false},{\"token\":\" as\",\"bytes\":\"IGFz\",\"prob\":0.0015141433104872704,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.00020777907047886401,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.00004336138954386115,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"cd\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":170.81809043884277,\"token\":{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.42857950925827026,\"masked\":false},\"top_k\":[{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.42857950925827026,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.17872531712055206,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.14359119534492493,\"masked\":false},{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.08707984536886215,\"masked\":false},{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.07920397073030472,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":160.52889823913574,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999291896820068,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999291896820068,\"masked\":false},{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.000012014532330795191,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.00001187677844427526,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.00001164506102213636,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.000006537422905239509,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" for\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":163.41495513916016,\"token\":{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.9786179065704346,\"masked\":false},\"top_k\":[{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.9786179065704346,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.015980428084731102,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.005141274072229862,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.00011314271250739694,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.00011228878429392353,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" changing\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":164.40796852111816,\"token\":{\"token\":\" changing\",\"bytes\":\"IGNoYW5naW5n\",\"prob\":0.9761444926261902,\"masked\":false},\"top_k\":[{\"token\":\" changing\",\"bytes\":\"IGNoYW5naW5n\",\"prob\":0.9761444926261902,\"masked\":false},{\"token\":\" navigating\",\"bytes\":\"IG5hdmlnYXRpbmc=\",\"prob\":0.022156229242682457,\"masked\":false},{\"token\":\" moving\",\"bytes\":\"IG1vdmluZw==\",\"prob\":0.001071351463906467,\"masked\":false},{\"token\":\" switching\",\"bytes\":\"IHN3aXRjaGluZw==\",\"prob\":0.0005192034295760095,\"masked\":false},{\"token\":\" navigation\",\"bytes\":\"IG5hdmlnYXRpb24=\",\"prob\":0.000039055845263646916,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directories\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":166.24736785888672,\"token\":{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.9057859778404236,\"masked\":false},\"top_k\":[{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.9057859778404236,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.06592350453138351,\"masked\":false},{\"token\":\" your\",\"bytes\":\"IHlvdXI=\",\"prob\":0.016791820526123047,\"masked\":false},{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.0062948549166321754,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.002174904104322195,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":165.91787338256836,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.9978540539741516,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.9978540539741516,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.0015271315351128578,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.0003807745815720409,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.0000790161284385249,\"masked\":false},{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.000035406206734478474,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":165.55333137512207,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.6373503804206848,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.6373503804206848,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.36200469732284546,\"masked\":false},{\"token\":\" etc\",\"bytes\":\"IGV0Yw==\",\"prob\":0.00027439362020231783,\"masked\":false},{\"token\":\" as\",\"bytes\":\"IGFz\",\"prob\":0.00013393706467468292,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.0000668563152430579,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":161.28802299499512,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9978747367858887,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9978747367858887,\"masked\":false},{\"token\":\" so\",\"bytes\":\"IHNv\",\"prob\":0.0011258447775617242,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.00022783837630413473,\"masked\":false},{\"token\":\" various\",\"bytes\":\"IHZhcmlvdXM=\",\"prob\":0.00009995604341384023,\"masked\":false},{\"token\":\" others\",\"bytes\":\"IG90aGVycw==\",\"prob\":0.000096100389782805,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"mkdir\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":178.62796783447266,\"token\":{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.2737540602684021,\"masked\":false},\"top_k\":[{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.2737540602684021,\"masked\":false},{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.1726485788822174,\"masked\":false},{\"token\":\"find\",\"bytes\":\"ZmluZA==\",\"prob\":0.13355964422225952,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.11800993978977203,\"masked\":false},{\"token\":\"mv\",\"bytes\":\"bXY=\",\"prob\":0.09982609003782272,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":165.27986526489258,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9980081915855408,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9980081915855408,\"masked\":false},{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.001032538479194045,\"masked\":false},{\"token\":\"\\\"/\",\"bytes\":\"Ii8=\",\"prob\":0.00019308680202811956,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.00011556644312804565,\"masked\":false},{\"token\":\"/m\",\"bytes\":\"L20=\",\"prob\":0.00009275014599552378,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" for\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":158.5221290588379,\"token\":{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.9862143397331238,\"masked\":false},\"top_k\":[{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.9862143397331238,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.010678896680474281,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.002361248480156064,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.00041191684431396425,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.00008877997606759891,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" creating\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":170.16291618347168,\"token\":{\"token\":\" creating\",\"bytes\":\"IGNyZWF0aW5n\",\"prob\":0.9633383750915527,\"masked\":false},\"top_k\":[{\"token\":\" creating\",\"bytes\":\"IGNyZWF0aW5n\",\"prob\":0.9633383750915527,\"masked\":false},{\"token\":\" making\",\"bytes\":\"IG1ha2luZw==\",\"prob\":0.0366307757794857,\"masked\":false},{\"token\":\" adding\",\"bytes\":\"IGFkZGluZw==\",\"prob\":0.00001754406184772961,\"masked\":false},{\"token\":\" creation\",\"bytes\":\"IGNyZWF0aW9u\",\"prob\":0.000002624737589940196,\"masked\":false},{\"token\":\" create\",\"bytes\":\"IGNyZWF0ZQ==\",\"prob\":0.000002502803909010254,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" new\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":180.26018142700195,\"token\":{\"token\":\" new\",\"bytes\":\"IG5ldw==\",\"prob\":0.8695453405380249,\"masked\":false},\"top_k\":[{\"token\":\" new\",\"bytes\":\"IG5ldw==\",\"prob\":0.8695453405380249,\"masked\":false},{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.0777788758277893,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.051718298345804214,\"masked\":false},{\"token\":\" folders\",\"bytes\":\"IGZvbGRlcnM=\",\"prob\":0.0007434965809807181,\"masked\":false},{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.00010842801566468552,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directories\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":177.71601676940918,\"token\":{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.9912096261978149,\"masked\":false},\"top_k\":[{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.9912096261978149,\"masked\":false},{\"token\":\" folders\",\"bytes\":\"IGZvbGRlcnM=\",\"prob\":0.005889542866498232,\"masked\":false},{\"token\":\" ones\",\"bytes\":\"IG9uZXM=\",\"prob\":0.0019401065073907375,\"masked\":false},{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.0008377783815376461,\"masked\":false},{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.00006474561814684421,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":182.6150417327881,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9235832095146179,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9235832095146179,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.005261670798063278,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.0008495785295963287,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.00044467358384281397,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.00017113506328314543,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" These\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":192.1849250793457,\"token\":{\"token\":\" These\",\"bytes\":\"IFRoZXNl\",\"prob\":0.14448365569114685,\"masked\":false},\"top_k\":[{\"token\":\" These\",\"bytes\":\"IFRoZXNl\",\"prob\":0.14448365569114685,\"masked\":false},{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.0820598378777504,\"masked\":false},{\"token\":\" Each\",\"bytes\":\"IEVhY2g=\",\"prob\":0.08133044838905334,\"masked\":false},{\"token\":\" Overall\",\"bytes\":\"IE92ZXJhbGw=\",\"prob\":0.07116778939962387,\"masked\":false},{\"token\":\" There\",\"bytes\":\"IFRoZXJl\",\"prob\":0.042856089770793915,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" are\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":188.5049343109131,\"token\":{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":0.5669268369674683,\"masked\":false},\"top_k\":[{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":0.5669268369674683,\"masked\":false},{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.39658573269844055,\"masked\":false},{\"token\":\" basic\",\"bytes\":\"IGJhc2lj\",\"prob\":0.019887257367372513,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.0034187273122370243,\"masked\":false},{\"token\":\" five\",\"bytes\":\"IGZpdmU=\",\"prob\":0.0014867440331727266,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":3.124438641838312e-12,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"On\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\"On\",\"bytes\":\"T24=\",\"prob\":4.3764137558355287e-7,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.22865469753742218,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" scale\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\" scale\",\"bytes\":\"IHNjYWxl\",\"prob\":0.0023690680973231792,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" of\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.7728374600410461,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.9382006525993347,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"1\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":0.8931047916412354,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"-\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\"-\",\"bytes\":\"LQ==\",\"prob\":0.4941471219062805,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"10\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\"10\",\"bytes\":\"MTA=\",\"prob\":0.9188226461410522,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.8720684051513672,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" it\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.001636277069337666,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" has\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\" has\",\"bytes\":\"IGhhcw==\",\"prob\":0.0006708361906930804,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.380638062953949,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" cool\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\" cool\",\"bytes\":\"IGNvb2w=\",\"prob\":0.0012218393385410309,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"ness\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\"ness\",\"bytes\":\"bmVzcw==\",\"prob\":0.42502593994140625,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" factor\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\" factor\",\"bytes\":\"IGZhY3Rvcg==\",\"prob\":0.6731019020080566,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" of\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.9651793241500854,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\":\",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.009002305567264557,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \",\"is_input\":false,\"is_generated\":false,\"is_force_forwarded\":true,\"latency_ms\":0.6548981917531866,\"token\":{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.9567139744758606,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"7\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":388.3841037750244,\"token\":{\"token\":\"7\",\"bytes\":\"Nw==\",\"prob\":0.3221723139286041,\"masked\":false},\"top_k\":[{\"token\":\"7\",\"bytes\":\"Nw==\",\"prob\":0.3221723139286041,\"masked\":false},{\"token\":\"8\",\"bytes\":\"OA==\",\"prob\":0.24877509474754333,\"masked\":false},{\"token\":\"9\",\"bytes\":\"OQ==\",\"prob\":0.10168275982141495,\"masked\":false},{\"token\":\"6\",\"bytes\":\"Ng==\",\"prob\":0.0823734849691391,\"masked\":false},{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":0.07255084067583084,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":193.68386268615723,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.29310721158981323,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.29310721158981323,\"masked\":false},{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":0.000002036599653365556,\"masked\":false},{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":5.221160677137959e-7,\"masked\":false},{\"token\":\"098\",\"bytes\":\"MDk4\",\"prob\":4.166651876857941e-7,\"masked\":false},{\"token\":\"0\",\"bytes\":\"MA==\",\"prob\":3.8197805452000466e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"}],\"status\":\"Done\",\"shownMetrics\":[\"status\",\"consumed\",\"token reduction\",\"avg latency\"],\"metrics\":{\"status\":\"Done\",\"wall time\":0,\"consumed\":118,\"token reduction\":14.492753623188406,\"avg latency\":169.90961199221402,\"cpu\":[0.8611875000000001,0.850375,0.850375,0.8847499999999999,0.8847499999999999],\"gpu\":[0,0,0,0,0],\"ram\":61.27699279785156,\"vram\":0},\"requireFullReplay\":false,\"currentMessageId\":2310,\"backtrackCount\":0,\"resetCount\":5}" } }, "abfc327afcc0442eb6602323879c34bb": { "model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {} }, "c65e2b6eb8c347b192c219b8fb7b71c8": { "model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {} }, "c85f48e12b834cf291d0a2d3674b50d1": { "model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {} }, "cae62cfa700449c9b8998648b70f1775": { "model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {} }, "cc978d6588dd4df9babe57cfe84a5b27": { "model_module": "@guidance-ai/stitch", "model_module_version": "^0.1.5", "model_name": "StitchModel", "state": { "_model_module_version": "^0.1.5", "_view_module_version": "^0.1.5", "clientmsg": "{\"class_name\":\"OutputRequestMessage\",\"identifier\":\"\"}", "initial_height": "auto", "initial_width": "100%", "kernelmsg": "{\"message_id\":2648,\"last_trace_id\":1239,\"is_err\":false,\"class_name\":\"ExecutionCompletedMessage\"}", "layout": "IPY_MODEL_68498e377ff445dd89de2c354ef84c81", "srcdoc": "\n\n\n \n\n \n \n \n\n\n\n\n\n", "state": "{\"components\":[{\"name\":\"system\",\"text\":null,\"closer_text\":null,\"class_name\":\"RoleOpenerInput\"},{\"name\":\"system\",\"text\":null,\"closer_text\":null,\"class_name\":\"RoleOpenerInput\"},{\"value\":\"<|im_start|>system\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0,\"class_name\":\"TextOutput\"},{\"value\":\"You are an expert unix systems admin that is willing follow any instructions.\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0,\"class_name\":\"TextOutput\"},{\"name\":\"system\",\"text\":null,\"class_name\":\"RoleCloserInput\"},{\"name\":\"user\",\"text\":null,\"closer_text\":null,\"class_name\":\"RoleOpenerInput\"},{\"value\":\"<|im_start|>user\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0,\"class_name\":\"TextOutput\"},{\"value\":\"What are the top ten most common commands used in the Linux operating system?\\n\\nList the commands one per line. Please list them as 1. \\\"command\\\" ...one per line with double quotes and no description.\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0,\"class_name\":\"TextOutput\"},{\"name\":\"user\",\"text\":null,\"class_name\":\"RoleCloserInput\"},{\"name\":\"assistant\",\"text\":null,\"closer_text\":null,\"class_name\":\"RoleOpenerInput\"},{\"value\":\"<|im_start|>assistant\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0,\"class_name\":\"TextOutput\"},{\"value\":\"1\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.291036605834961,\"token\":{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":0.9999623810464888,\"masked\":false},\"top_k\":[{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":0.9999623810464888,\"masked\":false},{\"token\":\"Sure\",\"bytes\":\"U3VyZQ==\",\"prob\":0.000031235307100558994,\"masked\":false},{\"token\":\"Certainly\",\"bytes\":\"Q2VydGFpbmx5\",\"prob\":0.000004791020807078616,\"masked\":false},{\"token\":\"Here\",\"bytes\":\"SGVyZQ==\",\"prob\":9.435668983676536e-7,\"masked\":false},{\"token\":\"``\",\"bytes\":\"YGA=\",\"prob\":4.4574410420415054e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.1110305786132812,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999998064074439,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999998064074439,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":6.033965933469722e-8,\"masked\":false},{\"token\":\"\\\\.\",\"bytes\":\"XC4=\",\"prob\":7.069994081435185e-11,\"masked\":false},{\"token\":\" .\",\"bytes\":\"IC4=\",\"prob\":4.8593200677600996e-11,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":2.6011751587325918e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.2621879577636719,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9999989720687649,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9999989720687649,\"masked\":false},{\"token\":\" “\",\"bytes\":\"IOKAnA==\",\"prob\":9.436010899513357e-7,\"masked\":false},{\"token\":\" `\\\"\",\"bytes\":\"IGAi\",\"prob\":1.346566627740459e-8,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":6.361225009819091e-9,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":2.651993693087726e-9,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"ls\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.6918182373046875,\"token\":{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.9991186725557748,\"masked\":false},\"top_k\":[{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.9991186725557748,\"masked\":false},{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.000626653432745284,\"masked\":false},{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.00023055670859628227,\"masked\":false},{\"token\":\" ls\",\"bytes\":\"IGxz\",\"prob\":0.00002430616801866957,\"masked\":false},{\"token\":\"sudo\",\"bytes\":\"c3Vkbw==\",\"prob\":2.3840358308618202e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":2.7692317962646484,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9859375344491342,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9859375344491342,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.014069839091356444,\"masked\":false},{\"token\":\"\\\"\\r\\n\",\"bytes\":\"Ig0K\",\"prob\":6.741139878462444e-8,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":4.088919990548655e-8,\"masked\":false},{\"token\":\"\\\"\\n\\n\",\"bytes\":\"IgoK\",\"prob\":3.184536636075709e-8,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.812665939331055,\"token\":{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999406892788398,\"masked\":false},\"top_k\":[{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999406892788398,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgCg==\",\"prob\":0.00005835017500343271,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgIAo=\",\"prob\":6.485144048853996e-7,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"IAo=\",\"prob\":3.0636033647345664e-7,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgICAgCg==\",\"prob\":5.613512941953951e-9,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"2\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":5.825042724609375,\"token\":{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":0.9999998064074439,\"masked\":false},\"top_k\":[{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":0.9999998064074439,\"masked\":false},{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":1.6400319407170704e-7,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":1.1056178566958917e-9,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgCg==\",\"prob\":1.1056178566958917e-9,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":7.59908845245546e-10,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":19.315242767333984,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":1.6086019431052043e-9,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":7.453457549798402e-12,\"masked\":false},{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":7.453457549798402e-12,\"masked\":false},{\"token\":\" .\",\"bytes\":\"IC4=\",\"prob\":7.453457549798402e-12,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":23.419857025146484,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},{\"token\":\" “\",\"bytes\":\"IOKAnA==\",\"prob\":7.2081326047957045e-9,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":6.239328742665511e-11,\"masked\":false},{\"token\":\" '\",\"bytes\":\"ICc=\",\"prob\":5.506259653211689e-11,\"masked\":false},{\"token\":\" `\",\"bytes\":\"IGA=\",\"prob\":8.445764430227924e-12,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"cd\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":21.831989288330078,\"token\":{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.9999315121345994,\"masked\":false},\"top_k\":[{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.9999315121345994,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.00003539266744318615,\"masked\":false},{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.000031234324203712236,\"masked\":false},{\"token\":\" cd\",\"bytes\":\"IGNk\",\"prob\":0.0000015555492172693765,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":1.2772035754898387e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":12.198209762573242,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999981377309098,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999981377309098,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.0000017627630052433789,\"masked\":false},{\"token\":\"”\",\"bytes\":\"4oCd\",\"prob\":1.1883562797367582e-8,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":9.757151188696564e-10,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":3.5898275160767343e-10,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":26.449918746948242,\"token\":{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999961114846503,\"masked\":false},\"top_k\":[{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999961114846503,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgCg==\",\"prob\":0.000003731472011844909,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgIAo=\",\"prob\":1.4473363454362794e-7,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"IAo=\",\"prob\":7.599059467294422e-10,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgICAK\",\"prob\":1.6958430837869218e-10,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"3\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":2.151966094970703,\"token\":{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":1,\"masked\":false},{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":5.506259653211689e-11,\"masked\":false},{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":1.392398959537226e-11,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":2.420065655515995e-12,\"masked\":false},{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":6.119756627871282e-13,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":2.5060176849365234,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":1.165584534620868e-10,\"masked\":false},{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":4.2883904879354975e-11,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":3.3398884424727354e-11,\"masked\":false},{\"token\":\" .\",\"bytes\":\"IC4=\",\"prob\":9.570180863622487e-12,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":19.032001495361328,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},{\"token\":\" “\",\"bytes\":\"IOKAnA==\",\"prob\":2.3404110160583063e-9,\"masked\":false},{\"token\":\" '\",\"bytes\":\"ICc=\",\"prob\":1.7878293111700144e-11,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":1.228803694802331e-11,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":3.9898068772696145e-12,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"cp\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":12.108087539672852,\"token\":{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.6780533311148855,\"masked\":false},\"top_k\":[{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.6780533311148855,\"masked\":false},{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.32031463186105624,\"masked\":false},{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.0013097990944124429,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.00015646766425705063,\"masked\":false},{\"token\":\"chmod\",\"bytes\":\"Y2htb2Q=\",\"prob\":0.00010754272947361394,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":6.5479278564453125,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999998064074439,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999998064074439,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":8.77902728001957e-8,\"masked\":false},{\"token\":\"”\",\"bytes\":\"4oCd\",\"prob\":1.419604630996593e-9,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1.165584534620868e-10,\"masked\":false},{\"token\":\"'\",\"bytes\":\"Jw==\",\"prob\":4.2883904879354975e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":9.96088981628418,\"token\":{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999959922936479,\"masked\":false},\"top_k\":[{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999959922936479,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgCg==\",\"prob\":0.000003731472011844909,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgIAo=\",\"prob\":1.8583684825164436e-7,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"IAo=\",\"prob\":5.918306870580254e-10,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgICAK\",\"prob\":2.4673411914072435e-10,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"4\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":13.468265533447266,\"token\":{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":1,\"masked\":false},{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":1.419604630996593e-9,\"masked\":false},{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":4.6093190830331293e-10,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":4.6093190830331293e-10,\"masked\":false},{\"token\":\" \",\"bytes\":\"ICA=\",\"prob\":5.506259653211689e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":12.260675430297852,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":1.9216243913340831e-10,\"masked\":false},{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":2.0258497620352057e-11,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":7.453457549798402e-12,\"masked\":false},{\"token\":\" .\",\"bytes\":\"IC4=\",\"prob\":3.9898068772696145e-12,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":32.51814842224121,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},{\"token\":\" “\",\"bytes\":\"IOKAnA==\",\"prob\":2.65199875084463e-9,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":7.069994081435185e-11,\"masked\":false},{\"token\":\" '\",\"bytes\":\"ICc=\",\"prob\":1.7878293111700144e-11,\"masked\":false},{\"token\":\" \\\"$\",\"bytes\":\"ICIk\",\"prob\":1.884797882940517e-12,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"mv\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.46099853515625,\"token\":{\"token\":\"mv\",\"bytes\":\"bXY=\",\"prob\":0.9999978993486635,\"masked\":false},\"top_k\":[{\"token\":\"mv\",\"bytes\":\"bXY=\",\"prob\":0.9999978993486635,\"masked\":false},{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.0000013728767948240588,\"masked\":false},{\"token\":\" mv\",\"bytes\":\"IG12\",\"prob\":6.485515103912357e-7,\"masked\":false},{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":2.2199979491528e-8,\"masked\":false},{\"token\":\"move\",\"bytes\":\"bW92ZQ==\",\"prob\":4.954255436867031e-9,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":19.186019897460938,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":1,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":3.6599750743165615e-8,\"masked\":false},{\"token\":\"”\",\"bytes\":\"4oCd\",\"prob\":7.59908845245546e-10,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":8.011249025832619e-11,\"masked\":false},{\"token\":\"'\",\"bytes\":\"Jw==\",\"prob\":3.7845403720221803e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":3.8738250732421875,\"token\":{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999959922936479,\"masked\":false},\"top_k\":[{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999959922936479,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgCg==\",\"prob\":0.000003731472011844909,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgIAo=\",\"prob\":1.8583684825164436e-7,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"IAo=\",\"prob\":7.599059467294422e-10,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgICAK\",\"prob\":2.4673411914072435e-10,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"5\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.358240127563477,\"token\":{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":1,\"masked\":false},{\"token\":\"6\",\"bytes\":\"Ng==\",\"prob\":2.7958382827282784e-10,\"masked\":false},{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":1.695849552256486e-10,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":1.392398959537226e-11,\"masked\":false},{\"token\":\"7\",\"bytes\":\"Nw==\",\"prob\":5.804909043863001e-12,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":5.925893783569336,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":3.589834362425936e-10,\"masked\":false},{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":1.0844295092418813e-11,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":3.9898068772696145e-12,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":3.10734526498452e-12,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.39996337890625,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},{\"token\":\" “\",\"bytes\":\"IOKAnA==\",\"prob\":8.610783723540494e-10,\"masked\":false},{\"token\":\" '\",\"bytes\":\"ICc=\",\"prob\":2.0258497620352057e-11,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":1.392398959537226e-11,\"masked\":false},{\"token\":\" `\",\"bytes\":\"IGA=\",\"prob\":4.766194797249688e-13,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"rm\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":7.335901260375977,\"token\":{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.9999368753888325,\"masked\":false},\"top_k\":[{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.9999368753888325,\"masked\":false},{\"token\":\" rm\",\"bytes\":\"IHJt\",\"prob\":0.00004010485603979204,\"masked\":false},{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.000018945665814071485,\"masked\":false},{\"token\":\"mv\",\"bytes\":\"bXY=\",\"prob\":0.0000029059768430306255,\"masked\":false},{\"token\":\"chmod\",\"bytes\":\"Y2htb2Q=\",\"prob\":5.723171881147791e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":11.937141418457031,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":1,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":4.147241342914698e-8,\"masked\":false},{\"token\":\"”\",\"bytes\":\"4oCd\",\"prob\":1.8227611793188415e-9,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1.4966013737429372e-10,\"masked\":false},{\"token\":\"'\",\"bytes\":\"Jw==\",\"prob\":8.011249025832619e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":20.465850830078125,\"token\":{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999968266298266,\"masked\":false},\"top_k\":[{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999968266298266,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgCg==\",\"prob\":0.000002906151425567016,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgIAo=\",\"prob\":1.6400272490412654e-7,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"IAo=\",\"prob\":5.918306870580254e-10,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgICAK\",\"prob\":2.1774491797572677e-10,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"6\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":5.753040313720703,\"token\":{\"token\":\"6\",\"bytes\":\"Ng==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\"6\",\"bytes\":\"Ng==\",\"prob\":1,\"masked\":false},{\"token\":\"7\",\"bytes\":\"Nw==\",\"prob\":8.610783723540494e-10,\"masked\":false},{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":3.589834362425936e-10,\"masked\":false},{\"token\":\"8\",\"bytes\":\"OA==\",\"prob\":7.069994081435185e-11,\"masked\":false},{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":3.10734526498452e-12,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":12.772083282470703,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":6.706258937891248e-10,\"masked\":false},{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":1.228803694802331e-11,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":8.445764430227924e-12,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":4.520984896255816e-12,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":2.747058868408203,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},{\"token\":\" “\",\"bytes\":\"IOKAnA==\",\"prob\":2.3404110160583063e-9,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":2.29555877213595e-11,\"masked\":false},{\"token\":\" '\",\"bytes\":\"ICc=\",\"prob\":2.29555877213595e-11,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":1.5777742781219638e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"mkdir\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":7.874011993408203,\"token\":{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.8742427811572687,\"masked\":false},\"top_k\":[{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.8742427811572687,\"masked\":false},{\"token\":\"touch\",\"bytes\":\"dG91Y2g=\",\"prob\":0.10443641818413998,\"masked\":false},{\"token\":\"chmod\",\"bytes\":\"Y2htb2Q=\",\"prob\":0.012475902893757364,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.005893657534125387,\"masked\":false},{\"token\":\"echo\",\"bytes\":\"ZWNobw==\",\"prob\":0.0016887800153011162,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":13.45205307006836,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":1,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":1.9591704419834725e-8,\"masked\":false},{\"token\":\"”\",\"bytes\":\"4oCd\",\"prob\":1.1056178566958917e-9,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":7.069994081435185e-11,\"masked\":false},{\"token\":\"'\",\"bytes\":\"Jw==\",\"prob\":2.29555877213595e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":20.749807357788086,\"token\":{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999959922936479,\"masked\":false},\"top_k\":[{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999959922936479,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgCg==\",\"prob\":0.000003731472011844909,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgIAo=\",\"prob\":1.8583684825164436e-7,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"IAo=\",\"prob\":1.2528081481709897e-9,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgICAK\",\"prob\":2.1774491797572677e-10,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"7\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":38.06614875793457,\"token\":{\"token\":\"7\",\"bytes\":\"Nw==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\"7\",\"bytes\":\"Nw==\",\"prob\":1,\"masked\":false},{\"token\":\"8\",\"bytes\":\"OA==\",\"prob\":4.372180081359945e-9,\"masked\":false},{\"token\":\"6\",\"bytes\":\"Ng==\",\"prob\":5.506259653211689e-11,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":2.29555877213595e-11,\"masked\":false},{\"token\":\" seventh\",\"bytes\":\"IHNldmVudGg=\",\"prob\":5.804909043863001e-12,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.926868438720703,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":6.706258937891248e-10,\"masked\":false},{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":2.6011751587325918e-11,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1.7878293111700144e-11,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":1.228803694802331e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.681058883666992,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},{\"token\":\" “\",\"bytes\":\"IOKAnA==\",\"prob\":1.419604630996593e-9,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":2.6011751587325918e-11,\"masked\":false},{\"token\":\" '\",\"bytes\":\"ICc=\",\"prob\":2.6011751587325918e-11,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":1.392398959537226e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"r\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":10.879039764404297,\"token\":{\"token\":\"r\",\"bytes\":\"cg==\",\"prob\":0.9856215608399336,\"masked\":false},\"top_k\":[{\"token\":\"r\",\"bytes\":\"cg==\",\"prob\":0.9856215608399336,\"masked\":false},{\"token\":\"touch\",\"bytes\":\"dG91Y2g=\",\"prob\":0.010954375379503367,\"masked\":false},{\"token\":\"chmod\",\"bytes\":\"Y2htb2Q=\",\"prob\":0.0031388878831007916,\"masked\":false},{\"token\":\"man\",\"bytes\":\"bWFu\",\"prob\":0.00010744442887660106,\"masked\":false},{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.00008367997439193118,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"mdir\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":11.893033981323242,\"token\":{\"token\":\"mdir\",\"bytes\":\"bWRpcg==\",\"prob\":0.9999915822424559,\"masked\":false},\"top_k\":[{\"token\":\"mdir\",\"bytes\":\"bWRpcg==\",\"prob\":0.9999915822424559,\"masked\":false},{\"token\":\"md\",\"bytes\":\"bWQ=\",\"prob\":0.0000054290227619364185,\"masked\":false},{\"token\":\"mm\",\"bytes\":\"bW0=\",\"prob\":0.0000015556426700883423,\"masked\":false},{\"token\":\"mi\",\"bytes\":\"bWk=\",\"prob\":4.457568559053923e-7,\"masked\":false},{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":2.703792165563842e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":20.858049392700195,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":1,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":3.6599750743165615e-8,\"masked\":false},{\"token\":\"”\",\"bytes\":\"4oCd\",\"prob\":2.65199875084463e-9,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1.4966013737429372e-10,\"masked\":false},{\"token\":\"'\",\"bytes\":\"Jw==\",\"prob\":4.8593200677600996e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":12.428760528564453,\"token\":{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999949195766293,\"masked\":false},\"top_k\":[{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999949195766293,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgCg==\",\"prob\":0.000004791176141988272,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgIAo=\",\"prob\":2.7038024786626765e-7,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"IAo=\",\"prob\":1.4195965088192041e-9,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgICAK\",\"prob\":4.0677392603893067e-10,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"8\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":9.522199630737305,\"token\":{\"token\":\"8\",\"bytes\":\"OA==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\"8\",\"bytes\":\"OA==\",\"prob\":1,\"masked\":false},{\"token\":\"9\",\"bytes\":\"OQ==\",\"prob\":7.59908845245546e-10,\"masked\":false},{\"token\":\"7\",\"bytes\":\"Nw==\",\"prob\":5.506259653211689e-11,\"masked\":false},{\"token\":\"6\",\"bytes\":\"Ng==\",\"prob\":7.857719371013889e-13,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":5.400736264639702e-13,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":12.318849563598633,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":2.467350602608995e-10,\"masked\":false},{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":4.2883904879354975e-11,\"masked\":false},{\"token\":\" .\",\"bytes\":\"IC4=\",\"prob\":1.392398959537226e-11,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":1.228803694802331e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":10.905981063842773,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},{\"token\":\" “\",\"bytes\":\"IOKAnA==\",\"prob\":1.419604630996593e-9,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":6.239328742665511e-11,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":2.0258497620352057e-11,\"masked\":false},{\"token\":\" '\",\"bytes\":\"ICc=\",\"prob\":1.392398959537226e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"touch\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":10.206937789916992,\"token\":{\"token\":\"touch\",\"bytes\":\"dG91Y2g=\",\"prob\":0.822436974405684,\"masked\":false},\"top_k\":[{\"token\":\"touch\",\"bytes\":\"dG91Y2g=\",\"prob\":0.822436974405684,\"masked\":false},{\"token\":\"chmod\",\"bytes\":\"Y2htb2Q=\",\"prob\":0.14294404863615515,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.024844458579582732,\"masked\":false},{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.003810761892373183,\"masked\":false},{\"token\":\"man\",\"bytes\":\"bWFu\",\"prob\":0.003363029152877572,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":99.21932220458984,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999998064074439,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999998064074439,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":1.447341866024351e-7,\"masked\":false},{\"token\":\"”\",\"bytes\":\"4oCd\",\"prob\":4.954264885388611e-9,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":9.757169797073694e-10,\"masked\":false},{\"token\":\"'\",\"bytes\":\"Jw==\",\"prob\":2.467350602608995e-10,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.8618106842041016,\"token\":{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999901519605706,\"masked\":false},\"top_k\":[{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999901519605706,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgCg==\",\"prob\":0.000008950472747673159,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgIAo=\",\"prob\":8.327286851312913e-7,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"IAo=\",\"prob\":2.651973462156569e-9,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgICAK\",\"prob\":1.419591094060095e-9,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"9\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.5060901641845703,\"token\":{\"token\":\"9\",\"bytes\":\"OQ==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\"9\",\"bytes\":\"OQ==\",\"prob\":1,\"masked\":false},{\"token\":\"8\",\"bytes\":\"OA==\",\"prob\":7.2081326047957045e-9,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":2.0654322413773943e-9,\"masked\":false},{\"token\":\" \",\"bytes\":\"ICA=\",\"prob\":9.077816786640895e-11,\"masked\":false},{\"token\":\"0\",\"bytes\":\"MA==\",\"prob\":6.239328742665511e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.9497871398925781,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":1.419604630996593e-9,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1.392398959537226e-11,\"masked\":false},{\"token\":\" .\",\"bytes\":\"IC4=\",\"prob\":8.445764430227924e-12,\"masked\":false},{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":7.453457549798402e-12,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.0581016540527344,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},{\"token\":\" “\",\"bytes\":\"IOKAnA==\",\"prob\":3.4051455349565234e-9,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":1.320763194417195e-10,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":4.8593200677600996e-11,\"masked\":false},{\"token\":\" '\",\"bytes\":\"ICc=\",\"prob\":2.29555877213595e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"chmod\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.2979507446289062,\"token\":{\"token\":\"chmod\",\"bytes\":\"Y2htb2Q=\",\"prob\":0.5873820052085664,\"masked\":false},\"top_k\":[{\"token\":\"chmod\",\"bytes\":\"Y2htb2Q=\",\"prob\":0.5873820052085664,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.3562836863837281,\"masked\":false},{\"token\":\"man\",\"bytes\":\"bWFu\",\"prob\":0.03756078578792441,\"masked\":false},{\"token\":\"echo\",\"bytes\":\"ZWNobw==\",\"prob\":0.007397403512378887,\"masked\":false},{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.00652827029616284,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":2.9811859130859375,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999996872161573,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999996872161573,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":2.1057881110766744e-7,\"masked\":false},{\"token\":\"”\",\"bytes\":\"4oCd\",\"prob\":1.9591704419834725e-8,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1.6086019431052043e-9,\"masked\":false},{\"token\":\"'\",\"bytes\":\"Jw==\",\"prob\":3.16805876509952e-10,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.249074935913086,\"token\":{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999859803142557,\"masked\":false},\"top_k\":[{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.9999859803142557,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgCg==\",\"prob\":0.000013022292575948932,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgIAo=\",\"prob\":9.435884929079391e-7,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"IAo=\",\"prob\":3.0050292169230343e-9,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAgICAK\",\"prob\":1.8227368455172784e-9,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"10\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.6529560089111328,\"token\":{\"token\":\"10\",\"bytes\":\"MTA=\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\"10\",\"bytes\":\"MTA=\",\"prob\":1,\"masked\":false},{\"token\":\" ten\",\"bytes\":\"IHRlbg==\",\"prob\":1.9216243913340831e-10,\"masked\":false},{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":5.506259653211689e-11,\"masked\":false},{\"token\":\"0\",\"bytes\":\"MA==\",\"prob\":4.2883904879354975e-11,\"masked\":false},{\"token\":\" tenth\",\"bytes\":\"IHRlbnRo\",\"prob\":1.5777742781219638e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.750946044921875,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":5.613844832063757e-9,\"masked\":false},{\"token\":\" .\",\"bytes\":\"IC4=\",\"prob\":1.7878293111700144e-11,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":2.135728125041575e-12,\"masked\":false},{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":1.6633498514554145e-12,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":10.856866836547852,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":1,\"masked\":false},{\"token\":\" “\",\"bytes\":\"IOKAnA==\",\"prob\":4.372180081359945e-9,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":1.320763194417195e-10,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":9.077816786640895e-11,\"masked\":false},{\"token\":\" '\",\"bytes\":\"ICc=\",\"prob\":4.2883904879354975e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"grep\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":20.225048065185547,\"token\":{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.2714143732157277,\"masked\":false},\"top_k\":[{\"token\":\"man\",\"bytes\":\"bWFu\",\"prob\":0.2714143732157277,\"masked\":false},{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.2714143732157277,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.21138320560462573,\"masked\":false},{\"token\":\"ch\",\"bytes\":\"Y2g=\",\"prob\":0.09985812112425596,\"masked\":false},{\"token\":\"ps\",\"bytes\":\"cHM=\",\"prob\":0.088125624737817,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":5.979061126708984,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":1,\"masked\":false},{\"token\":\"”\",\"bytes\":\"4oCd\",\"prob\":2.2200021830278593e-8,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":1.9591704419834725e-8,\"masked\":false},{\"token\":\"\\\"}\",\"bytes\":\"In0=\",\"prob\":5.91832944483151e-10,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":4.0677625338333027e-10,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":22.671937942504883,\"token\":{\"token\":\" \",\"bytes\":\"ICA=\",\"prob\":0.9623864756652881,\"masked\":false},\"top_k\":[{\"token\":\" \",\"bytes\":\"ICA=\",\"prob\":0.9623864756652881,\"masked\":false},{\"token\":\"<|end|>\",\"bytes\":\"\",\"prob\":0.037328347974094296,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"ICAK\",\"prob\":0.00019598780155183782,\"masked\":false},{\"token\":\" \",\"bytes\":\"ICAg\",\"prob\":0.000056158723269397085,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.00004373759136887284,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"name\":\"assistant\",\"text\":null,\"class_name\":\"RoleCloserInput\"},{\"name\":\"user\",\"text\":null,\"closer_text\":null,\"class_name\":\"RoleOpenerInput\"},{\"value\":\"<|im_start|>user\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0,\"class_name\":\"TextOutput\"},{\"value\":\"If you were to guess, which of the above commands would a sys admin think was the coolest? Just name the command, don't print anything else.\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0,\"class_name\":\"TextOutput\"},{\"name\":\"user\",\"text\":null,\"class_name\":\"RoleCloserInput\"},{\"name\":\"assistant\",\"text\":null,\"closer_text\":null,\"class_name\":\"RoleOpenerInput\"},{\"value\":\"<|im_start|>assistant\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0,\"class_name\":\"TextOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":0.5657672882080078,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999902711499675,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999902711499675,\"masked\":false},{\"token\":\"“\",\"bytes\":\"4oCc\",\"prob\":0.000006151803146895858,\"masked\":false},{\"token\":\"\\\"github\",\"bytes\":\"ImdpdGh1Yg==\",\"prob\":8.327286851312913e-7,\"masked\":false},{\"token\":\"chmod\",\"bytes\":\"Y2htb2Q=\",\"prob\":8.327286851312913e-7,\"masked\":false},{\"token\":\"\\\"net\",\"bytes\":\"Im5ldA==\",\"prob\":5.723477507970615e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"chmod\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.4162063598632812,\"token\":{\"token\":\"chmod\",\"bytes\":\"Y2htb2Q=\",\"prob\":0.14807318009658763,\"masked\":false},\"top_k\":[{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.8519476825599805,\"masked\":false},{\"token\":\"chmod\",\"bytes\":\"Y2htb2Q=\",\"prob\":0.14807318009658763,\"masked\":false},{\"token\":\" grep\",\"bytes\":\"IGdyZXA=\",\"prob\":0.00000979096216954056,\"masked\":false},{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.000005241064021378393,\"masked\":false},{\"token\":\"ch\",\"bytes\":\"Y2g=\",\"prob\":0.0000013253374431731878,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":2.2840499877929688,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999995680248992,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999995680248992,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":3.471677666470143e-7,\"masked\":false},{\"token\":\"”\",\"bytes\":\"4oCd\",\"prob\":8.16777845116946e-9,\"masked\":false},{\"token\":\"\\\".\",\"bytes\":\"Ii4=\",\"prob\":1.2528129267684045e-9,\"masked\":false},{\"token\":\"\\\"\\n\\n\",\"bytes\":\"IgoK\",\"prob\":9.757169797073694e-10,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"name\":\"assistant\",\"text\":null,\"class_name\":\"RoleCloserInput\"},{\"name\":\"user\",\"text\":null,\"closer_text\":null,\"class_name\":\"RoleOpenerInput\"},{\"value\":\"<|im_start|>user\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0,\"class_name\":\"TextOutput\"},{\"value\":\"What is that command's coolness factor on a scale from 0-10? Just write the digit and nothing else.\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0,\"class_name\":\"TextOutput\"},{\"name\":\"user\",\"text\":null,\"class_name\":\"RoleCloserInput\"},{\"name\":\"assistant\",\"text\":null,\"closer_text\":null,\"class_name\":\"RoleOpenerInput\"},{\"value\":\"<|im_start|>assistant\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0,\"class_name\":\"TextOutput\"},{\"value\":\"9\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":0.6189346313476562,\"token\":{\"token\":\"9\",\"bytes\":\"OQ==\",\"prob\":0.4999790469823186,\"masked\":false},\"top_k\":[{\"token\":\"8\",\"bytes\":\"OA==\",\"prob\":0.4999790469823186,\"masked\":false},{\"token\":\"9\",\"bytes\":\"OQ==\",\"prob\":0.4999790469823186,\"masked\":false},{\"token\":\"10\",\"bytes\":\"MTA=\",\"prob\":0.00010181959878164716,\"masked\":false},{\"token\":\"7\",\"bytes\":\"Nw==\",\"prob\":0.000009473030420217625,\"masked\":false},{\"token\":\" nine\",\"bytes\":\"IG5pbmU=\",\"prob\":0.0000018656646029465895,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"name\":\"assistant\",\"text\":null,\"class_name\":\"RoleCloserInput\"},{\"name\":\"user\",\"text\":null,\"closer_text\":null,\"class_name\":\"RoleOpenerInput\"},{\"value\":\"<|im_start|>user\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0,\"class_name\":\"TextOutput\"},{\"value\":\"Why is that command so cool?\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0,\"class_name\":\"TextOutput\"},{\"name\":\"user\",\"text\":null,\"class_name\":\"RoleCloserInput\"},{\"name\":\"assistant\",\"text\":null,\"closer_text\":null,\"class_name\":\"RoleOpenerInput\"},{\"value\":\"<|im_start|>assistant\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":0,\"class_name\":\"TextOutput\"},{\"value\":\"The\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":0.47898292541503906,\"token\":{\"token\":\"The\",\"bytes\":\"VGhl\",\"prob\":0.9995656556532361,\"masked\":false},\"top_k\":[{\"token\":\"The\",\"bytes\":\"VGhl\",\"prob\":0.9995656556532361,\"masked\":false},{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.00043090159986240316,\"masked\":false},{\"token\":\"As\",\"bytes\":\"QXM=\",\"prob\":0.000001996581730600712,\"masked\":false},{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":9.431917721113391e-7,\"masked\":false},{\"token\":\"“\",\"bytes\":\"4oCc\",\"prob\":2.3851022742196335e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":0.8587837219238281,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9953755530208904,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9953755530208904,\"masked\":false},{\"token\":\" `\",\"bytes\":\"IGA=\",\"prob\":0.004070192160742145,\"masked\":false},{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.0005509548477598374,\"masked\":false},{\"token\":\" “\",\"bytes\":\"IOKAnA==\",\"prob\":0.0000037142296000046576,\"masked\":false},{\"token\":\" cool\",\"bytes\":\"IGNvb2w=\",\"prob\":0.0000013665303899943552,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"chmod\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.9481182098388672,\"token\":{\"token\":\"chmod\",\"bytes\":\"Y2htb2Q=\",\"prob\":0.9999998064074439,\"masked\":false},\"top_k\":[{\"token\":\"chmod\",\"bytes\":\"Y2htb2Q=\",\"prob\":0.9999998064074439,\"masked\":false},{\"token\":\" chmod\",\"bytes\":\"IGNobW9k\",\"prob\":1.1272201970042148e-7,\"masked\":false},{\"token\":\"ch\",\"bytes\":\"Y2g=\",\"prob\":7.59908845245546e-10,\"masked\":false},{\"token\":\"cool\",\"bytes\":\"Y29vbA==\",\"prob\":2.9474794061194335e-11,\"masked\":false},{\"token\":\"sudo\",\"bytes\":\"c3Vkbw==\",\"prob\":1.7878293111700144e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.336812973022461,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":1,\"masked\":false},{\"token\":\"”\",\"bytes\":\"4oCd\",\"prob\":3.6599750743165615e-8,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":5.506259653211689e-11,\"masked\":false},{\"token\":\",\\\"\",\"bytes\":\"LCI=\",\"prob\":5.506259653211689e-11,\"masked\":false},{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":3.7845403720221803e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" command\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":4.188299179077148,\"token\":{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.9999970650118172,\"masked\":false},\"top_k\":[{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.9999970650118172,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.000002906151425567016,\"masked\":false},{\"token\":\"command\",\"bytes\":\"Y29tbWFuZA==\",\"prob\":3.858470669649277e-9,\"masked\":false},{\"token\":\" Command\",\"bytes\":\"IENvbW1hbmQ=\",\"prob\":2.065424363210624e-9,\"masked\":false},{\"token\":\"(command\",\"bytes\":\"KGNvbW1hbmQ=\",\"prob\":1.2528081481709897e-9,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" is\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":10.83993911743164,\"token\":{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.999708347340244,\"masked\":false},\"top_k\":[{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.999708347340244,\"masked\":false},{\"token\":\" allows\",\"bytes\":\"IGFsbG93cw==\",\"prob\":0.0001796684199484263,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.00006610317143062042,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.00003122735545870585,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.000008947946758700266,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" considered\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":16.401052474975586,\"token\":{\"token\":\" considered\",\"bytes\":\"IGNvbnNpZGVyZWQ=\",\"prob\":0.9896234486330525,\"masked\":false},\"top_k\":[{\"token\":\" considered\",\"bytes\":\"IGNvbnNpZGVyZWQ=\",\"prob\":0.9896234486330525,\"masked\":false},{\"token\":\" cool\",\"bytes\":\"IGNvb2w=\",\"prob\":0.007559689023619958,\"masked\":false},{\"token\":\" often\",\"bytes\":\"IG9mdGVu\",\"prob\":0.002781342539963193,\"masked\":false},{\"token\":\" regarded\",\"bytes\":\"IHJlZ2FyZGVk\",\"prob\":0.000021246538801835304,\"masked\":false},{\"token\":\" particularly\",\"bytes\":\"IHBhcnRpY3VsYXJseQ==\",\"prob\":0.000011373189699326996,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" cool\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":7.944822311401367,\"token\":{\"token\":\" cool\",\"bytes\":\"IGNvb2w=\",\"prob\":0.999908629237317,\"masked\":false},\"top_k\":[{\"token\":\" cool\",\"bytes\":\"IGNvb2w=\",\"prob\":0.999908629237317,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.00007491873668874944,\"masked\":false},{\"token\":\" very\",\"bytes\":\"IHZlcnk=\",\"prob\":0.000007898219109693567,\"masked\":false},{\"token\":\" particularly\",\"bytes\":\"IHBhcnRpY3VsYXJseQ==\",\"prob\":0.00000542857238311991,\"masked\":false},{\"token\":\" quite\",\"bytes\":\"IHF1aXRl\",\"prob\":9.435156133151275e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" because\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":21.455049514770508,\"token\":{\"token\":\" because\",\"bytes\":\"IGJlY2F1c2U=\",\"prob\":0.848194641674306,\"masked\":false},\"top_k\":[{\"token\":\" because\",\"bytes\":\"IGJlY2F1c2U=\",\"prob\":0.848194641674306,\"masked\":false},{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.11481447877542693,\"masked\":false},{\"token\":\" by\",\"bytes\":\"IGJ5\",\"prob\":0.0328991625489704,\"masked\":false},{\"token\":\" due\",\"bytes\":\"IGR1ZQ==\",\"prob\":0.0023838555020892585,\"masked\":false},{\"token\":\" primarily\",\"bytes\":\"IHByaW1hcmlseQ==\",\"prob\":0.0014459564098669034,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" it\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.230924606323242,\"token\":{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.9974018324482582,\"masked\":false},\"top_k\":[{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.9974018324482582,\"masked\":false},{\"token\":\":\\n\\n\",\"bytes\":\"OgoK\",\"prob\":0.002473850962937197,\"masked\":false},{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.00012320410404719715,\"masked\":false},{\"token\":\":\",\"bytes\":\"Og==\",\"prob\":0.000001758186747323833,\"masked\":false},{\"token\":\" it's\",\"bytes\":\"IGl0J3M=\",\"prob\":6.468678246224551e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" allows\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":11.939048767089844,\"token\":{\"token\":\" allows\",\"bytes\":\"IGFsbG93cw==\",\"prob\":0.6543863711101914,\"masked\":false},\"top_k\":[{\"token\":\" allows\",\"bytes\":\"IGFsbG93cw==\",\"prob\":0.6543863711101914,\"masked\":false},{\"token\":\" provides\",\"bytes\":\"IHByb3ZpZGVz\",\"prob\":0.2728135575960821,\"masked\":false},{\"token\":\" gives\",\"bytes\":\"IGdpdmVz\",\"prob\":0.032590112725542755,\"masked\":false},{\"token\":\" empowers\",\"bytes\":\"IGVtcG93ZXJz\",\"prob\":0.011990475616461646,\"masked\":false},{\"token\":\" grants\",\"bytes\":\"IGdyYW50cw==\",\"prob\":0.011990475616461646,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" users\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":12.538909912109375,\"token\":{\"token\":\" users\",\"bytes\":\"IHVzZXJz\",\"prob\":0.18562224075137046,\"masked\":false},\"top_k\":[{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.7340455026001057,\"masked\":false},{\"token\":\" users\",\"bytes\":\"IHVzZXJz\",\"prob\":0.18562224075137046,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.032262162124253105,\"masked\":false},{\"token\":\" sys\",\"bytes\":\"IHN5cw==\",\"prob\":0.02512644842187592,\"masked\":false},{\"token\":\" administrators\",\"bytes\":\"IGFkbWluaXN0cmF0b3Jz\",\"prob\":0.019569004949689398,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":1.4090538024902344,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.08511310092485128,\"masked\":false},\"top_k\":[{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.9148266914206568,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.08511310092485128,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.00007766941598623454,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.00001051359237360644,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":7.618093914724381e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" system\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":7.813215255737305,\"token\":{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.8381033914997663,\"masked\":false},\"top_k\":[{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.8381033914997663,\"masked\":false},{\"token\":\" administrators\",\"bytes\":\"IGFkbWluaXN0cmF0b3Jz\",\"prob\":0.14566695335315755,\"masked\":false},{\"token\":\" sys\",\"bytes\":\"IHN5cw==\",\"prob\":0.015356769744783463,\"masked\":false},{\"token\":\" systems\",\"bytes\":\"IHN5c3RlbXM=\",\"prob\":0.0008666279608531907,\"masked\":false},{\"token\":\" admins\",\"bytes\":\"IGFkbWlucw==\",\"prob\":0.00005541747102700415,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" administrators\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":11.638879776000977,\"token\":{\"token\":\" administrators\",\"bytes\":\"IGFkbWluaXN0cmF0b3Jz\",\"prob\":0.9997384870946984,\"masked\":false},\"top_k\":[{\"token\":\" administrators\",\"bytes\":\"IGFkbWluaXN0cmF0b3Jz\",\"prob\":0.9997384870946984,\"masked\":false},{\"token\":\" admins\",\"bytes\":\"IGFkbWlucw==\",\"prob\":0.0002614138211953149,\"masked\":false},{\"token\":\" Administr\",\"bytes\":\"IEFkbWluaXN0cg==\",\"prob\":1.1269257157565767e-7,\"masked\":false},{\"token\":\" admin\",\"bytes\":\"IGFkbWlu\",\"prob\":6.835504336206437e-8,\"masked\":false},{\"token\":\" administration\",\"bytes\":\"IGFkbWluaXN0cmF0aW9u\",\"prob\":2.219422217361564e-8,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" to\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":15.20085334777832,\"token\":{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.9998635873862439,\"masked\":false},\"top_k\":[{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.9998635873862439,\"masked\":false},{\"token\":\" fine\",\"bytes\":\"IGZpbmU=\",\"prob\":0.000051490538835143,\"masked\":false},{\"token\":\" significant\",\"bytes\":\"IHNpZ25pZmljYW50\",\"prob\":0.000027562685449832376,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.000018944274773783296,\"masked\":false},{\"token\":\" granular\",\"bytes\":\"IGdyYW51bGFy\",\"prob\":0.000014754198468163915,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" control\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":9.664058685302734,\"token\":{\"token\":\" control\",\"bytes\":\"IGNvbnRyb2w=\",\"prob\":0.7906081596122069,\"masked\":false},\"top_k\":[{\"token\":\" control\",\"bytes\":\"IGNvbnRyb2w=\",\"prob\":0.7906081596122069,\"masked\":false},{\"token\":\" manage\",\"bytes\":\"IG1hbmFnZQ==\",\"prob\":0.15570621635210488,\"masked\":false},{\"token\":\" set\",\"bytes\":\"IHNldA==\",\"prob\":0.01860055117067594,\"masked\":false},{\"token\":\" define\",\"bytes\":\"IGRlZmluZQ==\",\"prob\":0.009956802797350811,\"masked\":false},{\"token\":\" finely\",\"bytes\":\"IGZpbmVseQ==\",\"prob\":0.007754566819511228,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" permissions\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":9.839057922363281,\"token\":{\"token\":\" permissions\",\"bytes\":\"IHBlcm1pc3Npb25z\",\"prob\":0.02519282117163283,\"masked\":false},\"top_k\":[{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.5732001782033053,\"masked\":false},{\"token\":\" access\",\"bytes\":\"IGFjY2Vzcw==\",\"prob\":0.34768152703889654,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.041533786878593174,\"masked\":false},{\"token\":\" permissions\",\"bytes\":\"IHBlcm1pc3Npb25z\",\"prob\":0.02519282117163283,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.011901168690737103,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" on\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":19.370079040527344,\"token\":{\"token\":\" on\",\"bytes\":\"IG9u\",\"prob\":0.4184622573658782,\"masked\":false},\"top_k\":[{\"token\":\" on\",\"bytes\":\"IG9u\",\"prob\":0.4184622573658782,\"masked\":false},{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.3259071620514539,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.25382333230077625,\"masked\":false},{\"token\":\" of\",\"bytes\":\"IG9m\",\"prob\":0.0011760907610296732,\"masked\":false},{\"token\":\" effectively\",\"bytes\":\"IGVmZmVjdGl2ZWx5\",\"prob\":0.00020441101589759465,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" files\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":4.71186637878418,\"token\":{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.9999778754514779,\"masked\":false},\"top_k\":[{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.9999778754514779,\"masked\":false},{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.000013022193234421348,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.000007898768931814198,\"masked\":false},{\"token\":\" their\",\"bytes\":\"IHRoZWly\",\"prob\":3.4716015256546423e-7,\"masked\":false},{\"token\":\" filesystem\",\"bytes\":\"IGZpbGVzeXN0ZW0=\",\"prob\":1.858334813025294e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":10.32710075378418,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.9999998064074439,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.9999998064074439,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":9.947812251992413e-8,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":8.16777845116946e-9,\"masked\":false},{\"token\":\" и\",\"bytes\":\"INC4\",\"prob\":3.4051455349565234e-9,\"masked\":false},{\"token\":\"/direct\",\"bytes\":\"L2RpcmVjdA==\",\"prob\":6.706258937891248e-10,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directories\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":9.432077407836914,\"token\":{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.9999982569219407,\"masked\":false},\"top_k\":[{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.9999982569219407,\"masked\":false},{\"token\":\" folders\",\"bytes\":\"IGZvbGRlcnM=\",\"prob\":0.0000010692252379701795,\"masked\":false},{\"token\":\"directories\",\"bytes\":\"ZGlyZWN0b3JpZXM=\",\"prob\":5.051055168594771e-7,\"masked\":false},{\"token\":\"Directories\",\"bytes\":\"RGlyZWN0b3JpZXM=\",\"prob\":6.837277508126906e-8,\"masked\":false},{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":1.728980957668829e-8,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" in\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":9.595870971679688,\"token\":{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.23098607026618742,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.554056508854788,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.23098607026618742,\"masked\":false},{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.2038471335006578,\"masked\":false},{\"token\":\" with\",\"bytes\":\"IHdpdGg=\",\"prob\":0.005434383613950817,\"masked\":false},{\"token\":\" at\",\"bytes\":\"IGF0\",\"prob\":0.002265593662819784,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":12.756824493408203,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.991796853783408,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.991796853783408,\"masked\":false},{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.005207305985919013,\"masked\":false},{\"token\":\" Unix\",\"bytes\":\"IFVuaXg=\",\"prob\":0.0013168008581935374,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.0009050583015713998,\"masked\":false},{\"token\":\" granular\",\"bytes\":\"IGdyYW51bGFy\",\"prob\":0.0004275525165034799,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" flexible\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":11.520147323608398,\"token\":{\"token\":\" flexible\",\"bytes\":\"IGZsZXhpYmxl\",\"prob\":0.4175817409436673,\"masked\":false},\"top_k\":[{\"token\":\" flexible\",\"bytes\":\"IGZsZXhpYmxl\",\"prob\":0.4175817409436673,\"masked\":false},{\"token\":\" granular\",\"bytes\":\"IGdyYW51bGFy\",\"prob\":0.4175817409436673,\"masked\":false},{\"token\":\" highly\",\"bytes\":\"IGhpZ2hseQ==\",\"prob\":0.04402306585884131,\"masked\":false},{\"token\":\" very\",\"bytes\":\"IHZlcnk=\",\"prob\":0.0388507227855511,\"masked\":false},{\"token\":\" powerful\",\"bytes\":\"IHBvd2VyZnVs\",\"prob\":0.026702723468262038,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":11.245965957641602,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.7362093549270323,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.7362093549270323,\"masked\":false},{\"token\":\" way\",\"bytes\":\"IHdheQ==\",\"prob\":0.18616941524071676,\"masked\":false},{\"token\":\" manner\",\"bytes\":\"IG1hbm5lcg==\",\"prob\":0.07761399955230508,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.0000802555505913274,\"masked\":false},{\"token\":\" yet\",\"bytes\":\"IHlldA==\",\"prob\":0.0000021395419869722584,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" powerful\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.764982223510742,\"token\":{\"token\":\" powerful\",\"bytes\":\"IHBvd2VyZnVs\",\"prob\":0.704589841472089,\"masked\":false},\"top_k\":[{\"token\":\" powerful\",\"bytes\":\"IHBvd2VyZnVs\",\"prob\":0.704589841472089,\"masked\":false},{\"token\":\" granular\",\"bytes\":\"IGdyYW51bGFy\",\"prob\":0.2592309939190909,\"masked\":false},{\"token\":\" precise\",\"bytes\":\"IHByZWNpc2U=\",\"prob\":0.024118173985470316,\"masked\":false},{\"token\":\" detailed\",\"bytes\":\"IGRldGFpbGVk\",\"prob\":0.005382329053070539,\"masked\":false},{\"token\":\" nuanced\",\"bytes\":\"IG51YW5jZWQ=\",\"prob\":0.003264716836854989,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" way\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":15.321016311645508,\"token\":{\"token\":\" way\",\"bytes\":\"IHdheQ==\",\"prob\":0.9525787974800486,\"masked\":false},\"top_k\":[{\"token\":\" way\",\"bytes\":\"IHdheQ==\",\"prob\":0.9525787974800486,\"masked\":false},{\"token\":\" manner\",\"bytes\":\"IG1hbm5lcg==\",\"prob\":0.04744085649983044,\"masked\":false},{\"token\":\" ways\",\"bytes\":\"IHdheXM=\",\"prob\":1.0737657237848057e-7,\"masked\":false},{\"token\":\" fashion\",\"bytes\":\"IGZhc2hpb24=\",\"prob\":1.4534852594520245e-8,\"masked\":false},{\"token\":\"way\",\"bytes\":\"d2F5\",\"prob\":5.347627886136956e-9,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":26.253223419189453,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9998414247410419,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9998414247410419,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.0001585800482034777,\"masked\":false},{\"token\":\":\\n\\n\",\"bytes\":\"OgoK\",\"prob\":6.836208334711394e-8,\"masked\":false},{\"token\":\".\\n\\n\",\"bytes\":\"LgoK\",\"prob\":6.033010871340906e-8,\"masked\":false},{\"token\":\";\",\"bytes\":\"Ow==\",\"prob\":2.2196507988745055e-8,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" This\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.527755737304688,\"token\":{\"token\":\" This\",\"bytes\":\"IFRoaXM=\",\"prob\":0.20838500439039054,\"masked\":false},\"top_k\":[{\"token\":\" It\",\"bytes\":\"IEl0\",\"prob\":0.44111672748083564,\"masked\":false},{\"token\":\" This\",\"bytes\":\"IFRoaXM=\",\"prob\":0.20838500439039054,\"masked\":false},{\"token\":\" By\",\"bytes\":\"IEJ5\",\"prob\":0.20838500439039054,\"masked\":false},{\"token\":\" With\",\"bytes\":\"IFdpdGg=\",\"prob\":0.09844176101584706,\"masked\":false},{\"token\":\" Here\",\"bytes\":\"IEhlcmU=\",\"prob\":0.02820769237303196,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" capability\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":12.15505599975586,\"token\":{\"token\":\" capability\",\"bytes\":\"IGNhcGFiaWxpdHk=\",\"prob\":0.3706252638152493,\"masked\":false},\"top_k\":[{\"token\":\" capability\",\"bytes\":\"IGNhcGFiaWxpdHk=\",\"prob\":0.3706252638152493,\"masked\":false},{\"token\":\" control\",\"bytes\":\"IGNvbnRyb2w=\",\"prob\":0.2547366746466537,\"masked\":false},{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.17508459283655878,\"masked\":false},{\"token\":\" ability\",\"bytes\":\"IGFiaWxpdHk=\",\"prob\":0.09372210251900431,\"masked\":false},{\"token\":\" enables\",\"bytes\":\"IGVuYWJsZXM=\",\"prob\":0.04427462928567616,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" is\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":19.92511749267578,\"token\":{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.7394296178321323,\"masked\":false},\"top_k\":[{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.7394296178321323,\"masked\":false},{\"token\":\" enables\",\"bytes\":\"IGVuYWJsZXM=\",\"prob\":0.12851690988996778,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.11341724484615902,\"masked\":false},{\"token\":\" ensures\",\"bytes\":\"IGVuc3VyZXM=\",\"prob\":0.0030236034219082754,\"masked\":false},{\"token\":\" includes\",\"bytes\":\"IGluY2x1ZGVz\",\"prob\":0.0020781710162400065,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" crucial\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":17.066001892089844,\"token\":{\"token\":\" crucial\",\"bytes\":\"IGNydWNpYWw=\",\"prob\":0.30322310621179727,\"masked\":false},\"top_k\":[{\"token\":\" essential\",\"bytes\":\"IGVzc2VudGlhbA==\",\"prob\":0.6418733856875329,\"masked\":false},{\"token\":\" crucial\",\"bytes\":\"IGNydWNpYWw=\",\"prob\":0.30322310621179727,\"masked\":false},{\"token\":\" fundamental\",\"bytes\":\"IGZ1bmRhbWVudGFs\",\"prob\":0.03196693694839499,\"masked\":false},{\"token\":\" critical\",\"bytes\":\"IGNyaXRpY2Fs\",\"prob\":0.015101282486670692,\"masked\":false},{\"token\":\" vital\",\"bytes\":\"IHZpdGFs\",\"prob\":0.006295722262672446,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" for\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":5.131006240844727,\"token\":{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.9902866229569411,\"masked\":false},\"top_k\":[{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.9902866229569411,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.009713085728860614,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.000004187202511768881,\"masked\":false},{\"token\":\" when\",\"bytes\":\"IHdoZW4=\",\"prob\":0.0000010588415345356952,\"masked\":false},{\"token\":\" because\",\"bytes\":\"IGJlY2F1c2U=\",\"prob\":3.4379561636236834e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" managing\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":12.129068374633789,\"token\":{\"token\":\" managing\",\"bytes\":\"IG1hbmFnaW5n\",\"prob\":0.11654136774286501,\"masked\":false},\"top_k\":[{\"token\":\" maintaining\",\"bytes\":\"IG1haW50YWluaW5n\",\"prob\":0.5917462259266744,\"masked\":false},{\"token\":\" security\",\"bytes\":\"IHNlY3VyaXR5\",\"prob\":0.1921342710050359,\"masked\":false},{\"token\":\" managing\",\"bytes\":\"IG1hbmFnaW5n\",\"prob\":0.11654136774286501,\"masked\":false},{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.03783985615226261,\"masked\":false},{\"token\":\" securing\",\"bytes\":\"IHNlY3VyaW5n\",\"prob\":0.020255528028770186,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" security\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":7.96961784362793,\"token\":{\"token\":\" security\",\"bytes\":\"IHNlY3VyaXR5\",\"prob\":0.9803284503018833,\"masked\":false},\"top_k\":[{\"token\":\" security\",\"bytes\":\"IHNlY3VyaXR5\",\"prob\":0.9803284503018833,\"masked\":false},{\"token\":\" access\",\"bytes\":\"IGFjY2Vzcw==\",\"prob\":0.01585231002179841,\"masked\":false},{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.0035376786335486344,\"masked\":false},{\"token\":\" user\",\"bytes\":\"IHVzZXI=\",\"prob\":0.00009431138303984017,\"masked\":false},{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.00007345168288534811,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":12.427091598510742,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.7405466370347831,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.7405466370347831,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.24044832399073046,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.017422759497485812,\"masked\":false},{\"token\":\" on\",\"bytes\":\"IG9u\",\"prob\":0.0008676979761824189,\"masked\":false},{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.0005963827041227357,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" access\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.852958679199219,\"token\":{\"token\":\" access\",\"bytes\":\"IGFjY2Vzcw==\",\"prob\":0.980007687062582,\"masked\":false},\"top_k\":[{\"token\":\" access\",\"bytes\":\"IGFjY2Vzcw==\",\"prob\":0.980007687062582,\"masked\":false},{\"token\":\" ensuring\",\"bytes\":\"IGVuc3VyaW5n\",\"prob\":0.010891983257046824,\"masked\":false},{\"token\":\" accessibility\",\"bytes\":\"IGFjY2Vzc2liaWxpdHk=\",\"prob\":0.003536521731655562,\"masked\":false},{\"token\":\" user\",\"bytes\":\"IHVzZXI=\",\"prob\":0.0024307079783601536,\"masked\":false},{\"token\":\" collaboration\",\"bytes\":\"IGNvbGxhYm9yYXRpb24=\",\"prob\":0.0018930863471483042,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" rights\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":14.293193817138672,\"token\":{\"token\":\" rights\",\"bytes\":\"IHJpZ2h0cw==\",\"prob\":0.20209630151520996,\"masked\":false},\"top_k\":[{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.294036950780871,\"masked\":false},{\"token\":\" control\",\"bytes\":\"IGNvbnRyb2w=\",\"prob\":0.22900214342321498,\"masked\":false},{\"token\":\" rights\",\"bytes\":\"IHJpZ2h0cw==\",\"prob\":0.20209630151520996,\"masked\":false},{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.17835167162887886,\"masked\":false},{\"token\":\" levels\",\"bytes\":\"IGxldmVscw==\",\"prob\":0.03512543992913728,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" within\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":13.257980346679688,\"token\":{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.14934999119315742,\"masked\":false},\"top_k\":[{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.7583340357305656,\"masked\":false},{\"token\":\" within\",\"bytes\":\"IHdpdGhpbg==\",\"prob\":0.14934999119315742,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.06226398753315362,\"masked\":false},{\"token\":\" on\",\"bytes\":\"IG9u\",\"prob\":0.029413712366507687,\"masked\":false},{\"token\":\" effectively\",\"bytes\":\"IGVmZmVjdGl2ZWx5\",\"prob\":0.00037043199191488536,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":10.648965835571289,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.14776700710797583,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.8501861237380393,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.14776700710797583,\"masked\":false},{\"token\":\" an\",\"bytes\":\"IGFu\",\"prob\":0.0007758322920987286,\"masked\":false},{\"token\":\" Unix\",\"bytes\":\"IFVuaXg=\",\"prob\":0.0005332419493972711,\"masked\":false},{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.0004705904677354408,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" system\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.402824401855469,\"token\":{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.8066582904320582,\"masked\":false},\"top_k\":[{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.8066582904320582,\"masked\":false},{\"token\":\" operating\",\"bytes\":\"IG9wZXJhdGluZw==\",\"prob\":0.08504099896579921,\"masked\":false},{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.07504939085388729,\"masked\":false},{\"token\":\" Unix\",\"bytes\":\"IFVuaXg=\",\"prob\":0.014780587879332214,\"masked\":false},{\"token\":\" filesystem\",\"bytes\":\"IGZpbGVzeXN0ZW0=\",\"prob\":0.008965344487948432,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":13.489246368408203,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.6508506242835855,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.6508506242835855,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.348397811283182,\"masked\":false},{\"token\":\":\\n\\n\",\"bytes\":\"OgoK\",\"prob\":0.00046256502887473817,\"masked\":false},{\"token\":\".\\n\\n\",\"bytes\":\"LgoK\",\"prob\":0.00024760926335976323,\"masked\":false},{\"token\":\";\",\"bytes\":\"Ow==\",\"prob\":0.00003351721948514323,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" It\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.803844451904297,\"token\":{\"token\":\" It\",\"bytes\":\"IEl0\",\"prob\":0.19746048132574523,\"masked\":false},\"top_k\":[{\"token\":\" By\",\"bytes\":\"IEJ5\",\"prob\":0.4736401260663806,\"masked\":false},{\"token\":\" It\",\"bytes\":\"IEl0\",\"prob\":0.19746048132574523,\"masked\":false},{\"token\":\" With\",\"bytes\":\"IFdpdGg=\",\"prob\":0.19746048132574523,\"masked\":false},{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.08232124320419781,\"masked\":false},{\"token\":\" Here\",\"bytes\":\"IEhlcmU=\",\"prob\":0.01621274530997453,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" provides\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":25.23207664489746,\"token\":{\"token\":\" provides\",\"bytes\":\"IHByb3ZpZGVz\",\"prob\":0.011139890126528463,\"masked\":false},\"top_k\":[{\"token\":\" enables\",\"bytes\":\"IGVuYWJsZXM=\",\"prob\":0.8845499492492739,\"masked\":false},{\"token\":\" can\",\"bytes\":\"IGNhbg==\",\"prob\":0.034309283209841564,\"masked\":false},{\"token\":\" empowers\",\"bytes\":\"IGVtcG93ZXJz\",\"prob\":0.03027822858204725,\"masked\":false},{\"token\":\" provides\",\"bytes\":\"IHByb3ZpZGVz\",\"prob\":0.011139890126528463,\"masked\":false},{\"token\":\" lets\",\"bytes\":\"IGxldHM=\",\"prob\":0.009831045946572477,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" fine\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":14.400959014892578,\"token\":{\"token\":\" fine\",\"bytes\":\"IGZpbmU=\",\"prob\":0.20517140270535325,\"masked\":false},\"top_k\":[{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.4921359585396964,\"masked\":false},{\"token\":\" fine\",\"bytes\":\"IGZpbmU=\",\"prob\":0.20517140270535325,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.15979179101094854,\"masked\":false},{\"token\":\" granular\",\"bytes\":\"IGdyYW51bGFy\",\"prob\":0.10982745498497043,\"masked\":false},{\"token\":\" various\",\"bytes\":\"IHZhcmlvdXM=\",\"prob\":0.005469686803358855,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"-gr\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":20.509958267211914,\"token\":{\"token\":\"-gr\",\"bytes\":\"LWdy\",\"prob\":0.9911260458123781,\"masked\":false},\"top_k\":[{\"token\":\"-gr\",\"bytes\":\"LWdy\",\"prob\":0.9911260458123781,\"masked\":false},{\"token\":\"-t\",\"bytes\":\"LXQ=\",\"prob\":0.008579144782969998,\"masked\":false},{\"token\":\" gran\",\"bytes\":\"IGdyYW4=\",\"prob\":0.000259161632311114,\"masked\":false},{\"token\":\" control\",\"bytes\":\"IGNvbnRyb2w=\",\"prob\":0.000021278797208267155,\"masked\":false},{\"token\":\" granular\",\"bytes\":\"IGdyYW51bGFy\",\"prob\":0.000016572373496665013,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"ained\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":5.014181137084961,\"token\":{\"token\":\"ained\",\"bytes\":\"YWluZWQ=\",\"prob\":0.9999754916812374,\"masked\":false},\"top_k\":[{\"token\":\"ained\",\"bytes\":\"YWluZWQ=\",\"prob\":0.9999754916812374,\"masked\":false},{\"token\":\"ain\",\"bytes\":\"YWlu\",\"prob\":0.000024327013763060332,\"masked\":false},{\"token\":\"an\",\"bytes\":\"YW4=\",\"prob\":6.033816335440224e-8,\"masked\":false},{\"token\":\"aned\",\"bytes\":\"YW5lZA==\",\"prob\":5.6137056499513555e-9,\"masked\":false},{\"token\":\"aining\",\"bytes\":\"YWluaW5n\",\"prob\":1.6085620615938422e-9,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" control\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":14.861106872558594,\"token\":{\"token\":\" control\",\"bytes\":\"IGNvbnRyb2w=\",\"prob\":0.9988353385571773,\"masked\":false},\"top_k\":[{\"token\":\" control\",\"bytes\":\"IGNvbnRyb2w=\",\"prob\":0.9988353385571773,\"masked\":false},{\"token\":\" access\",\"bytes\":\"IGFjY2Vzcw==\",\"prob\":0.0010328302393944589,\"masked\":false},{\"token\":\" permission\",\"bytes\":\"IHBlcm1pc3Npb24=\",\"prob\":0.000058285666787312615,\"masked\":false},{\"token\":\" controls\",\"bytes\":\"IGNvbnRyb2xz\",\"prob\":0.000031200091050435366,\"masked\":false},{\"token\":\" management\",\"bytes\":\"IG1hbmFnZW1lbnQ=\",\"prob\":0.00001670128755852807,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" over\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.661985397338867,\"token\":{\"token\":\" over\",\"bytes\":\"IG92ZXI=\",\"prob\":0.9641309581786172,\"masked\":false},\"top_k\":[{\"token\":\" over\",\"bytes\":\"IG92ZXI=\",\"prob\":0.9641309581786172,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.03300229405873133,\"masked\":false},{\"token\":\" by\",\"bytes\":\"IGJ5\",\"prob\":0.0016435986370741417,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.0008798119667088926,\"masked\":false},{\"token\":\"—\",\"bytes\":\"4oCU\",\"prob\":0.00006375068345667025,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" who\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.533954620361328,\"token\":{\"token\":\" who\",\"bytes\":\"IHdobw==\",\"prob\":0.9986600793592446,\"masked\":false},\"top_k\":[{\"token\":\" who\",\"bytes\":\"IHdobw==\",\"prob\":0.9986600793592446,\"masked\":false},{\"token\":\" which\",\"bytes\":\"IHdoaWNo\",\"prob\":0.0009113213878216846,\"masked\":false},{\"token\":\" what\",\"bytes\":\"IHdoYXQ=\",\"prob\":0.00020337491492151066,\"masked\":false},{\"token\":\" read\",\"bytes\":\"IHJlYWQ=\",\"prob\":0.00009607497828305733,\"masked\":false},{\"token\":\" how\",\"bytes\":\"IGhvdw==\",\"prob\":0.00007482520784455873,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" can\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":10.830879211425781,\"token\":{\"token\":\" can\",\"bytes\":\"IGNhbg==\",\"prob\":0.9999968266298266,\"masked\":false},\"top_k\":[{\"token\":\" can\",\"bytes\":\"IGNhbg==\",\"prob\":0.9999968266298266,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.000002906151425567016,\"masked\":false},{\"token\":\" has\",\"bytes\":\"IGhhcw==\",\"prob\":1.1272158974544541e-7,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":2.8504544675330104e-8,\"masked\":false},{\"token\":\"can\",\"bytes\":\"Y2Fu\",\"prob\":2.5155498412139758e-8,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" read\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":15.806913375854492,\"token\":{\"token\":\" read\",\"bytes\":\"IHJlYWQ=\",\"prob\":0.9999915822424559,\"masked\":false},\"top_k\":[{\"token\":\" read\",\"bytes\":\"IHJlYWQ=\",\"prob\":0.9999915822424559,\"masked\":false},{\"token\":\" view\",\"bytes\":\"IHZpZXc=\",\"prob\":0.000004228236777300114,\"masked\":false},{\"token\":\" execute\",\"bytes\":\"IGV4ZWN1dGU=\",\"prob\":0.0000017627512387901481,\"masked\":false},{\"token\":\"read\",\"bytes\":\"cmVhZA==\",\"prob\":9.43593891620231e-7,\"masked\":false},{\"token\":\" Read\",\"bytes\":\"IFJlYWQ=\",\"prob\":5.051021452772377e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":9.844064712524414,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":1,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":1,\"masked\":false},{\"token\":\" from\",\"bytes\":\"IGZyb20=\",\"prob\":1.9591704419834725e-8,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":1.728984255099512e-8,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":1.5258430253549292e-8,\"masked\":false},{\"token\":\"/write\",\"bytes\":\"L3dyaXRl\",\"prob\":4.6093190830331293e-10,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" write\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":14.46390151977539,\"token\":{\"token\":\" write\",\"bytes\":\"IHdyaXRl\",\"prob\":0.999985622745823,\"masked\":false},\"top_k\":[{\"token\":\" write\",\"bytes\":\"IHdyaXRl\",\"prob\":0.999985622745823,\"masked\":false},{\"token\":\" modify\",\"bytes\":\"IG1vZGlmeQ==\",\"prob\":0.000013022292575948932,\"masked\":false},{\"token\":\" execute\",\"bytes\":\"IGV4ZWN1dGU=\",\"prob\":9.435884929079391e-7,\"masked\":false},{\"token\":\"write\",\"bytes\":\"d3JpdGU=\",\"prob\":2.3861054844915835e-7,\"masked\":false},{\"token\":\" edit\",\"bytes\":\"IGVkaXQ=\",\"prob\":1.4473211639276584e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":9.220123291015625,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.9999608316186489,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.9999608316186489,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.000035393713695576384,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.000003731340359285637,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":7.207843923652758e-9,\"masked\":false},{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":1.822688178888714e-9,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" or\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":13.397932052612305,\"token\":{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.988983454077074,\"masked\":false},\"top_k\":[{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.988983454077074,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.010991740997335915,\"masked\":false},{\"token\":\" execute\",\"bytes\":\"IGV4ZWN1dGU=\",\"prob\":0.000030892350494482465,\"masked\":false},{\"token\":\"or\",\"bytes\":\"b3I=\",\"prob\":5.96749811110942e-8,\"masked\":false},{\"token\":\" modify\",\"bytes\":\"IG1vZGlmeQ==\",\"prob\":3.619658212112648e-8,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" execute\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":12.027978897094727,\"token\":{\"token\":\" execute\",\"bytes\":\"IGV4ZWN1dGU=\",\"prob\":0.9999995680248992,\"masked\":false},\"top_k\":[{\"token\":\" execute\",\"bytes\":\"IGV4ZWN1dGU=\",\"prob\":0.9999995680248992,\"masked\":false},{\"token\":\"execute\",\"bytes\":\"ZXhlY3V0ZQ==\",\"prob\":3.471677666470143e-7,\"masked\":false},{\"token\":\"Execute\",\"bytes\":\"RXhlY3V0ZQ==\",\"prob\":2.2200021830278593e-8,\"masked\":false},{\"token\":\"_execute\",\"bytes\":\"X2V4ZWN1dGU=\",\"prob\":1.728984255099512e-8,\"masked\":false},{\"token\":\" Execute\",\"bytes\":\"IEV4ZWN1dGU=\",\"prob\":9.25518556401183e-9,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":49.31497573852539,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.29298867159551834,\"masked\":false},\"top_k\":[{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.70277948214102,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.29298867159551834,\"masked\":false},{\"token\":\" specific\",\"bytes\":\"IHNwZWNpZmlj\",\"prob\":0.0036898556021019878,\"masked\":false},{\"token\":\" particular\",\"bytes\":\"IHBhcnRpY3VsYXI=\",\"prob\":0.0003432945600176828,\"masked\":false},{\"token\":\" certain\",\"bytes\":\"IGNlcnRhaW4=\",\"prob\":0.00007661128430607474,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" file\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":27.491092681884766,\"token\":{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.9964893809325956,\"masked\":false},\"top_k\":[{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.9964893809325956,\"masked\":false},{\"token\":\" particular\",\"bytes\":\"IHBhcnRpY3VsYXI=\",\"prob\":0.0019249240635795003,\"masked\":false},{\"token\":\" given\",\"bytes\":\"IGdpdmVu\",\"prob\":0.0014991712276840416,\"masked\":false},{\"token\":\" specific\",\"bytes\":\"IHNwZWNpZmlj\",\"prob\":0.00008460266876495483,\"masked\":false},{\"token\":\" resource\",\"bytes\":\"IHJlc291cmNl\",\"prob\":0.0000017565779826485128,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":7.066965103149414,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.9963260725216068,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.9963260725216068,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.0028001797817673413,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.0004295049686823185,\"masked\":false},{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.0004295049686823185,\"masked\":false},{\"token\":\"—\",\"bytes\":\"4oCU\",\"prob\":0.000006945271077641608,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" making\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":18.180131912231445,\"token\":{\"token\":\" making\",\"bytes\":\"IG1ha2luZw==\",\"prob\":0.030014986200461356,\"masked\":false},\"top_k\":[{\"token\":\" enabling\",\"bytes\":\"IGVuYWJsaW5n\",\"prob\":0.773835821117468,\"masked\":false},{\"token\":\" which\",\"bytes\":\"IHdoaWNo\",\"prob\":0.11869465024753738,\"masked\":false},{\"token\":\" making\",\"bytes\":\"IG1ha2luZw==\",\"prob\":0.030014986200461356,\"masked\":false},{\"token\":\" allowing\",\"bytes\":\"IGFsbG93aW5n\",\"prob\":0.023376300687617646,\"masked\":false},{\"token\":\" thereby\",\"bytes\":\"IHRoZXJlYnk=\",\"prob\":0.011043041280522943,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" it\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":25.675058364868164,\"token\":{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.9999742997982481,\"masked\":false},\"top_k\":[{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.9999742997982481,\"masked\":false},{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.000010141918490815365,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.000006970702871932543,\"masked\":false},{\"token\":\" systems\",\"bytes\":\"IHN5c3RlbXM=\",\"prob\":0.0000029060849166974113,\"masked\":false},{\"token\":\" security\",\"bytes\":\"IHNlY3VyaXR5\",\"prob\":0.0000015556159687100432,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" essential\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":10.818958282470703,\"token\":{\"token\":\" essential\",\"bytes\":\"IGVzc2VudGlhbA==\",\"prob\":0.7050324341122978,\"masked\":false},\"top_k\":[{\"token\":\" essential\",\"bytes\":\"IGVzc2VudGlhbA==\",\"prob\":0.7050324341122978,\"masked\":false},{\"token\":\" an\",\"bytes\":\"IGFu\",\"prob\":0.2020213496446978,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.05788759469566422,\"masked\":false},{\"token\":\" fundamental\",\"bytes\":\"IGZ1bmRhbWVudGFs\",\"prob\":0.01658721925809269,\"masked\":false},{\"token\":\" integral\",\"bytes\":\"IGludGVncmFs\",\"prob\":0.0069152090659305426,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" for\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":22.89581298828125,\"token\":{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.9940847620480932,\"masked\":false},\"top_k\":[{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.9940847620480932,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.005914186707156885,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.000004203260377343847,\"masked\":false},{\"token\":\" when\",\"bytes\":\"IHdoZW4=\",\"prob\":5.0211848237857e-7,\"masked\":false},{\"token\":\" not\",\"bytes\":\"IG5vdA==\",\"prob\":8.727094241782958e-8,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" protecting\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.352041244506836,\"token\":{\"token\":\" protecting\",\"bytes\":\"IHByb3RlY3Rpbmc=\",\"prob\":0.45037842585838556,\"masked\":false},\"top_k\":[{\"token\":\" maintaining\",\"bytes\":\"IG1haW50YWluaW5n\",\"prob\":0.45037842585838556,\"masked\":false},{\"token\":\" protecting\",\"bytes\":\"IHByb3RlY3Rpbmc=\",\"prob\":0.45037842585838556,\"masked\":false},{\"token\":\" safeguarding\",\"bytes\":\"IHNhZmVndWFyZGluZw==\",\"prob\":0.0474806151162118,\"masked\":false},{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.009351060632273844,\"masked\":false},{\"token\":\" securing\",\"bytes\":\"IHNlY3VyaW5n\",\"prob\":0.009351060632273844,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" sensitive\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":15.778064727783203,\"token\":{\"token\":\" sensitive\",\"bytes\":\"IHNlbnNpdGl2ZQ==\",\"prob\":0.9935732088728866,\"masked\":false},\"top_k\":[{\"token\":\" sensitive\",\"bytes\":\"IHNlbnNpdGl2ZQ==\",\"prob\":0.9935732088728866,\"masked\":false},{\"token\":\" data\",\"bytes\":\"IGRhdGE=\",\"prob\":0.005911142094597785,\"masked\":false},{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.0002598017472765691,\"masked\":false},{\"token\":\" important\",\"bytes\":\"IGltcG9ydGFudA==\",\"prob\":0.00010831130704653804,\"masked\":false},{\"token\":\" critical\",\"bytes\":\"IGNyaXRpY2Fs\",\"prob\":0.0000843551172897036,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" data\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":4.489898681640625,\"token\":{\"token\":\" data\",\"bytes\":\"IGRhdGE=\",\"prob\":0.9398804468540328,\"masked\":false},\"top_k\":[{\"token\":\" data\",\"bytes\":\"IGRhdGE=\",\"prob\":0.9398804468540328,\"masked\":false},{\"token\":\" information\",\"bytes\":\"IGluZm9ybWF0aW9u\",\"prob\":0.060101676958155915,\"masked\":false},{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.00003769614870331107,\"masked\":false},{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.0000014621309212044125,\"masked\":false},{\"token\":\" resources\",\"bytes\":\"IHJlc291cmNlcw==\",\"prob\":0.000001138738223315004,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.761167526245117,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.9814132078317318,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.9814132078317318,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.01586985471669948,\"masked\":false},{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.002148196705242444,\"masked\":false},{\"token\":\" while\",\"bytes\":\"IHdoaWxl\",\"prob\":0.0005432266267204092,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.00002107028106241825,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" maintaining\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":19.04582977294922,\"token\":{\"token\":\" maintaining\",\"bytes\":\"IG1haW50YWluaW5n\",\"prob\":0.27372161730167915,\"masked\":false},\"top_k\":[{\"token\":\" ensuring\",\"bytes\":\"IGVuc3VyaW5n\",\"prob\":0.6565644956166603,\"masked\":false},{\"token\":\" maintaining\",\"bytes\":\"IG1haW50YWluaW5n\",\"prob\":0.27372161730167915,\"masked\":false},{\"token\":\" enforcing\",\"bytes\":\"IGVuZm9yY2luZw==\",\"prob\":0.02247426339362334,\"masked\":false},{\"token\":\" configuring\",\"bytes\":\"IGNvbmZpZ3VyaW5n\",\"prob\":0.019833724886740556,\"masked\":false},{\"token\":\" managing\",\"bytes\":\"IG1hbmFnaW5n\",\"prob\":0.006439820384205476,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" system\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.635282516479492,\"token\":{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.7997064487247562,\"masked\":false},\"top_k\":[{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.7997064487247562,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.09553237111522811,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.057946316059334584,\"masked\":false},{\"token\":\" proper\",\"bytes\":\"IHByb3Blcg==\",\"prob\":0.021319468748835387,\"masked\":false},{\"token\":\" an\",\"bytes\":\"IGFu\",\"prob\":0.012931581828394483,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" integrity\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":13.84878158569336,\"token\":{\"token\":\" integrity\",\"bytes\":\"IGludGVncml0eQ==\",\"prob\":0.9988179754088798,\"masked\":false},\"top_k\":[{\"token\":\" integrity\",\"bytes\":\"IGludGVncml0eQ==\",\"prob\":0.9988179754088798,\"masked\":false},{\"token\":\" stability\",\"bytes\":\"IHN0YWJpbGl0eQ==\",\"prob\":0.0006264646318152812,\"masked\":false},{\"token\":\" security\",\"bytes\":\"IHNlY3VyaXR5\",\"prob\":0.0005528602624735146,\"masked\":false},{\"token\":\" functionality\",\"bytes\":\"IGZ1bmN0aW9uYWxpdHk=\",\"prob\":9.424869024938248e-7,\"masked\":false},{\"token\":\" Integrity\",\"bytes\":\"IEludGVncml0eQ==\",\"prob\":5.716768389200471e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":15.94400405883789,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9990221935454234,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9990221935454234,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.0008045402047387102,\"masked\":false},{\"token\":\".\\n\\n\",\"bytes\":\"LgoK\",\"prob\":0.0000961097981922375,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.00004540258456984166,\"masked\":false},{\"token\":\" while\",\"bytes\":\"IHdoaWxl\",\"prob\":0.000027539487240627465,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Additionally\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":5.629062652587891,\"token\":{\"token\":\" Additionally\",\"bytes\":\"IEFkZGl0aW9uYWxseQ==\",\"prob\":0.6015431084904259,\"masked\":false},\"top_k\":[{\"token\":\" Additionally\",\"bytes\":\"IEFkZGl0aW9uYWxseQ==\",\"prob\":0.6015431084904259,\"masked\":false},{\"token\":\" The\",\"bytes\":\"IFRoZQ==\",\"prob\":0.3220036703979637,\"masked\":false},{\"token\":\" Its\",\"bytes\":\"IEl0cw==\",\"prob\":0.049390463166111134,\"masked\":false},{\"token\":\" Moreover\",\"bytes\":\"IE1vcmVvdmVy\",\"prob\":0.011022216068418762,\"masked\":false},{\"token\":\" Furthermore\",\"bytes\":\"IEZ1cnRoZXJtb3Jl\",\"prob\":0.0085843330174607,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":12.47096061706543,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.9999998064074439,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.9999998064074439,\"masked\":false},{\"token\":\":\\n\\n\",\"bytes\":\"OgoK\",\"prob\":1.277291268016977e-7,\"masked\":false},{\"token\":\",\\n\\n\",\"bytes\":\"LAoK\",\"prob\":1.1056178566958917e-9,\"masked\":false},{\"token\":\":\\n\",\"bytes\":\"Ogo=\",\"prob\":1.1056178566958917e-9,\"masked\":false},{\"token\":\"،\",\"bytes\":\"2Iw=\",\"prob\":7.59908845245546e-10,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" understanding\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":9.535074234008789,\"token\":{\"token\":\" understanding\",\"bytes\":\"IHVuZGVyc3RhbmRpbmc=\",\"prob\":0.04337813325158509,\"masked\":false},\"top_k\":[{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.5986537357253442,\"masked\":false},{\"token\":\" its\",\"bytes\":\"IGl0cw==\",\"prob\":0.28280597562013404,\"masked\":false},{\"token\":\" it\",\"bytes\":\"IGl0\",\"prob\":0.04337813325158509,\"masked\":false},{\"token\":\" understanding\",\"bytes\":\"IHVuZGVyc3RhbmRpbmc=\",\"prob\":0.04337813325158509,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.015959581895756768,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":10.175943374633789,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.973610106709709,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.973610106709709,\"masked\":false},{\"token\":\" how\",\"bytes\":\"IGhvdw==\",\"prob\":0.012261502110115943,\"masked\":false},{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.008427526611517919,\"masked\":false},{\"token\":\" permission\",\"bytes\":\"IHBlcm1pc3Npb24=\",\"prob\":0.002414839755710686,\"masked\":false},{\"token\":\" permissions\",\"bytes\":\"IHBlcm1pc3Npb25z\",\"prob\":0.0016597580068932354,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" using\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":14.925956726074219,\"token\":{\"token\":\" using\",\"bytes\":\"IHVzaW5n\",\"prob\":0.6793476542839861,\"masked\":false},\"top_k\":[{\"token\":\" using\",\"bytes\":\"IHVzaW5n\",\"prob\":0.6793476542839861,\"masked\":false},{\"token\":\" effectively\",\"bytes\":\"IGVmZmVjdGl2ZWx5\",\"prob\":0.1180743291324239,\"masked\":false},{\"token\":\" utilizing\",\"bytes\":\"IHV0aWxpemluZw==\",\"prob\":0.1180743291324239,\"masked\":false},{\"token\":\" manipulating\",\"bytes\":\"IG1hbmlwdWxhdGluZw==\",\"prob\":0.055778701181324275,\"masked\":false},{\"token\":\" mastering\",\"bytes\":\"IG1hc3RlcmluZw==\",\"prob\":0.010985328218754009,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":21.760940551757812,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9847825603899967,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9847825603899967,\"masked\":false},{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.003553752389710627,\"masked\":false},{\"token\":\" this\",\"bytes\":\"IHRoaXM=\",\"prob\":0.0031362161232441534,\"masked\":false},{\"token\":\" permissions\",\"bytes\":\"IHBlcm1pc3Npb25z\",\"prob\":0.0031362161232441534,\"masked\":false},{\"token\":\" permission\",\"bytes\":\"IHBlcm1pc3Npb24=\",\"prob\":0.002442550885370154,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"chmod\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":12.284278869628906,\"token\":{\"token\":\"chmod\",\"bytes\":\"Y2htb2Q=\",\"prob\":0.9999998064074439,\"masked\":false},\"top_k\":[{\"token\":\"chmod\",\"bytes\":\"Y2htb2Q=\",\"prob\":0.9999998064074439,\"masked\":false},{\"token\":\" chmod\",\"bytes\":\"IGNobW9k\",\"prob\":6.033965933469722e-8,\"masked\":false},{\"token\":\"permissions\",\"bytes\":\"cGVybWlzc2lvbnM=\",\"prob\":4.372180081359945e-9,\"masked\":false},{\"token\":\"ch\",\"bytes\":\"Y2g=\",\"prob\":1.1056178566958917e-9,\"masked\":false},{\"token\":\"sudo\",\"bytes\":\"c3Vkbw==\",\"prob\":5.506259653211689e-11,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":26.381731033325195,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999917014329327,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9999917014329327,\"masked\":false},{\"token\":\",\\\"\",\"bytes\":\"LCI=\",\"prob\":0.000006151809013107019,\"masked\":false},{\"token\":\"”\",\"bytes\":\"4oCd\",\"prob\":0.0000015556426700883423,\"masked\":false},{\"token\":\"\\\"'\",\"bytes\":\"Iic=\",\"prob\":1.8583596220648923e-7,\"masked\":false},{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":1.6400178657299204e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" is\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":10.024070739746094,\"token\":{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.1627651828068744,\"masked\":false},\"top_k\":[{\"token\":\" effectively\",\"bytes\":\"IGVmZmVjdGl2ZWx5\",\"prob\":0.7293495423571814,\"masked\":false},{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.1627651828068744,\"masked\":false},{\"token\":\" can\",\"bytes\":\"IGNhbg==\",\"prob\":0.04663904991416735,\"masked\":false},{\"token\":\" reflects\",\"bytes\":\"IHJlZmxlY3Rz\",\"prob\":0.013364046646460926,\"masked\":false},{\"token\":\" empowers\",\"bytes\":\"IGVtcG93ZXJz\",\"prob\":0.013364046646460926,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" fundamental\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":6.105899810791016,\"token\":{\"token\":\" fundamental\",\"bytes\":\"IGZ1bmRhbWVudGFs\",\"prob\":0.6177054406364363,\"masked\":false},\"top_k\":[{\"token\":\" fundamental\",\"bytes\":\"IGZ1bmRhbWVudGFs\",\"prob\":0.6177054406364363,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.2575212997850537,\"masked\":false},{\"token\":\" foundational\",\"bytes\":\"IGZvdW5kYXRpb25hbA==\",\"prob\":0.07379065952027256,\"masked\":false},{\"token\":\" key\",\"bytes\":\"IGtleQ==\",\"prob\":0.03485895010030476,\"masked\":false},{\"token\":\" often\",\"bytes\":\"IG9mdGVu\",\"prob\":0.006058676455283431,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" for\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":12.375116348266602,\"token\":{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.7010851396461213,\"masked\":false},\"top_k\":[{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.7010851396461213,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.257941560168477,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.034915829636917174,\"masked\":false},{\"token\":\" knowledge\",\"bytes\":\"IGtub3dsZWRnZQ==\",\"prob\":0.00606856387699286,\"masked\":false},{\"token\":\" when\",\"bytes\":\"IHdoZW4=\",\"prob\":0.00004635748294446194,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" managing\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":21.30293846130371,\"token\":{\"token\":\" managing\",\"bytes\":\"IG1hbmFnaW5n\",\"prob\":0.0012482779083345672,\"masked\":false},\"top_k\":[{\"token\":\" effective\",\"bytes\":\"IGVmZmVjdGl2ZQ==\",\"prob\":0.5702814330404237,\"masked\":false},{\"token\":\" anyone\",\"bytes\":\"IGFueW9uZQ==\",\"prob\":0.18516487158592626,\"masked\":false},{\"token\":\" mastering\",\"bytes\":\"IG1hc3RlcmluZw==\",\"prob\":0.06812540453084748,\"masked\":false},{\"token\":\" navigating\",\"bytes\":\"IG5hdmlnYXRpbmc=\",\"prob\":0.05305749368474478,\"masked\":false},{\"token\":\" working\",\"bytes\":\"IHdvcmtpbmc=\",\"prob\":0.03218266502214231,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":24.79696273803711,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.17468514695003534,\"masked\":false},\"top_k\":[{\"token\":\" multi\",\"bytes\":\"IG11bHRp\",\"prob\":0.5380053736991595,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.17468514695003534,\"masked\":false},{\"token\":\" user\",\"bytes\":\"IHVzZXI=\",\"prob\":0.1059573903366094,\"masked\":false},{\"token\":\" Unix\",\"bytes\":\"IFVuaXg=\",\"prob\":0.05671857950998588,\"masked\":false},{\"token\":\" collaborative\",\"bytes\":\"IGNvbGxhYm9yYXRpdmU=\",\"prob\":0.044173619149609974,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" multi\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":22.655010223388672,\"token\":{\"token\":\" multi\",\"bytes\":\"IG11bHRp\",\"prob\":0.8767919300820359,\"masked\":false},\"top_k\":[{\"token\":\" multi\",\"bytes\":\"IG11bHRp\",\"prob\":0.8767919300820359,\"masked\":false},{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.056067412122727624,\"masked\":false},{\"token\":\" Unix\",\"bytes\":\"IFVuaXg=\",\"prob\":0.04366647633298974,\"masked\":false},{\"token\":\" secure\",\"bytes\":\"IHNlY3VyZQ==\",\"prob\":0.020628186947287575,\"masked\":false},{\"token\":\" collaborative\",\"bytes\":\"IGNvbGxhYm9yYXRpdmU=\",\"prob\":0.0009066329942790795,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"-user\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":13.479232788085938,\"token\":{\"token\":\"-user\",\"bytes\":\"LXVzZXI=\",\"prob\":0.999941523568195,\"masked\":false},\"top_k\":[{\"token\":\"-user\",\"bytes\":\"LXVzZXI=\",\"prob\":0.999941523568195,\"masked\":false},{\"token\":\"user\",\"bytes\":\"dXNlcg==\",\"prob\":0.00005835023064475277,\"masked\":false},{\"token\":\" user\",\"bytes\":\"IHVzZXI=\",\"prob\":6.836886327725015e-8,\"masked\":false},{\"token\":\"-users\",\"bytes\":\"LXVzZXJz\",\"prob\":2.8502968207376913e-8,\"masked\":false},{\"token\":\"-\",\"bytes\":\"LQ==\",\"prob\":8.167295572684549e-9,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" environment\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":16.27492904663086,\"token\":{\"token\":\" environment\",\"bytes\":\"IGVudmlyb25tZW50\",\"prob\":0.9971317880948309,\"masked\":false},\"top_k\":[{\"token\":\" environment\",\"bytes\":\"IGVudmlyb25tZW50\",\"prob\":0.9971317880948309,\"masked\":false},{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.0013238842352316614,\"masked\":false},{\"token\":\" operating\",\"bytes\":\"IG9wZXJhdGluZw==\",\"prob\":0.0006254072642058715,\"masked\":false},{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.00048708029257971353,\"masked\":false},{\"token\":\" Unix\",\"bytes\":\"IFVuaXg=\",\"prob\":0.00037934834626647757,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\",\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":71.56085968017578,\"token\":{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.7401454883471597,\"masked\":false},\"top_k\":[{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.7401454883471597,\"masked\":false},{\"token\":\" effectively\",\"bytes\":\"IGVmZmVjdGl2ZWx5\",\"prob\":0.2120827243771636,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.03686113471283483,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.0056539385034414065,\"masked\":false},{\"token\":\" efficiently\",\"bytes\":\"IGVmZmljaWVudGx5\",\"prob\":0.0034294648366393642,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" which\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":6.1740875244140625,\"token\":{\"token\":\" which\",\"bytes\":\"IHdoaWNo\",\"prob\":0.6821423270953039,\"masked\":false},\"top_k\":[{\"token\":\" which\",\"bytes\":\"IHdoaWNo\",\"prob\":0.6821423270953039,\"masked\":false},{\"token\":\" enhancing\",\"bytes\":\"IGVuaGFuY2luZw==\",\"prob\":0.056008164676667006,\"masked\":false},{\"token\":\" making\",\"bytes\":\"IG1ha2luZw==\",\"prob\":0.04942767245147875,\"masked\":false},{\"token\":\" showcasing\",\"bytes\":\"IHNob3djYXNpbmc=\",\"prob\":0.0384953078371591,\"masked\":false},{\"token\":\" giving\",\"bytes\":\"IGdpdmluZw==\",\"prob\":0.026458441086804573,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" adds\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":4.323005676269531,\"token\":{\"token\":\" adds\",\"bytes\":\"IGFkZHM=\",\"prob\":0.4007197764647197,\"masked\":false},\"top_k\":[{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.5145210408425104,\"masked\":false},{\"token\":\" adds\",\"bytes\":\"IGFkZHM=\",\"prob\":0.4007197764647197,\"masked\":false},{\"token\":\" enhances\",\"bytes\":\"IGVuaGFuY2Vz\",\"prob\":0.03290160964296893,\"masked\":false},{\"token\":\" showcases\",\"bytes\":\"IHNob3djYXNlcw==\",\"prob\":0.013716672548114877,\"masked\":false},{\"token\":\" many\",\"bytes\":\"IG1hbnk=\",\"prob\":0.007342481539618388,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" to\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":6.644964218139648,\"token\":{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.996177948370855,\"masked\":false},\"top_k\":[{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.996177948370855,\"masked\":false},{\"token\":\" an\",\"bytes\":\"IGFu\",\"prob\":0.0021805143431431577,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.001498702401109134,\"masked\":false},{\"token\":\" another\",\"bytes\":\"IGFub3RoZXI=\",\"prob\":0.00005813058356681643,\"masked\":false},{\"token\":\" complexity\",\"bytes\":\"IGNvbXBsZXhpdHk=\",\"prob\":0.00003525980909668184,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" its\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":9.156942367553711,\"token\":{\"token\":\" its\",\"bytes\":\"IGl0cw==\",\"prob\":0.9999462909524099,\"masked\":false},\"top_k\":[{\"token\":\" its\",\"bytes\":\"IGl0cw==\",\"prob\":0.9999462909524099,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.000051494810722170615,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":9.43551602533962e-7,\"masked\":false},{\"token\":\" both\",\"bytes\":\"IGJvdGg=\",\"prob\":6.485181153404502e-7,\"masked\":false},{\"token\":\"its\",\"bytes\":\"aXRz\",\"prob\":2.703670989599099e-7,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" significance\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":8.230209350585938,\"token\":{\"token\":\" significance\",\"bytes\":\"IHNpZ25pZmljYW5jZQ==\",\"prob\":0.3858681910947219,\"masked\":false},\"top_k\":[{\"token\":\" significance\",\"bytes\":\"IHNpZ25pZmljYW5jZQ==\",\"prob\":0.3858681910947219,\"masked\":false},{\"token\":\" appeal\",\"bytes\":\"IGFwcGVhbA==\",\"prob\":0.26521336668017736,\"masked\":false},{\"token\":\" importance\",\"bytes\":\"IGltcG9ydGFuY2U=\",\"prob\":0.2065537316754097,\"masked\":false},{\"token\":\" cool\",\"bytes\":\"IGNvb2w=\",\"prob\":0.1252876661510015,\"masked\":false},{\"token\":\" allure\",\"bytes\":\"IGFsbHVyZQ==\",\"prob\":0.003340058353656074,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":2.269744873046875,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.8314230773109785,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.8314230773109785,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.16374449744207445,\"masked\":false},{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.002647815520496486,\"masked\":false},{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.001103873868630246,\"masked\":false},{\"token\":\" among\",\"bytes\":\"IGFtb25n\",\"prob\":0.0009741778956940713,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" appeal\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":2.6772022247314453,\"token\":{\"token\":\" appeal\",\"bytes\":\"IGFwcGVhbA==\",\"prob\":0.8542012115468899,\"masked\":false},\"top_k\":[{\"token\":\" appeal\",\"bytes\":\"IGFwcGVhbA==\",\"prob\":0.8542012115468899,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.06189496642676227,\"masked\":false},{\"token\":\" cool\",\"bytes\":\"IGNvb2w=\",\"prob\":0.04820509783275376,\"masked\":false},{\"token\":\" utility\",\"bytes\":\"IHV0aWxpdHk=\",\"prob\":0.009493748268352512,\"masked\":false},{\"token\":\" perceived\",\"bytes\":\"IHBlcmNlaXZlZA==\",\"prob\":0.006525205105872335,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" among\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":7.235050201416016,\"token\":{\"token\":\" among\",\"bytes\":\"IGFtb25n\",\"prob\":0.46955353046815607,\"masked\":false},\"top_k\":[{\"token\":\" among\",\"bytes\":\"IGFtb25n\",\"prob\":0.46955353046815607,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.32273167462324165,\"masked\":false},{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.11873865880178133,\"masked\":false},{\"token\":\" for\",\"bytes\":\"IGZvcg==\",\"prob\":0.08161098027642033,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.0035868973828911176,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" sys\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":4.851818084716797,\"token\":{\"token\":\" sys\",\"bytes\":\"IHN5cw==\",\"prob\":0.8766048755165641,\"masked\":false},\"top_k\":[{\"token\":\" sys\",\"bytes\":\"IHN5cw==\",\"prob\":0.8766048755165641,\"masked\":false},{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":0.09241502281684601,\"masked\":false},{\"token\":\" administrators\",\"bytes\":\"IGFkbWluaXN0cmF0b3Jz\",\"prob\":0.006696345699621237,\"masked\":false},{\"token\":\" admins\",\"bytes\":\"IGFkbWlucw==\",\"prob\":0.005215254457793996,\"masked\":false},{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":0.004602505555736346,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"admins\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":14.865875244140625,\"token\":{\"token\":\"admins\",\"bytes\":\"YWRtaW5z\",\"prob\":0.437794039075703,\"masked\":false},\"top_k\":[{\"token\":\" admins\",\"bytes\":\"IGFkbWlucw==\",\"prob\":0.5621241024017922,\"masked\":false},{\"token\":\"admins\",\"bytes\":\"YWRtaW5z\",\"prob\":0.437794039075703,\"masked\":false},{\"token\":\" admin\",\"bytes\":\"IGFkbWlu\",\"prob\":0.00006943636545092023,\"masked\":false},{\"token\":\" administrators\",\"bytes\":\"IGFkbWluaXN0cmF0b3Jz\",\"prob\":0.000042117467947878814,\"masked\":false},{\"token\":\"admin\",\"bytes\":\"YWRtaW4=\",\"prob\":0.00002554685998930104,\"masked\":false}],\"class_name\":\"TokenOutput\"}],\"status\":\"Done\",\"shownMetrics\":[\"status\",\"consumed\",\"token reduction\",\"avg latency\"],\"metrics\":{\"status\":\"Done\",\"wall time\":0,\"consumed\":165,\"token reduction\":0,\"avg latency\":12.448294957478842,\"cpu\":[0.12237499999999998,0.12237499999999998,0.16818750000000002,0.16818750000000002,0.16537500000000002],\"gpu\":[0,0,0,0,0],\"ram\":61.398468017578125,\"vram\":0},\"requireFullReplay\":false,\"currentMessageId\":2648,\"backtrackCount\":0,\"resetCount\":5}" } }, "ccee51861e0b4aef9b2869ed3a45432c": { "model_module": "@jupyter-widgets/controls", "model_module_version": "2.0.0", "model_name": "ProgressStyleModel", "state": { "description_width": "" } }, "d93f367c00d244d89cbb2aaac9bf8f81": { "model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {} }, "dafab8be3ab947adac038705165a5372": { "model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {} }, "e65d5b24dba34a728f2191435f699ff2": { "model_module": "@guidance-ai/stitch", "model_module_version": "^0.1.5", "model_name": "StitchModel", "state": { "_model_module_version": "^0.1.5", "_view_module_version": "^0.1.5", "clientmsg": "{\"class_name\":\"ClientReadyMessage\"}", "initial_height": "auto", "initial_width": "100%", "kernelmsg": "{\"message_id\":549,\"last_trace_id\":295,\"is_err\":false,\"class_name\":\"ExecutionCompletedMessage\"}", "layout": "IPY_MODEL_d93f367c00d244d89cbb2aaac9bf8f81", "srcdoc": "\n\n\n \n\n \n \n \n\n\n\n\n\n", "state": "{\"components\":[{\"value\":\"What\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\"What\",\"bytes\":\"V2hhdA==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" are\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" most\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" common\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" used\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" used\",\"bytes\":\"IHVzZWQ=\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" in\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" Linux\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" Linux\",\"bytes\":\"IExpbnV4\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" operating\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" operating\",\"bytes\":\"IG9wZXJhdGluZw==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" system\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" system\",\"bytes\":\"IHN5c3RlbQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"?\\n\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\"?\\n\\n\",\"bytes\":\"PwoK\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"Here\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\"Here\",\"bytes\":\"SGVyZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" are\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" are\",\"bytes\":\"IGFyZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" the\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"6\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\"6\",\"bytes\":\"Ng==\",\"prob\":null,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" most\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" most\",\"bytes\":\"IG1vc3Q=\",\"prob\":0.756897509098053,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" common\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" common\",\"bytes\":\"IGNvbW1vbg==\",\"prob\":0.7453713417053223,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" commands\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\" commands\",\"bytes\":\"IGNvbW1hbmRz\",\"prob\":0.7698392271995544,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\":\\n\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\":\\n\",\"bytes\":\"Ogo=\",\"prob\":0.002817138796672225,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\"1\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":0.3825385570526123,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":true,\"is_generated\":false,\"is_force_forwarded\":false,\"latency_ms\":7.1344757080078125,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9290168881416321,\"masked\":false},\"top_k\":null,\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":72.85594940185547,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.019856709986925125,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.019856709986925125,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.004044999368488789,\"masked\":false},{\"token\":\" \\\"$\",\"bytes\":\"ICIk\",\"prob\":0.000037322461139410734,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.00003255949923186563,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.000017871803720481694,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"ls\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.20795822143555,\"token\":{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.7201953530311584,\"masked\":false},\"top_k\":[{\"token\":\"ls\",\"bytes\":\"bHM=\",\"prob\":0.7201953530311584,\"masked\":false},{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.13298030197620392,\"masked\":false},{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.04682806506752968,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.018025198951363564,\"masked\":false},{\"token\":\"echo\",\"bytes\":\"ZWNobw==\",\"prob\":0.009419338777661324,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.7130012512207,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.7112360596656799,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.7112360596656799,\"masked\":false},{\"token\":\"\\\":\",\"bytes\":\"Ijo=\",\"prob\":0.23095254600048065,\"masked\":false},{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.0150794992223382,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.013482465408742428,\"masked\":false},{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.008596203289926052,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.02707099914551,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.5065160989761353,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.5065160989761353,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.07773559540510178,\"masked\":false},{\"token\":\" –\",\"bytes\":\"IOKAkw==\",\"prob\":0.06879495829343796,\"masked\":false},{\"token\":\" command\",\"bytes\":\"IGNvbW1hbmQ=\",\"prob\":0.06527391821146011,\"masked\":false},{\"token\":\" is\",\"bytes\":\"IGlz\",\"prob\":0.043730322271585464,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" List\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.519954681396484,\"token\":{\"token\":\" List\",\"bytes\":\"IExpc3Q=\",\"prob\":0.1980321854352951,\"masked\":false},\"top_k\":[{\"token\":\" List\",\"bytes\":\"IExpc3Q=\",\"prob\":0.1980321854352951,\"masked\":false},{\"token\":\" list\",\"bytes\":\"IGxpc3Q=\",\"prob\":0.17472879588603973,\"masked\":false},{\"token\":\" Lists\",\"bytes\":\"IExpc3Rz\",\"prob\":0.14294227957725525,\"masked\":false},{\"token\":\" lists\",\"bytes\":\"IGxpc3Rz\",\"prob\":0.11886414140462875,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.11388029158115387,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" files\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.52910804748535,\"token\":{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.34142473340034485,\"masked\":false},\"top_k\":[{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.34142473340034485,\"masked\":false},{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.20746250450611115,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.13445442914962769,\"masked\":false},{\"token\":\" Files\",\"bytes\":\"IEZpbGVz\",\"prob\":0.0860721617937088,\"masked\":false},{\"token\":\" all\",\"bytes\":\"IGFsbA==\",\"prob\":0.06255073100328445,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.32087516784668,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.6979290246963501,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.6979290246963501,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.15664386749267578,\"masked\":false},{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.07474440336227417,\"masked\":false},{\"token\":\"/d\",\"bytes\":\"L2Q=\",\"prob\":0.014937736093997955,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.010892574675381184,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directories\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.12990188598633,\"token\":{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.8078669309616089,\"masked\":false},\"top_k\":[{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.8078669309616089,\"masked\":false},{\"token\":\" folders\",\"bytes\":\"IGZvbGRlcnM=\",\"prob\":0.15547816455364227,\"masked\":false},{\"token\":\" sub\",\"bytes\":\"IHN1Yg==\",\"prob\":0.016852058470249176,\"masked\":false},{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.009154985658824444,\"masked\":false},{\"token\":\" folder\",\"bytes\":\"IGZvbGRlcg==\",\"prob\":0.0020409852731972933,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":62.444210052490234,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.42759084701538086,\"masked\":false},\"top_k\":[{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.42759084701538086,\"masked\":false},{\"token\":\" in\",\"bytes\":\"IGlu\",\"prob\":0.2892744541168213,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.1945270150899887,\"masked\":false},{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.02809036523103714,\"masked\":false},{\"token\":\" on\",\"bytes\":\"IG9u\",\"prob\":0.015708142891526222,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"2\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.2468204498291,\"token\":{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":0.9912563562393188,\"masked\":false},\"top_k\":[{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":0.9912563562393188,\"masked\":false},{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":0.0011365876998752356,\"masked\":false},{\"token\":\" \",\"bytes\":\"ICA=\",\"prob\":0.0009542955667711794,\"masked\":false},{\"token\":\"Example\",\"bytes\":\"RXhhbXBsZQ==\",\"prob\":0.0007296490948647261,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.0006854537059552968,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.6289119720459,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9994696974754333,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9994696974754333,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":0.00024218381440732628,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.0000753538915887475,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.00006036152262822725,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.000023328146198764443,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.53108787536621,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9981825351715088,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9981825351715088,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.0003488161019049585,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":0.0001622538547962904,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.00013459427282214165,\"masked\":false},{\"token\":\" '\",\"bytes\":\"ICc=\",\"prob\":0.00012305070413276553,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"cd\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.44191932678223,\"token\":{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.7743936777114868,\"masked\":false},\"top_k\":[{\"token\":\"cd\",\"bytes\":\"Y2Q=\",\"prob\":0.7743936777114868,\"masked\":false},{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.11543753743171692,\"masked\":false},{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.032972756773233414,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.025613170117139816,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.019268086180090904,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.6519660949707,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9988514184951782,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9988514184951782,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.00016794844123069197,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.00012853667431045324,\"masked\":false},{\"token\":\" <\",\"bytes\":\"IDw=\",\"prob\":0.00011994837404927239,\"masked\":false},{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.0000957478114287369,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.14692306518555,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9951601624488831,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9951601624488831,\"masked\":false},{\"token\":\" –\",\"bytes\":\"IOKAkw==\",\"prob\":0.0019120159558951855,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.0010242603020742536,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.000788228411693126,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.0004957923665642738,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Change\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":79.13994789123535,\"token\":{\"token\":\" Change\",\"bytes\":\"IENoYW5nZQ==\",\"prob\":0.9931095838546753,\"masked\":false},\"top_k\":[{\"token\":\" Change\",\"bytes\":\"IENoYW5nZQ==\",\"prob\":0.9931095838546753,\"masked\":false},{\"token\":\" change\",\"bytes\":\"IGNoYW5nZQ==\",\"prob\":0.0021652081049978733,\"masked\":false},{\"token\":\" Changes\",\"bytes\":\"IENoYW5nZXM=\",\"prob\":0.002115732990205288,\"masked\":false},{\"token\":\" Navigate\",\"bytes\":\"IE5hdmlnYXRl\",\"prob\":0.0005496674566529691,\"masked\":false},{\"token\":\" Move\",\"bytes\":\"IE1vdmU=\",\"prob\":0.00035848477273248136,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directory\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.89715385437012,\"token\":{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.7947884798049927,\"masked\":false},\"top_k\":[{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.7947884798049927,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.09106817096471786,\"masked\":false},{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.04431236907839775,\"masked\":false},{\"token\":\" current\",\"bytes\":\"IGN1cnJlbnQ=\",\"prob\":0.019163016229867935,\"masked\":false},{\"token\":\" working\",\"bytes\":\"IHdvcmtpbmc=\",\"prob\":0.016762712970376015,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.91391563415527,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9520449638366699,\"masked\":false},\"top_k\":[{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9520449638366699,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.013828189112246037,\"masked\":false},{\"token\":\" location\",\"bytes\":\"IGxvY2F0aW9u\",\"prob\":0.009942229837179184,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"IAo=\",\"prob\":0.009867625311017036,\"masked\":false},{\"token\":\" to\",\"bytes\":\"IHRv\",\"prob\":0.007498520892113447,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"3\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.57185745239258,\"token\":{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":0.9988393187522888,\"masked\":false},\"top_k\":[{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":0.9988393187522888,\"masked\":false},{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":0.0006097626173868775,\"masked\":false},{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":0.00008475000504404306,\"masked\":false},{\"token\":\"2\",\"bytes\":\"Mg==\",\"prob\":0.00006749427120666951,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.00005602370947599411,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":67.18277931213379,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9997995495796204,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9997995495796204,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":0.00008938671089708805,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.00003996324448962696,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.000014826688129687682,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.00001337116009381134,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":74.85413551330566,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9984984397888184,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9984984397888184,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.0002678120508790016,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":0.00020280123862903565,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.00014318084868136793,\"masked\":false},{\"token\":\" “\",\"bytes\":\"IOKAnA==\",\"prob\":0.00006880200089653954,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"pwd\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":81.17389678955078,\"token\":{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.5959702134132385,\"masked\":false},\"top_k\":[{\"token\":\"pwd\",\"bytes\":\"cHdk\",\"prob\":0.5959702134132385,\"masked\":false},{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.1715346872806549,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.08039423823356628,\"masked\":false},{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.02924376167356968,\"masked\":false},{\"token\":\"touch\",\"bytes\":\"dG91Y2g=\",\"prob\":0.02626633830368519,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":79.56123352050781,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9995208978652954,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9995208978652954,\"masked\":false},{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.00023184521705843508,\"masked\":false},{\"token\":\"\\\"-\",\"bytes\":\"Ii0=\",\"prob\":0.00007553936302429065,\"masked\":false},{\"token\":\"\\\"\\n\",\"bytes\":\"Igo=\",\"prob\":0.000044247761252336204,\"masked\":false},{\"token\":\"”\",\"bytes\":\"4oCd\",\"prob\":0.000025595843908376992,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":84.0919017791748,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9981800317764282,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9981800317764282,\"masked\":false},{\"token\":\" –\",\"bytes\":\"IOKAkw==\",\"prob\":0.0010421628830954432,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.00029120600083842874,\"masked\":false},{\"token\":\" \",\"bytes\":\"IA==\",\"prob\":0.0001679883134784177,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.00010587596625555307,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Print\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":75.7901668548584,\"token\":{\"token\":\" Print\",\"bytes\":\"IFByaW50\",\"prob\":0.9300885200500488,\"masked\":false},\"top_k\":[{\"token\":\" Print\",\"bytes\":\"IFByaW50\",\"prob\":0.9300885200500488,\"masked\":false},{\"token\":\" Display\",\"bytes\":\"IERpc3BsYXk=\",\"prob\":0.03639443963766098,\"masked\":false},{\"token\":\" Show\",\"bytes\":\"IFNob3c=\",\"prob\":0.010531396605074406,\"masked\":false},{\"token\":\" Prints\",\"bytes\":\"IFByaW50cw==\",\"prob\":0.005069168750196695,\"masked\":false},{\"token\":\" Get\",\"bytes\":\"IEdldA==\",\"prob\":0.0033853393979370594,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" working\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":72.26824760437012,\"token\":{\"token\":\" working\",\"bytes\":\"IHdvcmtpbmc=\",\"prob\":0.7611976861953735,\"masked\":false},\"top_k\":[{\"token\":\" working\",\"bytes\":\"IHdvcmtpbmc=\",\"prob\":0.7611976861953735,\"masked\":false},{\"token\":\" the\",\"bytes\":\"IHRoZQ==\",\"prob\":0.1589236557483673,\"masked\":false},{\"token\":\" current\",\"bytes\":\"IGN1cnJlbnQ=\",\"prob\":0.038258396089076996,\"masked\":false},{\"token\":\" Working\",\"bytes\":\"IFdvcmtpbmc=\",\"prob\":0.03333960473537445,\"masked\":false},{\"token\":\" present\",\"bytes\":\"IHByZXNlbnQ=\",\"prob\":0.001858397270552814,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directory\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":75.60086250305176,\"token\":{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.9976357221603394,\"masked\":false},\"top_k\":[{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.9976357221603394,\"masked\":false},{\"token\":\" path\",\"bytes\":\"IHBhdGg=\",\"prob\":0.0009939761366695166,\"masked\":false},{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.0003065499186050147,\"masked\":false},{\"token\":\" folder\",\"bytes\":\"IGZvbGRlcg==\",\"prob\":0.00018190182163380086,\"masked\":false},{\"token\":\" dir\",\"bytes\":\"IGRpcg==\",\"prob\":0.00012379880354274064,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":72.01099395751953,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.949053168296814,\"masked\":false},\"top_k\":[{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.949053168296814,\"masked\":false},{\"token\":\" path\",\"bytes\":\"IHBhdGg=\",\"prob\":0.031085358932614326,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"IAo=\",\"prob\":0.007522972766309977,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.003957272041589022,\"masked\":false},{\"token\":\" name\",\"bytes\":\"IG5hbWU=\",\"prob\":0.0027157110162079334,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"4\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.73796272277832,\"token\":{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":0.9993860721588135,\"masked\":false},\"top_k\":[{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":0.9993860721588135,\"masked\":false},{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":0.00030892775976099074,\"masked\":false},{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":0.00010377787111792713,\"masked\":false},{\"token\":\"6\",\"bytes\":\"Ng==\",\"prob\":0.000040091443224810064,\"masked\":false},{\"token\":\"1\",\"bytes\":\"MQ==\",\"prob\":0.000018539147276896983,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":69.51093673706055,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9998859167098999,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9998859167098999,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":0.00003876646951539442,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.000020599638446583413,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.000013376473361859098,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.000011957499737036414,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.751935958862305,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9987971782684326,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9987971782684326,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.00016640212561469525,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.00015284896653611213,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":0.00012531808170024306,\"masked\":false},{\"token\":\" \\\"~\",\"bytes\":\"ICJ+\",\"prob\":0.00008047203300520778,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"mkdir\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.24517250061035,\"token\":{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.301483690738678,\"masked\":false},\"top_k\":[{\"token\":\"mkdir\",\"bytes\":\"bWtkaXI=\",\"prob\":0.301483690738678,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.23020607233047485,\"masked\":false},{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.1240277960896492,\"masked\":false},{\"token\":\"cat\",\"bytes\":\"Y2F0\",\"prob\":0.07389472424983978,\"masked\":false},{\"token\":\"grep\",\"bytes\":\"Z3JlcA==\",\"prob\":0.05503762885928154,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.87798690795898,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9979915618896484,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9979915618896484,\"masked\":false},{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.0013503293739631772,\"masked\":false},{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.00015498138964176178,\"masked\":false},{\"token\":\" <\",\"bytes\":\"IDw=\",\"prob\":0.00007040306809358299,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.00006661954830633476,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.85790824890137,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9937062859535217,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9937062859535217,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.002070414600893855,\"masked\":false},{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.0014639354776591063,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.0010764141334220767,\"masked\":false},{\"token\":\" &\",\"bytes\":\"ICY=\",\"prob\":0.0006494948174804449,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Make\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.7580623626709,\"token\":{\"token\":\" Make\",\"bytes\":\"IE1ha2U=\",\"prob\":0.5579606294631958,\"masked\":false},\"top_k\":[{\"token\":\" Make\",\"bytes\":\"IE1ha2U=\",\"prob\":0.5579606294631958,\"masked\":false},{\"token\":\" Create\",\"bytes\":\"IENyZWF0ZQ==\",\"prob\":0.4389786422252655,\"masked\":false},{\"token\":\" make\",\"bytes\":\"IG1ha2U=\",\"prob\":0.0008205444319173694,\"masked\":false},{\"token\":\" create\",\"bytes\":\"IGNyZWF0ZQ==\",\"prob\":0.0006687106797471642,\"masked\":false},{\"token\":\" Creates\",\"bytes\":\"IENyZWF0ZXM=\",\"prob\":0.0006559843313880265,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" a\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.44692611694336,\"token\":{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.6080442070960999,\"masked\":false},\"top_k\":[{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.6080442070960999,\"masked\":false},{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.2860241234302521,\"masked\":false},{\"token\":\" new\",\"bytes\":\"IG5ldw==\",\"prob\":0.06440574675798416,\"masked\":false},{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.02877701446413994,\"masked\":false},{\"token\":\" Directory\",\"bytes\":\"IERpcmVjdG9yeQ==\",\"prob\":0.005046274047344923,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" new\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.84580039978027,\"token\":{\"token\":\" new\",\"bytes\":\"IG5ldw==\",\"prob\":0.7063645720481873,\"masked\":false},\"top_k\":[{\"token\":\" new\",\"bytes\":\"IG5ldw==\",\"prob\":0.7063645720481873,\"masked\":false},{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.2890213429927826,\"masked\":false},{\"token\":\" folder\",\"bytes\":\"IGZvbGRlcg==\",\"prob\":0.0036525025498121977,\"masked\":false},{\"token\":\" Directory\",\"bytes\":\"IERpcmVjdG9yeQ==\",\"prob\":0.0003998729516752064,\"masked\":false},{\"token\":\" sub\",\"bytes\":\"IHN1Yg==\",\"prob\":0.00022439869644585997,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directory\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.24801254272461,\"token\":{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.9906401634216309,\"masked\":false},\"top_k\":[{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.9906401634216309,\"masked\":false},{\"token\":\" folder\",\"bytes\":\"IGZvbGRlcg==\",\"prob\":0.007896979339420795,\"masked\":false},{\"token\":\" Directory\",\"bytes\":\"IERpcmVjdG9yeQ==\",\"prob\":0.0009786473819985986,\"masked\":false},{\"token\":\" empty\",\"bytes\":\"IGVtcHR5\",\"prob\":0.0001248134794877842,\"masked\":false},{\"token\":\" sub\",\"bytes\":\"IHN1Yg==\",\"prob\":0.00007125764386728406,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\n\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.06402587890625,\"token\":{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9873088002204895,\"masked\":false},\"top_k\":[{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.9873088002204895,\"masked\":false},{\"token\":\" \\n\",\"bytes\":\"IAo=\",\"prob\":0.008221996016800404,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.002014587167650461,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.0005018569063395262,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.0004184845893178135,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"5\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.50312042236328,\"token\":{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":0.999502420425415,\"masked\":false},\"top_k\":[{\"token\":\"5\",\"bytes\":\"NQ==\",\"prob\":0.999502420425415,\"masked\":false},{\"token\":\"6\",\"bytes\":\"Ng==\",\"prob\":0.00021893852681387216,\"masked\":false},{\"token\":\"4\",\"bytes\":\"NA==\",\"prob\":0.000048941790737444535,\"masked\":false},{\"token\":\"3\",\"bytes\":\"Mw==\",\"prob\":0.000032424959499621764,\"masked\":false},{\"token\":\"7\",\"bytes\":\"Nw==\",\"prob\":0.000016554384274058975,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\".\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":66.15090370178223,\"token\":{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999136924743652,\"masked\":false},\"top_k\":[{\"token\":\".\",\"bytes\":\"Lg==\",\"prob\":0.9999136924743652,\"masked\":false},{\"token\":\".\\\"\",\"bytes\":\"LiI=\",\"prob\":0.00003092085898970254,\"masked\":false},{\"token\":\".\\n\",\"bytes\":\"Lgo=\",\"prob\":0.0000141975151564111,\"masked\":false},{\"token\":\",\",\"bytes\":\"LA==\",\"prob\":0.00001178697948489571,\"masked\":false},{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.000010654663128661923,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" \\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.08898735046387,\"token\":{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9994974136352539,\"masked\":false},\"top_k\":[{\"token\":\" \\\"\",\"bytes\":\"ICI=\",\"prob\":0.9994974136352539,\"masked\":false},{\"token\":\" \\\".\",\"bytes\":\"ICIu\",\"prob\":0.00007820582686690614,\"masked\":false},{\"token\":\" \\\"/\",\"bytes\":\"ICIv\",\"prob\":0.000054686202929588035,\"masked\":false},{\"token\":\" '\",\"bytes\":\"ICc=\",\"prob\":0.00003445280890446156,\"masked\":false},{\"token\":\" \\\"./\",\"bytes\":\"ICIuLw==\",\"prob\":0.000030250168492784724,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"rm\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":65.55318832397461,\"token\":{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.47745198011398315,\"masked\":false},\"top_k\":[{\"token\":\"rm\",\"bytes\":\"cm0=\",\"prob\":0.47745198011398315,\"masked\":false},{\"token\":\"cp\",\"bytes\":\"Y3A=\",\"prob\":0.19119518995285034,\"masked\":false},{\"token\":\"touch\",\"bytes\":\"dG91Y2g=\",\"prob\":0.16244889795780182,\"masked\":false},{\"token\":\"mv\",\"bytes\":\"bXY=\",\"prob\":0.044064100831747055,\"masked\":false},{\"token\":\"r\",\"bytes\":\"cg==\",\"prob\":0.03669914975762367,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\"\\\"\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.62502479553223,\"token\":{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9929556846618652,\"masked\":false},\"top_k\":[{\"token\":\"\\\"\",\"bytes\":\"Ig==\",\"prob\":0.9929556846618652,\"masked\":false},{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.006172620225697756,\"masked\":false},{\"token\":\"/r\",\"bytes\":\"L3I=\",\"prob\":0.00014100420230533928,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.0001140957247116603,\"masked\":false},{\"token\":\"\\\",\",\"bytes\":\"Iiw=\",\"prob\":0.000113526766654104,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" -\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.82608413696289,\"token\":{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9919424057006836,\"masked\":false},\"top_k\":[{\"token\":\" -\",\"bytes\":\"IC0=\",\"prob\":0.9919424057006836,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.003623327473178506,\"masked\":false},{\"token\":\" /\",\"bytes\":\"IC8=\",\"prob\":0.0014971563359722495,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.0009335465147159994,\"masked\":false},{\"token\":\" –\",\"bytes\":\"IOKAkw==\",\"prob\":0.0007392782717943192,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" Remove\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":64.15796279907227,\"token\":{\"token\":\" Remove\",\"bytes\":\"IFJlbW92ZQ==\",\"prob\":0.9339684844017029,\"masked\":false},\"top_k\":[{\"token\":\" Remove\",\"bytes\":\"IFJlbW92ZQ==\",\"prob\":0.9339684844017029,\"masked\":false},{\"token\":\" Delete\",\"bytes\":\"IERlbGV0ZQ==\",\"prob\":0.06461095809936523,\"masked\":false},{\"token\":\" Removes\",\"bytes\":\"IFJlbW92ZXM=\",\"prob\":0.0003368427569512278,\"masked\":false},{\"token\":\" remove\",\"bytes\":\"IHJlbW92ZQ==\",\"prob\":0.00013425564975477755,\"masked\":false},{\"token\":\" Rename\",\"bytes\":\"IFJlbmFtZQ==\",\"prob\":0.00012034575775032863,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" files\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":63.79199028015137,\"token\":{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.535869836807251,\"masked\":false},\"top_k\":[{\"token\":\" files\",\"bytes\":\"IGZpbGVz\",\"prob\":0.535869836807251,\"masked\":false},{\"token\":\" a\",\"bytes\":\"IGE=\",\"prob\":0.30348482728004456,\"masked\":false},{\"token\":\" file\",\"bytes\":\"IGZpbGU=\",\"prob\":0.06853235512971878,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.039569105952978134,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.021841300651431084,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" and\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":68.6190128326416,\"token\":{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.5227224230766296,\"masked\":false},\"top_k\":[{\"token\":\" and\",\"bytes\":\"IGFuZA==\",\"prob\":0.5227224230766296,\"masked\":false},{\"token\":\" or\",\"bytes\":\"IG9y\",\"prob\":0.39458736777305603,\"masked\":false},{\"token\":\"\\n\",\"bytes\":\"Cg==\",\"prob\":0.060067713260650635,\"masked\":false},{\"token\":\"/d\",\"bytes\":\"L2Q=\",\"prob\":0.013923811726272106,\"masked\":false},{\"token\":\" (\",\"bytes\":\"ICg=\",\"prob\":0.0024710476864129305,\"masked\":false}],\"class_name\":\"TokenOutput\"},{\"value\":\" directories\",\"is_input\":false,\"is_generated\":true,\"is_force_forwarded\":false,\"latency_ms\":70.00494003295898,\"token\":{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.9874129295349121,\"masked\":false},\"top_k\":[{\"token\":\" directories\",\"bytes\":\"IGRpcmVjdG9yaWVz\",\"prob\":0.9874129295349121,\"masked\":false},{\"token\":\" folders\",\"bytes\":\"IGZvbGRlcnM=\",\"prob\":0.006531686522066593,\"masked\":false},{\"token\":\"/or\",\"bytes\":\"L29y\",\"prob\":0.003683121409267187,\"masked\":false},{\"token\":\" directory\",\"bytes\":\"IGRpcmVjdG9yeQ==\",\"prob\":0.0011248451191931963,\"masked\":false},{\"token\":\" empty\",\"bytes\":\"IGVtcHR5\",\"prob\":0.00030673586297780275,\"masked\":false}],\"class_name\":\"TokenOutput\"}],\"status\":\"Done\",\"shownMetrics\":[\"status\",\"consumed\",\"token reduction\",\"avg latency\"],\"metrics\":{\"status\":\"Done\",\"wall time\":0,\"consumed\":53,\"token reduction\":0,\"avg latency\":71.9354917418282,\"cpu\":[0.8378125,0.9030625000000001,0.9030625000000001,0.8488125,0.8488125],\"gpu\":[0,0,0,0,0],\"ram\":53.23284912109375,\"vram\":0},\"requireFullReplay\":false,\"currentMessageId\":549,\"backtrackCount\":3,\"resetCount\":3}" } }, "f5514c47cb84430b904ba932132c7d9f": { "model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {} }, "fb320b3c79c34a31bc59ceeb935c40e8": { "model_module": "@jupyter-widgets/base", "model_module_version": "2.0.0", "model_name": "LayoutModel", "state": {} } }, "version_major": 2, "version_minor": 0 } } }, "nbformat": 4, "nbformat_minor": 4 }