Ollama
Ollama is a software based on llama.cpp for LLM inference.
llama.cpp is a library for LLMs inference in C/C++, so Ollama has been built on top of it making it easier to use for any kind of user. That is, it is a wrapper to be able to use llama.cpp
with a Python, JavaScript and terminal API.
This notebook has been automatically translated to make it accessible to more people, please let me know if you see any typos.
Installation
To install ollama on windows or mac you have to download an installer from their [downloads] page (https://ollama.com/download), however, if you use linux, as in my case, you have to run the following command
curl -fsSL https://ollama.com/install.sh | sh
Run
To run an LLM it is enough to execute ollama run <LLLM>
, for example I can use llama3
using
!ollama run llama3
pulling manifestpulling 6a0746a1ec1a... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 4.7 GBpulling 4fa551d4f938... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 12 KBpulling 8ab4849b038c... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 254 Bpulling 577073ffcc6c... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 110 Bpulling 3f8eb4da87fa... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 485 Bverifying sha256 digestwriting manifestremoving any unused layerssuccess>>> holaHola! ¿Cómo estás?>>> Send a message (/? for help)
As you can see ollama works like docker, as it did not have llama3 downloaded, it has downloaded it and then we can use it.
Models
If we want to know which models are available, we can go to their models page, where we can see all the available models.
Download a model
If we want to download a model, we will do the same as with docker ollama pull <LLM>
, for example, I will download phi3
.
!ollama pull phi3
pulling manifestpulling 4fed7364ee3e... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 2.3 GBpulling c608dc615584... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 149 Bpulling fa8235e5b48f... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 1.1 KBpulling d47ab88b61ba... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 140 Bpulling f7eda1da5a81... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 485 Bverifying sha256 digestwriting manifestremoving any unused layerssuccess
Help
If we want to see all the commands we have available we can use ollama -h
.
!ollama -h
Large language model runnerUsage:ollama [flags]ollama [command]Available Commands:serve Start ollamacreate Create a model from a Modelfileshow Show information for a modelrun Run a modelpull Pull a model from a registrypush Push a model to a registrylist List modelsps List running modelscp Copy a modelrm Remove a modelhelp Help about any commandFlags:-h, --help help for ollama-v, --version Show version informationUse "ollama [command] --help" for more information about a command.
List available models
We can see in the help that if we make ollama list
we can see all the available models.
!ollama list
NAME ID SIZE MODIFIEDphi3:latest a2c89ceaed85 2.3 GB 4 minutes agollama3:latest 365c0bd3c000 4.7 GB 10 minutes ago
And as we can see we only have the two that we have downloaded up to now
See models running
If we do call ps
we can see the models we have running
!ollama ps
NAME ID SIZE PROCESSOR UNTILllama3:latest 365c0bd3c000 5.4 GB 100% GPU 3 minutes from now
We see that we have llama3 running because at the beginning we did ollama run llama3
, but if we now try phi3
!ollama run phi3
>>> Send a message (/? for help)
If we now go back to making call ps
.
!ollama ps
NAME ID SIZE PROCESSOR UNTILphi3:latest a2c89ceaed85 3.8 GB 100% GPU 3 minutes from now
We can see that the model running is phi3
.
Multimodal models
In the ollama model list there are multimodal models, such as moondream2, which being a model with only 1.8B of parameters has a very good performance, so let's download it to test it.
!ollama pull moondream
pulling manifestpulling e554c6b9de01... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 828 MBpulling 4cc1cb3660d8... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 909 MBpulling c71d239df917... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 11 KBpulling 4b021a3b4b4a... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 77 Bpulling 9468773bdc1f... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 65 Bpulling ba5fbb481ada... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 562 Bverifying sha256 digestwriting manifestremoving any unused layerssuccess
Once downloaded we are going to ask for this image
To do this we have to pass in the prompt the path where we have the image
!ollama run moondream
>>> Puedes explicarme esta imagen? /home/wallabot/Documentos/web/portafolio/images/this_is_fine.pngAdded image '/home/wallabot/Documentos/web/portafolio/images/this_is_fine.png'The image is a comic strip featuring two dogs sitting at a table. One dog has its eyes closed, while the other one appears to be looking at something or someone infront of it. The scene takes place inside a house with a fireplace and a cup on the table. Above them, there's a speech bubble that says 'This is fine.'
Multiline Prompts
When we need to write more than one line in our prompt we simply have to put it in triple quotes """
.
!ollama run llama3
>>> """Hola, puedes hacerme un resumen de la siguiente conversación...... Alex: Bea, he estado revisando el modelo de clasificación de imágenes que entrenamos la semana pasada, y me parece que no está funcionando como esperábamos. Las métrica... s de precisión y recall están por debajo de lo que habíamos estimado....... Bea: Sí, lo noté también. He estado analizando las predicciones erróneas y creo que el problema puede estar en el preprocesamiento de los datos. Algunos de los ejemplos... de entrenamiento parecen estar etiquetados incorrectamente....... Alex: Eso tiene sentido. ¿Crees que deberíamos aplicar alguna técnica de aumento de datos para balancear mejor las clases y mejorar la calidad de las etiquetas?...... Bea: Podría funcionar. De hecho, estaba pensando en utilizar augmentations como rotaciones y traslaciones. También podríamos considerar el uso de GANs para generar más... ejemplos sintéticos, especialmente para las clases minoritarias....... Alex: Buena idea. Además, podríamos implementar una técnica de oversampling como SMOTE para equilibrar las clases. Pero primero, necesitamos limpiar y verificar nuestra... s etiquetas. ¿Te parece si dividimos las tareas? Yo puedo encargarme del aumento de datos y tú podrías revisar las etiquetas....... Bea: Perfecto. También me gustaría ajustar un poco los hiperparámetros del modelo. Quizás deberíamos hacer una búsqueda en grid para encontrar los mejores valores para... el learning rate y el batch size....... Alex: De acuerdo. Después de mejorar las etiquetas y los datos, podemos configurar una búsqueda en grid y usar un cluster de computación para agilizar el proceso. Creo... que podemos obtener resultados mucho más sólidos....... Bea: Me parece un buen plan. Vamos a dividir las tareas y nos reunimos en unos días para revisar los avances. Con un poco de suerte, podremos mejorar significativamente... el rendimiento del modelo....... Alex: Genial, vamos a ello. ¡Gracias por la colaboración, Bea!...... Bea: ¡A ti, Alex! Trabajar en equipo siempre da mejores resultados. ¡Nos vemos pronto!"""Aquí te presento un resumen de la conversación:La conversación comienza con Alex, quien está revisando el modelo de clasificación de imágenes entrenado la semana pasada y descubre que no está funcionando comoesperaban. Bea también había notado el problema y cree que puede estar relacionado con el preprocesamiento de los datos, ya que algunos ejemplos de entrenamientoparecen estar etiquetados incorrectamente.Discuten posibles soluciones para mejorar la calidad del modelo, incluyendo el uso de técnicas de aumento de datos (augmentations) y generación de ejemplos sintéticoscon GANs. También mencionan la posibilidad de implementar una técnica de oversampling como SMOTE para equilibrar las clases.Acuerdan dividir las tareas: Alex se encargará del aumento de datos, mientras que Bea revisará las etiquetas. Después de mejorar los datos y las etiquetas, puedenconfigurar una búsqueda en grid para encontrar los mejores hiperparámetros del modelo.Finalmente, acuerdan reunirse después de unos días para revisar los avances y trabajar juntos en equipo para mejorar el rendimiento del modelo.
GGUF files
As we have said, ollama is based on llama.cpp
, so the type of models used by ollama are those used by llama.cpp
and are the GGUF
tip files.
The GGUF
files refer to the Generalized GPU-Friendly Unified Format
file format, which is designed to store and
run large language models (LLMs) efficiently on GPU-accelerated hardware.
The GGUF format is specifically optimized for storing and executing large language models, such as transformer-based architectures. It provides a compact and efficient way to represent model weights, activations, and computational graphs, which allows faster inference times and reduced memory usage.
GGUF files usually contain the following components:
Model architecture: The GGUF file stores the model architecture, including the number of layers, hidden sizes and attention mechanisms. Weights: Model weights are stored in a compressed format to reduce memory usage. That is, the models are quantized 3. Activations: The GGUF file contains pre-computed activations for certain layers or sub-layers, which can be reused during inference. 4. Computation network: The computation network represents the sequence of operations required to perform inference with the model.
By using GGUF files, developers can implement large language models on a variety of hardware, including GPUs, TPUs and CPUs, while achieving faster inference times and improved performance.
For example, the model llama3 of 70B of paŕametros in FP32 should occupy 280 GB, in FP16 should occupy 140 GB and in INT8 should occupy 70GB. However, when we are going to download it, in the web it says that it occupies 40 GB, reason why when occupying a little more than half that in INT8 we can think that it is quantized in INT4.
As I have 2 GPUs of 24 GB I could use it between the two GPUs, if I load it in parallel on both of them, so I'm going to download it and try it out
!ollama pull llama3:70B
pulling manifestpulling 0bd51f8f0c97... 100% ▕████████████████████████████████████████████████████████████████████████████████████████████████▏ 39 GBpulling 4fa551d4f938... 100% ▕████████████████████████████████████████████████████████████████████████████████████████████████▏ 12 KBpulling 8ab4849b038c... 100% ▕████████████████████████████████████████████████████████████████████████████████████████████████▏ 254 Bpulling 577073ffcc6c... 100% ▕████████████████████████████████████████████████████████████████████████████████████████████████▏ 110 Bpulling ea8e06d28e47... 100% ▕████████████████████████████████████████████████████████████████████████████████████████████████▏ 486 Bverifying sha256 digestwriting manifestremoving any unused layerssuccess
I test it
!ollama run llama3:70B
>>> Hola, me puedes decir cómo pasar un array de numpy a un tensor de pytorch?Sí!En PyTorch, puedes convertir un arreglo de NumPy a un tensor utilizando la función `torch.from_numpy()`.Aquí tienes un ejemplo:```import numpy as npimport torch# Creamos un arreglo de NumPyarr = np.array([1, 2, 3, 4, 5])# Convertimos el arreglo a un tensor de PyTorchtensor = torch.from_numpy(arr)print(tensor) # Output: tensor([1, 2, 3, 4, 5])```Ten en cuenta que la función `torch.from_numpy()` devuelve un tensor que comparte la memoria con el arreglo de NumPy original. Esto significa que simodificas el tensor, también estarás modificando el arreglo de NumPy original.Si deseas crear un tensor independiente del arreglo de NumPy, puedes utilizar la función `torch.tensor()` y pasarle el arreglo de NumPy como parámetro:```tensor = torch.tensor(arr)```De esta manera, el tensor creado será una copia independiente del arreglo de NumPy original.Espero que esto te ayude!
Not only does it answer well, but it goes very fast.
It also shows that it has loaded the model on my two GPUs in parallel.
This can be assumed, because in a single one it would not fit as I have commented before. But I have also created a GPU monitor, with which I can see that the two GPUs are almost full.
From here we can draw another conclusion, and that is that through the GGUF
files we can run the LLMs in the most efficient way in our computers, in my case I have loaded in parallel the LLM in my two GPUs.
Modelfile
Now that we have seen what GGUF
files are, we can see how to create new ones from others. Just as with docker we can create images from other images with a dockerfile, ollama allows us to create models from other models with a modelfile.
For this we will start from the file Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf
which is the GGUF
file of the NousResearch/Hermes-2-Theta-Llama-3-8B-GGUF
model. This model is a flame3 version of 8B parameters.
When creating models and uploading them to the Internet, the ideal is to give them descriptive names, for example, in this case we see that we have in the name
- Llama-3-Instruct: This means that it is a model that starts from llama3 8B Instruct.
- Merged: It is a merge model.
- DPO: Alignment with DPO has been done.
- Q4: It is quantized to 4 bits.
First we are going to create the folder where we are going to create the modelfile
!mkdir ollama_modelfile
Now we create the modelfile
!mkdir ollama_modelfile!touch ollama_modelfile/Modelfile
And now we download the file GGUF
.
!mkdir ollama_modelfile!touch ollama_modelfile/Modelfile!wget https://huggingface.co/NousResearch/Hermes-2-Theta-Llama-3-8B-GGUF/resolve/main/Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf -O ollama_modelfile/Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf
--2024-05-23 06:31:53-- https://huggingface.co/NousResearch/Hermes-2-Theta-Llama-3-8B-GGUF/resolve/main/Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.ggufResolving huggingface.co (huggingface.co)... 54.192.95.26, 54.192.95.79, 54.192.95.21, ...Connecting to huggingface.co (huggingface.co)|54.192.95.26|:443... connected.HTTP request sent, awaiting response... 302 FoundLocation: https://cdn-lfs-us-1.huggingface.co/repos/48/0d/480d1b9ea3df81b6cf974d62b6bc04f402ac5600a1dfdde7bbb9e819a111c572/762b9371a296ab2628592b9462dc676b27d881a3402816492801641a437669b3?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf%3B+filename%3D%22Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf%22%3B&Expires=1716697914&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxNjY5NzkxNH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzQ4LzBkLzQ4MGQxYjllYTNkZjgxYjZjZjk3NGQ2MmI2YmMwNGY0MDJhYzU2MDBhMWRmZGRlN2JiYjllODE5YTExMWM1NzIvNzYyYjkzNzFhMjk2YWIyNjI4NTkyYjk0NjJkYzY3NmIyN2Q4ODFhMzQwMjgxNjQ5MjgwMTY0MWE0Mzc2NjliMz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=LQecPNccMxv4R-BowDrcwORGpk%7ETTh-gVmMrAzzmdT8EFDVXNH7KTwmqKF-pEAbbir9iRS1pX7NFCterYF0w5UMe%7EWkvGg46Z73yMn3s96hm7edWypv9OCMFuBvcp8arYonKljUQ4UvdQKFHXAZxKhLrx6OVqx9YoTvHuXmpBoKXAPi1XNLPwY0YTX4wn3DnAFFzkHOsDK7p2TJ3z7RFzmfyZg%7E5daWm008oGBvIV192MKk5uqQGwqv3l-4mi2Nd8eOwMW2Yfzigz7EZJgPM7UDYzin5vABsnyXJorOSRdri13hlC-AMaY9db76vLsT1NBvVU1xVtWxAylDqU6XYlQ__&Key-Pair-Id=KCD77M1F0VK2B [following]--2024-05-23 06:31:54-- https://cdn-lfs-us-1.huggingface.co/repos/48/0d/480d1b9ea3df81b6cf974d62b6bc04f402ac5600a1dfdde7bbb9e819a111c572/762b9371a296ab2628592b9462dc676b27d881a3402816492801641a437669b3?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf%3B+filename%3D%22Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf%22%3B&Expires=1716697914&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxNjY5NzkxNH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzQ4LzBkLzQ4MGQxYjllYTNkZjgxYjZjZjk3NGQ2MmI2YmMwNGY0MDJhYzU2MDBhMWRmZGRlN2JiYjllODE5YTExMWM1NzIvNzYyYjkzNzFhMjk2YWIyNjI4NTkyYjk0NjJkYzY3NmIyN2Q4ODFhMzQwMjgxNjQ5MjgwMTY0MWE0Mzc2NjliMz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=LQecPNccMxv4R-BowDrcwORGpk%7ETTh-gVmMrAzzmdT8EFDVXNH7KTwmqKF-pEAbbir9iRS1pX7NFCterYF0w5UMe%7EWkvGg46Z73yMn3s96hm7edWypv9OCMFuBvcp8arYonKljUQ4UvdQKFHXAZxKhLrx6OVqx9YoTvHuXmpBoKXAPi1XNLPwY0YTX4wn3DnAFFzkHOsDK7p2TJ3z7RFzmfyZg%7E5daWm008oGBvIV192MKk5uqQGwqv3l-4mi2Nd8eOwMW2Yfzigz7EZJgPM7UDYzin5vABsnyXJorOSRdri13hlC-AMaY9db76vLsT1NBvVU1xVtWxAylDqU6XYlQ__&Key-Pair-Id=KCD77M1F0VK2BResolving cdn-lfs-us-1.huggingface.co (cdn-lfs-us-1.huggingface.co)... 108.157.98.20, 108.157.98.92, 108.157.98.55, ...Connecting to cdn-lfs-us-1.huggingface.co (cdn-lfs-us-1.huggingface.co)|108.157.98.20|:443... connected.HTTP request sent, awaiting response... 200 OKLength: 4920733728 (4,6G) [binary/octet-stream]Saving to: ‘ollama_modelfile/Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf’ollama_modelfile/He 100%[===================>] 4,58G 71,1MB/s in 65s2024-05-23 06:32:59 (72,2 MB/s) - ‘ollama_modelfile/Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf’ saved [4920733728/4920733728]
Once downloaded we start to create the modelfile
FROM
First we have to specify which model we are starting from
We can start from a model that is in the ollama hub, for example, we could make
FROM llama3
But as we are going to start from the file we have downloaded, we specify it by means of the path
FROM ./Hermes-2-Pro-Llamama-3-Instruct-Merged-DPO-Q4_K_M.gguf
%%writefile ollama_modelfile/ModelfileFROM ./Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf
Overwriting ollama_modelfile/Modelfile
PARAMETER
Now we have to set the values of the LLM parameters, for example, if we want to modify the value of the temperature we put
PARAMETER temperature 0.5
The parameters that can be modified are
Parameter | Description | Value Type | Example Usage |
---|---|---|---|
mirostat | Enable Mirostat sampling to control perplexity. (default: 0, 0 = disabled, 1 = Mirostat, 2 = Mirostat 2.0) | int | mirostat 0 |
mirostat_eta | Influences how quickly the algorithm responds to feedback from the generated text. A lower learning rate will result in slower adjustments, while a higher rate will make the algorithm more sensitive. (Default: 0.1) | float | mirostat_eta 0.1 |
mirostat_tau | Controls the balance between coherence and diversity of the output. A lower value will result in more focused and coherent text. (Default: 5.0) | float | mirostat_tau 5.0 |
num_ctx | Sets the size of the context window used to generate the next token. (Default: 4096) | int | num_ctx 4096 |
repeat_last_n | Sets how far back the model should look to avoid repetitions. (Default: 64, 0 = disabled, -1 = num_ctx) | int | repeat_last_n 64 |
repeat_penalty | Sets the intensity with which repetitions are penalized. A higher value (e.g., 1.5) will penalize repetitions more strongly, while a lower value (e.g., 0.9) will be more lenient. (Default: 1.1) | float | repeat_penalty 1.1 |
temperature | The temperature of the model. Increasing the temperature will make the model respond more creatively. (Default: 0.8) | float | temperature 0.7 |
seed | Sets the seed for random number generation. Setting this to a specific number will make the model generate the same text for the same prompt. (Default: 0) | int | seed 42 |
stop | Sets the stop sequences to use. When this pattern is found, the LLM will stop generating text and return. Multiple stop patterns can be set by specifying multiple stop parameters in a model file. | string | stop "AI assistant:" |
tfs_z | Top-k sampling is used to reduce the impact of less likely tokens on the output. A higher value (e.g., 2.0) will reduce the impact more, while a value of 1.0 disables this setting. (default: 1) | float | tfs_z 1 |
num_predict | Maximum number of tokens to predict when generating text. (Default: 128, -1 = infinite generation, -2 = fill context) | int | num_predict 42 |
top_k | Reduces the probability of generating nonsense. A higher value (e.g., 100) will give more diverse responses, while a lower value (e.g., 10) will be more conservative. (Default: 40) | int | top_k 40 |
top_p | Works together with top-k. A higher value (e.g., 0.95) will lead to more diverse text, while a lower value (e.g., 0.5) will generate more focused and conservative text. (Default: 0.9) | float | top_p 0.9 |
Let's look at the parameters of the llama3
model.
!ollama show llama3 --modelfile | grep PARAMETER
PARAMETER num_keep 24PARAMETER stop "<|start_header_id|>"PARAMETER stop "<|end_header_id|>"PARAMETER stop "<|eot_id|>"
We can see that it has a parameter num_keep = 24
which is not in the ollama documentation and also three stop tokens
Let's make the model more creative by raising the temperature and keep the stop tokens, otherwise the model will not stop generating text.
%%writefile ollama_modelfile/ModelfileFROM ./Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.ggufPARAMETER temperature 1PARAMETER stop "<|start_header_id|>"PARAMETER stop "<|end_header_id|>"PARAMETER stop "<|eot_id|>"
Overwriting ollama_modelfile/Modelfile
SYSTEM
We can condition the model with a system message
%%writefile ollama_modelfile/ModelfileFROM ./Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.ggufPARAMETER temperature 1SYSTEM """Eres un asistente de IA, que quiere ayudar, pero no tiene muchas habilidades sociales"""
Overwriting ollama_modelfile/Modelfile
TEMPLATE
It is the template that we will pass to the model, the types of data that can be included are
Variable | Description |
---|---|
{{ .System }} | The system message used to specify a custom behavior. |
{{ .Prompt }} | The user's prompt message. |
{{ .Response }} | The response of the model. When generating a response, the text after this variable is omitted. |
As it is not very intuitive, let's see it with an example, let's imagine that we have the following template
TEMPLATE """{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
"""
If we pass the following prompt to the template Hello, how are you?
the template will do three things
{{ if .System }}<|im_start|>system{{ .System }}<|im_end|>{{ end }}
:If there is a system message, it is passed to the model in the following way
<|im_start|>system message <|im_end|>
.As in our case there is a system message, it will happen to you
`<|im_start|>You are an AI assistant, who wants to help, but does not have many social skills<|im_end|>``.
{{ if .Prompt }}<|im_start|>user{{ .Prompt }}<|im_end|>{{ end }}
:If there is a user message, it is passed to the model in the following way
<|im_start|>user message <|im_end|>
.As in our case there is a user message (the prompt) it will be passed to you
<|im_start|>user Hi, how are you? <|im_end|>
<|im_start|>assistant
:It will always happen to the model
<|im_start|>assistant
so that the LLM knows that it is now his turn to respond
After looking at it in parts we can put the total message that will be passed to the LLM and it is
<|im_start|>You are an AI assistant, who wants to help, but does not have many social skills<|im_end|>.
<|im_start|>user Hello, how are you? <|im_end|>
<|im_start|>assistant
Let's see what the llama3 template looks like.
!ollama show llama3 --modelfile | grep {opening_brace}{opening_brace}
TEMPLATE "{{ if .System }}<|start_header_id|>system<|end_header_id|>{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>{{ .Response }}<|eot_id|>"
It is very similar to the one we have seen, with the llama3 template, in our case it will be passed to the LLM.
<|start_header_id|>system<|end_header_id|>You are an AI assistant, who wants to help, but does not have many social skills<|eot_id|>.
<|start_header_id|>user<|end_header_id|>Hello, how are you?<|eot_id|>
<|start_header_id|>assistant<|end_header_id|>{{ .Response }}<|eot_id|>
As we are going to use a model based on llama3 we are going to use its template
%%writefile ollama_modelfile/ModelfileFROM ./Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.ggufPARAMETER temperature 1SYSTEM """Eres un asistente de IA, que quiere ayudar, pero no tiene muchas habilidades sociales"""TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>{{ .Response }}<|eot_id|>"""
Overwriting ollama_modelfile/Modelfile
LICENSE
Serves to establish the model license
%%writefile ollama_modelfile/ModelfileFROM ./Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.ggufPARAMETER temperature 1SYSTEM """Eres un asistente de IA, que quiere ayudar, pero no tiene muchas habilidades sociales"""TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>{{ .Response }}<|eot_id|>"""LICENSE """Apache-2.0"""
Overwriting ollama_modelfile/Modelfile
MESSAGE
We can pass you a chat history
%%writefile ollama_modelfile/ModelfileFROM ./Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.ggufPARAMETER temperature 1SYSTEM """Eres un asistente de IA, que quiere ayudar, pero no tiene muchas habilidades sociales"""TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>{{ .Response }}<|eot_id|>"""LICENSE """Apache-2.0"""MESSAGE user Sabes cómo pasar un array de numpy a un tensor de torch?MESSAGE assistant SíMESSAGE user Y me lo podrías decir?MESSAGE assistant SíMESSAGE user DímeloMESSAGE assistant Te lo puedo decir
Overwriting ollama_modelfile/Modelfile
ADAPTER
An adapter is a matrix that is added to the model. It is used to avoid having to do fine tuning to the LLMs and to do it only to that matrix, so that when it is added to the model, the LLM behaves as we want it to.
So in order to do this we pass the path to the adapter file
ADAPTER ./ollama-lora.bin
Create the model
Once the modelfile has been written we can create the model by means of
ollama create <model-name> -f <path-of-the-modelfile>'
!ollama create assistanmal -f ollama_modelfile/Modelfile
transferring model datausing existing layer sha256:762b9371a296ab2628592b9462dc676b27d881a3402816492801641a437669b3using existing layer sha256:ba85fc82591e657e639f779f4fdc5e6e7cb977f9d36487d67cefe589a8af670eusing existing layer sha256:995b40fa08b7063fd4fe21ef93f0a1c147d82ecd7e2e87216c11ae809693e101using existing layer sha256:2af71558e438db0b73a20beab92dc278a94e1bbe974c00c1a33e3ab62d53a608using existing layer sha256:20dc17cb752058f95ad600722883b22f3328ca8ccccbb667d5e07991ae1985c7using existing layer sha256:d8ba2f9a17b3bbdeb5690efaa409b3fcb0b56296a777c7a69c78aa33bbddf182using existing layer sha256:c2ca5c1f4ec2cfaa477ed5f5770beff313b28d083ce5ceb90daed9d6ecbb773fwriting manifestsuccess
We see that we get an output very similar to the one we get when we create a docker image
Yes, now we list the models we have available
!ollama list
NAME ID SIZE MODIFIEDassistanmal:latest 2be327b28fbf 4.9 GB 48 seconds agollama3:70b 786f3184aec0 39 GB 38 hours agollava:latest 8dd30f6b0cb1 4.7 GB 40 hours agomoondream:latest 55fc3abd3867 1.7 GB 40 hours agophi3:latest a2c89ceaed85 2.3 GB 2 days agollama3:latest 365c0bd3c000 4.7 GB 2 days ago
We see that there is the wizard we just created. Let's try it out
!ollama run assistanmal
>>> Sabes cómo pasar un array de numpy a un tensor de torch?Sí>>> Y me lo podrías decir?Sí>>> DímeloTe lo puedo decir>>> DímeloPara convertir un array de NumPy a un tensor de PyTorch, puedes seguir estos pasos:1. Instalar la librería torch: `pip install torch`2. Importar las librerías necesarias: `import numpy as np`, `import torch`3. Convertir el array de NumPy a una variable torch.Tensor: `tensor = torch.from_numpy(array_numpy)`Aquí tienes un ejemplo:```pythonimport numpy as npimport torch# Crea un array en NumPyarray_numpy = np.array([1, 2, 3])# Convierte el array de NumPy a una variable torch.Tensortensor = torch.from_numpy(array_numpy)print(tensor)```Este código crea un array en NumPy y luego lo convierte a una variable `torch.Tensor` utilizando la función `from_numpy`. La salida sería:```pythontensor([1, 2, 3])
REST API
By default ollama runs on port 11434
of our localhost and as it has implemented a REST API we can make calls using this API
We can make a query to an LLM using the POST
method, for this we have to pass it a json with, at least, the model and the prompt
!curl -X POST http://127.0.0.1:11434/api/generate -d '{"model": "llama3","prompt": "¿Por que el cielo es azul?"}' -H "Content-Type: application/json"
{"model":"llama3","created_at":"2024-05-25T05:08:18.884851337Z","response":"La","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:18.895040313Z","response":" raz","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:18.905195114Z","response":"ón","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:18.915384212Z","response":" por","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:18.925599888Z","response":" la","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:18.935894594Z","response":" que","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:18.946216271Z","response":" el","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:18.95667124Z","response":" ci","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:18.967006633Z","response":"elo","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:18.977232419Z","response":" sue","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:18.987573713Z","response":"le","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:18.998090659Z","response":" ser","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:19.008252975Z","response":" az","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:19.018568771Z","response":"ul","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:19.029065258Z","response":" es","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:19.03963268Z","response":" un","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:19.050107165Z","response":" tema","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:19.060833657Z","response":" muy","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:19.071234073Z","response":" interes","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:19.081710362Z","response":"ante","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:19.091871325Z","response":" y","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:19.10204305Z","response":" comple","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:19.112288302Z","response":"jo","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:19.122615519Z","response":".","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:19.132758358Z","response":" Hay","done":false}...{"model":"llama3","created_at":"2024-05-25T05:08:23.70235664Z","response":"ó","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:23.712846234Z","response":"meno","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:23.723233334Z","response":".","done":false}{"model":"llama3","created_at":"2024-05-25T05:08:23.733833978Z","response":"","done":true,"done_reason":"stop","context":[128006,882,128007,271,31282,29197,1744,658,12088,20782,1560,12657,360,30,128009,128006,78191,128007,271,8921,24788,3244,4247,1208,1744,658,12088,20782,34872,273,1446,12657,360,1560,653,47015,23321,50516,5048,379,1946,7453,13,18276,86050,115256,25318,89097,46602,15540,1744,7537,276,56369,277,10566,44585,1832,70191,11,20003,912,18137,5203,44460,31388,10126,13,23815,2483,1028,3118,78,74854,409,5252,115256,25318,11158,470,8699,1473,16,13,3146,8921,72916,409,1208,65566,96618,84201,409,2537,757,4919,2191,437,11158,75419,1560,1208,72916,320,288,1768,67137,8,409,1208,65566,4247,961,27235,300,23321,48467,61025,665,1208,70887,29832,809,64,11,8112,22337,978,3395,300,409,308,22288,1832,4469,78,379,19488,2483,4469,78,13,5034,65566,12657,360,24215,653,65013,409,389,3315,11158,23100,78,1744,39505,1400,4692,11,781,1744,68832,1744,513,5320,68364,2649,11158,18922,531,39961,4247,1208,72916,13,93125,35905,1744,1208,65566,12657,360,1469,39614,936,11158,18041,5048,665,658,12088,20782,7809,2172,390,39505,1400,4692,627,17,13,3146,8921,15938,78031,409,5252,1317,21237,409,389,3315,96618,507,2221,115256,7583,79048,43668,1744,658,12657,360,1560,658,1933,11358,5048,28895,1208,70887,29832,809,64,15938,1395,5252,1317,21237,409,389,3315,938,30826,379,2807,5919,11158,98420,1744,5252,1317,21237,409,389,3315,12657,2482,13,93125,18274,852,28895,1208,70887,29832,809,64,81533,45612,8112,1208,1891,1832,87,5362,409,12782,78,11,658,25616,10358,379,658,38752,409,56562,11,1744,15938,8123,2537,18803,437,2092,5518,390,1317,21237,409,389,3315,11158,4143,300,627,18,13,3146,8921,8881,95266,409,1208,23126,14210,96618,5034,115256,7583,409,1208,8881,95266,31705,19380,1744,1208,23126,14210,2098,273,5697,1208,65566,12657,360,11158,31469,292,1394,12826,91992,264,924,40321,26826,934,56094,3074,379,25107,35497,3074,13,93125,35905,1744,1208,65566,12657,360,9581,11158,25228,64,665,658,12088,20782,627,19,13,3146,8921,62822,44428,2854,3444,96618,13321,12826,11,29571,18137,115256,25318,1744,31705,16414,1744,658,12657,360,1560,653,1933,78632,6632,1744,12155,65117,5933,28895,513,439,511,689,390,658,56562,379,658,12088,20782,13,5034,62822,44428,2854,3444,21329,6791,404,665,42791,77998,3739,1624,1933,1624,12088,20782,382,1737,594,28999,11,912,18137,5203,96189,24788,3244,4247,1208,1744,658,12088,20782,9581,12657,360,11,52904,11158,14707,653,68593,409,2144,4692,65946,17038,11,934,56094,17038,379,78632,25204,1744,6044,38855,264,10566,44585,1832,70191,13,128009],"total_duration":8342889543,"load_duration":3407077432,"prompt_eval_count":19,"prompt_eval_duration":85819000,"eval_count":464,"eval_duration":4848923000}
As we can see it has answered us by stream, if we do not want this and we want a single answer we have to pass "stream": false
in the json
!curl -X POST http://127.0.0.1:11434/api/generate -d '{"model": "llama3","prompt": "¿Por que el cielo es azul?","stream": false}' -H "Content-Type: application/json"
{"model":"llama3","created_at":"2024-05-25T05:42:03.468060994Z","response":"¡Excelente pregunta! La razón por la que el cielo suele ser azul es un fenómeno físico llamado scattering (difracción) de luz. Cuando la luz del sol entra en la atmósfera, se enfrenta a pequeños partículas de gases como el nitrógeno y el oxígeno, así como a partículas más grandes como las moléculas de agua y los polvo. La scattering tiene dos tipos: Rayleigh scattering (difracción de Rayleigh) y Mie scattering (difracción de Mie). La primera es la que ocurre cuando la luz se enfrenta con pequeñas partículas, como el nitrógeno y el oxígeno, que son muy delgadas en comparación con la longitud de onda de la luz. En este caso, la luz azul (con una longitud de onda más corta) es scattering más fuerte que la luz roja (con una longitud de onda más larga). Esto es porque las partículas pequeñas son más efectivas en scattering la luz con longitudes de onda más cortas. La segunda tipo de scattering, Mie scattering, ocurre cuando la luz se enfrenta con partículas más grandes, como las moléculas de agua y los polvo. En este caso, la scattering es más fuerte para las longitudes de onda más largas, lo que significa que la luz roja es scatterred más fuerte que la luz azul. Finalmente, cuando llega el momento en que la luz solar ha sido scattering por ambas tipos de partículas, la luz azul (con una longitud de onda más corta) ha sido scatterred más fuerte y llega a nuestros ojos desde diferentes ángulos. Esto es lo que nos hace ver el cielo como azul. En resumen, la combinación de scattering de Rayleigh y Mie es lo que nos permite ver al cielo como azul. ¡Y qué bonito resultado es eso!","done":true,"done_reason":"stop","context":[128006,882,128007,271,31282,29197,1744,658,12088,20782,1560,12657,360,30,128009,128006,78191,128007,271,40932,20656,6960,80440,2268,8921,24788,3244,4247,1208,1744,658,12088,20782,34872,273,1446,12657,360,1560,653,44585,1832,70191,65946,4042,51204,2172,72916,320,88564,81,67147,8,409,65566,13,89014,1208,65566,1624,2092,83786,665,1208,70887,29832,809,64,11,513,89599,64,264,48467,18720,961,27235,300,409,45612,8112,658,308,22288,1832,4469,78,379,658,19488,2483,4469,78,11,37560,8112,264,961,27235,300,11158,38546,8112,5252,22337,978,3395,300,409,56562,379,2537,1499,3415,382,8921,72916,24215,8924,64962,25,13558,64069,72916,320,88564,81,67147,409,13558,64069,8,379,386,648,72916,320,88564,81,67147,409,386,648,570,5034,44769,1560,1208,1744,18274,852,27443,1208,65566,513,89599,64,390,48467,61025,961,27235,300,11,8112,658,308,22288,1832,4469,78,379,658,19488,2483,4469,78,11,1744,4538,23321,1624,70,11354,665,7809,5840,390,1208,49704,409,389,3315,409,1208,65566,13,2998,10566,23884,11,1208,65566,12657,360,320,444,5203,49704,409,389,3315,11158,23100,64,8,1560,72916,11158,18922,14140,1744,1208,65566,938,5697,320,444,5203,49704,409,389,3315,11158,4143,64,570,93125,1560,28895,5252,961,27235,300,48467,61025,4538,11158,44046,39924,665,72916,1208,65566,390,1317,21237,409,389,3315,11158,23100,300,382,8921,56072,16697,409,72916,11,386,648,72916,11,18274,852,27443,1208,65566,513,89599,64,390,961,27235,300,11158,38546,11,8112,5252,22337,978,3395,300,409,56562,379,2537,1499,3415,13,2998,10566,23884,11,1208,72916,1560,11158,18922,14140,3429,5252,1317,21237,409,389,3315,11158,4143,300,11,781,1744,68832,1744,1208,65566,938,5697,1560,45577,1171,11158,18922,14140,1744,1208,65566,12657,360,382,19918,12826,11,27443,33602,64,658,31221,665,1744,1208,65566,13238,6520,35071,72916,4247,9049,300,64962,409,961,27235,300,11,1208,65566,12657,360,320,444,5203,49704,409,389,3315,11158,23100,64,8,6520,35071,45577,1171,11158,18922,14140,379,33602,64,264,58013,297,40261,23553,46418,19216,983,29752,13,93125,1560,781,1744,12155,35905,2807,658,12088,20782,8112,12657,360,382,1737,594,28999,11,1208,68225,5840,409,72916,409,13558,64069,379,386,648,1560,781,1744,12155,52603,2807,453,12088,20782,8112,12657,360,13,49913,56,43388,7970,6491,27284,1560,44841,0,128009],"total_duration":4760167793,"load_duration":910317,"prompt_eval_count":19,"prompt_eval_duration":126007000,"eval_count":436,"eval_duration":4586524000}
Python API
To use the Python API we need to install the ollama Python package
pip install ollama
Once installed we have the following methods
ollama.chat`: To initiate a chat with a model
ollama.generate`: To generate a response to a prompt
ollama.list
: List of available modelsollama.show`: Displays information of a model
ollama.create`: Creates a model
ollama.delete`: Deletes a template
ollama.pull`: Download a model
ollama.push`: Upload a model
ollama.embeddings`: Return embeddings from a prompt
Let's try some of them
import ollamastream = ollama.chat(model='llama3',messages=[{'role': 'user', 'content': '¿Por que el cielo es azul?'}],stream=True,)for chunk in stream:print(chunk['message']['content'], end='', flush=True)
¡Excelente pregunta!La razón por la que el cielo suele ser azul es un tema de mucha discusión y debate entre científicos y filósofos. Hay varias teorías sobre este asunto, pero te presento algunas de las más populares:1. **Absorción del azul**: La luz solar contiene todos los colores del espectro visible, desde el rojo hasta el violeta. Cuando la luz solar entra en la atmósfera terrestre, se absorbe y dispersa en diferentes grados dependiendo de la longitud de onda. La longitud de onda azul es particularmente pequeña, lo que significa que es absorbida y dispersada más que cualquier otro color. Esto hace que el azul sea el color predominante que nos llega a los ojos.2. **Espejo de Rayos X**: Otra teoría sugiere que la atmósfera terrestre actúa como un "espejo" para los rayos X, que son una forma de radiación electromagnética con energías muy altas. Cuando los rayos X chocan contra la molécula de gases en la atmósfera, emiten fotones azules. Estos fotones azules then se propagan a través de la atmósfera y nos llegan a los ojos.3. **Composición de la atmósfera**: La atmósfera terrestre está compuesta por diferentes gases, como el nitrógeno (N2) y el oxígeno (O2). Los átomos de estos gases pueden absorber y reemitter luz en diferentes longitudes de onda, lo que puede contribuir al color azul del cielo.4. **Efecto Mie**: El efecto Mie es un proceso físico que ocurre cuando la luz solar interactúa con las partículas pequeñas en la atmósfera, como los aerosoles y las moléculas de gases. Este efecto puede hacer que el azul sea el color predominante que nos llega a los ojos.En resumen, no hay una única razón por la que el cielo es azul, sino que es un resultado de la interacción compleja entre la luz solar, la atmósfera terrestre y otros factores físicos.
import ollamastream = ollama.generate(model='llama3',prompt='¿Por que el cielo es azul?',stream=True,)for chunk in stream:print(chunk['response'], end='', flush=True)
La pregunta clásica!La razón por la que el cielo suele ser azul es un tema de debate entre científicos y filósofos durante siglos. A continuación, te presento algunas teorías sobre por qué el cielo es azul:1. **Scattering de luz**: La luz solar que llega a la Tierra está compuesta por diferentes longitudes de onda, desde las rayas infrarrojas hasta las rayas violetas. Cuando esta luz entra en la atmósfera, los átomos y moléculas de gases, como el nitrógeno (N2) y el oxígeno (O2), se ponen en marcha para scatter (esparcir) la luz. La luz azul tiene una longitud de onda más pequeña que la luz roja, por lo que es más susceptible a ser esparcida por los gases atmosféricos.2. **Absorción de longitudes de onda**: La atmósfera también absorbe ciertas longitudes de onda de la luz solar, como las rayas infrarrojas y las rayas rojas. Esto hace que la luz azul y verde sean más fáciles de ver, ya que no se absorben tanto.3. **Dosis de oxígeno**: La cantidad de oxígeno en la atmósfera también puede influir en el color del cielo. El oxígeno absorbe la luz roja y las rayas infrarrojas, lo que deja a la luz azul y verde dominar.4. **Estructura molecular**: La estructura molecular de los gases atmosféricos, como el nitrógeno y el oxígeno, puede influir en cómo se scattering (esparce) la luz. Los átomos y moléculas con una geometría específica pueden preferir scatter (esparcir) ciertas longitudes de onda sobre otras.5. **Efecto Mie**: El efecto Mie es un fenómeno óptico que describe cómo los pequeños particulas en la atmósfera, como las gotas de agua y los polvo, pueden scatter (esparcir) la luz. La luz azul es más susceptible a ser esparcida por estos pequeños particulas, lo que contribuye al color azul del cielo.En resumen, el cielo suele ser azul porque la atmósfera tiende a scatter (esparcir) la luz azul y a absorber la luz roja y las rayas infrarrojas. La combinación de estos procesos ópticos y físicos es responsable del color azul que vemos en el cielo.Es importante destacar que hay muchas variaciones en el color del cielo dependiendo de la condición atmosférica, como la niebla, la polución y la cantidad de vapor de agua. Sin embargo, en condiciones normales, el cielo puede ser describirse como azul porque es el color que se ve cuando la luz solar es scatter (esparcida) por los gases atmosféricos.
import ollamamodels = ollama.list()for model in models['models']:keys = model.keys()for key in keys:print(key, model[key])print()
name assistanmal:latestmodel assistanmal:latestmodified_at 2024-05-24T08:14:10.147033666+02:00size 4920735028digest 2be327b28fbf24439dc2dcf5c7679784106327eaa2ead4bcb351f51ce0c9fed6details {'parent_model': '', 'format': 'gguf', 'family': 'llama', 'families': ['llama'], 'parameter_size': '8.0B', 'quantization_level': 'Q4_K_M'}expires_at 0001-01-01T00:00:00Zname llama3:70bmodel llama3:70bmodified_at 2024-05-22T18:16:15.277839889+02:00size 39969745349digest 786f3184aec0e907952488b865362bdaa38180739a9881a8190d85bad8cab893details {'parent_model': '', 'format': 'gguf', 'family': 'llama', 'families': ['llama'], 'parameter_size': '70.6B', 'quantization_level': 'Q4_0'}expires_at 0001-01-01T00:00:00Zname llava:latestmodel llava:latestmodified_at 2024-05-22T16:08:45.909038007+02:00size 4733363377digest 8dd30f6b0cb19f555f2c7a7ebda861449ea2cc76bf1f44e262931f45fc81d081details {'parent_model': '', 'format': 'gguf', 'family': 'llama', 'families': ['llama', 'clip'], 'parameter_size': '7B', 'quantization_level': 'Q4_0'}expires_at 0001-01-01T00:00:00Zname moondream:latestmodel moondream:latestmodified_at 2024-05-22T15:57:30.934618788+02:00size 1738451197digest 55fc3abd386771e5b5d1bbcc732f3c3f4df6e9f9f08f1131f9cc27ba2d1eec5bdetails {'parent_model': '', 'format': 'gguf', 'family': 'phi2', 'families': ['phi2', 'clip'], 'parameter_size': '1B', 'quantization_level': 'Q4_0'}expires_at 0001-01-01T00:00:00Zname phi3:latestmodel phi3:latestmodified_at 2024-05-21T14:00:26.525751453+02:00size 2318920898digest a2c89ceaed85371d0b8a51b5cc70ff054acc37465ea25e72e1612fe28bce7ad9details {'parent_model': '', 'format': 'gguf', 'family': 'llama', 'families': ['llama'], 'parameter_size': '4B', 'quantization_level': 'Q4_K_M'}expires_at 0001-01-01T00:00:00Zname llama3:latestmodel llama3:latestmodified_at 2024-05-21T13:54:47.514572753+02:00size 4661224676digest 365c0bd3c000a25d28ddbf732fe1c6add414de7275464c4e4d1c3b5fcb5d8ad1details {'parent_model': '', 'format': 'gguf', 'family': 'llama', 'families': ['llama'], 'parameter_size': '8.0B', 'quantization_level': 'Q4_0'}expires_at 0001-01-01T00:00:00Z
import ollamaassistanmal = ollama.show('assistanmal')keys = assistanmal.keys()for key in keys:print(key, assistanmal[key])
license Apache-2.0modelfile # Modelfile generated by "ollama show"# To build a new Modelfile based on this, replace FROM with:# FROM assistanmal:latestFROM /usr/share/ollama/.ollama/models/blobs/sha256-762b9371a296ab2628592b9462dc676b27d881a3402816492801641a437669b3TEMPLATE "{{ if .System }}<|start_header_id|>system<|end_header_id|>{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>{{ .Response }}<|eot_id|>"SYSTEM Eres un asistente de IA, que quiere ayudar, pero no tiene muchas habilidades socialesPARAMETER temperature 1LICENSE Apache-2.0MESSAGE user Sabes cómo pasar un array de numpy a un tensor de torch?MESSAGE assistant SíMESSAGE user Y me lo podrías decir?MESSAGE assistant SíMESSAGE user DímeloMESSAGE assistant Te lo puedo decirparameters temperature 1template {{ if .System }}<|start_header_id|>system<|end_header_id|>{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>{{ .Response }}<|eot_id|>system Eres un asistente de IA, que quiere ayudar, pero no tiene muchas habilidades socialesdetails {'parent_model': '', 'format': 'gguf', 'family': 'llama', 'families': ['llama'], 'parameter_size': '8.0B', 'quantization_level': 'Q4_K_M'}messages [{'role': 'user', 'content': 'Sabes cómo pasar un array de numpy a un tensor de torch?'}, {'role': 'assistant', 'content': 'Sí'}, {'role': 'user', 'content': 'Y me lo podrías decir?'}, {'role': 'assistant', 'content': 'Sí'}, {'role': 'user', 'content': 'Dímelo'}, {'role': 'assistant', 'content': 'Te lo puedo decir'}]
import ollamaembeddings = ollama.embeddings(model='llama3',prompt='¿Por que el cielo es azul?',)print(f"len embeddings: {len(embeddings['embedding'])}, embeddings: {embeddings['embedding']}")
len embeddings: 4096, embeddings: [-3.5709903240203857, -2.1733479499816895, 0.38256850838661194, -0.7110687494277954, -1.4685417413711548, -3.1000022888183594, -2.4890358448028564, 3.44036865234375, 1.2659403085708618, -0.20225396752357483, 2.1770575046539307, 0.5799544453620911, -2.7561943531036377, 1.8101686239242554, -1.6933118104934692, 0.2162412852048874, -2.965606451034546, -3.804832935333252, -0.5467535853385925, 1.858802318572998, -1.1412774324417114, -1.264650583267212, 0.3924441635608673, 2.071216583251953, 1.0475926399230957, -1.6638776063919067, -1.8243257999420166, -0.6105852723121643, 0.7387599945068359, -2.9104437828063965, -0.024957681074738503, 1.7622206211090088, -1.4952329397201538, 3.5881831645965576, 5.155212879180908, -2.2027933597564697, -2.191542863845825, 0.9409443736076355, 1.6278865337371826, 1.145223617553711, 0.5374143123626709, -1.0256531238555908, 3.842578411102295, -1.0968210697174072, 1.3904237747192383, -1.8557299375534058, -1.3526214361190796, -1.1416131258010864, -3.2644541263580322, -5.737625598907471, -2.008760690689087, 1.3844702243804932, 1.6246631145477295, 0.8016360998153687, -0.030481038615107536, 2.298166036605835, -3.9192237854003906, -3.035203218460083, -1.782038927078247, -1.7258855104446411, -5.746711730957031, -0.35096585750579834, 1.6632475852966309, -1.7531949281692505, 0.5898884534835815, 4.358534812927246, -3.531533718109131, 4.319108963012695, 3.430162191390991, -1.2140980958938599, 0.22373071312904358, 0.6440947651863098, -3.880579710006714, -4.528593063354492, 1.1950795650482178, -0.9991334080696106, -2.7974133491516113, -0.5666281580924988, 0.5676720142364502, 0.9137862324714661, -2.48816180229187, 2.4825150966644287, 1.2363556623458862, 4.960108280181885, -5.237436294555664, 1.0037667751312256, -0.3310686945915222, 0.6090074777603149, 1.8728065490722656, -1.1472115516662598, -0.1412253975868225, 5.209298133850098, 4.523755073547363, -2.622323989868164, 0.2997383773326874, -1.2514511346817017, -0.27786844968795776, -0.8706071972846985, 1.7568215131759644, 2.9767489433288574, 0.472599595785141, 1.5201655626296997, -0.848712146282196, 5.358476638793945, 1.857602596282959, -0.6478251218795776, 3.0913748741149902, -0.09521156549453735, -5.098915100097656, 0.9146490097045898, -4.041540622711182, 2.0770459175109863, -0.7856513857841492, -0.06006915867328644, 0.8622685670852661, -1.491736888885498, 3.310131311416626, 0.8778402805328369, -0.41889771819114685, 2.5716934204101562, 1.0106903314590454, 2.2289915084838867, 0.14578910171985626, 1.1669079065322876, -0.48978495597839355, 0.9569312930107117, 0.09900128096342087, 1.938784122467041, 5.946640968322754, -1.1337519884109497, -0.8550072312355042, -1.858678936958313, 0.35737159848213196, 12.833805084228516, 1.020747423171997, -2.005078077316284, 2.5968477725982666, 0.0339638814330101, 1.8790265321731567, 1.316766619682312, -0.7517922520637512, -0.26476719975471497, 5.264979362487793, 1.0595479011535645, -3.2346348762512207, -0.7008733749389648, 2.6678082942962646, 0.34292638301849365, 2.6336095333099365, -5.449492454528809, 1.8392881155014038, -1.149052381515503, 2.4435460567474365, -1.5761059522628784, -1.0055335760116577, -0.008810569532215595, -4.097605228424072, -0.86686110496521, 1.3230448961257935, -1.1321579217910767, -0.5583046674728394, -0.1093638688325882, -3.521775245666504, 0.49600842595100403, 2.6446125507354736, -0.19307686388492584, 1.888438105583191, 3.461682081222534, 0.6699156761169434, 2.4350223541259766, 1.8247735500335693, 2.1006722450256348, -0.6317830085754395, 2.0495195388793945, 2.408583164215088, -3.1435046195983887, -3.540788412094116, -0.743456244468689, 1.1295356750488281, 1.5371088981628418, 0.3319551348686218, -0.19235952198505402, 2.213836669921875, -0.27262499928474426, -0.1830073595046997, 1.2156487703323364, -2.8983805179595947, -0.5994898080825806, -1.6867365837097168, -1.4026514291763306, 2.8881092071533203, 1.0583044290542603, 1.6755084991455078, -1.3570199012756348, -0.02863301709294319, 0.3893628418445587, 2.2699222564697266, 2.0410315990448, 0.5284076929092407, -1.3849315643310547, -3.2410078048706055, -5.413166522979736, -0.18938720226287842, -7.636954307556152, 1.0516839027404785, 1.8927298784255981, -1.8319122791290283, -0.3104879856109619, -3.192800283432007, 0.7249773144721985, 2.4628212451934814, -5.237030029296875, -1.6819825172424316, -2.6519153118133545, -5.452773094177246, 2.5719199180603027, 4.594746112823486, 0.26059404015541077, -0.5879826545715332, -2.012744426727295, 4.347339630126953, 1.1387996673583984, -1.585600733757019, -1.8488795757293701, 0.43234241008758545, -2.1706769466400146, 2.02614426612854, -1.3547757863998413, -0.23999670147895813, 0.5241819620132446, -1.751906394958496, -2.181796073913574, 2.4499764442443848, -1.9204010963439941, 1.730446696281433, 0.12385261058807373, 3.325094699859619, 1.1947877407073975, -0.759490430355072, 2.091949224472046, -2.352848529815674, 0.8918092846870422, -2.944584608078003, 2.403661012649536, -1.3479825258255005, 0.06610975414514542, -3.977243185043335, 1.213283896446228, -2.078611373901367, -0.5690178871154785, -2.212489366531372, 2.329470634460449, 4.6698198318481445, -2.2548561096191406, -0.6902344226837158, 3.2000536918640137, -3.4179816246032715, 2.3877899646759033, 0.803355872631073, 0.7195305824279785, -0.05020619183778763, -2.350513219833374, 0.8627676963806152, 0.892014741897583, -1.1318942308425903, -2.360058546066284, -0.9107275605201721, 5.429220199584961, 0.3160887658596039, -0.5821715593338013, -0.05387498438358307, -1.9310585260391235, 1.1864994764328003, -0.5223034024238586, -0.14695927500724792, -1.3558963537216187, 3.2761178016662598, 2.1174533367156982, -3.3351476192474365, -1.919097661972046, -1.6523269414901733, 8.498637199401855, 1.5841808319091797, 0.8351742029190063, -0.47643807530403137, 0.4335901737213135, 0.8168123960494995, -1.606881022453308, 3.033907651901245, -4.34182596206665, 13.113082885742188, -1.7362353801727295, 2.71997332572937, -2.058112382888794, -3.530165433883667, 0.6679645776748657, -1.8624101877212524, -2.792393922805786, 0.3409225642681122, -1.988881230354309, 0.2653841972351074, 0.8095135688781738, -0.4962392747402191, -3.7835464477539062, 1.6932401657104492, -1.4169583320617676, 0.5265898108482361, 0.3822944760322571, -0.40417489409446716, 1.0212734937667847, 2.9532642364501953, 2.503154754638672, 0.29280903935432434, 0.48731330037117004, 0.1463029682636261, -0.8889073729515076, -4.234628677368164, -3.614084243774414, -0.2760423719882965, -0.026265254244208336, 3.186485528945923, 0.9897671341896057, 3.198659896850586, 2.4788753986358643, -1.439963459968567, 1.8077031373977661, 1.842383623123169, 1.8660616874694824, -2.531989574432373, 0.6639688014984131, 3.2474002838134766, 2.137742519378662, 0.994397759437561, 3.4729905128479004, 2.8363358974456787, -0.06270971894264221, 5.061746120452881, -1.3068524599075317, 3.0064680576324463, -2.5484275817871094, 1.1107360124588013, 2.9042749404907227, 0.17234551906585693, 0.3036850392818451, -0.19574975967407227, -2.148221015930176, -1.7283300161361694, -1.7208715677261353, -1.3642263412475586, 4.046931743621826, -0.12636420130729675, -0.2035427689552307, 1.7216098308563232, 0.43848779797554016, -3.614549160003662, 1.1797786951065063, -0.1516219675540924, 2.417402744293213, 0.12069121748209, 2.9423115253448486, 3.3223390579223633, 0.08259274065494537, 1.53631591796875, 0.04388677328824997, 3.7080609798431396, -3.54156494140625, -2.458104372024536, -1.2394227981567383, 0.46880877017974854, 0.3513844907283783, 0.3364567756652832, 1.4723302125930786, 0.11966782063245773, -0.6117515563964844, 3.3584911823272705, -0.4264973998069763, -1.5642184019088745, -1.159574031829834, 0.5609691739082336, 2.029670476913452, 3.194979667663574, -1.0252487659454346, -0.6890900731086731, -0.05864858999848366, 0.6144252419471741, 5.782567977905273, -2.65860652923584, 1.4193108081817627, 0.5520697236061096, 1.8532027006149292, -0.8976119160652161, 1.5241093635559082, 0.2157583087682724, 1.0333294868469238, 1.498881459236145, 2.227416753768921, -1.1072536706924438, -1.7048979997634888, 1.275403618812561, 0.8163477778434753, 2.403702735900879, 1.3578238487243652, -4.276787281036377, -3.929635763168335, -0.054064273834228516, -0.16745470464229584, 0.4731382131576538, -0.9403067231178284, 0.8995345234870911, 1.95155930519104, -0.6890628337860107, -3.224841833114624, -1.415235161781311, 0.24321462213993073, 5.774457931518555, -0.9721022248268127, -3.1032869815826416, 3.2869436740875244, -3.3082871437072754, 1.0737178325653076, -5.56853723526001, -0.4755292236804962, 1.6561086177825928, 1.596308946609497, -1.2966104745864868, -2.6836979389190674, -0.11683563888072968, -0.02348145842552185, 4.354658603668213, 2.3689823150634766, 2.4168097972869873, -1.050479769706726, 1.731070637702942, -1.660346269607544, -1.3943952322006226, 1.619246244430542, -2.8332929611206055, -1.2309725284576416, -0.7420948147773743, 0.31250253319740295, -1.099778413772583, -1.0853277444839478, 0.830448567867279, -4.566944599151611, -0.12674756348133087, 0.51172935962677, 1.4584320783615112, 3.3231608867645264, 0.4730960726737976, -0.43621763586997986, 0.3666110634803772, 1.6838008165359497, 0.5602437853813171, 1.173569679260254, 1.5356460809707642, -1.5813583135604858, 1.502920389175415, 0.043176211416721344, -8.606017112731934, 2.616706371307373, -0.3429355025291443, 0.4212046265602112, -3.448631525039673, 1.7500406503677368, -0.15831516683101654, -0.9675804376602173, 0.09411357343196869, -1.158867359161377, 1.0291807651519775, -3.3388733863830566, -0.5699865221977234, -1.0659765005111694, -1.466783046722412, 2.408832311630249, 0.6615399718284607, -0.41655123233795166, -1.6816552877426147, -3.5983195304870605, 1.211220145225525, -2.2571022510528564, 0.00010927499533863738, 0.2970433235168457, -0.8382472991943359, -0.4408542811870575, 2.74499773979187, 2.992504119873047, -2.711503028869629, 0.5057509541511536, -2.0505993366241455, -2.2970893383026123, -0.21033483743667603, -3.774324893951416, -1.9951436519622803, -1.9426825046539307, 0.5870206952095032, 1.6135040521621704, 2.379605293273926, -3.2735002040863037, -2.0550036430358887, 1.1960766315460205, -0.7515547871589661, 2.08927321434021, -0.23780010640621185, 1.3819012641906738, 3.1218101978302, -2.909371852874756, -4.355706691741943, -0.019170774146914482, 1.759203553199768, 0.48109686374664307, -4.4406352043151855, -1.8898074626922607, 1.4533193111419678, 2.441861629486084, 0.23535436391830444, -3.5163235664367676, -2.7819430828094482, -0.17778466641902924, 8.366904258728027, 0.713246762752533, 2.62131929397583, -1.8670955896377563, 0.382978230714798, 3.424891471862793, 0.600226879119873, -3.36027455329895, -2.0584378242492676, 2.6336004734039307, 2.134737253189087, -0.16959276795387268, -0.1036284789443016, 0.9810671210289001, 1.1418875455856323, 0.09962985664606094, 1.5914252996444702, -1.4545915126800537, -4.03810977935791, -0.7282320261001587, -8.482601165771484, 0.1327114701271057, -0.2752779424190521, 1.4184426069259644, 0.5733793377876282, 0.08223414421081543, 0.6222414374351501, -2.4597737789154053, -0.26593253016471863, 2.8372232913970947, -0.19282476603984833, 2.73103928565979, 0.6146931052207947, 0.7074552774429321, 1.1969836950302124, 1.1260418891906738, 0.5131900906562805, -1.2828993797302246, 1.3386794328689575, -1.8014036417007446, 1.7409440279006958, 0.08714856952428818, -2.159212827682495, 0.3832853138446808, -2.1119585037231445, 0.057761650532484055, 1.629834532737732, -4.008613586425781, -0.18078847229480743, 0.36479029059410095, 3.0292224884033203, -4.647429943084717, 1.4105931520462036, 0.14685384929180145, -2.7427775859832764, 1.6782023906707764, -1.3729807138442993, 5.332502365112305, -1.1668927669525146, 0.8168975114822388, -3.2900326251983643, -0.6102523803710938, -3.183854579925537, 3.688756227493286, -1.6288002729415894, 1.227471113204956, -0.32397547364234924, 0.2668505907058716, 3.316012382507324, -0.8223669528961182, -1.5635963678359985, -3.932425022125244, -1.5233489274978638, 0.8554443120956421, 3.2967934608459473, 4.95138692855835, -0.6281516551971436, 2.285294532775879, 0.7718386054039001, 0.1816239207983017, 2.007675886154175, -0.7778028249740601, 1.2278659343719482, 5.717531204223633, 1.481109857559204, 3.202547788619995, 3.465291976928711, -2.3789079189300537, -1.2358217239379883, -2.1978416442871094, -1.7168911695480347, -1.88066828250885, -7.866800308227539, -0.8011077642440796, -1.0275570154190063, 0.09445241093635559, -0.04172638803720474, 4.584714412689209, 3.101534366607666, 2.658493757247925, 0.17598022520542145, 1.2838610410690308, 4.7485785484313965, 3.408264636993408, -1.1186959743499756, 0.7971764206886292, 0.16952396929264069, -3.072563409805298, 3.4610233306884766, -1.439322590827942, -0.14502891898155212, -1.1009596586227417, 1.8348881006240845, 0.01855730079114437, 2.0746936798095703, 0.3936997354030609, -1.018744707107544, 3.3280391693115234, -0.1553063988685608, -4.110394477844238, 3.6121714115142822, -0.9740564823150635, -2.3469674587249756, -1.0248148441314697, 5.622794151306152, 4.866459369659424, 1.686584234237671, -0.4031165838241577, -6.158736228942871, -3.3289787769317627, 0.7099746465682983, 3.9457480907440186, -0.7544403672218323, 0.8887507319450378, -2.047558546066284, 3.7690515518188477, 0.7747164368629456, -3.2324941158294678, -0.5104861259460449, 2.5004994869232178, -0.20213449001312256, -0.3506910800933838, 0.19991439580917358, -2.2618813514709473, 2.2457990646362305, -1.3406918048858643, 1.157677412033081, -1.8261936902999878, -3.4050278663635254, 0.6939024329185486, -0.38150495290756226, -0.8440736532211304, 3.119615077972412, 1.0509897470474243, 1.7212930917739868, -1.4181828498840332, 6.471809387207031, -1.2109227180480957, 0.4508134424686432, -1.316296100616455, -1.3703230619430542, -1.8275609016418457, -2.74245285987854, -1.076255440711975, -0.3053441345691681, 2.7430131435394287, -2.574312448501587, -1.3241597414016724, 2.7385237216949463, 0.49683883786201477, -1.3965773582458496, 0.020975792780518532, 5.451194763183594, 0.5795206427574158, -0.48497387766838074, 0.8816636800765991, -0.08158492296934128, -1.060154914855957, 3.001741409301758, 0.5971808433532715, -0.5764495730400085, -1.2814199924468994, 0.3163350224494934, 3.7679755687713623, 0.09551535546779633, 2.357501983642578, 4.332345962524414, -0.7894896268844604, 0.6302068829536438, -2.898423194885254, 2.0931313037872314, 8.71098804473877, -0.04752988740801811, 0.7257133722305298, 0.1271584928035736, 0.6365450620651245, 1.5511466264724731, 1.9533740282058716, 2.3992066383361816, 3.926943302154541, 3.3248801231384277, -0.18604880571365356, 0.19740158319473267, -0.4012643098831177, 2.021028757095337, 3.8637330532073975, 2.575670003890991, -1.9365648031234741, 1.691444993019104, 2.2476296424865723, -1.9615851640701294, 0.002706246916204691, 1.1965627670288086, 1.631058931350708, 1.6077936887741089, 0.37226954102516174, 2.3644227981567383, 0.5751672387123108, 0.21432556211948395, -2.961639165878296, -0.1195574700832367, -2.5952560901641846, -1.1292909383773804, 0.34523868560791016, 0.5679969191551208, 1.7192620038986206, -2.389261245727539, -2.481879711151123, 0.24165616929531097, 2.0262961387634277, 1.1701478958129883, 1.3859567642211914, 1.7152780294418335, 2.0281617641448975, 1.8382415771484375, 1.1173278093338013, 2.8694252967834473, -3.3103885650634766, 2.402040481567383, -2.21357798576355, -2.2881109714508057, 1.4869003295898438, -1.0324887037277222, -5.4409942626953125, 1.7320265769958496, 4.665608882904053, -1.4724658727645874, 0.906815767288208, 0.4488605260848999, 1.4310017824172974, 1.8985599279403687, 0.3519801199436188, 3.0915486812591553, 1.8117051124572754, -2.6297123432159424, -0.7369126677513123, 1.0228630304336548, -1.2172415256500244, 0.905229389667511, 2.0640552043914795, 0.15564560890197754, -1.746980905532837, -2.079458475112915, 1.7389395236968994, -3.017563581466675, -1.3963100910186768, -0.17710325121879578, 3.3082163333892822, 1.3057005405426025, 4.105342864990234, -1.2242194414138794, -1.730143666267395, 1.565323829650879, 0.16045412421226501, -0.28249165415763855, 1.0591498613357544, 1.4410120248794556, 2.6321206092834473, 3.864403009414673, 1.5058237314224243, 0.017665212973952293, -0.23908689618110657, -1.820846438407898, 0.5008838176727295, -0.8114575147628784, -2.5787596702575684, -2.293384552001953, 0.20850887894630432, -3.0597705841064453, 0.8508138656616211, -0.8251520991325378, -0.6015176177024841, -1.7083408832550049, 3.254239559173584, -0.3540056347846985, -3.567826747894287, -0.5068729519844055, -0.7231264710426331, 0.07263125479221344, 4.496642589569092, -1.7761105298995972, -1.8822299242019653, -1.7277802228927612, 4.271916389465332, 0.08752737939357758, 0.3420945107936859, 0.33623436093330383, -0.8109123110771179, 0.11881151795387268, -1.0930507183074951, -0.8418698906898499, -2.286395788192749, -0.9247599840164185, -2.8689169883728027, -0.6005393266677856, 1.6728875637054443, -1.9595767259597778, 0.21688200533390045, -4.131806373596191, 0.8827064037322998, 3.134533643722534, 4.377490997314453, -0.14890450239181519, -2.932239532470703, -0.7125211954116821, -2.171063184738159, -2.236750841140747, 1.8922467231750488, 2.478151559829712, 0.5344278812408447, 1.0548337697982788, -2.1813416481018066, 1.4460980892181396, -0.8311839699745178, 1.6376347541809082, -1.0173778533935547, -0.3695203959941864, 0.25814804434776306, -2.0606374740600586, -2.062361001968384, 0.02003740519285202, -2.0083367824554443, -2.569866895675659, 1.641120195388794, -2.4589219093322754, -1.2245359420776367, 1.6952146291732788, -0.6217470765113831, 0.6591718196868896, 0.8530001044273376, -3.5597972869873047, 0.7347907423973083, -0.35392555594444275, -2.053921937942505, -1.7859218120574951, 0.24722696840763092, -2.3023266792297363, 0.9194344878196716, 0.3853018581867218, -2.844104051589966, 0.23804813623428345, 2.2432146072387695, -0.9430684447288513, -1.3244085311889648, 0.5206717252731323, -2.510953903198242, 2.6874470710754395, 2.884516716003418, -3.0947065353393555, 1.5549497604370117, 1.000489354133606, -3.7759156227111816, -3.5866310596466064, 0.3307448923587799, 2.717256784439087, 16.432958602905273, 0.4599498510360718, -0.3353075385093689, 0.632378339767456, -0.07045717537403107, -0.00426980247721076, -0.5268138647079468, -5.407313823699951, 2.4316935539245605, 1.001681923866272, -0.15660661458969116, -2.9473681449890137, -0.4327965974807739, -1.2289097309112549, 0.9028959274291992, -2.345223903656006, -5.678720951080322, -17.152206420898438, 1.3550357818603516, 0.16876499354839325, -1.806233286857605, -2.0235366821289062, -2.3942909240722656, 1.7706652879714966, 1.328552007675171, 0.9902170300483704, 1.0657343864440918, -0.8373643755912781, 1.3121364116668701, -2.431511878967285, 3.0992045402526855, -1.0835341215133667, 1.0107671022415161, 2.2383971214294434, 3.631667137145996, -4.688368797302246, -0.8407208919525146, -0.5139216780662537, -2.163087844848633, -3.8397138118743896, -2.0916390419006348, -0.8597046732902527, 0.21912139654159546, 0.12715370953083038, 1.153622031211853, -1.1585773229599, -1.8073042631149292, 8.559503555297852, 4.071874618530273, -1.358181357383728, 2.864137887954712, 1.7249234914779663, -1.0965842008590698, 0.3344517946243286, 5.06625509262085, -0.26273274421691895, -2.291105270385742, 1.437657117843628, -0.46924886107444763, 0.5913109183311462, -2.7366275787353516, -4.258198261260986, 4.3238630294799805, 3.392183303833008, 0.19327236711978912, 2.0916006565093994, -4.229781627655029, 1.4440361261367798, 2.496108293533325, -0.5718185901641846, 1.2844934463500977, -2.9670896530151367, -0.3494110703468323, 2.444650888442993, -5.554295063018799, 1.7922627925872803, -4.477921485900879, 0.23979905247688293, 0.7950924634933472, 3.354154109954834, 3.7648215293884277, 4.002387523651123, 1.03700852394104, -0.7424588799476624, -0.747087299823761, -0.35536155104637146, 1.478765845298767, -1.1725050210952759, 0.457451730966568, 1.706812858581543, -1.1370282173156738, 0.38487479090690613, -1.2322914600372314, -5.03274393081665, -4.228187561035156, -0.6503980159759521, 1.4518556594848633, 0.34141305088996887, 2.9639499187469482, 0.62786865234375, -2.555616855621338, -3.0853793621063232, 0.5655776262283325, -5.926087379455566, -0.6000630259513855, -0.4027203917503357, -0.4925157129764557, -2.452976942062378, 1.0469924211502075, 1.7627192735671997, 2.3034582138061523, 3.917992353439331, -0.7613748908042908, -1.0948745012283325, -0.39740902185440063, -3.4186253547668457, 0.6245608925819397, -0.2098216414451599, -1.9092230796813965, -2.178650140762329, -4.5010085105896, 3.2316954135894775, 2.955289840698242, 2.3127593994140625, 2.000962018966675, 0.8655766844749451, 1.269898533821106, 1.6150658130645752, -0.5559079051017761, 4.536555290222168, -0.9081788659095764, 5.060380458831787, -3.1440513134002686, 0.4749728739261627, -2.6961705684661865, 0.48110538721084595, -1.5157006978988647, -2.390120506286621, -2.559065341949463, 2.193802833557129, 3.6765360832214355, 3.9819557666778564, -1.4238238334655762, 1.3990014791488647, -5.17081880569458, 2.618035316467285, 0.4750138223171234, -0.4044628143310547, -3.6771671772003174, 0.7836385369300842, 0.7756246328353882, -3.7117950916290283, -2.2234394550323486, -0.6963503956794739, -1.0420076847076416, -0.6737702488899231, -1.6158595085144043, -0.23435267806053162, -0.8022506237030029, 1.1232982873916626, -0.045963115990161896, -1.8619283437728882, 2.048210859298706, -2.7934417724609375, -2.1800734996795654, -2.365126132965088, -7.31683349609375, -3.9046688079833984, -2.8341493606567383, -1.774977207183838, -0.9284342527389526, -2.0185604095458984, 1.9754153490066528, 1.8228507041931152, 3.101613998413086, -0.5012308359146118, -0.622053325176239, 1.690057635307312, 5.319388389587402, -0.4459887146949768, -2.209606647491455, 0.8800396919250488, 0.9330681562423706, 4.268242835998535, 4.140341758728027, -0.49039381742477417, 1.4208073616027832, 1.144311547279358, 0.3244566321372986, 2.9179792404174805, 0.35879212617874146, 3.0273144245147705, 0.3386215567588806, -0.8572790622711182, 2.599278450012207, -1.9755042791366577, 0.7163757681846619, 0.9644004106521606, 1.3313040733337402, -2.93749737739563, -1.9620243310928345, 2.5053915977478027, 0.8777453303337097, -1.1620169878005981, -1.8972275257110596, 3.337865114212036, -8.000229835510254, 0.30823370814323425, -0.6783313751220703, -0.35400134325027466, -0.5643881559371948, -2.711589813232422, 1.0459197759628296, -4.5445404052734375, 2.89302659034729, 1.04561185836792, 1.9752637147903442, -0.28261321783065796, -2.9703288078308105, -3.6222126483917236, -1.4383187294006348, 0.4069873094558716, -1.1182414293289185, 0.9198808073997498, -1.1735683679580688, 0.46487268805503845, 0.7948731184005737, -1.2332675457000732, -2.6994524002075195, -1.1529998779296875, 1.5351437330245972, -1.7849645614624023, 2.2038156986236572, -0.5266463160514832, 0.9077516198158264, 0.7357850074768066, 1.5007072687149048, -2.07084321975708, 2.605992078781128, -1.2520309686660767, -2.479884624481201, 2.3317666053771973, -1.2373405694961548, -0.3232228457927704, -1.4383701086044312, -0.021065227687358856, -2.227372884750366, -0.010048680938780308, -0.2604563534259796, 2.2095255851745605, 0.06470528990030289, -1.1263781785964966, -3.3996922969818115, 4.104774475097656, -0.04152122139930725, -6.401206016540527, 1.31611967086792, 1.9218440055847168, -0.6866925954818726, 2.3602161407470703, -2.5231804847717285, 0.6667537093162537, -1.0170143842697144, 0.9186195731163025, -2.131070137023926, -0.43874800205230713, -1.2322452068328857, -1.3605345487594604, -1.1996880769729614, 0.2085247039794922, -0.4078119695186615, 0.6022486090660095, 1.3491054773330688, -1.1185091733932495, -3.483367443084717, 0.9417869448661804, -0.8851912021636963, 1.438579797744751, 2.1984684467315674, 0.3961302936077118, -2.8186848163604736, -0.30686628818511963, 1.4371565580368042, -2.253955364227295, 1.5607082843780518, 3.3141539096832275, -5.4006781578063965, -1.0033739805221558, -1.014626383781433, -1.5705243349075317, 1.809509038925171, -3.0059304237365723, 0.429729700088501, 4.336503505706787, -0.47147083282470703, 2.152318239212036, 13.925320625305176, 3.3883864879608154, -3.9347054958343506, 4.762343406677246, 2.4967739582061768, -3.6560683250427246, 2.7617063522338867, 0.40017858147621155, 0.1542196422815323, -2.2952921390533447, -0.366949200630188, -2.6444313526153564, -2.7218775749206543, -1.4602349996566772, 4.774621963500977, -0.20149844884872437, -2.1073617935180664, 1.839576244354248, -1.221210241317749, -1.9074417352676392, 0.07884180545806885, -1.32472825050354, 7.124340534210205, -0.3509941101074219, 2.073611259460449, -1.0720932483673096, 1.6395602226257324, -2.964919090270996, -4.1628828048706055, 2.234105110168457, -0.3229958117008209, 1.0272473096847534, -1.6292227506637573, -0.15278007090091705, 0.5408380031585693, -4.847177982330322, -0.05311593413352966, 1.1312865018844604, 2.1299498081207275, 3.05112886428833, 3.928023338317871, -1.0899431705474854, -2.496884346008301, 0.09822199493646622, -1.8639878034591675, -1.2432682514190674, 6.173817157745361, 3.5335681438446045, 1.3310219049453735, -0.2995573878288269, -4.024162292480469, 1.0739487409591675, -1.0657744407653809, 0.5282360911369324, 0.7411217093467712, 2.536358594894409, 1.6138397455215454, -0.029570886865258217, 2.585991382598877, -1.554215669631958, -3.934455394744873, -2.9784507751464844, -0.044512372463941574, -0.7037416696548462, 0.5606247782707214, 2.2037577629089355, 1.2304697036743164, 1.4468368291854858, 1.0804389715194702, -0.38680657744407654, 0.6009941101074219, 0.4494793713092804, 2.863783121109009, -2.711683511734009, 0.5613974332809448, -1.5130969285964966, 1.191583514213562, 2.803816080093384, 1.3084938526153564, 2.1691229343414307, -1.6228604316711426, -3.6764676570892334, -3.4903674125671387, -3.1390273571014404, -0.7853108644485474, -2.6886606216430664, -1.449549913406372, -1.4155645370483398, -0.8658841848373413, -0.37090253829956055, 0.5015268325805664, -3.600803852081299, 0.3378714323043823, 0.06636380404233932, -0.6803212761878967, 1.0255857706069946, -1.2414180040359497, -3.767253875732422, 0.7778723239898682, 1.7470570802688599, -1.3887659311294556, 1.0858632326126099, 2.7913334369659424, -3.3359079360961914, 0.8880416750907898, 1.0861865282058716, 1.0754972696304321, 0.6781502366065979, -4.427796363830566, 2.6974170207977295, 3.482612371444702, 1.060753345489502, 0.4902668297290802, 3.8678979873657227, 0.742818295955658, -0.3497908413410187, 1.8841522932052612, 1.5679426193237305, -2.5528042316436768, 0.09365323185920715, -2.543358325958252, -2.426629066467285, 0.241494819521904, 0.2625811696052551, 0.7420327663421631, -1.758086085319519, 0.8050040602684021, 1.1659849882125854, 2.09049129486084, -1.1730401515960693, -1.2563282251358032, 1.1017701625823975, 2.4923088550567627, -1.603308081626892, 2.056373119354248, -0.9182299375534058, 2.4902634620666504, -1.7726845741271973, -1.3409607410430908, 1.721696138381958, -0.21937215328216553, -1.5970410108566284, 1.5463968515396118, -2.2399871349334717, -2.689202070236206, -1.655840277671814, 2.9419026374816895, -0.19106371700763702, -1.9395936727523804, -7.63442850112915, -2.799884796142578, 0.7460784316062927, 0.7562136054039001, 1.2043811082839966, -2.5326616764068604, -4.281978130340576, 1.0800150632858276, -4.655853271484375, 0.969577968120575, -1.1482301950454712, 1.5418624877929688, -3.08880877494812, 1.4554804563522339, -0.9221847653388977, 1.3303027153015137, -1.728074312210083, 0.2110508680343628, 1.2447799444198608, 1.4234880208969116, 0.655928373336792, -4.7058000564575195, 0.980875551700592, 2.8168163299560547, 5.50719690322876, 1.512297511100769, 1.3976364135742188, -0.07733888179063797, -1.3017395734786987, -2.4851372241973877, -0.6792453527450562, 0.09318779408931732, 0.7466562986373901, -3.5570878982543945, -1.1876238584518433, -5.330657482147217, 0.40573999285697937, 1.3347523212432861, -0.39044567942619324, -1.4076067209243774, 1.996909737586975, -3.365144729614258, 0.49468058347702026, 3.713127613067627, -8.4945068359375, -6.928589820861816, -0.3166569769382477, -3.051633358001709, 0.963836669921875, 3.7993195056915283, -1.1168889999389648, -3.9914538860321045, 1.6232191324234009, 0.11872398853302002, 3.6148579120635986, -1.9934262037277222, 0.05636120215058327, -0.6629801988601685, 0.8716393113136292, -2.8514983654022217, 1.6635459661483765, 3.114509105682373, -0.422751784324646, 0.645150899887085, 2.2943763732910156, 2.4540634155273438, 0.0672827735543251, 0.42319533228874207, -2.2443456649780273, -2.638045310974121, 0.1538098305463791, -0.4965120851993561, 1.5529780387878418, -0.1867440789937973, 1.0553231239318848, 2.333787202835083, 0.3588300049304962, 0.8439188003540039, 0.791310727596283, -3.3183815479278564, 0.3670140504837036, -1.1726025342941284, 0.7922552227973938, -1.207217812538147, 0.37850844860076904, 2.537259340286255, -1.147470235824585, -0.8211045861244202, 4.31798791885376, -1.8256325721740723, 0.9877752065658569, 1.1042789220809937, -2.028036117553711, -1.5307916402816772, -1.1776632070541382, -0.3931662440299988, 0.14373105764389038, 1.0512595176696777, -2.7358779907226562, -2.7031729221343994, -0.4925054907798767, -2.84689998626709, 1.2910932302474976, -0.286594033241272, -0.8258867263793945, 0.29243966937065125, -1.389451026916504, -7.750943183898926, -0.3456484079360962, -1.8374242782592773, -2.9385907649993896, 1.9873404502868652, 0.421228289604187, -0.28917068243026733, 0.1207314059138298, -3.022954225540161, -3.006281852722168, -3.6395320892333984, -0.04592841491103172, 1.4397656917572021, 3.6836071014404297, 2.425987720489502, 2.349182367324829, 2.8781638145446777, 2.2796523571014404, 1.0492945909500122, -2.0178983211517334, -0.050257593393325806, -0.8684335947036743, -1.6315178871154785, -0.3741435110569, -2.2837867736816406, -0.5467619895935059, -0.1317581832408905, 2.6047940254211426, 4.653141021728516, 0.6582071781158447, 0.03339575231075287, -1.7306127548217773, 5.126516819000244, -1.5154420137405396, 1.63021981716156, 0.9060959815979004, 1.0430899858474731, -1.524379014968872, 0.19922564923763275, -1.0476833581924438, -0.49919593334198, 1.9671411514282227, -0.6556757092475891, 1.3037986755371094, -4.087615013122559, -0.035534899681806564, -0.6530380845069885, -1.9110877513885498, -0.39812588691711426, 1.741985559463501, -0.14757144451141357, 1.0144023895263672, 2.859447956085205, -1.64835524559021, 0.8900044560432434, -1.1324634552001953, -2.0541436672210693, -0.12712179124355316, -1.9320201873779297, -3.4832119941711426, 0.9167724847793579, 0.2866372764110565, -2.497847557067871, 2.225536823272705, -2.347992181777954, -3.556384325027466, -3.5115976333618164, -3.4341421127319336, 0.3215564489364624, 0.42333561182022095, -2.633776903152466, 3.4280056953430176, -0.11355509608983994, 4.4162445068359375, 0.652360737323761, 0.3693672716617584, 0.8406402468681335, 0.5800317525863647, -0.40339264273643494, -1.32255220413208, 2.2589235305786133, -0.5896028876304626, 2.833510160446167, -2.1973671913146973, -2.1433517932891846, -1.958458423614502, 2.0094025135040283, -1.693271279335022, -0.6070998907089233, -3.7324821949005127, -2.042354106903076, 1.8593354225158691, 1.4811488389968872, 0.23461775481700897, 1.338157296180725, -0.3191300332546234, 3.6604349613189697, 3.7230405807495117, 1.0450537204742432, 0.7657374143600464, 2.0246214866638184, 3.0788414478302, 2.5447030067443848, 3.4321486949920654, -1.689874529838562, -0.5165721774101257, 0.4127790629863739, -1.9836186170578003, -1.372557520866394, -5.794012069702148, 1.5125136375427246, 1.3957287073135376, -3.70979380607605, 0.8486475944519043, 1.6273560523986816, 1.9299976825714111, -1.2916944026947021, -3.3648147583007812, -2.9207775592803955, -2.6380021572113037, 4.995087623596191, 2.9598748683929443, 0.3785438537597656, 0.4166192412376404, 3.0350608825683594, -0.8804364800453186, 1.496321201324463, -0.3164386749267578, -2.5588836669921875, -1.9835740327835083, -2.1071789264678955, -2.6062724590301514, 0.060028985142707825, 3.6234116554260254, 2.1669507026672363, -2.9112284183502197, 0.3972020447254181, -2.8265020847320557, 2.8438220024108887, -4.806768894195557, -6.963743209838867, -3.9642608165740967, 9.188138008117676, -0.18345701694488525, 3.740765333175659, 6.767358303070068, 0.17286311089992523, 1.1201016902923584, -0.6706677675247192, -0.8333630561828613, 1.7104347944259644, 1.9785096645355225, -2.720334768295288, 0.80999356508255, 1.9967111349105835, 3.083427906036377, -1.4512670040130615, -3.5462236404418945, 4.763698577880859, -0.8390009999275208, -0.02801389992237091, -1.4283075332641602, -2.749688148498535, 3.445946216583252, -2.0499844551086426, -0.16562716662883759, 2.462021589279175, -0.36010804772377014, -0.6161695122718811, -1.4864997863769531, -3.835376024246216, 2.3617639541625977, 0.8495863676071167, 0.18596042692661285, 3.7576193809509277, 4.860504627227783, 1.8053585290908813, 2.7769103050231934, -2.862537145614624, -1.1383543014526367, 0.1966051161289215, 1.208785057067871, 2.218079090118408, -1.777130365371704, -4.217644214630127, -2.128676652908325, 0.36872467398643494, 0.6467520594596863, 0.420412540435791, 1.4152511358261108, 1.496568202972412, -0.09782244265079498, -0.7595303654670715, 1.7761812210083008, -1.7302031517028809, 3.6339685916900635, -0.9662454128265381, 1.4717026948928833, 5.134150981903076, 0.0950796976685524, -0.05794414505362511, 0.24549096822738647, -1.9405808448791504, 1.7366737127304077, -0.5531566143035889, 0.2575986385345459, -1.1394054889678955, 3.2992188930511475, -0.23203109204769135, 4.314737319946289, -3.105592966079712, 2.4010543823242188, 2.02353835105896, 2.075608968734741, 0.6884871125221252, -1.979292631149292, 0.9862112998962402, 1.0455793142318726, -0.45799267292022705, 1.1594181060791016, 2.206686496734619, 4.866871356964111, -2.527500867843628, 2.951281785964966, 3.5269134044647217, -0.02973773330450058, -0.695919930934906, -3.5594143867492676, 3.4591355323791504, -0.07023453712463379, 2.777527093887329, 1.1756397485733032, -2.130584955215454, 0.2641402781009674, 1.3519498109817505, 3.8786544799804688, 2.877559185028076, 1.6023885011672974, 0.45966294407844543, -0.12839673459529877, -6.096737384796143, -1.9154478311538696, -0.20558804273605347, -1.9859083890914917, -0.11524983495473862, 0.643292248249054, 1.6555390357971191, 1.601739764213562, -3.183210849761963, 1.7148385047912598, -0.009530105628073215, 1.4066699743270874, -1.0563966035842896, 2.9099512100219727, 1.8363051414489746, 0.24004903435707092, -0.3675619661808014, 2.521517038345337, -2.0683305263519287, 2.403411865234375, 0.6963122487068176, 1.0661150217056274, 1.6288868188858032, -1.3240654468536377, -2.9048776626586914, -3.306037664413452, -2.009368658065796, -2.2537596225738525, 4.363896369934082, -0.9849804639816284, -2.6569344997406006, 0.041730210185050964, -1.91129732131958, -6.234752178192139, -0.45463404059410095, -6.273172855377197, -0.8214718103408813, -0.14008229970932007, -3.773129940032959, 1.6729103326797485, 0.926586389541626, 1.6829426288604736, -2.6960995197296143, -2.560077428817749, -0.9377068281173706, 3.58866810798645, 3.5899252891540527, -1.025821566581726, 2.304710626602173, 0.1121024638414383, -2.4388844966888428, 2.5825915336608887, -1.2303715944290161, -0.48363539576530457, 1.721494197845459, 1.9575861692428589, 1.1553378105163574, 0.47931820154190063, 0.8712751865386963, -4.865447044372559, 2.276536703109741, 1.4118449687957764, 0.9108882546424866, -2.1985740661621094, 4.147949695587158, 6.514428615570068, -0.4900270700454712, 2.138671636581421, 12.697185516357422, 0.1702597737312317, -0.581913411617279, -1.4690150022506714, 3.291365385055542, 1.5840920209884644, -1.2976336479187012, 1.842443823814392, 4.312709808349609, 2.36325740814209, -0.3436778485774994, -1.7422541379928589, 3.236283779144287, -3.1458051204681396, -1.0890759229660034, 2.5912160873413086, 1.21088445186615, 1.1430176496505737, 2.7021613121032715, -1.6227190494537354, 1.8330045938491821, -2.014857292175293, -1.6285412311553955, 0.6879022717475891, -1.3116636276245117, -0.05647524073719978, -0.7523167729377747, -2.0127041339874268, 2.7724740505218506, -3.1865944862365723, 0.5824164748191833, 0.8800039887428284, -3.2591750621795654, 0.8980127573013306, -0.5984199643135071, 1.715185523033142, -1.3693416118621826, 0.1957239955663681, 0.4493981897830963, 0.362431138753891, -0.5357111692428589, 0.21194039285182953, -2.7322158813476562, 0.3757284879684448, 0.7687205076217651, -0.5908454060554504, -2.1876003742218018, 1.4000626802444458, 1.8067703247070312, 0.08723151683807373, 0.29177868366241455, -3.9692893028259277, -2.2889692783355713, -0.13429246842861176, -4.40157413482666, 3.8034214973449707, -0.39560070633888245, 0.2060045450925827, -1.2885974645614624, 2.84647274017334, -1.6097418069839478, 0.7028008699417114, 1.9910683631896973, -4.682865142822266, 0.08241750299930573, 2.0089969635009766, -0.16355599462985992, -1.090924859046936, -2.204105854034424, 3.747685432434082, 1.4953826665878296, 1.1620583534240723, -1.7158586978912354, -0.5470337867736816, 1.1524372100830078, -4.065885066986084, -0.1520935446023941, -0.08945705741643906, -0.5676407814025879, -0.9692826271057129, -4.193799018859863, 2.5574755668640137, 0.05192914977669716, -1.2440725564956665, -0.9702206254005432, -1.4171842336654663, 1.4777820110321045, 0.5708855390548706, 3.234403371810913, 1.435015320777893, 1.5958772897720337, -0.4826149344444275, -0.4240429699420929, -1.2887234687805176, -2.4319846630096436, 3.517615556716919, 0.4199928343296051, 0.25387975573539734, -2.0640511512756348, 0.9562495350837708, -1.2582275867462158, 0.055465783923864365, -0.12762285768985748, 0.107339046895504, -1.4519932270050049, 0.3314581513404846, -0.8374611735343933, 2.369969367980957, -3.352442741394043, 0.10707128793001175, -3.445869207382202, -0.5676386952400208, 0.4549739956855774, -2.532949209213257, -1.1349865198135376, -0.5804040431976318, 0.13103124499320984, -2.0054023265838623, -1.3924400806427002, -2.369096279144287, -3.140526533126831, -0.5808191299438477, 0.874461829662323, -0.188277930021286, -1.9577866792678833, 1.1555860042572021, -0.0653008297085762, 3.690464496612549, 0.11360576003789902, 3.811629056930542, -4.0423970222473145, -4.366100311279297, 1.8321009874343872, 0.3742154836654663, -2.1414084434509277, 3.518573760986328, -1.3776410818099976, 1.5458232164382935, 2.419893980026245, -2.0645220279693604, 2.82112193107605, -2.486698627471924, -1.2540570497512817, 1.1698811054229736, 2.586034059524536, -2.9038424491882324, -1.2867175340652466, -3.596688747406006, -0.269835889339447, -1.048559546470642, -1.24339759349823, 0.6452747583389282, 1.4447095394134521, -0.3660987615585327, -3.9566009044647217, -2.0376088619232178, 4.2675933837890625, -0.042271699756383896, 0.27036112546920776, 0.6396157741546631, 0.9426888227462769, 3.0495753288269043, 0.7582582235336304, -0.45967456698417664, -15.701238632202148, -0.4160144627094269, -1.5584930181503296, -2.840134859085083, 1.3236922025680542, -5.107154846191406, -1.2027043104171753, -0.0928250327706337, -0.316132515668869, 3.304638385772705, 1.8706815242767334, -2.0473625659942627, -0.17349372804164886, 1.6978036165237427, -0.07119304686784744, -2.4761178493499756, -1.2115349769592285, 0.09616711735725403, 1.3279376029968262, -0.20660977065563202, -3.7437589168548584, 4.035397052764893, 5.1511125564575195, 0.13733580708503723, 4.3706889152526855, 0.47816595435142517, -4.939548492431641, 3.9821362495422363, 1.2960107326507568, -2.241407871246338, -0.5270397663116455, 0.3211750388145447, -0.9446754455566406, -2.263381004333496, -0.5284557938575745, -0.5716449022293091, -6.144455909729004, -0.20366817712783813, -0.9872948527336121, -0.4124278724193573, 1.2847188711166382, 0.009244943968951702, -0.19489696621894836, -0.8176560997962952, -4.316583156585693, -3.7163844108581543, 1.3861830234527588, 3.8930490016937256, -1.3680702447891235, -0.24294474720954895, -2.7681002616882324, 1.7113655805587769, -0.606324315071106, -0.6169490814208984, -7.158268928527832, 3.565070867538452, -3.822112798690796, -1.6086783409118652, 1.4382401704788208, 0.4208219647407532, -3.7997119426727295, -1.4455845355987549, -3.0762925148010254, 0.04034845158457756, 1.4584095478057861, 1.9918564558029175, -0.6388969421386719, 0.5506566762924194, 0.41992610692977905, 0.43102705478668213, -0.6727173924446106, -0.5633061528205872, 2.898101568222046, -0.06702973693609238, 2.3525285720825195, 1.7557615041732788, 2.0484392642974854, 0.37812069058418274, 1.176210641860962, -0.8906222581863403, -1.1188939809799194, -4.2457194328308105, -4.281935214996338, -0.45042505860328674, 0.5453838109970093, -3.830627679824829, 3.9956893920898438, -0.932000994682312, 1.8395558595657349, -2.7929651737213135, 0.2916111350059509, -1.8485019207000732, -1.039182424545288, -3.2927796840667725, 1.0021835565567017, 2.791674852371216, -0.08592307567596436, -2.6002085208892822, -3.934725284576416, 1.4596346616744995, 0.6913354992866516, -0.7221489548683167, -0.3737444579601288, -0.12355824559926987, -0.9695915579795837, -0.8177955150604248, -2.2838408946990967, 0.7469481229782104, 1.400248646736145, 0.15970098972320557, -5.866583347320557, 0.6808104515075684, 2.648599624633789, -4.547426700592041, -1.2506881952285767, -1.9755067825317383, -1.213073968887329, 0.6373104453086853, -2.8238868713378906, 2.2079269886016846, -1.1285902261734009, 0.6823954582214355, -4.364758014678955, 1.9091730117797852, -4.315164566040039, -0.12873969972133636, 3.0962893962860107, -2.5603556632995605, -1.615820288658142, -2.060540199279785, -2.1927671432495117, 2.989285469055176, 4.0191192626953125, 3.6707019805908203, -1.870025634765625, -3.3607120513916016, -1.3941831588745117, -3.0161614418029785, 1.6153520345687866, -3.17976450920105, 0.5760121941566467, 2.39695143699646, -1.6365699768066406, 0.7151207327842712, -0.5775105357170105, -2.692244529724121, -0.11869021505117416, 2.8183553218841553, -0.8114098906517029, -4.388206958770752, -0.7958301305770874, -1.8015962839126587, 2.151258707046509, -2.683326244354248, -1.2617017030715942, -5.878039360046387, 3.791125535964966, 2.1123387813568115, 0.3713659644126892, 4.008230686187744, -1.6238168478012085, -2.4058170318603516, -0.192941814661026, -0.2454437017440796, -3.0263428688049316, 0.5038865804672241, -0.5672710537910461, 0.4844038188457489, -4.140225887298584, -1.6168080568313599, -1.179776668548584, 1.833924651145935, -0.994143545627594, 3.737584352493286, -2.54579496383667, -0.6079219579696655, 2.046074151992798, -0.8043409585952759, -0.8280113339424133, -1.1323226690292358, 1.0587517023086548, -1.4634441137313843, 2.5994420051574707, 2.0451130867004395, 0.21864581108093262, 1.4689136743545532, -0.26963692903518677, 0.5055298805236816, 0.6850299835205078, -1.566035509109497, 0.48955920338630676, -1.4859213829040527, 3.471837043762207, 1.581892490386963, 2.0964314937591553, 2.0870323181152344, 8.435992240905762, -1.9760631322860718, 1.7222981452941895, -0.004874862730503082, -0.27196624875068665, -4.229193210601807, 1.550600528717041, -0.2807212471961975, -0.4815188944339752, -0.9566815495491028, 1.2792444229125977, 0.8331828117370605, -2.6063625812530518, -1.6821216344833374, -2.3349037170410156, 1.8884581327438354, -2.1717031002044678, -0.7671651840209961, 0.6128094792366028, -0.9759376645088196, -1.4117028713226318, -0.051028959453105927, -2.9533774852752686, 2.115994453430176, -1.4546232223510742, 3.0259058475494385, -0.6864786148071289, 2.7231955528259277, -2.7301056385040283, -3.702298164367676, -2.0040838718414307, 1.268046498298645, -1.021027684211731, 2.687023401260376, -2.0586564540863037, -0.6545397639274597, -1.379477858543396, 0.5673496723175049, 3.4700703620910645, -1.3382890224456787, 4.866246700286865, 0.8660249710083008, 0.3975282311439514, 0.3135291337966919, -1.3822522163391113, -1.7034674882888794, 0.4826319217681885, 2.3688549995422363, 3.266291379928589, 3.688753128051758, 2.2783472537994385, -2.1834399700164795, 0.14295364916324615, 0.4503699839115143, 1.7289085388183594, -1.9512842893600464, -0.21388515830039978, -1.1007331609725952, -2.500394821166992, -1.7623755931854248, -0.6051106452941895, 1.5108247995376587, -0.2411470264196396, 1.8177787065505981, 2.82437801361084, -1.0844836235046387, -2.26870059967041, 0.7420249581336975, 0.7531202435493469, 1.2801417112350464, -0.4092317819595337, -1.4025123119354248, 0.8112481832504272, 1.1145027875900269, 1.2985749244689941, 1.3352473974227905, 0.23345571756362915, -0.2348545789718628, 3.0657458305358887, 3.0020275115966797, 2.2588510513305664, 1.1705591678619385, -2.702425241470337, 1.1414426565170288, 0.7925302386283875, -0.9114995002746582, -3.437647819519043, 0.5685771703720093, 2.4016709327697754, -0.7104046940803528, -0.49384787678718567, 1.5193171501159668, -0.7541487216949463, -0.12032226473093033, 3.006114959716797, -1.442863941192627, -1.1988327503204346, -3.3316681385040283, -4.13327693939209, -2.686556339263916, 2.5955958366394043, 0.10486505925655365, -0.09457852691411972, -2.8425934314727783, 1.4546819925308228, -0.5347263216972351, 5.051701545715332, -1.6655638217926025, 1.5234990119934082, -0.2312779277563095, 2.778075695037842, -2.558663845062256, 1.3201924562454224, 0.6502883434295654, -2.151087760925293, -0.1096835732460022, -0.5541249513626099, 2.7854559421539307, 2.0658340454101562, -1.3783692121505737, -1.3417465686798096, -1.7596029043197632, 1.7820526361465454, 2.6531965732574463, 5.049012660980225, 1.2668673992156982, -1.8426216840744019, -2.9864134788513184, 1.929665207862854, -0.3497783839702606, 2.728487491607666, -0.40557560324668884, 0.6990113258361816, 2.051792621612549, -0.2968551218509674, -1.4910939931869507, 0.1516103893518448, -1.2123737335205078, -0.029318474233150482, -4.456618785858154, 2.538809299468994, -1.1352031230926514, 1.0192277431488037, -3.1692354679107666, -0.09158816933631897, -1.4177887439727783, -0.013344619423151016, -2.2111384868621826, -3.2617032527923584, 0.45793554186820984, 3.9405829906463623, 2.1735217571258545, -1.3528891801834106, -2.521921396255493, 0.5065068006515503, -4.01235818862915, 0.8525381684303284, 0.6978675127029419, -6.160739421844482, -0.9164103865623474, -0.805870532989502, -2.6573102474212646, -0.08076635748147964, -3.284416913986206, 1.4471145868301392, -1.2000759840011597, -3.713405132293701, 2.2166850566864014, -1.812878131866455, 2.7114756107330322, 0.6235495209693909, -0.6086971163749695, -1.331510066986084, -0.12749147415161133, -0.17716072499752045, -1.8694998025894165, 0.6047096252441406, -2.85516095161438, 0.1358904242515564, 0.7805721759796143, -1.4753942489624023, -0.39021924138069153, 2.9148035049438477, -1.811692237854004, -5.235791206359863, 7.800781726837158, 0.6893172860145569, -1.3959850072860718, 0.36975839734077454, 0.9769801497459412, -3.079468250274658, -0.6729356050491333, -0.4710131883621216, 1.9317784309387207, -0.8172504901885986, 2.3907625675201416, 0.4019831120967865, -3.3447656631469727, 0.3331543207168579, 3.5188796520233154, -0.1669885665178299, -1.8466448783874512, 1.465531349182129, 3.175078868865967, 0.1701231598854065, -0.9683067798614502, -4.42292594909668, 2.5984442234039307, 2.7046470642089844, -4.395741939544678, 3.746337652206421, 0.4244031310081482, 1.5427885055541992, -2.199817419052124, 3.163393259048462, 0.3206281065940857, 0.3537555932998657, -2.8342480659484863, -2.5620577335357666, -3.0775763988494873, -0.7712145447731018, -3.0951051712036133, -3.8998899459838867, 0.6240130066871643, -0.2558455765247345, 0.9448128938674927, -0.5790820121765137, -4.960383415222168, 1.5617133378982544, 1.887992024421692, 1.5062764883041382, -0.6209832429885864, -1.7849290370941162, 0.3490074574947357, -1.1174975633621216, 0.1620357185602188, 1.8000510931015015, -3.592987060546875, 1.2271937131881714, 1.4910303354263306, 2.7791011333465576, 0.179953470826149, -3.1681017875671387, -4.190149784088135, -1.2405109405517578, -2.385498523712158, -1.545311689376831, -0.947026252746582, 0.9008129835128784, -2.256457805633545, -0.2809835374355316, 1.023740291595459, 1.4511172771453857, -1.1371289491653442, 1.7444106340408325, 0.37013667821884155, 1.6489911079406738, 1.9184602499008179, 0.7044113278388977, 0.7469933032989502, -0.5680955052375793, 2.045294761657715, 0.9659559726715088, -2.065915107727051, -1.0256820917129517, 4.245923042297363, 0.006346825510263443, -1.6172049045562744, 3.3857743740081787, 3.8178958892822266, 0.7492371797561646, -2.13700270652771, 3.236737012863159, -3.0956428050994873, 1.656744122505188, 3.2310705184936523, -1.5321632623672485, -1.5883708000183105, -2.008495330810547, -4.471986770629883, -0.16234588623046875, -3.660121202468872, 1.174878478050232, -0.09413106739521027, -0.846261203289032, 2.0979487895965576, 0.24388058483600616, -0.2104274481534958, 0.9922427535057068, 3.184767484664917, -0.14923042058944702, 0.9851386547088623, -1.208364486694336, -2.944791555404663, -0.18839019536972046, 1.1857635974884033, -3.224734306335449, -0.7380123734474182, -0.17483972012996674, 1.3187201023101807, -0.5272297859191895, -0.33452925086021423, 1.0812890529632568, -2.4462406635284424, -0.9421428442001343, -1.5154457092285156, -1.282760739326477, -2.7113687992095947, 2.200863838195801, -1.4985806941986084, 0.4371044933795929, -1.2834148406982422, -1.023317813873291, -0.13607177138328552, -1.1731070280075073, -1.8092199563980103, -1.882957100868225, 1.2429536581039429, 2.7756540775299072, -1.2731683254241943, -0.042966458946466446, 3.493950366973877, 1.3863978385925293, -4.050278186798096, -2.4437808990478516, 4.007221221923828, 0.4056324362754822, -3.8610963821411133, -3.38032603263855, 0.03226513788104057, -1.0253623723983765, 1.8055856227874756, -1.2915111780166626, 2.348266839981079, 1.1229572296142578, 0.10846365243196487, -3.6355996131896973, 0.5546815991401672, -4.654440879821777, -0.6421487331390381, -3.0278685092926025, -2.867966890335083, -0.6417133212089539, -0.16655917465686798, -3.450296401977539, -0.7937993407249451, 0.5898528695106506, -2.2386786937713623, 2.9741051197052, 1.339334487915039, -0.6514186263084412, 2.0515005588531494, 0.3516179025173187, -0.9486892819404602, -1.0090086460113525, 0.6849254965782166, -1.6117932796478271, 0.5698704719543457, 0.9454623460769653, -0.10806802660226822, -0.028700638562440872, 2.1129589080810547, -0.7664430141448975, 3.493565559387207, 2.277860641479492, 0.43103259801864624, -0.7954084277153015, -0.45603346824645996, -0.08248656988143921, 1.7076635360717773, -1.6586490869522095, 0.23354007303714752, 1.2805887460708618, -0.6881493330001831, 0.47190213203430176, -0.2762589454650879, 1.2222782373428345, 0.2796950340270996, -2.0277211666107178, 3.638150930404663, -2.135806083679199, 2.349430799484253, -4.51079797744751, 0.8877189755439758, 6.042593479156494, 4.425210475921631, 0.31864118576049805, -2.21217942237854, 2.2608113288879395, -1.1744673252105713, 1.1684428453445435, 0.3420531749725342, -1.0366369485855103, -1.0127311944961548, -1.166195034980774, -0.264197438955307, 0.9961564540863037, 0.323848158121109, -0.25178733468055725, -4.579461574554443, 5.1684651374816895, 1.79317045211792, -1.1832327842712402, -0.1807108372449875, -3.895479440689087, -0.4131743609905243, 0.4652029871940613, 7.835202693939209, -1.1595900058746338, -1.9003138542175293, 1.7877007722854614, -1.2662034034729004, -0.09854788333177567, -0.3883928656578064, -7.287370681762695, 3.667846441268921, -0.9919368028640747, 0.24373267590999603, 1.3886449337005615, 0.9123986959457397, 0.20600004494190216, 0.06547829508781433, 2.691607713699341, -0.21633510291576385, -0.38329410552978516, 1.4984630346298218, 0.5484828948974609, 1.2277079820632935, 1.3605073690414429, 1.0617624521255493, 1.6541001796722412, -3.382378101348877, 2.567620038986206, -2.9945969581604004, -0.15206611156463623, 2.4816489219665527, 1.1608166694641113, 2.0143792629241943, -0.17348000407218933, 1.2482471466064453, -3.5860490798950195, 2.390685796737671, 1.7716898918151855, 1.6533682346343994, 0.6247808933258057, 1.010632038116455, -6.2842535972595215, 2.7807137966156006, 1.0555744171142578, -0.8460332155227661, -0.21186766028404236, 3.3283729553222656, 1.585921049118042, 2.437859535217285, 0.6931448578834534, -1.2054883241653442, 4.639156818389893, 0.1083696186542511, 3.1426844596862793, -0.4508814215660095, 1.0100650787353516, -2.0203123092651367, 0.5920539498329163, -0.23498451709747314, 2.3935446739196777, -0.2516234219074249, 2.5892913341522217, -4.157615661621094, -1.2084118127822876, 4.121028900146484, 2.126889228820801, -7.720630645751953, -1.5864404439926147, 1.4380946159362793, 0.2759478986263275, 0.5595775842666626, 1.78251314163208, -3.7740933895111084, 2.2429065704345703, -2.6186399459838867, 1.3426378965377808, -5.023711204528809, -1.9554263353347778, 2.0357346534729004, 3.2912678718566895, 0.8752732872962952, 1.3105992078781128, 4.317091941833496, -2.599243640899658, 2.139681339263916, 2.044283390045166, 2.4469966888427734, 0.8667670488357544, -0.9687913656234741, -0.1394311636686325, -1.0836305618286133, -0.3886713981628418, 1.8284778594970703, -0.823431670665741, 0.47136932611465454, -2.7638113498687744, -1.2559083700180054, 0.02866676077246666, -0.28781163692474365, 0.10259942710399628, -0.13134489953517914, 1.3004626035690308, -0.6438793540000916, 1.9256572723388672, -1.2391602993011475, 0.20152561366558075, -0.9481260180473328, 2.111696481704712, -1.5989331007003784, 0.7208812832832336, -1.7750318050384521, -2.3928825855255127, 2.1840922832489014, 1.3893780708312988, 1.6998844146728516, -0.1922273337841034, -8.971657752990723, -0.9873470067977905, 2.007349967956543, -0.22541534900665283, -0.5809320211410522, 4.992176532745361, 1.8170965909957886, 1.9098560810089111, 2.8335773944854736, 0.7733706831932068, -2.845320463180542, 0.9251722693443298, -3.1696560382843018, 0.2922274172306061, -3.9364640712738037, -0.1688007265329361, -0.6000857949256897, 4.981055736541748, 0.016525806859135628, -0.9914820194244385, -1.2189643383026123, 3.042454242706299, 3.1922268867492676, -3.612807273864746, -1.3446154594421387, -1.1116658449172974, -2.3935282230377197, -3.0040173530578613, 1.156960129737854, 8.931266784667969, -2.8200531005859375, 3.1291069984436035, -0.2172153741121292, -2.545248031616211, 0.38167017698287964, 2.3774607181549072, 1.8678227663040161, 0.45667481422424316, -3.944322109222412, -0.9412893056869507, 2.008579969406128, 0.04658455401659012, 0.5057538151741028, 2.7840840816497803, -0.7066482305526733, -2.3209893703460693, 0.6556432843208313, -0.5718920826911926, -0.9998102188110352, -1.5913628339767456, 1.662937045097351, -1.2158375978469849, 2.3553059101104736, 0.6069485545158386, 0.6065371036529541, -0.34541055560112, 3.669328212738037, 0.7335911989212036, -2.3117082118988037, -2.910933256149292, -3.7470932006835938, 0.8560271859169006, 0.9027539491653442, 3.726378917694092, -2.3590598106384277, -2.798882484436035, 1.2223103046417236, -2.194977045059204, 2.2480030059814453, -0.7471742630004883, -0.13222470879554749, 0.6265264749526978, 1.9396625757217407, -1.68454909324646, -2.4099297523498535, 1.755069613456726, 5.170214653015137, -2.663236618041992, 0.48841914534568787, 1.2020063400268555, 2.8858320713043213, 6.340968608856201, -2.778583526611328, 2.714036464691162, 0.3965836465358734, 6.065841197967529, -11.787812232971191, 0.8034173846244812, 1.1457864046096802, -0.5998978614807129, 0.20396718382835388, -0.6821736693382263, 1.0649672746658325, -2.2056167125701904, -3.083397150039673, -0.564154863357544, -0.07066323608160019, -1.5898175239562988, -1.0068533420562744, 2.1032211780548096, -0.008581727743148804, 0.7641226649284363, -1.0521985292434692, 0.3103034794330597, -1.0028390884399414, 3.6572153568267822, 0.8466099500656128, -1.9013910293579102, 2.57255220413208, 0.12370794266462326, -1.1825006008148193, -1.4730757474899292, 1.7853822708129883, -1.078636884689331, -4.4882073402404785, 2.8728175163269043, 1.142884612083435, -0.2284722775220871, -0.5572024583816528, 3.4876043796539307, 1.4424128532409668, -1.0775549411773682, -2.7868144512176514, -2.5481228828430176, -2.5063586235046387, -6.6909565925598145, 1.6144496202468872, 0.46227070689201355, -1.7164525985717773, 2.900507926940918, -2.15141224861145, 0.8296266198158264, 1.196572184562683, 2.0440402030944824, -1.478469967842102, -1.4952293634414673, -1.2604116201400757, 1.660720944404602, -1.5933164358139038, -2.1480607986450195, 0.7711711525917053, -2.3993406295776367, -0.06966866552829742, 2.059946298599243, -0.4566715359687805, -2.786612033843994, -0.17776893079280853, -2.242995500564575, -1.2581150531768799, 1.5545164346694946, -1.27358078956604, -2.3586783409118652, 1.9385241270065308, 0.6924269199371338, 4.487100601196289, 1.8668091297149658, -1.3038583993911743, -0.5718802809715271, -3.406736135482788, -1.8740988969802856, -2.579559087753296, 3.5575191974639893, -1.9012168645858765, -0.6446453332901001, -3.706104040145874, -1.274909496307373, 1.0854158401489258, 4.938322067260742, -0.034317463636398315, 1.0041160583496094, 3.406726598739624, 0.11912145465612411, 0.7376524806022644, -0.5364018082618713, -5.205355167388916, -1.0971821546554565, 1.9131735563278198, -2.839462995529175, 0.31031131744384766, -1.8573670387268066, -0.8996046185493469, -2.4299445152282715, 1.8416870832443237, 2.803520441055298, -0.5805333256721497, -3.6960997581481934, -0.44925570487976074, 3.5367813110351562, -0.09617689996957779, -0.6000037789344788, -2.3268606662750244, 3.1169939041137695, -2.785689353942871, -3.7839083671569824, 1.1033016443252563, 2.789825201034546, 4.187553405761719, -1.4831428527832031, 1.2709972858428955, 0.27063480019569397, 0.6509571671485901, -1.13896644115448, 0.37703800201416016, -2.9458916187286377, 2.3231711387634277, 2.843731641769409, -1.5839462280273438, 1.301965594291687, 1.0808913707733154, -0.09253580868244171, 2.5825629234313965, -2.641355037689209, 3.967339515686035, 0.16500918567180634, 1.1113405227661133, -0.3417763411998749, 5.666118144989014, -4.310584545135498, 1.2457000017166138, 3.3009891510009766, 2.7098779678344727, 2.898106098175049, 0.2768726050853729, 1.1578888893127441, -1.2840030193328857, -2.37660813331604, 0.5253475904464722, 1.6571922302246094, -3.323050022125244, 0.9949317574501038, -1.4239201545715332, 0.9542580842971802, 0.6072998642921448, -10.661696434020996, -0.23642340302467346, 1.4909578561782837, 0.5756940245628357, 1.3008942604064941, -2.070050001144409, 2.3093905448913574, 0.7659512162208557, 5.448395252227783, -1.1824164390563965, -0.43276455998420715, -0.025600099936127663, -5.757782936096191, -1.9699561595916748, 3.3015270233154297, -1.67880117893219, 3.273810863494873, -1.3143211603164673, 2.4338598251342773, -1.2256782054901123, 1.060526967048645, 2.42153263092041, -2.184488534927368, -2.4942080974578857, -2.2626547813415527, -1.8657258749008179, -0.11283643543720245, -2.3165695667266846, -0.7247585654258728, -0.4328407049179077, 1.9608774185180664, -2.3054418563842773, -0.30193960666656494, -0.4817558228969574, 1.0177124738693237, 4.7339277267456055, 4.79755163192749, -0.9943634271621704, -1.8012257814407349, 2.0729146003723145, -0.39120686054229736, -4.84207820892334, -0.3163617253303528, 0.9298372864723206, -2.6393449306488037, -2.262521266937256, 3.1610026359558105, -1.3447810411453247, -2.328961133956909, -1.170893907546997, -2.5291669368743896, -0.16013331711292267, -3.787527322769165, 2.2011194229125977, 2.070230722427368, 0.8022129535675049, 3.5476224422454834, -0.9972091913223267, 1.0731102228164673, 0.2406175583600998, -3.7186801433563232, -2.944087028503418, 12.510017395019531, -2.298562526702881, -1.5660927295684814, 0.35169124603271484, 2.3065826892852783, 1.8930768966674805, 1.3475706577301025, -4.768709182739258, 2.1381618976593018, -1.0250808000564575, 1.187092900276184, -0.7073611617088318, 0.4088502824306488, -1.0477856397628784, 9.250051498413086, -2.636702537536621, -3.23117733001709, -0.6294367909431458, -0.9858583211898804, 3.7684643268585205, -0.30768242478370667, 1.931359052658081, 0.6786062121391296, -0.3412635922431946, -0.20887453854084015, 1.0598642826080322, 1.1156891584396362, 4.407458305358887, 2.8946399688720703, -0.5846690535545349, -2.0223982334136963, -4.016970157623291, 1.6537903547286987, 2.9167609214782715, 1.9771865606307983, 1.4950798749923706, 1.4532934427261353, -1.1817007064819336, 0.41118326783180237, 2.620554208755493, 0.2350606769323349, -1.4991718530654907, 2.121272325515747, -1.038002848625183, -5.066666126251221, 0.050933837890625, -1.3453444242477417, -2.6591131687164307, -7.549269199371338, -3.233358860015869, -2.9078307151794434, -0.42613792419433594, -2.6183643341064453, -0.6673247814178467, -0.878889262676239, 2.7374439239501953, -1.421223521232605, -4.577195644378662, 0.2979596257209778, -0.9093871712684631, -1.2072086334228516, -6.008236408233643, -2.6960959434509277, -0.7583881616592407, -1.5450191497802734, 0.6690940260887146, 0.4044799208641052, 0.6745807528495789, -1.5859040021896362, 1.2908393144607544, 1.131693959236145, -1.950098991394043, -10.564895629882812, -0.8293746709823608, -1.8180145025253296, 1.0544989109039307, 2.9771780967712402, -2.0215115547180176, 0.7161983251571655, -2.942410469055176, -4.577591896057129, -0.4214494526386261, -3.7902565002441406, 2.4193687438964844, 0.6361039876937866, -1.1446858644485474, 0.21051979064941406, -1.8156347274780273, 3.1779873371124268, -0.12834787368774414, 0.7596103549003601, 0.20441102981567383, 2.763517379760742, 0.4530889093875885, -2.5710699558258057, 0.1512860506772995, -0.02258237637579441, 9.799036026000977, 1.1878324747085571, 1.8333076238632202, 1.8810205459594727, 0.6084635853767395, -1.1707195043563843, 0.9980959296226501, 2.7834432125091553, -1.297623872756958, -4.611412525177002, -0.9295774698257446, -0.835878312587738, 1.9822056293487549, -2.5864131450653076, 5.412862300872803, -2.9803972244262695, -1.6079275608062744, -3.734367847442627, 0.7598934173583984, 1.213516116142273, -0.9531375765800476, 1.9202756881713867, 0.8468578457832336, 2.6616971492767334, -0.32624712586402893, 1.1421434879302979, -3.983919620513916, -0.578429102897644, 0.11419153958559036, 1.5656777620315552, 3.2403104305267334, -0.43378111720085144, 1.1904046535491943, 0.5534138679504395, -0.09146038442850113, -1.6978938579559326, -5.417703628540039, 5.01988410949707, 1.4788066148757935, 2.5310444831848145, -0.1241249293088913, -0.4195098876953125, -5.323048114776611, -1.8477500677108765, -0.5748777985572815, -1.424595594406128, 0.7868162393569946, -1.83393394947052, -0.39235591888427734, 0.7389166951179504, -1.6374051570892334, 1.291599988937378, -1.151351809501648, -1.0876537561416626, 1.5390212535858154, 1.9445961713790894, -2.0906741619110107, -2.9865641593933105, 0.5297666788101196, -1.1678122282028198, 0.6290494203567505, 0.9166114926338196, 0.16268564760684967, 0.7838320732116699, 1.9534083604812622, -5.0189619064331055, 3.324213981628418, 0.9608350396156311, -0.35929685831069946, -0.6919776201248169, -1.4354023933410645, -0.6564591526985168, 1.1632227897644043, 0.5027574300765991, -0.7255263924598694, 3.6508948802948, -0.31847161054611206, 2.6922011375427246, 1.4939284324645996, -2.463646411895752, -0.31220123171806335, 3.211639165878296, -1.2100868225097656, -2.1848223209381104, 3.2432515621185303, -0.16251502931118011, 3.7923989295959473, 0.47213074564933777, 0.9155093431472778, -0.9361506104469299, 0.45228344202041626, -0.6302608847618103, -0.04587806761264801, -6.955352306365967, -0.699816107749939, 0.7887070178985596, 0.09700246155261993, 2.2844038009643555, 1.7729377746582031, 1.6180263757705688, 3.2293708324432373, -3.9025721549987793, -4.016733169555664, 1.814159870147705, 0.13299377262592316, -4.487119674682617, -1.5182322263717651, 3.259679079055786, -0.5491212010383606, -2.551727056503296, 3.2993810176849365, -1.070789098739624, -0.024800393730401993, -0.01206043642014265, -0.30373615026474, -0.5667331218719482, -1.516832709312439, 2.1284308433532715, -1.258467435836792, 0.3798469007015228, -7.20203971862793, -2.153857946395874, -1.283748984336853, -0.28266027569770813, 0.7459697723388672, -0.21141491830348969, 0.5616667866706848, -1.8301448822021484, 0.16450774669647217, 2.7450413703918457, 1.4470173120498657, 0.6773435473442078, -2.419020175933838, 0.740720272064209, 2.870666265487671, 8.702858924865723, -3.0582542419433594, 1.7906231880187988, -1.0752243995666504, -0.22802044451236725, -1.750667691230774, -1.0831588506698608, 0.410448282957077, 0.9831854104995728, 0.33229541778564453, 1.9927160739898682, -1.5814090967178345, 0.22703726589679718, -1.664965033531189, -2.8510639667510986, -0.9418948292732239, -4.0177178382873535, 0.48390722274780273, -0.4202764332294464, -0.08631628006696701, -4.478215217590332, 2.510772228240967, 1.8811125755310059, -0.8276928067207336, 5.471214771270752, 2.219226121902466, 0.6631379127502441, -1.7687164545059204, -1.8140149116516113, -1.6307352781295776, 4.10972785949707, 1.5442053079605103, 0.4631717801094055, 2.6138174533843994, -0.0020172882359474897, -0.15769486129283905, 0.34808608889579773, -0.1203898936510086, -1.9554212093353271, -1.9864252805709839, -1.5510597229003906, 0.34012341499328613, 0.6644759774208069, -0.4626784920692444, -0.5139544010162354, -2.980306625366211, 0.955170750617981, 2.0580320358276367, -4.214272975921631, -0.25895896553993225, 3.4092297554016113, -3.859855890274048, 4.0082688331604, -0.2759658396244049, 4.061126232147217, -0.16366933286190033, 0.707851231098175, 1.0982544422149658, -2.33379864692688, -0.7612348198890686, 2.6705868244171143, 1.2352789640426636, 0.8800400495529175, -1.9398682117462158, 1.0234628915786743, -1.788962721824646, 1.7956181764602661, 0.07625560462474823, 2.085361957550049, -3.3227264881134033, 0.7864394783973694, -2.1350979804992676, -0.15054906904697418, -1.2170214653015137, 1.1155805587768555, 3.2004079818725586, -1.2918903827667236, -0.20488430559635162, -4.637441635131836, -0.5489848256111145, 2.0769290924072266, -1.9094293117523193, 2.0157270431518555, -1.91693115234375, -5.100884437561035, 0.1441098153591156, 2.8491992950439453, 4.721612453460693, 3.4444668292999268, -1.8479762077331543, 0.9114598631858826, -1.3145253658294678, -1.2642245292663574, -1.8567110300064087, 0.503128707408905, -0.5900328159332275, 3.0174896717071533, -2.4958083629608154, -0.7924434542655945, 2.232632875442505, -0.8212334513664246, -3.046842336654663, -0.3621848225593567, 3.021644115447998, 0.01460407953709364, -2.7532472610473633, 0.40820926427841187, 1.7525098323822021, 1.5049467086791992, 0.9178628921508789, 1.7789554595947266, 1.3679965734481812, -2.053455352783203, -0.9078307151794434, 1.561583161354065, -1.2780026197433472, -2.0162928104400635, -0.7662555575370789, -0.6932178735733032, -4.127883434295654, -2.2648603916168213, 0.9696303009986877, 0.983005702495575, -3.870774507522583, -2.351198673248291, -0.5916604995727539, -0.32393768429756165, -0.043161991983652115, -2.5871853828430176, -3.8555800914764404, 0.6257693767547607, -0.2445283681154251, -2.6337292194366455, 1.682175636291504, 0.04976877570152283, -1.1722378730773926, 1.1840118169784546, 4.9788594245910645, -0.31173667311668396, -4.76590633392334, 0.09379472583532333, -0.6413598656654358, -3.7080564498901367, -2.5734670162200928, 0.23744319379329681, 2.1088411808013916, 1.2114840745925903, 0.9559599161148071, 0.7978425025939941, -2.2832376956939697, -1.23482346534729, -0.39267781376838684, -2.8191776275634766, 2.512301445007324, -0.38477984070777893, 0.7921768426895142, 1.702121615409851, 0.9719135165214539, -2.3410749435424805, 0.2567425072193146, -0.5905325412750244, 0.40070340037345886, 0.7265986800193787, -1.7549989223480225, -0.5580612421035767, 2.957824468612671, 6.705124855041504, 0.644254744052887, -3.2392475605010986, -4.986215591430664, 0.4677744209766388, 1.2718844413757324, 0.2714749574661255, -3.1971120834350586, 2.548825979232788, -2.666994094848633, -0.0012752908514812589, -0.08835110813379288, -5.509708404541016, 1.6634823083877563, 0.24641068279743195, -0.4688394069671631, -4.486588954925537, -0.8322016596794128, -2.3209009170532227, 0.5739090442657471, 1.5602891445159912, 0.3938969373703003, -1.1755297183990479, -1.3784135580062866, -1.6176286935806274, 2.652129888534546, 1.19441556930542, -0.5405601859092712, 0.36420518159866333, -1.1010218858718872, 0.5610994100570679, -4.707846641540527, -1.2780486345291138, -1.683534860610962, -3.0418286323547363, 1.1373423337936401, -1.17726731300354, 1.7790638208389282, -0.9131358861923218, 0.6240704655647278, -3.222696542739868, -2.5817410945892334, -1.0689915418624878, -2.532665491104126, -0.777873158454895, 2.330639600753784, -1.2706598043441772, -1.7521923780441284, 1.8605506420135498, 3.3315658569335938, -1.6655093431472778, -2.9681248664855957, -0.22121760249137878, 0.24475058913230896, 3.342764139175415, -0.3866404891014099, 0.2634011209011078, -0.3892625868320465, 0.849992036819458, 0.7544712424278259, -0.5174570679664612, -0.3555733859539032, -0.2621435523033142, 2.404741048812866, 2.6200404167175293, 0.884440541267395, -2.2806262969970703, 1.800385594367981, -2.5086934566497803, -4.611011028289795, 1.138973355293274, 0.12278850376605988, 0.3085995614528656, -1.4484553337097168, 5.512558460235596, 1.2924104928970337, 2.4474823474884033, -0.792114794254303, -4.298117637634277, 2.1162238121032715, 2.2046806812286377, 0.890233039855957, -0.4661184251308441, 2.583246946334839, -0.9042239189147949, 2.5919747352600098, 1.8273158073425293, -1.441765308380127, 1.058531403541565, 1.0542271137237549, -2.1779062747955322, -0.16736172139644623, -6.223123550415039, -1.090970516204834, 0.06372695416212082, -1.4100455045700073, -0.22143085300922394, 0.10294591635465622, -2.398212432861328, 0.37462466955184937, 0.8141704201698303, -1.6830960512161255, 2.619887113571167, 1.928707242012024, 0.6894463896751404, 0.9886108636856079, 1.8084213733673096, -0.9344422221183777, 1.790684461593628, -1.4789283275604248, -1.4110089540481567, 0.26827478408813477, -0.9703308343887329, 0.12055669724941254, -5.075197219848633, -1.2177296876907349, -0.6823002696037292, -1.4584848880767822, -0.20850791037082672, -1.3358060121536255, -0.5745410919189453, -0.8894801735877991, -3.5526833534240723, 0.1849609762430191, -0.7089292407035828, -1.0615671873092651, -1.9903374910354614, 2.2468788623809814, 0.7088488340377808, 3.2480363845825195, 0.692319393157959, -0.8905009627342224, 1.1062148809432983, 7.321426868438721, 1.4435876607894897, -3.9508280754089355, -2.602041244506836, -0.7143267393112183, 0.7181946635246277, -2.117581844329834, 1.1335607767105103, -0.2381308674812317, 0.26734644174575806, -3.094697952270508, 1.5443425178527832, 0.6815630793571472, 2.3725836277008057, 2.1262056827545166, 1.6833932399749756, 3.1369898319244385, 0.22501713037490845, 0.01502442266792059, -2.582103729248047, -1.2022837400436401, 1.771978497505188, -0.8031330704689026, -1.5578391551971436, 1.8515056371688843, 1.1004581451416016, 3.8136022090911865, 2.1532788276672363, -3.457136631011963, 0.18099626898765564, -0.2848474979400635, 1.221053957939148, 2.8015074729919434, -0.3335840106010437, 0.5462377071380615, -0.45215925574302673, -2.289963483810425, 0.07216161489486694, 1.7351986169815063, 1.458738923072815, -1.5319416522979736, 1.0984258651733398, -3.2769935131073, -0.12339019030332565, 2.101783037185669, -10.395681381225586, -0.007650176528841257, -1.4347728490829468, 2.2570619583129883, 1.2943730354309082, 1.9421950578689575, 0.6884933710098267, -0.19417615234851837, -0.11739306151866913, -0.6025469899177551, 1.1343588829040527, 3.3539066314697266, 2.1059820652008057, -0.2766933739185333, 0.18031753599643707, 2.230374336242676, -2.5740599632263184, 1.2767438888549805, 0.9364815950393677, -2.166224956512451, 1.0652506351470947, 1.5096004009246826, 0.6872370839118958, -1.4540482759475708, -2.0633604526519775, -0.4367252588272095, -2.399052381515503, -1.282071590423584, -0.044155512005090714, 2.48884916305542, 0.023437438532710075, 0.8073763251304626, -2.8832268714904785, -8.07063102722168, -0.3965567648410797, 0.7023154497146606, -1.8586671352386475, -0.8421910405158997, -0.1611238270998001, 2.5079379081726074, -4.007284164428711, 1.6155879497528076, -5.157525062561035, -0.3624225854873657, 1.2320910692214966, 0.6480355262756348, -0.014505828730762005, 2.4554195404052734, -1.989598035812378, -0.5162073969841003, 3.6845650672912598, 1.6853426694869995, -0.8387237787246704, 1.3507075309753418, 2.0365657806396484, -3.046884536743164, 2.6776187419891357, 1.2818331718444824, 0.8351423144340515, 1.3083134889602661, -1.2438671588897705, 1.5654478073120117, 0.7088436484336853, 0.5027146339416504, -0.1130550429224968, -1.413216233253479, -0.6483591794967651, 1.0834083557128906, 1.891887903213501, 0.5030806660652161, -1.1554231643676758, 0.2658778429031372, 0.834608793258667, -1.427506685256958, 4.739391803741455, -0.9727756977081299, 1.5138412714004517, 0.9154967069625854, -2.2378926277160645, 0.3499266505241394, 0.8613677620887756, 13.716211318969727, -0.024663135409355164, -2.62848162651062, 0.8786887526512146, -0.8232128024101257, 3.001176357269287, -0.5639929175376892, -1.259843111038208, -1.0307694673538208, -0.9894213676452637, 3.1511151790618896, 1.4428691864013672, 1.5179673433303833, -1.2720630168914795, -2.0126101970672607, 1.0964728593826294, -0.050848767161369324, -0.40940308570861816, -0.6419931054115295, 0.17953501641750336, 4.002809524536133, -0.08484639972448349, -0.3918556272983551, -3.66619610786438, 1.2439440488815308, 0.8560100197792053, 0.9869580864906311, -1.4466854333877563, 1.566542625427246, -0.44180577993392944, 0.5210701823234558, 0.026366224512457848, -0.2625639736652374, -1.0335851907730103, 4.082411289215088, 3.9162745475769043, -1.8949956893920898, 1.4772109985351562, 1.5810624361038208, -2.734541177749634, -1.2242658138275146, 2.1986517906188965, -2.4386746883392334, -0.7827430963516235, 0.43202123045921326, -3.3882668018341064, 1.3284215927124023, 4.130292892456055, 0.5116564631462097, -2.386350393295288, 0.7615227103233337, 2.6928112506866455, 2.741827964782715, -1.6699600219726562, 2.041027545928955, 2.135084629058838, -0.7697069048881531, 6.2188401222229, -0.37027469277381897, -1.442643404006958, 2.624312162399292, -3.1849844455718994, -3.578702449798584, -1.9616942405700684, -0.6366727948188782, -0.40032699704170227, 1.9600207805633545, 0.725960373878479, -0.40329742431640625, 0.6876182556152344, -3.0081446170806885, 1.7669646739959717, 0.4953126907348633, -3.816932439804077, -0.00906843226402998, 0.019090967252850533, 1.090166449546814, -1.9998998641967773, 1.3356420993804932, -2.701986789703369, 0.9503477811813354, -1.21523916721344, 1.5391088724136353, 4.086294651031494, -0.5681966543197632, 1.5586626529693604, 0.23215630650520325, -2.8759684562683105, -1.190187931060791, -1.4921268224716187, 1.31522798538208, 3.783092737197876, -1.0239709615707397, -2.1388111114501953, 0.5641912817955017, 0.3231648802757263, -5.408095836639404, -1.249610424041748, -1.656131625175476, -1.9331467151641846, -3.783811092376709, -1.2231287956237793, 0.20508044958114624, 1.4017202854156494, -1.323378086090088, 0.6841934323310852, 1.7025094032287598, -2.297074556350708, 1.0002022981643677, -0.13914304971694946, -0.26943346858024597, 3.2101919651031494, -2.214017391204834, 0.6172571778297424, -4.220190048217773, -2.7363808155059814, -1.8922712802886963, -0.47356274724006653, -1.6204299926757812, 1.0750973224639893, 0.5907970070838928, 0.33106160163879395, -1.2776787281036377, 1.044416069984436, 3.5759923458099365, 2.5081899166107178, 3.947270393371582, -0.3815639019012451, -0.34801962971687317, 1.3628497123718262, -0.12517859041690826, 0.19083663821220398, 1.3875478506088257, 4.682065963745117, -2.2389187812805176, 0.43245580792427063, 0.3070617616176605, -0.009348197840154171, 6.818076133728027, 2.928586006164551, -4.066124439239502, -1.0997172594070435, -1.5741344690322876, -0.12388645857572556, -1.163758397102356, -1.7312763929367065, -0.6819502115249634, 0.6570924520492554, 1.0236763954162598, -1.2241543531417847, 1.2495362758636475, 0.7123939990997314, -0.9497723579406738, 0.9842475056648254, -0.5749776363372803, 0.05570518597960472, -1.5516078472137451, -1.2821515798568726, 0.7456982731819153, 1.931745171546936, -2.810570001602173, 2.2908318042755127, 0.41322678327560425, 0.36725518107414246, -1.9216513633728027, 2.8667283058166504, 0.1822109818458557, -0.24910838901996613, 2.283859968185425, -1.9310730695724487, -3.3634865283966064, -0.6532301306724548, -4.70237922668457, -1.12579345703125, -2.040825366973877, -3.3832974433898926, -1.0839720964431763, 3.3403565883636475, 3.822727680206299, 0.5342526435852051, 1.1357072591781616, 1.5592999458312988, -3.3333420753479004, 3.5327913761138916, -2.5539679527282715, -1.5175338983535767, -0.3708907663822174, -12.463946342468262, -0.9213336706161499, 2.2293319702148438, 1.398068904876709, 2.462724447250366, -0.7464604377746582, -1.5133693218231201, -0.36755022406578064, -3.2392663955688477, 0.6240562796592712, -0.7729895114898682, 0.5558847188949585, -0.8303931355476379, 1.1528762578964233, 0.5230839252471924, -0.1472703218460083, 3.449622392654419, 0.12665943801403046, 2.9168496131896973, -3.3318188190460205, -0.9287435412406921, -1.3577803373336792, -5.711543560028076, 2.883948802947998, -1.0756027698516846, 0.5378207564353943, -1.8930484056472778, -3.206451416015625, -2.2132697105407715, 5.058618068695068, -1.804747462272644, -0.2282872200012207, 1.4655096530914307, 0.8955243229866028, 0.301523357629776, 6.466285228729248, 1.945784091949463, 0.45523086190223694, -3.502366781234741, -0.11891143769025803, -0.6262398362159729, 0.8484516143798828, -0.32931259274482727, -0.42028892040252686, 1.675168752670288, -0.38432446122169495, 0.4947401285171509, -0.3949742913246155, -1.3229141235351562, 1.9281558990478516, 1.6107319593429565, 0.16650919616222382, 1.4470117092132568, -1.3005725145339966, 1.9273335933685303, 3.0863685607910156, -1.5995413064956665, 2.5314512252807617, 0.10245386511087418, 4.309769630432129, -4.0902252197265625, -0.31487390398979187, -4.544051647186279, 2.5837345123291016, 4.418003082275391, 1.5204626321792603, -0.4228420853614807, 2.013505697250366, 1.5680060386657715, -2.989995002746582, -1.3916229009628296, 0.1875404417514801, 0.9286680817604065, -0.0395982526242733, -1.1284763813018799, 0.4437063932418823, -0.8143901824951172, -0.8134555816650391, -1.6235551834106445, -1.6263840198516846, 1.9525787830352783, 1.1034938097000122, -8.717255592346191, 1.4937522411346436, -0.349617063999176, 1.0715340375900269, 2.147158622741699, -3.0903687477111816, -0.8252754807472229, 3.0069046020507812, -0.6979692578315735, -0.48904767632484436, 4.265597820281982, -1.8104647397994995, -0.6100952625274658, 0.8066357374191284, -1.1512173414230347, 1.5316277742385864, 0.1252065747976303, 3.1174588203430176, 2.542187213897705, 2.991629123687744, -5.110601425170898, -0.48710957169532776, -1.9535632133483887, 0.7153872847557068, 0.12419969588518143, -0.2656199634075165, 0.5092053413391113, -2.609516143798828, -1.8370811939239502, -5.229562759399414, -2.5335469245910645, 3.8033509254455566, -0.284759521484375, 3.5861053466796875, -1.6900355815887451, 0.6565672755241394, 3.486699342727661, -1.729464054107666, 1.8654218912124634, 1.2440614700317383, 1.4933671951293945, -0.9785898923873901, -3.079610586166382, 2.4139516353607178, -0.29621121287345886, 3.7440061569213867, 0.7092859148979187, 1.7413740158081055, -0.9076554775238037, 1.6674847602844238, 1.287865161895752, -2.2960543632507324, 1.7715214490890503, -0.2641471028327942, 8.167329788208008, -2.0263044834136963, 0.5593990087509155, 0.39249324798583984, 1.0601530075073242, -0.4858159124851227, -4.683915138244629, -0.5213146805763245, -1.7416198253631592, -2.990283966064453, -1.2409173250198364, 0.7051007747650146, 0.11596938967704773, 0.9516615867614746, 0.19274798035621643, 0.8495862483978271, -0.9856677055358887, -0.9277161359786987, 3.4419617652893066, 14.472667694091797, -2.2102131843566895, -1.6442638635635376, -1.7681670188903809, -0.4131341874599457, -1.1363463401794434, 2.4251184463500977, -0.43746712803840637, 3.972994089126587, -0.1318419873714447, -1.056019902229309, 1.7555656433105469, 2.7997663021087646, -4.304599761962891, 2.1411452293395996, 1.0004128217697144, 3.67427134513855, -1.657857894897461, -2.586104393005371, 0.4810795485973358, 0.6908578872680664, -3.168255090713501, -0.5378316044807434, 14.570016860961914, 3.1249186992645264, -0.12121376395225525, 1.0846680402755737, -2.9557368755340576, -5.034856796264648, -5.1041998863220215, 2.0942912101745605, -0.8606932163238525, 0.8112332224845886, -2.9160313606262207, -1.7898685932159424, -0.7321101427078247, 4.394458293914795, -2.727302312850952, -1.7645714282989502, 3.308013439178467, 0.3768421709537506, 0.600409746170044, 1.5649691820144653, -1.619080662727356, -1.0917795896530151, 1.391066074371338, 3.523925542831421, -0.25520578026771545, -1.4525595903396606, 0.41161012649536133, -1.264905571937561, 1.1050399541854858, -4.535818576812744, 1.979875922203064, -3.202632427215576, 2.1728172302246094, -0.11758963018655777, 0.2337736189365387, -0.9971612691879272, 3.386942148208618, -0.8723754286766052, 0.3580930233001709, 0.8906329870223999, 1.4193137884140015, -0.6854945421218872, 1.086416482925415, -1.4884363412857056, -0.9165447354316711, -1.6670769453048706, -2.1550588607788086, 0.6295282244682312, 5.916707992553711, 5.086348533630371, 1.2870584726333618, -4.202667236328125, 0.38834086060523987, -3.4828455448150635, 1.1609498262405396, 3.0407660007476807, 0.6540374755859375, 1.7353816032409668, 0.19802501797676086, -0.6163817644119263, 1.9317697286605835, 1.6042762994766235, -3.665048599243164, 0.7768906354904175, 3.366405963897705, 3.4709341526031494, -6.443081378936768, -2.0661282539367676, 4.324657917022705, 0.6470865607261658, 4.231536388397217, -0.30135443806648254, 1.7501721382141113, -0.2890607416629791, 1.2070163488388062, 0.3844335973262787, 2.8388705253601074, -0.5520831346511841, -1.3708150386810303, 1.511051058769226, -0.2419203668832779, 1.6756776571273804, 0.828872799873352, -0.6272377967834473, -1.0207611322402954, -1.5887625217437744, 0.6566981673240662, 1.913051724433899, -0.11921954900026321, -1.587217092514038, 3.205491065979004, 2.963395595550537, 0.25447648763656616, 3.3500895500183105, 0.0011852560564875603, -0.20465822517871857, 1.445924162864685, -1.3199782371520996, 1.8639761209487915, 1.0131362676620483, -1.0631523132324219, 0.4349328875541687, -0.1496729850769043, -1.2207533121109009, -11.034804344177246, -2.9236109256744385, 0.397918164730072, -4.915587425231934, 2.047562599182129, 3.2327003479003906, 1.705835223197937, -1.1656087636947632, -3.022463083267212, 1.3008933067321777, -0.26006388664245605, 1.7835063934326172, 2.347099781036377, -3.3509907722473145, -1.6843963861465454, 0.21283820271492004, -2.8408877849578857, -0.7590367794036865, -0.8653252124786377, 0.2704552710056305, -6.379304885864258, -0.36488816142082214, -2.667449951171875, -0.7147334218025208, -0.26092538237571716, -10.47561264038086, -0.12957844138145447, 1.1993448734283447, -2.9925973415374756, 3.278733015060425, 2.8640387058258057, -3.526357889175415, 0.7499355673789978, 4.841008186340332, -1.0102190971374512, 0.23530183732509613, 0.12328588962554932, 2.639430284500122, 1.1267786026000977, -1.5553920269012451, -0.02911207638680935]