Ollama

Ollama Ollama

Ollamalink image 22

Ollama is a software based on llama.cpp for LLM inference.

llama.cpp is a library for LLMs inference in C/C++, so Ollama has been built on top of it making it easier to use for any kind of user. That is, it is a wrapper to be able to use llama.cpp with a Python, JavaScript and terminal API.

This notebook has been automatically translated to make it accessible to more people, please let me know if you see any typos.

Installationlink image 23

To install ollama on windows or mac you have to download an installer from their [downloads] page (https://ollama.com/download), however, if you use linux, as in my case, you have to run the following command

curl -fsSL https://ollama.com/install.sh | sh
      

Runlink image 24

To run an LLM it is enough to execute ollama run <LLLM>, for example I can use llama3 using

	
!ollama run llama3
Copy
	
pulling manifest
pulling 6a0746a1ec1a... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 4.7 GB
pulling 4fa551d4f938... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 12 KB
pulling 8ab4849b038c... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 254 B
pulling 577073ffcc6c... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 110 B
pulling 3f8eb4da87fa... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 485 B
verifying sha256 digest
writing manifest
removing any unused layers
success
>>> hola
Hola! ¿Cómo estás?
>>> Send a message (/? for help)

As you can see ollama works like docker, as it did not have llama3 downloaded, it has downloaded it and then we can use it.

Modelslink image 25

If we want to know which models are available, we can go to their models page, where we can see all the available models.

Download a modellink image 26

If we want to download a model, we will do the same as with docker ollama pull <LLM>, for example, I will download phi3.

	
!ollama pull phi3
Copy
	
pulling manifest
pulling 4fed7364ee3e... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 2.3 GB
pulling c608dc615584... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 149 B
pulling fa8235e5b48f... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 1.1 KB
pulling d47ab88b61ba... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 140 B
pulling f7eda1da5a81... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 485 B
verifying sha256 digest
writing manifest
removing any unused layers
success

Helplink image 27

If we want to see all the commands we have available we can use ollama -h.

	
!ollama -h
Copy
	
Large language model runner
Usage:
ollama [flags]
ollama [command]
Available Commands:
serve Start ollama
create Create a model from a Modelfile
show Show information for a model
run Run a model
pull Pull a model from a registry
push Push a model to a registry
list List models
ps List running models
cp Copy a model
rm Remove a model
help Help about any command
Flags:
-h, --help help for ollama
-v, --version Show version information
Use "ollama [command] --help" for more information about a command.

List available modelslink image 28

We can see in the help that if we make ollama list we can see all the available models.

	
!ollama list
Copy
	
NAME ID SIZE MODIFIED
phi3:latest a2c89ceaed85 2.3 GB 4 minutes ago
llama3:latest 365c0bd3c000 4.7 GB 10 minutes ago

And as we can see we only have the two that we have downloaded up to now

See models runninglink image 29

If we do call ps we can see the models we have running

	
!ollama ps
Copy
	
NAME ID SIZE PROCESSOR UNTIL
llama3:latest 365c0bd3c000 5.4 GB 100% GPU 3 minutes from now

We see that we have llama3 running because at the beginning we did ollama run llama3, but if we now try phi3

	
!ollama run phi3
Copy
	
>>> Send a message (/? for help)

If we now go back to making call ps.

	
!ollama ps
Copy
	
NAME ID SIZE PROCESSOR UNTIL
phi3:latest a2c89ceaed85 3.8 GB 100% GPU 3 minutes from now

We can see that the model running is phi3.

Multimodal modelslink image 30

In the ollama model list there are multimodal models, such as moondream2, which being a model with only 1.8B of parameters has a very good performance, so let's download it to test it.

	
!ollama pull moondream
Copy
	
pulling manifest
pulling e554c6b9de01... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 828 MB
pulling 4cc1cb3660d8... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 909 MB
pulling c71d239df917... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 11 KB
pulling 4b021a3b4b4a... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 77 B
pulling 9468773bdc1f... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 65 B
pulling ba5fbb481ada... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 562 B
verifying sha256 digest
writing manifest
removing any unused layers
success

Once downloaded we are going to ask for this image

this_is_fine

To do this we have to pass in the prompt the path where we have the image

	
!ollama run moondream
Copy
	
>>> Puedes explicarme esta imagen? /home/wallabot/Documentos/web/portafolio/images/this_is_fine.png
Added image '/home/wallabot/Documentos/web/portafolio/images/this_is_fine.png'
The image is a comic strip featuring two dogs sitting at a table. One dog has its eyes closed, while the other one appears to be looking at something or someone in
front of it. The scene takes place inside a house with a fireplace and a cup on the table. Above them, there's a speech bubble that says 'This is fine.'

Multiline Promptslink image 31

When we need to write more than one line in our prompt we simply have to put it in triple quotes """.

	
!ollama run llama3
Copy
	
>>> """Hola, puedes hacerme un resumen de la siguiente conversación
...
... Alex: Bea, he estado revisando el modelo de clasificación de imágenes que entrenamos la semana pasada, y me parece que no está funcionando como esperábamos. Las métrica
... s de precisión y recall están por debajo de lo que habíamos estimado.
...
... Bea: Sí, lo noté también. He estado analizando las predicciones erróneas y creo que el problema puede estar en el preprocesamiento de los datos. Algunos de los ejemplos
... de entrenamiento parecen estar etiquetados incorrectamente.
...
... Alex: Eso tiene sentido. ¿Crees que deberíamos aplicar alguna técnica de aumento de datos para balancear mejor las clases y mejorar la calidad de las etiquetas?
...
... Bea: Podría funcionar. De hecho, estaba pensando en utilizar augmentations como rotaciones y traslaciones. También podríamos considerar el uso de GANs para generar más
... ejemplos sintéticos, especialmente para las clases minoritarias.
...
... Alex: Buena idea. Además, podríamos implementar una técnica de oversampling como SMOTE para equilibrar las clases. Pero primero, necesitamos limpiar y verificar nuestra
... s etiquetas. ¿Te parece si dividimos las tareas? Yo puedo encargarme del aumento de datos y tú podrías revisar las etiquetas.
...
... Bea: Perfecto. También me gustaría ajustar un poco los hiperparámetros del modelo. Quizás deberíamos hacer una búsqueda en grid para encontrar los mejores valores para
... el learning rate y el batch size.
...
... Alex: De acuerdo. Después de mejorar las etiquetas y los datos, podemos configurar una búsqueda en grid y usar un cluster de computación para agilizar el proceso. Creo
... que podemos obtener resultados mucho más sólidos.
...
... Bea: Me parece un buen plan. Vamos a dividir las tareas y nos reunimos en unos días para revisar los avances. Con un poco de suerte, podremos mejorar significativamente
... el rendimiento del modelo.
...
... Alex: Genial, vamos a ello. ¡Gracias por la colaboración, Bea!
...
... Bea: ¡A ti, Alex! Trabajar en equipo siempre da mejores resultados. ¡Nos vemos pronto!"""
Aquí te presento un resumen de la conversación:
La conversación comienza con Alex, quien está revisando el modelo de clasificación de imágenes entrenado la semana pasada y descubre que no está funcionando como
esperaban. Bea también había notado el problema y cree que puede estar relacionado con el preprocesamiento de los datos, ya que algunos ejemplos de entrenamiento
parecen estar etiquetados incorrectamente.
Discuten posibles soluciones para mejorar la calidad del modelo, incluyendo el uso de técnicas de aumento de datos (augmentations) y generación de ejemplos sintéticos
con GANs. También mencionan la posibilidad de implementar una técnica de oversampling como SMOTE para equilibrar las clases.
Acuerdan dividir las tareas: Alex se encargará del aumento de datos, mientras que Bea revisará las etiquetas. Después de mejorar los datos y las etiquetas, pueden
configurar una búsqueda en grid para encontrar los mejores hiperparámetros del modelo.
Finalmente, acuerdan reunirse después de unos días para revisar los avances y trabajar juntos en equipo para mejorar el rendimiento del modelo.

GGUF fileslink image 32

As we have said, ollama is based on llama.cpp, so the type of models used by ollama are those used by llama.cpp and are the GGUF tip files.

The GGUF files refer to the Generalized GPU-Friendly Unified Format file format, which is designed to store and run large language models (LLMs) efficiently on GPU-accelerated hardware.

The GGUF format is specifically optimized for storing and executing large language models, such as transformer-based architectures. It provides a compact and efficient way to represent model weights, activations, and computational graphs, which allows faster inference times and reduced memory usage.

GGUF files usually contain the following components:

Model architecture: The GGUF file stores the model architecture, including the number of layers, hidden sizes and attention mechanisms. Weights: Model weights are stored in a compressed format to reduce memory usage. That is, the models are quantized 3. Activations: The GGUF file contains pre-computed activations for certain layers or sub-layers, which can be reused during inference. 4. Computation network: The computation network represents the sequence of operations required to perform inference with the model.

By using GGUF files, developers can implement large language models on a variety of hardware, including GPUs, TPUs and CPUs, while achieving faster inference times and improved performance.

For example, the model llama3 of 70B of paŕametros in FP32 should occupy 280 GB, in FP16 should occupy 140 GB and in INT8 should occupy 70GB. However, when we are going to download it, in the web it says that it occupies 40 GB, reason why when occupying a little more than half that in INT8 we can think that it is quantized in INT4.

As I have 2 GPUs of 24 GB I could use it between the two GPUs, if I load it in parallel on both of them, so I'm going to download it and try it out

	
!ollama pull llama3:70B
Copy
	
pulling manifest
pulling 0bd51f8f0c97... 100% ▕████████████████████████████████████████████████████████████████████████████████████████████████▏ 39 GB
pulling 4fa551d4f938... 100% ▕████████████████████████████████████████████████████████████████████████████████████████████████▏ 12 KB
pulling 8ab4849b038c... 100% ▕████████████████████████████████████████████████████████████████████████████████████████████████▏ 254 B
pulling 577073ffcc6c... 100% ▕████████████████████████████████████████████████████████████████████████████████████████████████▏ 110 B
pulling ea8e06d28e47... 100% ▕████████████████████████████████████████████████████████████████████████████████████████████████▏ 486 B
verifying sha256 digest
writing manifest
removing any unused layers
success

I test it

	
!ollama run llama3:70B
Copy
	
>>> Hola, me puedes decir cómo pasar un array de numpy a un tensor de pytorch?
Sí!
En PyTorch, puedes convertir un arreglo de NumPy a un tensor utilizando la función `torch.from_numpy()`.
Aquí tienes un ejemplo:
```
import numpy as np
import torch
# Creamos un arreglo de NumPy
arr = np.array([1, 2, 3, 4, 5])
# Convertimos el arreglo a un tensor de PyTorch
tensor = torch.from_numpy(arr)
print(tensor) # Output: tensor([1, 2, 3, 4, 5])
```
Ten en cuenta que la función `torch.from_numpy()` devuelve un tensor que comparte la memoria con el arreglo de NumPy original. Esto significa que si
modificas el tensor, también estarás modificando el arreglo de NumPy original.
Si deseas crear un tensor independiente del arreglo de NumPy, puedes utilizar la función `torch.tensor()` y pasarle el arreglo de NumPy como parámetro:
```
tensor = torch.tensor(arr)
```
De esta manera, el tensor creado será una copia independiente del arreglo de NumPy original.
Espero que esto te ayude!

Not only does it answer well, but it goes very fast.

It also shows that it has loaded the model on my two GPUs in parallel.

This can be assumed, because in a single one it would not fit as I have commented before. But I have also created a GPU monitor, with which I can see that the two GPUs are almost full.

From here we can draw another conclusion, and that is that through the GGUF files we can run the LLMs in the most efficient way in our computers, in my case I have loaded in parallel the LLM in my two GPUs.

Modelfilelink image 33

Now that we have seen what GGUF files are, we can see how to create new ones from others. Just as with docker we can create images from other images with a dockerfile, ollama allows us to create models from other models with a modelfile.

For this we will start from the file Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf which is the GGUF file of the NousResearch/Hermes-2-Theta-Llama-3-8B-GGUF model. This model is a flame3 version of 8B parameters.

When creating models and uploading them to the Internet, the ideal is to give them descriptive names, for example, in this case we see that we have in the name

  • Llama-3-Instruct: This means that it is a model that starts from llama3 8B Instruct.
  • Merged: It is a merge model.
  • DPO: Alignment with DPO has been done.
  • Q4: It is quantized to 4 bits.

First we are going to create the folder where we are going to create the modelfile

	
!mkdir ollama_modelfile
Copy

Now we create the modelfile

	
!mkdir ollama_modelfile
!touch ollama_modelfile/Modelfile
Copy

And now we download the file GGUF.

	
!mkdir ollama_modelfile
!touch ollama_modelfile/Modelfile
!wget https://huggingface.co/NousResearch/Hermes-2-Theta-Llama-3-8B-GGUF/resolve/main/Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf -O ollama_modelfile/Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf
Copy
	
--2024-05-23 06:31:53-- https://huggingface.co/NousResearch/Hermes-2-Theta-Llama-3-8B-GGUF/resolve/main/Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf
Resolving huggingface.co (huggingface.co)... 54.192.95.26, 54.192.95.79, 54.192.95.21, ...
Connecting to huggingface.co (huggingface.co)|54.192.95.26|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://cdn-lfs-us-1.huggingface.co/repos/48/0d/480d1b9ea3df81b6cf974d62b6bc04f402ac5600a1dfdde7bbb9e819a111c572/762b9371a296ab2628592b9462dc676b27d881a3402816492801641a437669b3?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf%3B+filename%3D%22Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf%22%3B&Expires=1716697914&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxNjY5NzkxNH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzQ4LzBkLzQ4MGQxYjllYTNkZjgxYjZjZjk3NGQ2MmI2YmMwNGY0MDJhYzU2MDBhMWRmZGRlN2JiYjllODE5YTExMWM1NzIvNzYyYjkzNzFhMjk2YWIyNjI4NTkyYjk0NjJkYzY3NmIyN2Q4ODFhMzQwMjgxNjQ5MjgwMTY0MWE0Mzc2NjliMz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=LQecPNccMxv4R-BowDrcwORGpk%7ETTh-gVmMrAzzmdT8EFDVXNH7KTwmqKF-pEAbbir9iRS1pX7NFCterYF0w5UMe%7EWkvGg46Z73yMn3s96hm7edWypv9OCMFuBvcp8arYonKljUQ4UvdQKFHXAZxKhLrx6OVqx9YoTvHuXmpBoKXAPi1XNLPwY0YTX4wn3DnAFFzkHOsDK7p2TJ3z7RFzmfyZg%7E5daWm008oGBvIV192MKk5uqQGwqv3l-4mi2Nd8eOwMW2Yfzigz7EZJgPM7UDYzin5vABsnyXJorOSRdri13hlC-AMaY9db76vLsT1NBvVU1xVtWxAylDqU6XYlQ__&Key-Pair-Id=KCD77M1F0VK2B [following]
--2024-05-23 06:31:54-- https://cdn-lfs-us-1.huggingface.co/repos/48/0d/480d1b9ea3df81b6cf974d62b6bc04f402ac5600a1dfdde7bbb9e819a111c572/762b9371a296ab2628592b9462dc676b27d881a3402816492801641a437669b3?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf%3B+filename%3D%22Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf%22%3B&Expires=1716697914&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxNjY5NzkxNH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzQ4LzBkLzQ4MGQxYjllYTNkZjgxYjZjZjk3NGQ2MmI2YmMwNGY0MDJhYzU2MDBhMWRmZGRlN2JiYjllODE5YTExMWM1NzIvNzYyYjkzNzFhMjk2YWIyNjI4NTkyYjk0NjJkYzY3NmIyN2Q4ODFhMzQwMjgxNjQ5MjgwMTY0MWE0Mzc2NjliMz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=LQecPNccMxv4R-BowDrcwORGpk%7ETTh-gVmMrAzzmdT8EFDVXNH7KTwmqKF-pEAbbir9iRS1pX7NFCterYF0w5UMe%7EWkvGg46Z73yMn3s96hm7edWypv9OCMFuBvcp8arYonKljUQ4UvdQKFHXAZxKhLrx6OVqx9YoTvHuXmpBoKXAPi1XNLPwY0YTX4wn3DnAFFzkHOsDK7p2TJ3z7RFzmfyZg%7E5daWm008oGBvIV192MKk5uqQGwqv3l-4mi2Nd8eOwMW2Yfzigz7EZJgPM7UDYzin5vABsnyXJorOSRdri13hlC-AMaY9db76vLsT1NBvVU1xVtWxAylDqU6XYlQ__&Key-Pair-Id=KCD77M1F0VK2B
Resolving cdn-lfs-us-1.huggingface.co (cdn-lfs-us-1.huggingface.co)... 108.157.98.20, 108.157.98.92, 108.157.98.55, ...
Connecting to cdn-lfs-us-1.huggingface.co (cdn-lfs-us-1.huggingface.co)|108.157.98.20|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 4920733728 (4,6G) [binary/octet-stream]
Saving to: ‘ollama_modelfile/Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf’
ollama_modelfile/He 100%[===================>] 4,58G 71,1MB/s in 65s
2024-05-23 06:32:59 (72,2 MB/s) - ‘ollama_modelfile/Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf’ saved [4920733728/4920733728]

Once downloaded we start to create the modelfile

FROMlink image 34

First we have to specify which model we are starting from

We can start from a model that is in the ollama hub, for example, we could make

FROM llama3
      

But as we are going to start from the file we have downloaded, we specify it by means of the path

FROM ./Hermes-2-Pro-Llamama-3-Instruct-Merged-DPO-Q4_K_M.gguf
      
	
%%writefile ollama_modelfile/Modelfile
FROM ./Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf
Copy
	
Overwriting ollama_modelfile/Modelfile

PARAMETERlink image 35

Now we have to set the values of the LLM parameters, for example, if we want to modify the value of the temperature we put

PARAMETER temperature 0.5
      

The parameters that can be modified are

Parameter Description Value Type Example Usage
mirostat Enable Mirostat sampling to control perplexity. (default: 0, 0 = disabled, 1 = Mirostat, 2 = Mirostat 2.0) int mirostat 0
mirostat_eta Influences how quickly the algorithm responds to feedback from the generated text. A lower learning rate will result in slower adjustments, while a higher rate will make the algorithm more sensitive. (Default: 0.1) float mirostat_eta 0.1
mirostat_tau Controls the balance between coherence and diversity of the output. A lower value will result in more focused and coherent text. (Default: 5.0) float mirostat_tau 5.0
num_ctx Sets the size of the context window used to generate the next token. (Default: 4096) int num_ctx 4096
repeat_last_n Sets how far back the model should look to avoid repetitions. (Default: 64, 0 = disabled, -1 = num_ctx) int repeat_last_n 64
repeat_penalty Sets the intensity with which repetitions are penalized. A higher value (e.g., 1.5) will penalize repetitions more strongly, while a lower value (e.g., 0.9) will be more lenient. (Default: 1.1) float repeat_penalty 1.1
temperature The temperature of the model. Increasing the temperature will make the model respond more creatively. (Default: 0.8) float temperature 0.7
seed Sets the seed for random number generation. Setting this to a specific number will make the model generate the same text for the same prompt. (Default: 0) int seed 42
stop Sets the stop sequences to use. When this pattern is found, the LLM will stop generating text and return. Multiple stop patterns can be set by specifying multiple stop parameters in a model file. string stop "AI assistant:"
tfs_z Top-k sampling is used to reduce the impact of less likely tokens on the output. A higher value (e.g., 2.0) will reduce the impact more, while a value of 1.0 disables this setting. (default: 1) float tfs_z 1
num_predict Maximum number of tokens to predict when generating text. (Default: 128, -1 = infinite generation, -2 = fill context) int num_predict 42
top_k Reduces the probability of generating nonsense. A higher value (e.g., 100) will give more diverse responses, while a lower value (e.g., 10) will be more conservative. (Default: 40) int top_k 40
top_p Works together with top-k. A higher value (e.g., 0.95) will lead to more diverse text, while a lower value (e.g., 0.5) will generate more focused and conservative text. (Default: 0.9) float top_p 0.9

Let's look at the parameters of the llama3 model.

	
!ollama show llama3 --modelfile | grep PARAMETER
Copy
	
PARAMETER num_keep 24
PARAMETER stop "<|start_header_id|>"
PARAMETER stop "<|end_header_id|>"
PARAMETER stop "<|eot_id|>"

We can see that it has a parameter num_keep = 24 which is not in the ollama documentation and also three stop tokens

Let's make the model more creative by raising the temperature and keep the stop tokens, otherwise the model will not stop generating text.

	
%%writefile ollama_modelfile/Modelfile
FROM ./Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf
PARAMETER temperature 1
PARAMETER stop "<|start_header_id|>"
PARAMETER stop "<|end_header_id|>"
PARAMETER stop "<|eot_id|>"
Copy
	
Overwriting ollama_modelfile/Modelfile

SYSTEMlink image 36

We can condition the model with a system message

	
%%writefile ollama_modelfile/Modelfile
FROM ./Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf
PARAMETER temperature 1
SYSTEM """Eres un asistente de IA, que quiere ayudar, pero no tiene muchas habilidades sociales"""
Copy
	
Overwriting ollama_modelfile/Modelfile

TEMPLATElink image 37

It is the template that we will pass to the model, the types of data that can be included are

Variable Description
{{ .System }} The system message used to specify a custom behavior.
{{ .Prompt }} The user's prompt message.
{{ .Response }} The response of the model. When generating a response, the text after this variable is omitted.

As it is not very intuitive, let's see it with an example, let's imagine that we have the following template

TEMPLATE """{{ if .System }}<|im_start|>system
      {{ .System }}<|im_end|>
      {{ end }}{{{ if .Prompt }}<|im_start|>user
      {{ .Prompt }}<|im_end|>
      {{ end }}<|im_start|>assistant
      """
      

If we pass the following prompt to the template Hello, how are you? the template will do three things

  • {{ if .System }}<|im_start|>system{{ .System }}<|im_end|>{{ end }}:

    If there is a system message, it is passed to the model in the following way

    <|im_start|>system message <|im_end|>.

    As in our case there is a system message, it will happen to you

    `<|im_start|>You are an AI assistant, who wants to help, but does not have many social skills<|im_end|>``.

  • {{ if .Prompt }}<|im_start|>user{{ .Prompt }}<|im_end|>{{ end }}:

    If there is a user message, it is passed to the model in the following way

    <|im_start|>user message <|im_end|>.

    As in our case there is a user message (the prompt) it will be passed to you

    <|im_start|>user Hi, how are you? <|im_end|>

  • <|im_start|>assistant:

    It will always happen to the model

    <|im_start|>assistant

    so that the LLM knows that it is now his turn to respond

After looking at it in parts we can put the total message that will be passed to the LLM and it is

<|im_start|>You are an AI assistant, who wants to help, but does not have many social skills<|im_end|>.
      <|im_start|>user Hello, how are you? <|im_end|>
      <|im_start|>assistant

Let's see what the llama3 template looks like.

	
!ollama show llama3 --modelfile | grep {opening_brace}{opening_brace}
Copy
	
TEMPLATE "{{ if .System }}<|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
{{ .Response }}<|eot_id|>"

It is very similar to the one we have seen, with the llama3 template, in our case it will be passed to the LLM.

<|start_header_id|>system<|end_header_id|>You are an AI assistant, who wants to help, but does not have many social skills<|eot_id|>.
      <|start_header_id|>user<|end_header_id|>Hello, how are you?<|eot_id|>
      <|start_header_id|>assistant<|end_header_id|>{{ .Response }}<|eot_id|>

As we are going to use a model based on llama3 we are going to use its template

	
%%writefile ollama_modelfile/Modelfile
FROM ./Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf
PARAMETER temperature 1
SYSTEM """Eres un asistente de IA, que quiere ayudar, pero no tiene muchas habilidades sociales"""
TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
{{ .Response }}<|eot_id|>"""
Copy
	
Overwriting ollama_modelfile/Modelfile

LICENSElink image 38

Serves to establish the model license

	
%%writefile ollama_modelfile/Modelfile
FROM ./Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf
PARAMETER temperature 1
SYSTEM """Eres un asistente de IA, que quiere ayudar, pero no tiene muchas habilidades sociales"""
TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
{{ .Response }}<|eot_id|>"""
LICENSE """Apache-2.0"""
Copy
	
Overwriting ollama_modelfile/Modelfile

MESSAGElink image 39

We can pass you a chat history

	
%%writefile ollama_modelfile/Modelfile
FROM ./Hermes-2-Pro-Llama-3-Instruct-Merged-DPO-Q4_K_M.gguf
PARAMETER temperature 1
SYSTEM """Eres un asistente de IA, que quiere ayudar, pero no tiene muchas habilidades sociales"""
TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
{{ .Response }}<|eot_id|>"""
LICENSE """Apache-2.0"""
MESSAGE user Sabes cómo pasar un array de numpy a un tensor de torch?
MESSAGE assistant
MESSAGE user Y me lo podrías decir?
MESSAGE assistant
MESSAGE user Dímelo
MESSAGE assistant Te lo puedo decir
Copy
	
Overwriting ollama_modelfile/Modelfile

ADAPTERlink image 40

An adapter is a matrix that is added to the model. It is used to avoid having to do fine tuning to the LLMs and to do it only to that matrix, so that when it is added to the model, the LLM behaves as we want it to.

So in order to do this we pass the path to the adapter file

ADAPTER ./ollama-lora.bin

Create the modellink image 41

Once the modelfile has been written we can create the model by means of

ollama create <model-name> -f <path-of-the-modelfile>'
      
	
!ollama create assistanmal -f ollama_modelfile/Modelfile
Copy
	
transferring model data
using existing layer sha256:762b9371a296ab2628592b9462dc676b27d881a3402816492801641a437669b3
using existing layer sha256:ba85fc82591e657e639f779f4fdc5e6e7cb977f9d36487d67cefe589a8af670e
using existing layer sha256:995b40fa08b7063fd4fe21ef93f0a1c147d82ecd7e2e87216c11ae809693e101
using existing layer sha256:2af71558e438db0b73a20beab92dc278a94e1bbe974c00c1a33e3ab62d53a608
using existing layer sha256:20dc17cb752058f95ad600722883b22f3328ca8ccccbb667d5e07991ae1985c7
using existing layer sha256:d8ba2f9a17b3bbdeb5690efaa409b3fcb0b56296a777c7a69c78aa33bbddf182
using existing layer sha256:c2ca5c1f4ec2cfaa477ed5f5770beff313b28d083ce5ceb90daed9d6ecbb773f
writing manifest
success

We see that we get an output very similar to the one we get when we create a docker image

Yes, now we list the models we have available

	
!ollama list
Copy
	
NAME ID SIZE MODIFIED
assistanmal:latest 2be327b28fbf 4.9 GB 48 seconds ago
llama3:70b 786f3184aec0 39 GB 38 hours ago
llava:latest 8dd30f6b0cb1 4.7 GB 40 hours ago
moondream:latest 55fc3abd3867 1.7 GB 40 hours ago
phi3:latest a2c89ceaed85 2.3 GB 2 days ago
llama3:latest 365c0bd3c000 4.7 GB 2 days ago

We see that there is the wizard we just created. Let's try it out

	
!ollama run assistanmal
Copy
	
>>> Sabes cómo pasar un array de numpy a un tensor de torch?
>>> Y me lo podrías decir?
>>> Dímelo
Te lo puedo decir
>>> Dímelo
Para convertir un array de NumPy a un tensor de PyTorch, puedes seguir estos pasos:
1. Instalar la librería torch: `pip install torch`
2. Importar las librerías necesarias: `import numpy as np`, `import torch`
3. Convertir el array de NumPy a una variable torch.Tensor: `tensor = torch.from_numpy(array_numpy)`
Aquí tienes un ejemplo:
```python
import numpy as np
import torch
# Crea un array en NumPy
array_numpy = np.array([1, 2, 3])
# Convierte el array de NumPy a una variable torch.Tensor
tensor = torch.from_numpy(array_numpy)
print(tensor)
```
Este código crea un array en NumPy y luego lo convierte a una variable `torch.Tensor` utilizando la función `from_numpy`. La salida sería:
```python
tensor([1, 2, 3])

REST APIlink image 42

By default ollama runs on port 11434 of our localhost and as it has implemented a REST API we can make calls using this API

We can make a query to an LLM using the POST method, for this we have to pass it a json with, at least, the model and the prompt

	
!curl -X POST http://127.0.0.1:11434/api/generate -d '{
"model": "llama3",
"prompt": "¿Por que el cielo es azul?"
}' -H "Content-Type: application/json"
Copy
	
{"model":"llama3","created_at":"2024-05-25T05:08:18.884851337Z","response":"La","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:18.895040313Z","response":" raz","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:18.905195114Z","response":"ón","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:18.915384212Z","response":" por","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:18.925599888Z","response":" la","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:18.935894594Z","response":" que","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:18.946216271Z","response":" el","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:18.95667124Z","response":" ci","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:18.967006633Z","response":"elo","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:18.977232419Z","response":" sue","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:18.987573713Z","response":"le","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:18.998090659Z","response":" ser","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:19.008252975Z","response":" az","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:19.018568771Z","response":"ul","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:19.029065258Z","response":" es","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:19.03963268Z","response":" un","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:19.050107165Z","response":" tema","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:19.060833657Z","response":" muy","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:19.071234073Z","response":" interes","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:19.081710362Z","response":"ante","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:19.091871325Z","response":" y","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:19.10204305Z","response":" comple","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:19.112288302Z","response":"jo","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:19.122615519Z","response":".","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:19.132758358Z","response":" Hay","done":false}
...
{"model":"llama3","created_at":"2024-05-25T05:08:23.70235664Z","response":"ó","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:23.712846234Z","response":"meno","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:23.723233334Z","response":".","done":false}
{"model":"llama3","created_at":"2024-05-25T05:08:23.733833978Z","response":"","done":true,"done_reason":"stop","context":[128006,882,128007,271,31282,29197,1744,658,12088,20782,1560,12657,360,30,128009,128006,78191,128007,271,8921,24788,3244,4247,1208,1744,658,12088,20782,34872,273,1446,12657,360,1560,653,47015,23321,50516,5048,379,1946,7453,13,18276,86050,115256,25318,89097,46602,15540,1744,7537,276,56369,277,10566,44585,1832,70191,11,20003,912,18137,5203,44460,31388,10126,13,23815,2483,1028,3118,78,74854,409,5252,115256,25318,11158,470,8699,1473,16,13,3146,8921,72916,409,1208,65566,96618,84201,409,2537,757,4919,2191,437,11158,75419,1560,1208,72916,320,288,1768,67137,8,409,1208,65566,4247,961,27235,300,23321,48467,61025,665,1208,70887,29832,809,64,11,8112,22337,978,3395,300,409,308,22288,1832,4469,78,379,19488,2483,4469,78,13,5034,65566,12657,360,24215,653,65013,409,389,3315,11158,23100,78,1744,39505,1400,4692,11,781,1744,68832,1744,513,5320,68364,2649,11158,18922,531,39961,4247,1208,72916,13,93125,35905,1744,1208,65566,12657,360,1469,39614,936,11158,18041,5048,665,658,12088,20782,7809,2172,390,39505,1400,4692,627,17,13,3146,8921,15938,78031,409,5252,1317,21237,409,389,3315,96618,507,2221,115256,7583,79048,43668,1744,658,12657,360,1560,658,1933,11358,5048,28895,1208,70887,29832,809,64,15938,1395,5252,1317,21237,409,389,3315,938,30826,379,2807,5919,11158,98420,1744,5252,1317,21237,409,389,3315,12657,2482,13,93125,18274,852,28895,1208,70887,29832,809,64,81533,45612,8112,1208,1891,1832,87,5362,409,12782,78,11,658,25616,10358,379,658,38752,409,56562,11,1744,15938,8123,2537,18803,437,2092,5518,390,1317,21237,409,389,3315,11158,4143,300,627,18,13,3146,8921,8881,95266,409,1208,23126,14210,96618,5034,115256,7583,409,1208,8881,95266,31705,19380,1744,1208,23126,14210,2098,273,5697,1208,65566,12657,360,11158,31469,292,1394,12826,91992,264,924,40321,26826,934,56094,3074,379,25107,35497,3074,13,93125,35905,1744,1208,65566,12657,360,9581,11158,25228,64,665,658,12088,20782,627,19,13,3146,8921,62822,44428,2854,3444,96618,13321,12826,11,29571,18137,115256,25318,1744,31705,16414,1744,658,12657,360,1560,653,1933,78632,6632,1744,12155,65117,5933,28895,513,439,511,689,390,658,56562,379,658,12088,20782,13,5034,62822,44428,2854,3444,21329,6791,404,665,42791,77998,3739,1624,1933,1624,12088,20782,382,1737,594,28999,11,912,18137,5203,96189,24788,3244,4247,1208,1744,658,12088,20782,9581,12657,360,11,52904,11158,14707,653,68593,409,2144,4692,65946,17038,11,934,56094,17038,379,78632,25204,1744,6044,38855,264,10566,44585,1832,70191,13,128009],"total_duration":8342889543,"load_duration":3407077432,"prompt_eval_count":19,"prompt_eval_duration":85819000,"eval_count":464,"eval_duration":4848923000}

As we can see it has answered us by stream, if we do not want this and we want a single answer we have to pass "stream": false in the json

	
!curl -X POST http://127.0.0.1:11434/api/generate -d '{
"model": "llama3",
"prompt": "¿Por que el cielo es azul?",
"stream": false
}' -H "Content-Type: application/json"
Copy
	
{"model":"llama3","created_at":"2024-05-25T05:42:03.468060994Z","response":"¡Excelente pregunta! La razón por la que el cielo suele ser azul es un fenómeno físico llamado scattering (difracción) de luz. Cuando la luz del sol entra en la atmósfera, se enfrenta a pequeños partículas de gases como el nitrógeno y el oxígeno, así como a partículas más grandes como las moléculas de agua y los polvo. La scattering tiene dos tipos: Rayleigh scattering (difracción de Rayleigh) y Mie scattering (difracción de Mie). La primera es la que ocurre cuando la luz se enfrenta con pequeñas partículas, como el nitrógeno y el oxígeno, que son muy delgadas en comparación con la longitud de onda de la luz. En este caso, la luz azul (con una longitud de onda más corta) es scattering más fuerte que la luz roja (con una longitud de onda más larga). Esto es porque las partículas pequeñas son más efectivas en scattering la luz con longitudes de onda más cortas. La segunda tipo de scattering, Mie scattering, ocurre cuando la luz se enfrenta con partículas más grandes, como las moléculas de agua y los polvo. En este caso, la scattering es más fuerte para las longitudes de onda más largas, lo que significa que la luz roja es scatterred más fuerte que la luz azul. Finalmente, cuando llega el momento en que la luz solar ha sido scattering por ambas tipos de partículas, la luz azul (con una longitud de onda más corta) ha sido scatterred más fuerte y llega a nuestros ojos desde diferentes ángulos. Esto es lo que nos hace ver el cielo como azul. En resumen, la combinación de scattering de Rayleigh y Mie es lo que nos permite ver al cielo como azul. ¡Y qué bonito resultado es eso!","done":true,"done_reason":"stop","context":[128006,882,128007,271,31282,29197,1744,658,12088,20782,1560,12657,360,30,128009,128006,78191,128007,271,40932,20656,6960,80440,2268,8921,24788,3244,4247,1208,1744,658,12088,20782,34872,273,1446,12657,360,1560,653,44585,1832,70191,65946,4042,51204,2172,72916,320,88564,81,67147,8,409,65566,13,89014,1208,65566,1624,2092,83786,665,1208,70887,29832,809,64,11,513,89599,64,264,48467,18720,961,27235,300,409,45612,8112,658,308,22288,1832,4469,78,379,658,19488,2483,4469,78,11,37560,8112,264,961,27235,300,11158,38546,8112,5252,22337,978,3395,300,409,56562,379,2537,1499,3415,382,8921,72916,24215,8924,64962,25,13558,64069,72916,320,88564,81,67147,409,13558,64069,8,379,386,648,72916,320,88564,81,67147,409,386,648,570,5034,44769,1560,1208,1744,18274,852,27443,1208,65566,513,89599,64,390,48467,61025,961,27235,300,11,8112,658,308,22288,1832,4469,78,379,658,19488,2483,4469,78,11,1744,4538,23321,1624,70,11354,665,7809,5840,390,1208,49704,409,389,3315,409,1208,65566,13,2998,10566,23884,11,1208,65566,12657,360,320,444,5203,49704,409,389,3315,11158,23100,64,8,1560,72916,11158,18922,14140,1744,1208,65566,938,5697,320,444,5203,49704,409,389,3315,11158,4143,64,570,93125,1560,28895,5252,961,27235,300,48467,61025,4538,11158,44046,39924,665,72916,1208,65566,390,1317,21237,409,389,3315,11158,23100,300,382,8921,56072,16697,409,72916,11,386,648,72916,11,18274,852,27443,1208,65566,513,89599,64,390,961,27235,300,11158,38546,11,8112,5252,22337,978,3395,300,409,56562,379,2537,1499,3415,13,2998,10566,23884,11,1208,72916,1560,11158,18922,14140,3429,5252,1317,21237,409,389,3315,11158,4143,300,11,781,1744,68832,1744,1208,65566,938,5697,1560,45577,1171,11158,18922,14140,1744,1208,65566,12657,360,382,19918,12826,11,27443,33602,64,658,31221,665,1744,1208,65566,13238,6520,35071,72916,4247,9049,300,64962,409,961,27235,300,11,1208,65566,12657,360,320,444,5203,49704,409,389,3315,11158,23100,64,8,6520,35071,45577,1171,11158,18922,14140,379,33602,64,264,58013,297,40261,23553,46418,19216,983,29752,13,93125,1560,781,1744,12155,35905,2807,658,12088,20782,8112,12657,360,382,1737,594,28999,11,1208,68225,5840,409,72916,409,13558,64069,379,386,648,1560,781,1744,12155,52603,2807,453,12088,20782,8112,12657,360,13,49913,56,43388,7970,6491,27284,1560,44841,0,128009],"total_duration":4760167793,"load_duration":910317,"prompt_eval_count":19,"prompt_eval_duration":126007000,"eval_count":436,"eval_duration":4586524000}

Python APIlink image 43

To use the Python API we need to install the ollama Python package

pip install ollama
      

Once installed we have the following methods

  • ollama.chat`: To initiate a chat with a model
  • ollama.generate`: To generate a response to a prompt
  • ollama.list: List of available models
  • ollama.show`: Displays information of a model
  • ollama.create`: Creates a model
  • ollama.delete`: Deletes a template
  • ollama.pull`: Download a model
  • ollama.push`: Upload a model
  • ollama.embeddings`: Return embeddings from a prompt

Let's try some of them

	
import ollama
stream = ollama.chat(
model='llama3',
messages=[{'role': 'user', 'content': '¿Por que el cielo es azul?'}],
stream=True,
)
for chunk in stream:
print(chunk['message']['content'], end='', flush=True)
Copy
	
¡Excelente pregunta!
La razón por la que el cielo suele ser azul es un tema de mucha discusión y debate entre científicos y filósofos. Hay varias teorías sobre este asunto, pero te presento algunas de las más populares:
1. **Absorción del azul**: La luz solar contiene todos los colores del espectro visible, desde el rojo hasta el violeta. Cuando la luz solar entra en la atmósfera terrestre, se absorbe y dispersa en diferentes grados dependiendo de la longitud de onda. La longitud de onda azul es particularmente pequeña, lo que significa que es absorbida y dispersada más que cualquier otro color. Esto hace que el azul sea el color predominante que nos llega a los ojos.
2. **Espejo de Rayos X**: Otra teoría sugiere que la atmósfera terrestre actúa como un "espejo" para los rayos X, que son una forma de radiación electromagnética con energías muy altas. Cuando los rayos X chocan contra la molécula de gases en la atmósfera, emiten fotones azules. Estos fotones azules then se propagan a través de la atmósfera y nos llegan a los ojos.
3. **Composición de la atmósfera**: La atmósfera terrestre está compuesta por diferentes gases, como el nitrógeno (N2) y el oxígeno (O2). Los átomos de estos gases pueden absorber y reemitter luz en diferentes longitudes de onda, lo que puede contribuir al color azul del cielo.
4. **Efecto Mie**: El efecto Mie es un proceso físico que ocurre cuando la luz solar interactúa con las partículas pequeñas en la atmósfera, como los aerosoles y las moléculas de gases. Este efecto puede hacer que el azul sea el color predominante que nos llega a los ojos.
En resumen, no hay una única razón por la que el cielo es azul, sino que es un resultado de la interacción compleja entre la luz solar, la atmósfera terrestre y otros factores físicos.
	
import ollama
stream = ollama.generate(
model='llama3',
prompt='¿Por que el cielo es azul?',
stream=True,
)
for chunk in stream:
print(chunk['response'], end='', flush=True)
Copy
	
La pregunta clásica!
La razón por la que el cielo suele ser azul es un tema de debate entre científicos y filósofos durante siglos. A continuación, te presento algunas teorías sobre por qué el cielo es azul:
1. **Scattering de luz**: La luz solar que llega a la Tierra está compuesta por diferentes longitudes de onda, desde las rayas infrarrojas hasta las rayas violetas. Cuando esta luz entra en la atmósfera, los átomos y moléculas de gases, como el nitrógeno (N2) y el oxígeno (O2), se ponen en marcha para scatter (esparcir) la luz. La luz azul tiene una longitud de onda más pequeña que la luz roja, por lo que es más susceptible a ser esparcida por los gases atmosféricos.
2. **Absorción de longitudes de onda**: La atmósfera también absorbe ciertas longitudes de onda de la luz solar, como las rayas infrarrojas y las rayas rojas. Esto hace que la luz azul y verde sean más fáciles de ver, ya que no se absorben tanto.
3. **Dosis de oxígeno**: La cantidad de oxígeno en la atmósfera también puede influir en el color del cielo. El oxígeno absorbe la luz roja y las rayas infrarrojas, lo que deja a la luz azul y verde dominar.
4. **Estructura molecular**: La estructura molecular de los gases atmosféricos, como el nitrógeno y el oxígeno, puede influir en cómo se scattering (esparce) la luz. Los átomos y moléculas con una geometría específica pueden preferir scatter (esparcir) ciertas longitudes de onda sobre otras.
5. **Efecto Mie**: El efecto Mie es un fenómeno óptico que describe cómo los pequeños particulas en la atmósfera, como las gotas de agua y los polvo, pueden scatter (esparcir) la luz. La luz azul es más susceptible a ser esparcida por estos pequeños particulas, lo que contribuye al color azul del cielo.
En resumen, el cielo suele ser azul porque la atmósfera tiende a scatter (esparcir) la luz azul y a absorber la luz roja y las rayas infrarrojas. La combinación de estos procesos ópticos y físicos es responsable del color azul que vemos en el cielo.
Es importante destacar que hay muchas variaciones en el color del cielo dependiendo de la condición atmosférica, como la niebla, la polución y la cantidad de vapor de agua. Sin embargo, en condiciones normales, el cielo puede ser describirse como azul porque es el color que se ve cuando la luz solar es scatter (esparcida) por los gases atmosféricos.
	
import ollama
models = ollama.list()
for model in models['models']:
keys = model.keys()
for key in keys:
print(key, model[key])
print()
Copy
	
name assistanmal:latest
model assistanmal:latest
modified_at 2024-05-24T08:14:10.147033666+02:00
size 4920735028
digest 2be327b28fbf24439dc2dcf5c7679784106327eaa2ead4bcb351f51ce0c9fed6
details {'parent_model': '', 'format': 'gguf', 'family': 'llama', 'families': ['llama'], 'parameter_size': '8.0B', 'quantization_level': 'Q4_K_M'}
expires_at 0001-01-01T00:00:00Z
name llama3:70b
model llama3:70b
modified_at 2024-05-22T18:16:15.277839889+02:00
size 39969745349
digest 786f3184aec0e907952488b865362bdaa38180739a9881a8190d85bad8cab893
details {'parent_model': '', 'format': 'gguf', 'family': 'llama', 'families': ['llama'], 'parameter_size': '70.6B', 'quantization_level': 'Q4_0'}
expires_at 0001-01-01T00:00:00Z
name llava:latest
model llava:latest
modified_at 2024-05-22T16:08:45.909038007+02:00
size 4733363377
digest 8dd30f6b0cb19f555f2c7a7ebda861449ea2cc76bf1f44e262931f45fc81d081
details {'parent_model': '', 'format': 'gguf', 'family': 'llama', 'families': ['llama', 'clip'], 'parameter_size': '7B', 'quantization_level': 'Q4_0'}
expires_at 0001-01-01T00:00:00Z
name moondream:latest
model moondream:latest
modified_at 2024-05-22T15:57:30.934618788+02:00
size 1738451197
digest 55fc3abd386771e5b5d1bbcc732f3c3f4df6e9f9f08f1131f9cc27ba2d1eec5b
details {'parent_model': '', 'format': 'gguf', 'family': 'phi2', 'families': ['phi2', 'clip'], 'parameter_size': '1B', 'quantization_level': 'Q4_0'}
expires_at 0001-01-01T00:00:00Z
name phi3:latest
model phi3:latest
modified_at 2024-05-21T14:00:26.525751453+02:00
size 2318920898
digest a2c89ceaed85371d0b8a51b5cc70ff054acc37465ea25e72e1612fe28bce7ad9
details {'parent_model': '', 'format': 'gguf', 'family': 'llama', 'families': ['llama'], 'parameter_size': '4B', 'quantization_level': 'Q4_K_M'}
expires_at 0001-01-01T00:00:00Z
name llama3:latest
model llama3:latest
modified_at 2024-05-21T13:54:47.514572753+02:00
size 4661224676
digest 365c0bd3c000a25d28ddbf732fe1c6add414de7275464c4e4d1c3b5fcb5d8ad1
details {'parent_model': '', 'format': 'gguf', 'family': 'llama', 'families': ['llama'], 'parameter_size': '8.0B', 'quantization_level': 'Q4_0'}
expires_at 0001-01-01T00:00:00Z
	
import ollama
assistanmal = ollama.show('assistanmal')
keys = assistanmal.keys()
for key in keys:
print(key, assistanmal[key])
Copy
	
license Apache-2.0
modelfile # Modelfile generated by "ollama show"
# To build a new Modelfile based on this, replace FROM with:
# FROM assistanmal:latest
FROM /usr/share/ollama/.ollama/models/blobs/sha256-762b9371a296ab2628592b9462dc676b27d881a3402816492801641a437669b3
TEMPLATE "{{ if .System }}<|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
{{ .Response }}<|eot_id|>"
SYSTEM Eres un asistente de IA, que quiere ayudar, pero no tiene muchas habilidades sociales
PARAMETER temperature 1
LICENSE Apache-2.0
MESSAGE user Sabes cómo pasar un array de numpy a un tensor de torch?
MESSAGE assistant Sí
MESSAGE user Y me lo podrías decir?
MESSAGE assistant Sí
MESSAGE user Dímelo
MESSAGE assistant Te lo puedo decir
parameters temperature 1
template {{ if .System }}<|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
{{ .Response }}<|eot_id|>
system Eres un asistente de IA, que quiere ayudar, pero no tiene muchas habilidades sociales
details {'parent_model': '', 'format': 'gguf', 'family': 'llama', 'families': ['llama'], 'parameter_size': '8.0B', 'quantization_level': 'Q4_K_M'}
messages [{'role': 'user', 'content': 'Sabes cómo pasar un array de numpy a un tensor de torch?'}, {'role': 'assistant', 'content': 'Sí'}, {'role': 'user', 'content': 'Y me lo podrías decir?'}, {'role': 'assistant', 'content': 'Sí'}, {'role': 'user', 'content': 'Dímelo'}, {'role': 'assistant', 'content': 'Te lo puedo decir'}]
	
import ollama
embeddings = ollama.embeddings(
model='llama3',
prompt='¿Por que el cielo es azul?',
)
print(f"len embeddings: {len(embeddings['embedding'])}, embeddings: {embeddings['embedding']}")
Copy
	
len embeddings: 4096, embeddings: [-3.5709903240203857, -2.1733479499816895, 0.38256850838661194, -0.7110687494277954, -1.4685417413711548, -3.1000022888183594, -2.4890358448028564, 3.44036865234375, 1.2659403085708618, -0.20225396752357483, 2.1770575046539307, 0.5799544453620911, -2.7561943531036377, 1.8101686239242554, -1.6933118104934692, 0.2162412852048874, -2.965606451034546, -3.804832935333252, -0.5467535853385925, 1.858802318572998, -1.1412774324417114, -1.264650583267212, 0.3924441635608673, 2.071216583251953, 1.0475926399230957, -1.6638776063919067, -1.8243257999420166, -0.6105852723121643, 0.7387599945068359, -2.9104437828063965, -0.024957681074738503, 1.7622206211090088, -1.4952329397201538, 3.5881831645965576, 5.155212879180908, -2.2027933597564697, -2.191542863845825, 0.9409443736076355, 1.6278865337371826, 1.145223617553711, 0.5374143123626709, -1.0256531238555908, 3.842578411102295, -1.0968210697174072, 1.3904237747192383, -1.8557299375534058, -1.3526214361190796, -1.1416131258010864, -3.2644541263580322, -5.737625598907471, -2.008760690689087, 1.3844702243804932, 1.6246631145477295, 0.8016360998153687, -0.030481038615107536, 2.298166036605835, -3.9192237854003906, -3.035203218460083, -1.782038927078247, -1.7258855104446411, -5.746711730957031, -0.35096585750579834, 1.6632475852966309, -1.7531949281692505, 0.5898884534835815, 4.358534812927246, -3.531533718109131, 4.319108963012695, 3.430162191390991, -1.2140980958938599, 0.22373071312904358, 0.6440947651863098, -3.880579710006714, -4.528593063354492, 1.1950795650482178, -0.9991334080696106, -2.7974133491516113, -0.5666281580924988, 0.5676720142364502, 0.9137862324714661, -2.48816180229187, 2.4825150966644287, 1.2363556623458862, 4.960108280181885, -5.237436294555664, 1.0037667751312256, -0.3310686945915222, 0.6090074777603149, 1.8728065490722656, -1.1472115516662598, -0.1412253975868225, 5.209298133850098, 4.523755073547363, -2.622323989868164, 0.2997383773326874, -1.2514511346817017, -0.27786844968795776, -0.8706071972846985, 1.7568215131759644, 2.9767489433288574, 0.472599595785141, 1.5201655626296997, -0.848712146282196, 5.358476638793945, 1.857602596282959, -0.6478251218795776, 3.0913748741149902, -0.09521156549453735, -5.098915100097656, 0.9146490097045898, -4.041540622711182, 2.0770459175109863, -0.7856513857841492, -0.06006915867328644, 0.8622685670852661, -1.491736888885498, 3.310131311416626, 0.8778402805328369, -0.41889771819114685, 2.5716934204101562, 1.0106903314590454, 2.2289915084838867, 0.14578910171985626, 1.1669079065322876, -0.48978495597839355, 0.9569312930107117, 0.09900128096342087, 1.938784122467041, 5.946640968322754, -1.1337519884109497, -0.8550072312355042, -1.858678936958313, 0.35737159848213196, 12.833805084228516, 1.020747423171997, -2.005078077316284, 2.5968477725982666, 0.0339638814330101, 1.8790265321731567, 1.316766619682312, -0.7517922520637512, -0.26476719975471497, 5.264979362487793, 1.0595479011535645, -3.2346348762512207, -0.7008733749389648, 2.6678082942962646, 0.34292638301849365, 2.6336095333099365, -5.449492454528809, 1.8392881155014038, -1.149052381515503, 2.4435460567474365, -1.5761059522628784, -1.0055335760116577, -0.008810569532215595, -4.097605228424072, -0.86686110496521, 1.3230448961257935, -1.1321579217910767, -0.5583046674728394, -0.1093638688325882, -3.521775245666504, 0.49600842595100403, 2.6446125507354736, -0.19307686388492584, 1.888438105583191, 3.461682081222534, 0.6699156761169434, 2.4350223541259766, 1.8247735500335693, 2.1006722450256348, -0.6317830085754395, 2.0495195388793945, 2.408583164215088, -3.1435046195983887, -3.540788412094116, -0.743456244468689, 1.1295356750488281, 1.5371088981628418, 0.3319551348686218, -0.19235952198505402, 2.213836669921875, -0.27262499928474426, -0.1830073595046997, 1.2156487703323364, -2.8983805179595947, -0.5994898080825806, -1.6867365837097168, -1.4026514291763306, 2.8881092071533203, 1.0583044290542603, 1.6755084991455078, -1.3570199012756348, -0.02863301709294319, 0.3893628418445587, 2.2699222564697266, 2.0410315990448, 0.5284076929092407, -1.3849315643310547, -3.2410078048706055, -5.413166522979736, -0.18938720226287842, -7.636954307556152, 1.0516839027404785, 1.8927298784255981, -1.8319122791290283, -0.3104879856109619, -3.192800283432007, 0.7249773144721985, 2.4628212451934814, -5.237030029296875, -1.6819825172424316, -2.6519153118133545, -5.452773094177246, 2.5719199180603027, 4.594746112823486, 0.26059404015541077, -0.5879826545715332, -2.012744426727295, 4.347339630126953, 1.1387996673583984, -1.585600733757019, -1.8488795757293701, 0.43234241008758545, -2.1706769466400146, 2.02614426612854, -1.3547757863998413, -0.23999670147895813, 0.5241819620132446, -1.751906394958496, -2.181796073913574, 2.4499764442443848, -1.9204010963439941, 1.730446696281433, 0.12385261058807373, 3.325094699859619, 1.1947877407073975, -0.759490430355072, 2.091949224472046, -2.352848529815674, 0.8918092846870422, -2.944584608078003, 2.403661012649536, -1.3479825258255005, 0.06610975414514542, -3.977243185043335, 1.213283896446228, -2.078611373901367, -0.5690178871154785, -2.212489366531372, 2.329470634460449, 4.6698198318481445, -2.2548561096191406, -0.6902344226837158, 3.2000536918640137, -3.4179816246032715, 2.3877899646759033, 0.803355872631073, 0.7195305824279785, -0.05020619183778763, -2.350513219833374, 0.8627676963806152, 0.892014741897583, -1.1318942308425903, -2.360058546066284, -0.9107275605201721, 5.429220199584961, 0.3160887658596039, -0.5821715593338013, -0.05387498438358307, -1.9310585260391235, 1.1864994764328003, -0.5223034024238586, -0.14695927500724792, -1.3558963537216187, 3.2761178016662598, 2.1174533367156982, -3.3351476192474365, -1.919097661972046, -1.6523269414901733, 8.498637199401855, 1.5841808319091797, 0.8351742029190063, -0.47643807530403137, 0.4335901737213135, 0.8168123960494995, -1.606881022453308, 3.033907651901245, -4.34182596206665, 13.113082885742188, -1.7362353801727295, 2.71997332572937, -2.058112382888794, -3.530165433883667, 0.6679645776748657, -1.8624101877212524, -2.792393922805786, 0.3409225642681122, -1.988881230354309, 0.2653841972351074, 0.8095135688781738, -0.4962392747402191, -3.7835464477539062, 1.6932401657104492, -1.4169583320617676, 0.5265898108482361, 0.3822944760322571, -0.40417489409446716, 1.0212734937667847, 2.9532642364501953, 2.503154754638672, 0.29280903935432434, 0.48731330037117004, 0.1463029682636261, -0.8889073729515076, -4.234628677368164, -3.614084243774414, -0.2760423719882965, -0.026265254244208336, 3.186485528945923, 0.9897671341896057, 3.198659896850586, 2.4788753986358643, -1.439963459968567, 1.8077031373977661, 1.842383623123169, 1.8660616874694824, -2.531989574432373, 0.6639688014984131, 3.2474002838134766, 2.137742519378662, 0.994397759437561, 3.4729905128479004, 2.8363358974456787, -0.06270971894264221, 5.061746120452881, -1.3068524599075317, 3.0064680576324463, -2.5484275817871094, 1.1107360124588013, 2.9042749404907227, 0.17234551906585693, 0.3036850392818451, -0.19574975967407227, -2.148221015930176, -1.7283300161361694, -1.7208715677261353, -1.3642263412475586, 4.046931743621826, -0.12636420130729675, -0.2035427689552307, 1.7216098308563232, 0.43848779797554016, -3.614549160003662, 1.1797786951065063, -0.1516219675540924, 2.417402744293213, 0.12069121748209, 2.9423115253448486, 3.3223390579223633, 0.08259274065494537, 1.53631591796875, 0.04388677328824997, 3.7080609798431396, -3.54156494140625, -2.458104372024536, -1.2394227981567383, 0.46880877017974854, 0.3513844907283783, 0.3364567756652832, 1.4723302125930786, 0.11966782063245773, -0.6117515563964844, 3.3584911823272705, -0.4264973998069763, -1.5642184019088745, -1.159574031829834, 0.5609691739082336, 2.029670476913452, 3.194979667663574, -1.0252487659454346, -0.6890900731086731, -0.05864858999848366, 0.6144252419471741, 5.782567977905273, -2.65860652923584, 1.4193108081817627, 0.5520697236061096, 1.8532027006149292, -0.8976119160652161, 1.5241093635559082, 0.2157583087682724, 1.0333294868469238, 1.498881459236145, 2.227416753768921, -1.1072536706924438, -1.7048979997634888, 1.275403618812561, 0.8163477778434753, 2.403702735900879, 1.3578238487243652, -4.276787281036377, -3.929635763168335, -0.054064273834228516, -0.16745470464229584, 0.4731382131576538, -0.9403067231178284, 0.8995345234870911, 1.95155930519104, -0.6890628337860107, -3.224841833114624, -1.415235161781311, 0.24321462213993073, 5.774457931518555, -0.9721022248268127, -3.1032869815826416, 3.2869436740875244, -3.3082871437072754, 1.0737178325653076, -5.56853723526001, -0.4755292236804962, 1.6561086177825928, 1.596308946609497, -1.2966104745864868, -2.6836979389190674, -0.11683563888072968, -0.02348145842552185, 4.354658603668213, 2.3689823150634766, 2.4168097972869873, -1.050479769706726, 1.731070637702942, -1.660346269607544, -1.3943952322006226, 1.619246244430542, -2.8332929611206055, -1.2309725284576416, -0.7420948147773743, 0.31250253319740295, -1.099778413772583, -1.0853277444839478, 0.830448567867279, -4.566944599151611, -0.12674756348133087, 0.51172935962677, 1.4584320783615112, 3.3231608867645264, 0.4730960726737976, -0.43621763586997986, 0.3666110634803772, 1.6838008165359497, 0.5602437853813171, 1.173569679260254, 1.5356460809707642, -1.5813583135604858, 1.502920389175415, 0.043176211416721344, -8.606017112731934, 2.616706371307373, -0.3429355025291443, 0.4212046265602112, -3.448631525039673, 1.7500406503677368, -0.15831516683101654, -0.9675804376602173, 0.09411357343196869, -1.158867359161377, 1.0291807651519775, -3.3388733863830566, -0.5699865221977234, -1.0659765005111694, -1.466783046722412, 2.408832311630249, 0.6615399718284607, -0.41655123233795166, -1.6816552877426147, -3.5983195304870605, 1.211220145225525, -2.2571022510528564, 0.00010927499533863738, 0.2970433235168457, -0.8382472991943359, -0.4408542811870575, 2.74499773979187, 2.992504119873047, -2.711503028869629, 0.5057509541511536, -2.0505993366241455, -2.2970893383026123, -0.21033483743667603, -3.774324893951416, -1.9951436519622803, -1.9426825046539307, 0.5870206952095032, 1.6135040521621704, 2.379605293273926, -3.2735002040863037, -2.0550036430358887, 1.1960766315460205, -0.7515547871589661, 2.08927321434021, -0.23780010640621185, 1.3819012641906738, 3.1218101978302, -2.909371852874756, -4.355706691741943, -0.019170774146914482, 1.759203553199768, 0.48109686374664307, -4.4406352043151855, -1.8898074626922607, 1.4533193111419678, 2.441861629486084, 0.23535436391830444, -3.5163235664367676, -2.7819430828094482, -0.17778466641902924, 8.366904258728027, 0.713246762752533, 2.62131929397583, -1.8670955896377563, 0.382978230714798, 3.424891471862793, 0.600226879119873, -3.36027455329895, -2.0584378242492676, 2.6336004734039307, 2.134737253189087, -0.16959276795387268, -0.1036284789443016, 0.9810671210289001, 1.1418875455856323, 0.09962985664606094, 1.5914252996444702, -1.4545915126800537, -4.03810977935791, -0.7282320261001587, -8.482601165771484, 0.1327114701271057, -0.2752779424190521, 1.4184426069259644, 0.5733793377876282, 0.08223414421081543, 0.6222414374351501, -2.4597737789154053, -0.26593253016471863, 2.8372232913970947, -0.19282476603984833, 2.73103928565979, 0.6146931052207947, 0.7074552774429321, 1.1969836950302124, 1.1260418891906738, 0.5131900906562805, -1.2828993797302246, 1.3386794328689575, -1.8014036417007446, 1.7409440279006958, 0.08714856952428818, -2.159212827682495, 0.3832853138446808, -2.1119585037231445, 0.057761650532484055, 1.629834532737732, -4.008613586425781, -0.18078847229480743, 0.36479029059410095, 3.0292224884033203, -4.647429943084717, 1.4105931520462036, 0.14685384929180145, -2.7427775859832764, 1.6782023906707764, -1.3729807138442993, 5.332502365112305, -1.1668927669525146, 0.8168975114822388, -3.2900326251983643, -0.6102523803710938, -3.183854579925537, 3.688756227493286, -1.6288002729415894, 1.227471113204956, -0.32397547364234924, 0.2668505907058716, 3.316012382507324, -0.8223669528961182, -1.5635963678359985, -3.932425022125244, -1.5233489274978638, 0.8554443120956421, 3.2967934608459473, 4.95138692855835, -0.6281516551971436, 2.285294532775879, 0.7718386054039001, 0.1816239207983017, 2.007675886154175, -0.7778028249740601, 1.2278659343719482, 5.717531204223633, 1.481109857559204, 3.202547788619995, 3.465291976928711, -2.3789079189300537, -1.2358217239379883, -2.1978416442871094, -1.7168911695480347, -1.88066828250885, -7.866800308227539, -0.8011077642440796, -1.0275570154190063, 0.09445241093635559, -0.04172638803720474, 4.584714412689209, 3.101534366607666, 2.658493757247925, 0.17598022520542145, 1.2838610410690308, 4.7485785484313965, 3.408264636993408, -1.1186959743499756, 0.7971764206886292, 0.16952396929264069, -3.072563409805298, 3.4610233306884766, -1.439322590827942, -0.14502891898155212, -1.1009596586227417, 1.8348881006240845, 0.01855730079114437, 2.0746936798095703, 0.3936997354030609, -1.018744707107544, 3.3280391693115234, -0.1553063988685608, -4.110394477844238, 3.6121714115142822, -0.9740564823150635, -2.3469674587249756, -1.0248148441314697, 5.622794151306152, 4.866459369659424, 1.686584234237671, -0.4031165838241577, -6.158736228942871, -3.3289787769317627, 0.7099746465682983, 3.9457480907440186, -0.7544403672218323, 0.8887507319450378, -2.047558546066284, 3.7690515518188477, 0.7747164368629456, -3.2324941158294678, -0.5104861259460449, 2.5004994869232178, -0.20213449001312256, -0.3506910800933838, 0.19991439580917358, -2.2618813514709473, 2.2457990646362305, -1.3406918048858643, 1.157677412033081, -1.8261936902999878, -3.4050278663635254, 0.6939024329185486, -0.38150495290756226, -0.8440736532211304, 3.119615077972412, 1.0509897470474243, 1.7212930917739868, -1.4181828498840332, 6.471809387207031, -1.2109227180480957, 0.4508134424686432, -1.316296100616455, -1.3703230619430542, -1.8275609016418457, -2.74245285987854, -1.076255440711975, -0.3053441345691681, 2.7430131435394287, -2.574312448501587, -1.3241597414016724, 2.7385237216949463, 0.49683883786201477, -1.3965773582458496, 0.020975792780518532, 5.451194763183594, 0.5795206427574158, -0.48497387766838074, 0.8816636800765991, -0.08158492296934128, -1.060154914855957, 3.001741409301758, 0.5971808433532715, -0.5764495730400085, -1.2814199924468994, 0.3163350224494934, 3.7679755687713623, 0.09551535546779633, 2.357501983642578, 4.332345962524414, -0.7894896268844604, 0.6302068829536438, -2.898423194885254, 2.0931313037872314, 8.71098804473877, -0.04752988740801811, 0.7257133722305298, 0.1271584928035736, 0.6365450620651245, 1.5511466264724731, 1.9533740282058716, 2.3992066383361816, 3.926943302154541, 3.3248801231384277, -0.18604880571365356, 0.19740158319473267, -0.4012643098831177, 2.021028757095337, 3.8637330532073975, 2.575670003890991, -1.9365648031234741, 1.691444993019104, 2.2476296424865723, -1.9615851640701294, 0.002706246916204691, 1.1965627670288086, 1.631058931350708, 1.6077936887741089, 0.37226954102516174, 2.3644227981567383, 0.5751672387123108, 0.21432556211948395, -2.961639165878296, -0.1195574700832367, -2.5952560901641846, -1.1292909383773804, 0.34523868560791016, 0.5679969191551208, 1.7192620038986206, -2.389261245727539, -2.481879711151123, 0.24165616929531097, 2.0262961387634277, 1.1701478958129883, 1.3859567642211914, 1.7152780294418335, 2.0281617641448975, 1.8382415771484375, 1.1173278093338013, 2.8694252967834473, -3.3103885650634766, 2.402040481567383, -2.21357798576355, -2.2881109714508057, 1.4869003295898438, -1.0324887037277222, -5.4409942626953125, 1.7320265769958496, 4.665608882904053, -1.4724658727645874, 0.906815767288208, 0.4488605260848999, 1.4310017824172974, 1.8985599279403687, 0.3519801199436188, 3.0915486812591553, 1.8117051124572754, -2.6297123432159424, -0.7369126677513123, 1.0228630304336548, -1.2172415256500244, 0.905229389667511, 2.0640552043914795, 0.15564560890197754, -1.746980905532837, -2.079458475112915, 1.7389395236968994, -3.017563581466675, -1.3963100910186768, -0.17710325121879578, 3.3082163333892822, 1.3057005405426025, 4.105342864990234, -1.2242194414138794, -1.730143666267395, 1.565323829650879, 0.16045412421226501, -0.28249165415763855, 1.0591498613357544, 1.4410120248794556, 2.6321206092834473, 3.864403009414673, 1.5058237314224243, 0.017665212973952293, -0.23908689618110657, -1.820846438407898, 0.5008838176727295, -0.8114575147628784, -2.5787596702575684, -2.293384552001953, 0.20850887894630432, -3.0597705841064453, 0.8508138656616211, -0.8251520991325378, -0.6015176177024841, -1.7083408832550049, 3.254239559173584, -0.3540056347846985, -3.567826747894287, -0.5068729519844055, -0.7231264710426331, 0.07263125479221344, 4.496642589569092, -1.7761105298995972, -1.8822299242019653, -1.7277802228927612, 4.271916389465332, 0.08752737939357758, 0.3420945107936859, 0.33623436093330383, -0.8109123110771179, 0.11881151795387268, -1.0930507183074951, -0.8418698906898499, -2.286395788192749, -0.9247599840164185, -2.8689169883728027, -0.6005393266677856, 1.6728875637054443, -1.9595767259597778, 0.21688200533390045, -4.131806373596191, 0.8827064037322998, 3.134533643722534, 4.377490997314453, -0.14890450239181519, -2.932239532470703, -0.7125211954116821, -2.171063184738159, -2.236750841140747, 1.8922467231750488, 2.478151559829712, 0.5344278812408447, 1.0548337697982788, -2.1813416481018066, 1.4460980892181396, -0.8311839699745178, 1.6376347541809082, -1.0173778533935547, -0.3695203959941864, 0.25814804434776306, -2.0606374740600586, -2.062361001968384, 0.02003740519285202, -2.0083367824554443, -2.569866895675659, 1.641120195388794, -2.4589219093322754, -1.2245359420776367, 1.6952146291732788, -0.6217470765113831, 0.6591718196868896, 0.8530001044273376, -3.5597972869873047, 0.7347907423973083, -0.35392555594444275, -2.053921937942505, -1.7859218120574951, 0.24722696840763092, -2.3023266792297363, 0.9194344878196716, 0.3853018581867218, -2.844104051589966, 0.23804813623428345, 2.2432146072387695, -0.9430684447288513, -1.3244085311889648, 0.5206717252731323, -2.510953903198242, 2.6874470710754395, 2.884516716003418, -3.0947065353393555, 1.5549497604370117, 1.000489354133606, -3.7759156227111816, -3.5866310596466064, 0.3307448923587799, 2.717256784439087, 16.432958602905273, 0.4599498510360718, -0.3353075385093689, 0.632378339767456, -0.07045717537403107, -0.00426980247721076, -0.5268138647079468, -5.407313823699951, 2.4316935539245605, 1.001681923866272, -0.15660661458969116, -2.9473681449890137, -0.4327965974807739, -1.2289097309112549, 0.9028959274291992, -2.345223903656006, -5.678720951080322, -17.152206420898438, 1.3550357818603516, 0.16876499354839325, -1.806233286857605, -2.0235366821289062, -2.3942909240722656, 1.7706652879714966, 1.328552007675171, 0.9902170300483704, 1.0657343864440918, -0.8373643755912781, 1.3121364116668701, -2.431511878967285, 3.0992045402526855, -1.0835341215133667, 1.0107671022415161, 2.2383971214294434, 3.631667137145996, -4.688368797302246, -0.8407208919525146, -0.5139216780662537, -2.163087844848633, -3.8397138118743896, -2.0916390419006348, -0.8597046732902527, 0.21912139654159546, 0.12715370953083038, 1.153622031211853, -1.1585773229599, -1.8073042631149292, 8.559503555297852, 4.071874618530273, -1.358181357383728, 2.864137887954712, 1.7249234914779663, -1.0965842008590698, 0.3344517946243286, 5.06625509262085, -0.26273274421691895, -2.291105270385742, 1.437657117843628, -0.46924886107444763, 0.5913109183311462, -2.7366275787353516, -4.258198261260986, 4.3238630294799805, 3.392183303833008, 0.19327236711978912, 2.0916006565093994, -4.229781627655029, 1.4440361261367798, 2.496108293533325, -0.5718185901641846, 1.2844934463500977, -2.9670896530151367, -0.3494110703468323, 2.444650888442993, -5.554295063018799, 1.7922627925872803, -4.477921485900879, 0.23979905247688293, 0.7950924634933472, 3.354154109954834, 3.7648215293884277, 4.002387523651123, 1.03700852394104, -0.7424588799476624, -0.747087299823761, -0.35536155104637146, 1.478765845298767, -1.1725050210952759, 0.457451730966568, 1.706812858581543, -1.1370282173156738, 0.38487479090690613, -1.2322914600372314, -5.03274393081665, -4.228187561035156, -0.6503980159759521, 1.4518556594848633, 0.34141305088996887, 2.9639499187469482, 0.62786865234375, -2.555616855621338, -3.0853793621063232, 0.5655776262283325, -5.926087379455566, -0.6000630259513855, -0.4027203917503357, -0.4925157129764557, -2.452976942062378, 1.0469924211502075, 1.7627192735671997, 2.3034582138061523, 3.917992353439331, -0.7613748908042908, -1.0948745012283325, -0.39740902185440063, -3.4186253547668457, 0.6245608925819397, -0.2098216414451599, -1.9092230796813965, -2.178650140762329, -4.5010085105896, 3.2316954135894775, 2.955289840698242, 2.3127593994140625, 2.000962018966675, 0.8655766844749451, 1.269898533821106, 1.6150658130645752, -0.5559079051017761, 4.536555290222168, -0.9081788659095764, 5.060380458831787, -3.1440513134002686, 0.4749728739261627, -2.6961705684661865, 0.48110538721084595, -1.5157006978988647, -2.390120506286621, -2.559065341949463, 2.193802833557129, 3.6765360832214355, 3.9819557666778564, -1.4238238334655762, 1.3990014791488647, -5.17081880569458, 2.618035316467285, 0.4750138223171234, -0.4044628143310547, -3.6771671772003174, 0.7836385369300842, 0.7756246328353882, -3.7117950916290283, -2.2234394550323486, -0.6963503956794739, -1.0420076847076416, -0.6737702488899231, -1.6158595085144043, -0.23435267806053162, -0.8022506237030029, 1.1232982873916626, -0.045963115990161896, -1.8619283437728882, 2.048210859298706, -2.7934417724609375, -2.1800734996795654, -2.365126132965088, -7.31683349609375, -3.9046688079833984, -2.8341493606567383, -1.774977207183838, -0.9284342527389526, -2.0185604095458984, 1.9754153490066528, 1.8228507041931152, 3.101613998413086, -0.5012308359146118, -0.622053325176239, 1.690057635307312, 5.319388389587402, -0.4459887146949768, -2.209606647491455, 0.8800396919250488, 0.9330681562423706, 4.268242835998535, 4.140341758728027, -0.49039381742477417, 1.4208073616027832, 1.144311547279358, 0.3244566321372986, 2.9179792404174805, 0.35879212617874146, 3.0273144245147705, 0.3386215567588806, -0.8572790622711182, 2.599278450012207, -1.9755042791366577, 0.7163757681846619, 0.9644004106521606, 1.3313040733337402, -2.93749737739563, -1.9620243310928345, 2.5053915977478027, 0.8777453303337097, -1.1620169878005981, -1.8972275257110596, 3.337865114212036, -8.000229835510254, 0.30823370814323425, -0.6783313751220703, -0.35400134325027466, -0.5643881559371948, -2.711589813232422, 1.0459197759628296, -4.5445404052734375, 2.89302659034729, 1.04561185836792, 1.9752637147903442, -0.28261321783065796, -2.9703288078308105, -3.6222126483917236, -1.4383187294006348, 0.4069873094558716, -1.1182414293289185, 0.9198808073997498, -1.1735683679580688, 0.46487268805503845, 0.7948731184005737, -1.2332675457000732, -2.6994524002075195, -1.1529998779296875, 1.5351437330245972, -1.7849645614624023, 2.2038156986236572, -0.5266463160514832, 0.9077516198158264, 0.7357850074768066, 1.5007072687149048, -2.07084321975708, 2.605992078781128, -1.2520309686660767, -2.479884624481201, 2.3317666053771973, -1.2373405694961548, -0.3232228457927704, -1.4383701086044312, -0.021065227687358856, -2.227372884750366, -0.010048680938780308, -0.2604563534259796, 2.2095255851745605, 0.06470528990030289, -1.1263781785964966, -3.3996922969818115, 4.104774475097656, -0.04152122139930725, -6.401206016540527, 1.31611967086792, 1.9218440055847168, -0.6866925954818726, 2.3602161407470703, -2.5231804847717285, 0.6667537093162537, -1.0170143842697144, 0.9186195731163025, -2.131070137023926, -0.43874800205230713, -1.2322452068328857, -1.3605345487594604, -1.1996880769729614, 0.2085247039794922, -0.4078119695186615, 0.6022486090660095, 1.3491054773330688, -1.1185091733932495, -3.483367443084717, 0.9417869448661804, -0.8851912021636963, 1.438579797744751, 2.1984684467315674, 0.3961302936077118, -2.8186848163604736, -0.30686628818511963, 1.4371565580368042, -2.253955364227295, 1.5607082843780518, 3.3141539096832275, -5.4006781578063965, -1.0033739805221558, -1.014626383781433, -1.5705243349075317, 1.809509038925171, -3.0059304237365723, 0.429729700088501, 4.336503505706787, -0.47147083282470703, 2.152318239212036, 13.925320625305176, 3.3883864879608154, -3.9347054958343506, 4.762343406677246, 2.4967739582061768, -3.6560683250427246, 2.7617063522338867, 0.40017858147621155, 0.1542196422815323, -2.2952921390533447, -0.366949200630188, -2.6444313526153564, -2.7218775749206543, -1.4602349996566772, 4.774621963500977, -0.20149844884872437, -2.1073617935180664, 1.839576244354248, -1.221210241317749, -1.9074417352676392, 0.07884180545806885, -1.32472825050354, 7.124340534210205, -0.3509941101074219, 2.073611259460449, -1.0720932483673096, 1.6395602226257324, -2.964919090270996, -4.1628828048706055, 2.234105110168457, -0.3229958117008209, 1.0272473096847534, -1.6292227506637573, -0.15278007090091705, 0.5408380031585693, -4.847177982330322, -0.05311593413352966, 1.1312865018844604, 2.1299498081207275, 3.05112886428833, 3.928023338317871, -1.0899431705474854, -2.496884346008301, 0.09822199493646622, -1.8639878034591675, -1.2432682514190674, 6.173817157745361, 3.5335681438446045, 1.3310219049453735, -0.2995573878288269, -4.024162292480469, 1.0739487409591675, -1.0657744407653809, 0.5282360911369324, 0.7411217093467712, 2.536358594894409, 1.6138397455215454, -0.029570886865258217, 2.585991382598877, -1.554215669631958, -3.934455394744873, -2.9784507751464844, -0.044512372463941574, -0.7037416696548462, 0.5606247782707214, 2.2037577629089355, 1.2304697036743164, 1.4468368291854858, 1.0804389715194702, -0.38680657744407654, 0.6009941101074219, 0.4494793713092804, 2.863783121109009, -2.711683511734009, 0.5613974332809448, -1.5130969285964966, 1.191583514213562, 2.803816080093384, 1.3084938526153564, 2.1691229343414307, -1.6228604316711426, -3.6764676570892334, -3.4903674125671387, -3.1390273571014404, -0.7853108644485474, -2.6886606216430664, -1.449549913406372, -1.4155645370483398, -0.8658841848373413, -0.37090253829956055, 0.5015268325805664, -3.600803852081299, 0.3378714323043823, 0.06636380404233932, -0.6803212761878967, 1.0255857706069946, -1.2414180040359497, -3.767253875732422, 0.7778723239898682, 1.7470570802688599, -1.3887659311294556, 1.0858632326126099, 2.7913334369659424, -3.3359079360961914, 0.8880416750907898, 1.0861865282058716, 1.0754972696304321, 0.6781502366065979, -4.427796363830566, 2.6974170207977295, 3.482612371444702, 1.060753345489502, 0.4902668297290802, 3.8678979873657227, 0.742818295955658, -0.3497908413410187, 1.8841522932052612, 1.5679426193237305, -2.5528042316436768, 0.09365323185920715, -2.543358325958252, -2.426629066467285, 0.241494819521904, 0.2625811696052551, 0.7420327663421631, -1.758086085319519, 0.8050040602684021, 1.1659849882125854, 2.09049129486084, -1.1730401515960693, -1.2563282251358032, 1.1017701625823975, 2.4923088550567627, -1.603308081626892, 2.056373119354248, -0.9182299375534058, 2.4902634620666504, -1.7726845741271973, -1.3409607410430908, 1.721696138381958, -0.21937215328216553, -1.5970410108566284, 1.5463968515396118, -2.2399871349334717, -2.689202070236206, -1.655840277671814, 2.9419026374816895, -0.19106371700763702, -1.9395936727523804, -7.63442850112915, -2.799884796142578, 0.7460784316062927, 0.7562136054039001, 1.2043811082839966, -2.5326616764068604, -4.281978130340576, 1.0800150632858276, -4.655853271484375, 0.969577968120575, -1.1482301950454712, 1.5418624877929688, -3.08880877494812, 1.4554804563522339, -0.9221847653388977, 1.3303027153015137, -1.728074312210083, 0.2110508680343628, 1.2447799444198608, 1.4234880208969116, 0.655928373336792, -4.7058000564575195, 0.980875551700592, 2.8168163299560547, 5.50719690322876, 1.512297511100769, 1.3976364135742188, -0.07733888179063797, -1.3017395734786987, -2.4851372241973877, -0.6792453527450562, 0.09318779408931732, 0.7466562986373901, -3.5570878982543945, -1.1876238584518433, -5.330657482147217, 0.40573999285697937, 1.3347523212432861, -0.39044567942619324, -1.4076067209243774, 1.996909737586975, -3.365144729614258, 0.49468058347702026, 3.713127613067627, -8.4945068359375, -6.928589820861816, -0.3166569769382477, -3.051633358001709, 0.963836669921875, 3.7993195056915283, -1.1168889999389648, -3.9914538860321045, 1.6232191324234009, 0.11872398853302002, 3.6148579120635986, -1.9934262037277222, 0.05636120215058327, -0.6629801988601685, 0.8716393113136292, -2.8514983654022217, 1.6635459661483765, 3.114509105682373, -0.422751784324646, 0.645150899887085, 2.2943763732910156, 2.4540634155273438, 0.0672827735543251, 0.42319533228874207, -2.2443456649780273, -2.638045310974121, 0.1538098305463791, -0.4965120851993561, 1.5529780387878418, -0.1867440789937973, 1.0553231239318848, 2.333787202835083, 0.3588300049304962, 0.8439188003540039, 0.791310727596283, -3.3183815479278564, 0.3670140504837036, -1.1726025342941284, 0.7922552227973938, -1.207217812538147, 0.37850844860076904, 2.537259340286255, -1.147470235824585, -0.8211045861244202, 4.31798791885376, -1.8256325721740723, 0.9877752065658569, 1.1042789220809937, -2.028036117553711, -1.5307916402816772, -1.1776632070541382, -0.3931662440299988, 0.14373105764389038, 1.0512595176696777, -2.7358779907226562, -2.7031729221343994, -0.4925054907798767, -2.84689998626709, 1.2910932302474976, -0.286594033241272, -0.8258867263793945, 0.29243966937065125, -1.389451026916504, -7.750943183898926, -0.3456484079360962, -1.8374242782592773, -2.9385907649993896, 1.9873404502868652, 0.421228289604187, -0.28917068243026733, 0.1207314059138298, -3.022954225540161, -3.006281852722168, -3.6395320892333984, -0.04592841491103172, 1.4397656917572021, 3.6836071014404297, 2.425987720489502, 2.349182367324829, 2.8781638145446777, 2.2796523571014404, 1.0492945909500122, -2.0178983211517334, -0.050257593393325806, -0.8684335947036743, -1.6315178871154785, -0.3741435110569, -2.2837867736816406, -0.5467619895935059, -0.1317581832408905, 2.6047940254211426, 4.653141021728516, 0.6582071781158447, 0.03339575231075287, -1.7306127548217773, 5.126516819000244, -1.5154420137405396, 1.63021981716156, 0.9060959815979004, 1.0430899858474731, -1.524379014968872, 0.19922564923763275, -1.0476833581924438, -0.49919593334198, 1.9671411514282227, -0.6556757092475891, 1.3037986755371094, -4.087615013122559, -0.035534899681806564, -0.6530380845069885, -1.9110877513885498, -0.39812588691711426, 1.741985559463501, -0.14757144451141357, 1.0144023895263672, 2.859447956085205, -1.64835524559021, 0.8900044560432434, -1.1324634552001953, -2.0541436672210693, -0.12712179124355316, -1.9320201873779297, -3.4832119941711426, 0.9167724847793579, 0.2866372764110565, -2.497847557067871, 2.225536823272705, -2.347992181777954, -3.556384325027466, -3.5115976333618164, -3.4341421127319336, 0.3215564489364624, 0.42333561182022095, -2.633776903152466, 3.4280056953430176, -0.11355509608983994, 4.4162445068359375, 0.652360737323761, 0.3693672716617584, 0.8406402468681335, 0.5800317525863647, -0.40339264273643494, -1.32255220413208, 2.2589235305786133, -0.5896028876304626, 2.833510160446167, -2.1973671913146973, -2.1433517932891846, -1.958458423614502, 2.0094025135040283, -1.693271279335022, -0.6070998907089233, -3.7324821949005127, -2.042354106903076, 1.8593354225158691, 1.4811488389968872, 0.23461775481700897, 1.338157296180725, -0.3191300332546234, 3.6604349613189697, 3.7230405807495117, 1.0450537204742432, 0.7657374143600464, 2.0246214866638184, 3.0788414478302, 2.5447030067443848, 3.4321486949920654, -1.689874529838562, -0.5165721774101257, 0.4127790629863739, -1.9836186170578003, -1.372557520866394, -5.794012069702148, 1.5125136375427246, 1.3957287073135376, -3.70979380607605, 0.8486475944519043, 1.6273560523986816, 1.9299976825714111, -1.2916944026947021, -3.3648147583007812, -2.9207775592803955, -2.6380021572113037, 4.995087623596191, 2.9598748683929443, 0.3785438537597656, 0.4166192412376404, 3.0350608825683594, -0.8804364800453186, 1.496321201324463, -0.3164386749267578, -2.5588836669921875, -1.9835740327835083, -2.1071789264678955, -2.6062724590301514, 0.060028985142707825, 3.6234116554260254, 2.1669507026672363, -2.9112284183502197, 0.3972020447254181, -2.8265020847320557, 2.8438220024108887, -4.806768894195557, -6.963743209838867, -3.9642608165740967, 9.188138008117676, -0.18345701694488525, 3.740765333175659, 6.767358303070068, 0.17286311089992523, 1.1201016902923584, -0.6706677675247192, -0.8333630561828613, 1.7104347944259644, 1.9785096645355225, -2.720334768295288, 0.80999356508255, 1.9967111349105835, 3.083427906036377, -1.4512670040130615, -3.5462236404418945, 4.763698577880859, -0.8390009999275208, -0.02801389992237091, -1.4283075332641602, -2.749688148498535, 3.445946216583252, -2.0499844551086426, -0.16562716662883759, 2.462021589279175, -0.36010804772377014, -0.6161695122718811, -1.4864997863769531, -3.835376024246216, 2.3617639541625977, 0.8495863676071167, 0.18596042692661285, 3.7576193809509277, 4.860504627227783, 1.8053585290908813, 2.7769103050231934, -2.862537145614624, -1.1383543014526367, 0.1966051161289215, 1.208785057067871, 2.218079090118408, -1.777130365371704, -4.217644214630127, -2.128676652908325, 0.36872467398643494, 0.6467520594596863, 0.420412540435791, 1.4152511358261108, 1.496568202972412, -0.09782244265079498, -0.7595303654670715, 1.7761812210083008, -1.7302031517028809, 3.6339685916900635, -0.9662454128265381, 1.4717026948928833, 5.134150981903076, 0.0950796976685524, -0.05794414505362511, 0.24549096822738647, -1.9405808448791504, 1.7366737127304077, -0.5531566143035889, 0.2575986385345459, -1.1394054889678955, 3.2992188930511475, -0.23203109204769135, 4.314737319946289, -3.105592966079712, 2.4010543823242188, 2.02353835105896, 2.075608968734741, 0.6884871125221252, -1.979292631149292, 0.9862112998962402, 1.0455793142318726, -0.45799267292022705, 1.1594181060791016, 2.206686496734619, 4.866871356964111, -2.527500867843628, 2.951281785964966, 3.5269134044647217, -0.02973773330450058, -0.695919930934906, -3.5594143867492676, 3.4591355323791504, -0.07023453712463379, 2.777527093887329, 1.1756397485733032, -2.130584955215454, 0.2641402781009674, 1.3519498109817505, 3.8786544799804688, 2.877559185028076, 1.6023885011672974, 0.45966294407844543, -0.12839673459529877, -6.096737384796143, -1.9154478311538696, -0.20558804273605347, -1.9859083890914917, -0.11524983495473862, 0.643292248249054, 1.6555390357971191, 1.601739764213562, -3.183210849761963, 1.7148385047912598, -0.009530105628073215, 1.4066699743270874, -1.0563966035842896, 2.9099512100219727, 1.8363051414489746, 0.24004903435707092, -0.3675619661808014, 2.521517038345337, -2.0683305263519287, 2.403411865234375, 0.6963122487068176, 1.0661150217056274, 1.6288868188858032, -1.3240654468536377, -2.9048776626586914, -3.306037664413452, -2.009368658065796, -2.2537596225738525, 4.363896369934082, -0.9849804639816284, -2.6569344997406006, 0.041730210185050964, -1.91129732131958, -6.234752178192139, -0.45463404059410095, -6.273172855377197, -0.8214718103408813, -0.14008229970932007, -3.773129940032959, 1.6729103326797485, 0.926586389541626, 1.6829426288604736, -2.6960995197296143, -2.560077428817749, -0.9377068281173706, 3.58866810798645, 3.5899252891540527, -1.025821566581726, 2.304710626602173, 0.1121024638414383, -2.4388844966888428, 2.5825915336608887, -1.2303715944290161, -0.48363539576530457, 1.721494197845459, 1.9575861692428589, 1.1553378105163574, 0.47931820154190063, 0.8712751865386963, -4.865447044372559, 2.276536703109741, 1.4118449687957764, 0.9108882546424866, -2.1985740661621094, 4.147949695587158, 6.514428615570068, -0.4900270700454712, 2.138671636581421, 12.697185516357422, 0.1702597737312317, -0.581913411617279, -1.4690150022506714, 3.291365385055542, 1.5840920209884644, -1.2976336479187012, 1.842443823814392, 4.312709808349609, 2.36325740814209, -0.3436778485774994, -1.7422541379928589, 3.236283779144287, -3.1458051204681396, -1.0890759229660034, 2.5912160873413086, 1.21088445186615, 1.1430176496505737, 2.7021613121032715, -1.6227190494537354, 1.8330045938491821, -2.014857292175293, -1.6285412311553955, 0.6879022717475891, -1.3116636276245117, -0.05647524073719978, -0.7523167729377747, -2.0127041339874268, 2.7724740505218506, -3.1865944862365723, 0.5824164748191833, 0.8800039887428284, -3.2591750621795654, 0.8980127573013306, -0.5984199643135071, 1.715185523033142, -1.3693416118621826, 0.1957239955663681, 0.4493981897830963, 0.362431138753891, -0.5357111692428589, 0.21194039285182953, -2.7322158813476562, 0.3757284879684448, 0.7687205076217651, -0.5908454060554504, -2.1876003742218018, 1.4000626802444458, 1.8067703247070312, 0.08723151683807373, 0.29177868366241455, -3.9692893028259277, -2.2889692783355713, -0.13429246842861176, -4.40157413482666, 3.8034214973449707, -0.39560070633888245, 0.2060045450925827, -1.2885974645614624, 2.84647274017334, -1.6097418069839478, 0.7028008699417114, 1.9910683631896973, -4.682865142822266, 0.08241750299930573, 2.0089969635009766, -0.16355599462985992, -1.090924859046936, -2.204105854034424, 3.747685432434082, 1.4953826665878296, 1.1620583534240723, -1.7158586978912354, -0.5470337867736816, 1.1524372100830078, -4.065885066986084, -0.1520935446023941, -0.08945705741643906, -0.5676407814025879, -0.9692826271057129, -4.193799018859863, 2.5574755668640137, 0.05192914977669716, -1.2440725564956665, -0.9702206254005432, -1.4171842336654663, 1.4777820110321045, 0.5708855390548706, 3.234403371810913, 1.435015320777893, 1.5958772897720337, -0.4826149344444275, -0.4240429699420929, -1.2887234687805176, -2.4319846630096436, 3.517615556716919, 0.4199928343296051, 0.25387975573539734, -2.0640511512756348, 0.9562495350837708, -1.2582275867462158, 0.055465783923864365, -0.12762285768985748, 0.107339046895504, -1.4519932270050049, 0.3314581513404846, -0.8374611735343933, 2.369969367980957, -3.352442741394043, 0.10707128793001175, -3.445869207382202, -0.5676386952400208, 0.4549739956855774, -2.532949209213257, -1.1349865198135376, -0.5804040431976318, 0.13103124499320984, -2.0054023265838623, -1.3924400806427002, -2.369096279144287, -3.140526533126831, -0.5808191299438477, 0.874461829662323, -0.188277930021286, -1.9577866792678833, 1.1555860042572021, -0.0653008297085762, 3.690464496612549, 0.11360576003789902, 3.811629056930542, -4.0423970222473145, -4.366100311279297, 1.8321009874343872, 0.3742154836654663, -2.1414084434509277, 3.518573760986328, -1.3776410818099976, 1.5458232164382935, 2.419893980026245, -2.0645220279693604, 2.82112193107605, -2.486698627471924, -1.2540570497512817, 1.1698811054229736, 2.586034059524536, -2.9038424491882324, -1.2867175340652466, -3.596688747406006, -0.269835889339447, -1.048559546470642, -1.24339759349823, 0.6452747583389282, 1.4447095394134521, -0.3660987615585327, -3.9566009044647217, -2.0376088619232178, 4.2675933837890625, -0.042271699756383896, 0.27036112546920776, 0.6396157741546631, 0.9426888227462769, 3.0495753288269043, 0.7582582235336304, -0.45967456698417664, -15.701238632202148, -0.4160144627094269, -1.5584930181503296, -2.840134859085083, 1.3236922025680542, -5.107154846191406, -1.2027043104171753, -0.0928250327706337, -0.316132515668869, 3.304638385772705, 1.8706815242767334, -2.0473625659942627, -0.17349372804164886, 1.6978036165237427, -0.07119304686784744, -2.4761178493499756, -1.2115349769592285, 0.09616711735725403, 1.3279376029968262, -0.20660977065563202, -3.7437589168548584, 4.035397052764893, 5.1511125564575195, 0.13733580708503723, 4.3706889152526855, 0.47816595435142517, -4.939548492431641, 3.9821362495422363, 1.2960107326507568, -2.241407871246338, -0.5270397663116455, 0.3211750388145447, -0.9446754455566406, -2.263381004333496, -0.5284557938575745, -0.5716449022293091, -6.144455909729004, -0.20366817712783813, -0.9872948527336121, -0.4124278724193573, 1.2847188711166382, 0.009244943968951702, -0.19489696621894836, -0.8176560997962952, -4.316583156585693, -3.7163844108581543, 1.3861830234527588, 3.8930490016937256, -1.3680702447891235, -0.24294474720954895, -2.7681002616882324, 1.7113655805587769, -0.606324315071106, -0.6169490814208984, -7.158268928527832, 3.565070867538452, -3.822112798690796, -1.6086783409118652, 1.4382401704788208, 0.4208219647407532, -3.7997119426727295, -1.4455845355987549, -3.0762925148010254, 0.04034845158457756, 1.4584095478057861, 1.9918564558029175, -0.6388969421386719, 0.5506566762924194, 0.41992610692977905, 0.43102705478668213, -0.6727173924446106, -0.5633061528205872, 2.898101568222046, -0.06702973693609238, 2.3525285720825195, 1.7557615041732788, 2.0484392642974854, 0.37812069058418274, 1.176210641860962, -0.8906222581863403, -1.1188939809799194, -4.2457194328308105, -4.281935214996338, -0.45042505860328674, 0.5453838109970093, -3.830627679824829, 3.9956893920898438, -0.932000994682312, 1.8395558595657349, -2.7929651737213135, 0.2916111350059509, -1.8485019207000732, -1.039182424545288, -3.2927796840667725, 1.0021835565567017, 2.791674852371216, -0.08592307567596436, -2.6002085208892822, -3.934725284576416, 1.4596346616744995, 0.6913354992866516, -0.7221489548683167, -0.3737444579601288, -0.12355824559926987, -0.9695915579795837, -0.8177955150604248, -2.2838408946990967, 0.7469481229782104, 1.400248646736145, 0.15970098972320557, -5.866583347320557, 0.6808104515075684, 2.648599624633789, -4.547426700592041, -1.2506881952285767, -1.9755067825317383, -1.213073968887329, 0.6373104453086853, -2.8238868713378906, 2.2079269886016846, -1.1285902261734009, 0.6823954582214355, -4.364758014678955, 1.9091730117797852, -4.315164566040039, -0.12873969972133636, 3.0962893962860107, -2.5603556632995605, -1.615820288658142, -2.060540199279785, -2.1927671432495117, 2.989285469055176, 4.0191192626953125, 3.6707019805908203, -1.870025634765625, -3.3607120513916016, -1.3941831588745117, -3.0161614418029785, 1.6153520345687866, -3.17976450920105, 0.5760121941566467, 2.39695143699646, -1.6365699768066406, 0.7151207327842712, -0.5775105357170105, -2.692244529724121, -0.11869021505117416, 2.8183553218841553, -0.8114098906517029, -4.388206958770752, -0.7958301305770874, -1.8015962839126587, 2.151258707046509, -2.683326244354248, -1.2617017030715942, -5.878039360046387, 3.791125535964966, 2.1123387813568115, 0.3713659644126892, 4.008230686187744, -1.6238168478012085, -2.4058170318603516, -0.192941814661026, -0.2454437017440796, -3.0263428688049316, 0.5038865804672241, -0.5672710537910461, 0.4844038188457489, -4.140225887298584, -1.6168080568313599, -1.179776668548584, 1.833924651145935, -0.994143545627594, 3.737584352493286, -2.54579496383667, -0.6079219579696655, 2.046074151992798, -0.8043409585952759, -0.8280113339424133, -1.1323226690292358, 1.0587517023086548, -1.4634441137313843, 2.5994420051574707, 2.0451130867004395, 0.21864581108093262, 1.4689136743545532, -0.26963692903518677, 0.5055298805236816, 0.6850299835205078, -1.566035509109497, 0.48955920338630676, -1.4859213829040527, 3.471837043762207, 1.581892490386963, 2.0964314937591553, 2.0870323181152344, 8.435992240905762, -1.9760631322860718, 1.7222981452941895, -0.004874862730503082, -0.27196624875068665, -4.229193210601807, 1.550600528717041, -0.2807212471961975, -0.4815188944339752, -0.9566815495491028, 1.2792444229125977, 0.8331828117370605, -2.6063625812530518, -1.6821216344833374, -2.3349037170410156, 1.8884581327438354, -2.1717031002044678, -0.7671651840209961, 0.6128094792366028, -0.9759376645088196, -1.4117028713226318, -0.051028959453105927, -2.9533774852752686, 2.115994453430176, -1.4546232223510742, 3.0259058475494385, -0.6864786148071289, 2.7231955528259277, -2.7301056385040283, -3.702298164367676, -2.0040838718414307, 1.268046498298645, -1.021027684211731, 2.687023401260376, -2.0586564540863037, -0.6545397639274597, -1.379477858543396, 0.5673496723175049, 3.4700703620910645, -1.3382890224456787, 4.866246700286865, 0.8660249710083008, 0.3975282311439514, 0.3135291337966919, -1.3822522163391113, -1.7034674882888794, 0.4826319217681885, 2.3688549995422363, 3.266291379928589, 3.688753128051758, 2.2783472537994385, -2.1834399700164795, 0.14295364916324615, 0.4503699839115143, 1.7289085388183594, -1.9512842893600464, -0.21388515830039978, -1.1007331609725952, -2.500394821166992, -1.7623755931854248, -0.6051106452941895, 1.5108247995376587, -0.2411470264196396, 1.8177787065505981, 2.82437801361084, -1.0844836235046387, -2.26870059967041, 0.7420249581336975, 0.7531202435493469, 1.2801417112350464, -0.4092317819595337, -1.4025123119354248, 0.8112481832504272, 1.1145027875900269, 1.2985749244689941, 1.3352473974227905, 0.23345571756362915, -0.2348545789718628, 3.0657458305358887, 3.0020275115966797, 2.2588510513305664, 1.1705591678619385, -2.702425241470337, 1.1414426565170288, 0.7925302386283875, -0.9114995002746582, -3.437647819519043, 0.5685771703720093, 2.4016709327697754, -0.7104046940803528, -0.49384787678718567, 1.5193171501159668, -0.7541487216949463, -0.12032226473093033, 3.006114959716797, -1.442863941192627, -1.1988327503204346, -3.3316681385040283, -4.13327693939209, -2.686556339263916, 2.5955958366394043, 0.10486505925655365, -0.09457852691411972, -2.8425934314727783, 1.4546819925308228, -0.5347263216972351, 5.051701545715332, -1.6655638217926025, 1.5234990119934082, -0.2312779277563095, 2.778075695037842, -2.558663845062256, 1.3201924562454224, 0.6502883434295654, -2.151087760925293, -0.1096835732460022, -0.5541249513626099, 2.7854559421539307, 2.0658340454101562, -1.3783692121505737, -1.3417465686798096, -1.7596029043197632, 1.7820526361465454, 2.6531965732574463, 5.049012660980225, 1.2668673992156982, -1.8426216840744019, -2.9864134788513184, 1.929665207862854, -0.3497783839702606, 2.728487491607666, -0.40557560324668884, 0.6990113258361816, 2.051792621612549, -0.2968551218509674, -1.4910939931869507, 0.1516103893518448, -1.2123737335205078, -0.029318474233150482, -4.456618785858154, 2.538809299468994, -1.1352031230926514, 1.0192277431488037, -3.1692354679107666, -0.09158816933631897, -1.4177887439727783, -0.013344619423151016, -2.2111384868621826, -3.2617032527923584, 0.45793554186820984, 3.9405829906463623, 2.1735217571258545, -1.3528891801834106, -2.521921396255493, 0.5065068006515503, -4.01235818862915, 0.8525381684303284, 0.6978675127029419, -6.160739421844482, -0.9164103865623474, -0.805870532989502, -2.6573102474212646, -0.08076635748147964, -3.284416913986206, 1.4471145868301392, -1.2000759840011597, -3.713405132293701, 2.2166850566864014, -1.812878131866455, 2.7114756107330322, 0.6235495209693909, -0.6086971163749695, -1.331510066986084, -0.12749147415161133, -0.17716072499752045, -1.8694998025894165, 0.6047096252441406, -2.85516095161438, 0.1358904242515564, 0.7805721759796143, -1.4753942489624023, -0.39021924138069153, 2.9148035049438477, -1.811692237854004, -5.235791206359863, 7.800781726837158, 0.6893172860145569, -1.3959850072860718, 0.36975839734077454, 0.9769801497459412, -3.079468250274658, -0.6729356050491333, -0.4710131883621216, 1.9317784309387207, -0.8172504901885986, 2.3907625675201416, 0.4019831120967865, -3.3447656631469727, 0.3331543207168579, 3.5188796520233154, -0.1669885665178299, -1.8466448783874512, 1.465531349182129, 3.175078868865967, 0.1701231598854065, -0.9683067798614502, -4.42292594909668, 2.5984442234039307, 2.7046470642089844, -4.395741939544678, 3.746337652206421, 0.4244031310081482, 1.5427885055541992, -2.199817419052124, 3.163393259048462, 0.3206281065940857, 0.3537555932998657, -2.8342480659484863, -2.5620577335357666, -3.0775763988494873, -0.7712145447731018, -3.0951051712036133, -3.8998899459838867, 0.6240130066871643, -0.2558455765247345, 0.9448128938674927, -0.5790820121765137, -4.960383415222168, 1.5617133378982544, 1.887992024421692, 1.5062764883041382, -0.6209832429885864, -1.7849290370941162, 0.3490074574947357, -1.1174975633621216, 0.1620357185602188, 1.8000510931015015, -3.592987060546875, 1.2271937131881714, 1.4910303354263306, 2.7791011333465576, 0.179953470826149, -3.1681017875671387, -4.190149784088135, -1.2405109405517578, -2.385498523712158, -1.545311689376831, -0.947026252746582, 0.9008129835128784, -2.256457805633545, -0.2809835374355316, 1.023740291595459, 1.4511172771453857, -1.1371289491653442, 1.7444106340408325, 0.37013667821884155, 1.6489911079406738, 1.9184602499008179, 0.7044113278388977, 0.7469933032989502, -0.5680955052375793, 2.045294761657715, 0.9659559726715088, -2.065915107727051, -1.0256820917129517, 4.245923042297363, 0.006346825510263443, -1.6172049045562744, 3.3857743740081787, 3.8178958892822266, 0.7492371797561646, -2.13700270652771, 3.236737012863159, -3.0956428050994873, 1.656744122505188, 3.2310705184936523, -1.5321632623672485, -1.5883708000183105, -2.008495330810547, -4.471986770629883, -0.16234588623046875, -3.660121202468872, 1.174878478050232, -0.09413106739521027, -0.846261203289032, 2.0979487895965576, 0.24388058483600616, -0.2104274481534958, 0.9922427535057068, 3.184767484664917, -0.14923042058944702, 0.9851386547088623, -1.208364486694336, -2.944791555404663, -0.18839019536972046, 1.1857635974884033, -3.224734306335449, -0.7380123734474182, -0.17483972012996674, 1.3187201023101807, -0.5272297859191895, -0.33452925086021423, 1.0812890529632568, -2.4462406635284424, -0.9421428442001343, -1.5154457092285156, -1.282760739326477, -2.7113687992095947, 2.200863838195801, -1.4985806941986084, 0.4371044933795929, -1.2834148406982422, -1.023317813873291, -0.13607177138328552, -1.1731070280075073, -1.8092199563980103, -1.882957100868225, 1.2429536581039429, 2.7756540775299072, -1.2731683254241943, -0.042966458946466446, 3.493950366973877, 1.3863978385925293, -4.050278186798096, -2.4437808990478516, 4.007221221923828, 0.4056324362754822, -3.8610963821411133, -3.38032603263855, 0.03226513788104057, -1.0253623723983765, 1.8055856227874756, -1.2915111780166626, 2.348266839981079, 1.1229572296142578, 0.10846365243196487, -3.6355996131896973, 0.5546815991401672, -4.654440879821777, -0.6421487331390381, -3.0278685092926025, -2.867966890335083, -0.6417133212089539, -0.16655917465686798, -3.450296401977539, -0.7937993407249451, 0.5898528695106506, -2.2386786937713623, 2.9741051197052, 1.339334487915039, -0.6514186263084412, 2.0515005588531494, 0.3516179025173187, -0.9486892819404602, -1.0090086460113525, 0.6849254965782166, -1.6117932796478271, 0.5698704719543457, 0.9454623460769653, -0.10806802660226822, -0.028700638562440872, 2.1129589080810547, -0.7664430141448975, 3.493565559387207, 2.277860641479492, 0.43103259801864624, -0.7954084277153015, -0.45603346824645996, -0.08248656988143921, 1.7076635360717773, -1.6586490869522095, 0.23354007303714752, 1.2805887460708618, -0.6881493330001831, 0.47190213203430176, -0.2762589454650879, 1.2222782373428345, 0.2796950340270996, -2.0277211666107178, 3.638150930404663, -2.135806083679199, 2.349430799484253, -4.51079797744751, 0.8877189755439758, 6.042593479156494, 4.425210475921631, 0.31864118576049805, -2.21217942237854, 2.2608113288879395, -1.1744673252105713, 1.1684428453445435, 0.3420531749725342, -1.0366369485855103, -1.0127311944961548, -1.166195034980774, -0.264197438955307, 0.9961564540863037, 0.323848158121109, -0.25178733468055725, -4.579461574554443, 5.1684651374816895, 1.79317045211792, -1.1832327842712402, -0.1807108372449875, -3.895479440689087, -0.4131743609905243, 0.4652029871940613, 7.835202693939209, -1.1595900058746338, -1.9003138542175293, 1.7877007722854614, -1.2662034034729004, -0.09854788333177567, -0.3883928656578064, -7.287370681762695, 3.667846441268921, -0.9919368028640747, 0.24373267590999603, 1.3886449337005615, 0.9123986959457397, 0.20600004494190216, 0.06547829508781433, 2.691607713699341, -0.21633510291576385, -0.38329410552978516, 1.4984630346298218, 0.5484828948974609, 1.2277079820632935, 1.3605073690414429, 1.0617624521255493, 1.6541001796722412, -3.382378101348877, 2.567620038986206, -2.9945969581604004, -0.15206611156463623, 2.4816489219665527, 1.1608166694641113, 2.0143792629241943, -0.17348000407218933, 1.2482471466064453, -3.5860490798950195, 2.390685796737671, 1.7716898918151855, 1.6533682346343994, 0.6247808933258057, 1.010632038116455, -6.2842535972595215, 2.7807137966156006, 1.0555744171142578, -0.8460332155227661, -0.21186766028404236, 3.3283729553222656, 1.585921049118042, 2.437859535217285, 0.6931448578834534, -1.2054883241653442, 4.639156818389893, 0.1083696186542511, 3.1426844596862793, -0.4508814215660095, 1.0100650787353516, -2.0203123092651367, 0.5920539498329163, -0.23498451709747314, 2.3935446739196777, -0.2516234219074249, 2.5892913341522217, -4.157615661621094, -1.2084118127822876, 4.121028900146484, 2.126889228820801, -7.720630645751953, -1.5864404439926147, 1.4380946159362793, 0.2759478986263275, 0.5595775842666626, 1.78251314163208, -3.7740933895111084, 2.2429065704345703, -2.6186399459838867, 1.3426378965377808, -5.023711204528809, -1.9554263353347778, 2.0357346534729004, 3.2912678718566895, 0.8752732872962952, 1.3105992078781128, 4.317091941833496, -2.599243640899658, 2.139681339263916, 2.044283390045166, 2.4469966888427734, 0.8667670488357544, -0.9687913656234741, -0.1394311636686325, -1.0836305618286133, -0.3886713981628418, 1.8284778594970703, -0.823431670665741, 0.47136932611465454, -2.7638113498687744, -1.2559083700180054, 0.02866676077246666, -0.28781163692474365, 0.10259942710399628, -0.13134489953517914, 1.3004626035690308, -0.6438793540000916, 1.9256572723388672, -1.2391602993011475, 0.20152561366558075, -0.9481260180473328, 2.111696481704712, -1.5989331007003784, 0.7208812832832336, -1.7750318050384521, -2.3928825855255127, 2.1840922832489014, 1.3893780708312988, 1.6998844146728516, -0.1922273337841034, -8.971657752990723, -0.9873470067977905, 2.007349967956543, -0.22541534900665283, -0.5809320211410522, 4.992176532745361, 1.8170965909957886, 1.9098560810089111, 2.8335773944854736, 0.7733706831932068, -2.845320463180542, 0.9251722693443298, -3.1696560382843018, 0.2922274172306061, -3.9364640712738037, -0.1688007265329361, -0.6000857949256897, 4.981055736541748, 0.016525806859135628, -0.9914820194244385, -1.2189643383026123, 3.042454242706299, 3.1922268867492676, -3.612807273864746, -1.3446154594421387, -1.1116658449172974, -2.3935282230377197, -3.0040173530578613, 1.156960129737854, 8.931266784667969, -2.8200531005859375, 3.1291069984436035, -0.2172153741121292, -2.545248031616211, 0.38167017698287964, 2.3774607181549072, 1.8678227663040161, 0.45667481422424316, -3.944322109222412, -0.9412893056869507, 2.008579969406128, 0.04658455401659012, 0.5057538151741028, 2.7840840816497803, -0.7066482305526733, -2.3209893703460693, 0.6556432843208313, -0.5718920826911926, -0.9998102188110352, -1.5913628339767456, 1.662937045097351, -1.2158375978469849, 2.3553059101104736, 0.6069485545158386, 0.6065371036529541, -0.34541055560112, 3.669328212738037, 0.7335911989212036, -2.3117082118988037, -2.910933256149292, -3.7470932006835938, 0.8560271859169006, 0.9027539491653442, 3.726378917694092, -2.3590598106384277, -2.798882484436035, 1.2223103046417236, -2.194977045059204, 2.2480030059814453, -0.7471742630004883, -0.13222470879554749, 0.6265264749526978, 1.9396625757217407, -1.68454909324646, -2.4099297523498535, 1.755069613456726, 5.170214653015137, -2.663236618041992, 0.48841914534568787, 1.2020063400268555, 2.8858320713043213, 6.340968608856201, -2.778583526611328, 2.714036464691162, 0.3965836465358734, 6.065841197967529, -11.787812232971191, 0.8034173846244812, 1.1457864046096802, -0.5998978614807129, 0.20396718382835388, -0.6821736693382263, 1.0649672746658325, -2.2056167125701904, -3.083397150039673, -0.564154863357544, -0.07066323608160019, -1.5898175239562988, -1.0068533420562744, 2.1032211780548096, -0.008581727743148804, 0.7641226649284363, -1.0521985292434692, 0.3103034794330597, -1.0028390884399414, 3.6572153568267822, 0.8466099500656128, -1.9013910293579102, 2.57255220413208, 0.12370794266462326, -1.1825006008148193, -1.4730757474899292, 1.7853822708129883, -1.078636884689331, -4.4882073402404785, 2.8728175163269043, 1.142884612083435, -0.2284722775220871, -0.5572024583816528, 3.4876043796539307, 1.4424128532409668, -1.0775549411773682, -2.7868144512176514, -2.5481228828430176, -2.5063586235046387, -6.6909565925598145, 1.6144496202468872, 0.46227070689201355, -1.7164525985717773, 2.900507926940918, -2.15141224861145, 0.8296266198158264, 1.196572184562683, 2.0440402030944824, -1.478469967842102, -1.4952293634414673, -1.2604116201400757, 1.660720944404602, -1.5933164358139038, -2.1480607986450195, 0.7711711525917053, -2.3993406295776367, -0.06966866552829742, 2.059946298599243, -0.4566715359687805, -2.786612033843994, -0.17776893079280853, -2.242995500564575, -1.2581150531768799, 1.5545164346694946, -1.27358078956604, -2.3586783409118652, 1.9385241270065308, 0.6924269199371338, 4.487100601196289, 1.8668091297149658, -1.3038583993911743, -0.5718802809715271, -3.406736135482788, -1.8740988969802856, -2.579559087753296, 3.5575191974639893, -1.9012168645858765, -0.6446453332901001, -3.706104040145874, -1.274909496307373, 1.0854158401489258, 4.938322067260742, -0.034317463636398315, 1.0041160583496094, 3.406726598739624, 0.11912145465612411, 0.7376524806022644, -0.5364018082618713, -5.205355167388916, -1.0971821546554565, 1.9131735563278198, -2.839462995529175, 0.31031131744384766, -1.8573670387268066, -0.8996046185493469, -2.4299445152282715, 1.8416870832443237, 2.803520441055298, -0.5805333256721497, -3.6960997581481934, -0.44925570487976074, 3.5367813110351562, -0.09617689996957779, -0.6000037789344788, -2.3268606662750244, 3.1169939041137695, -2.785689353942871, -3.7839083671569824, 1.1033016443252563, 2.789825201034546, 4.187553405761719, -1.4831428527832031, 1.2709972858428955, 0.27063480019569397, 0.6509571671485901, -1.13896644115448, 0.37703800201416016, -2.9458916187286377, 2.3231711387634277, 2.843731641769409, -1.5839462280273438, 1.301965594291687, 1.0808913707733154, -0.09253580868244171, 2.5825629234313965, -2.641355037689209, 3.967339515686035, 0.16500918567180634, 1.1113405227661133, -0.3417763411998749, 5.666118144989014, -4.310584545135498, 1.2457000017166138, 3.3009891510009766, 2.7098779678344727, 2.898106098175049, 0.2768726050853729, 1.1578888893127441, -1.2840030193328857, -2.37660813331604, 0.5253475904464722, 1.6571922302246094, -3.323050022125244, 0.9949317574501038, -1.4239201545715332, 0.9542580842971802, 0.6072998642921448, -10.661696434020996, -0.23642340302467346, 1.4909578561782837, 0.5756940245628357, 1.3008942604064941, -2.070050001144409, 2.3093905448913574, 0.7659512162208557, 5.448395252227783, -1.1824164390563965, -0.43276455998420715, -0.025600099936127663, -5.757782936096191, -1.9699561595916748, 3.3015270233154297, -1.67880117893219, 3.273810863494873, -1.3143211603164673, 2.4338598251342773, -1.2256782054901123, 1.060526967048645, 2.42153263092041, -2.184488534927368, -2.4942080974578857, -2.2626547813415527, -1.8657258749008179, -0.11283643543720245, -2.3165695667266846, -0.7247585654258728, -0.4328407049179077, 1.9608774185180664, -2.3054418563842773, -0.30193960666656494, -0.4817558228969574, 1.0177124738693237, 4.7339277267456055, 4.79755163192749, -0.9943634271621704, -1.8012257814407349, 2.0729146003723145, -0.39120686054229736, -4.84207820892334, -0.3163617253303528, 0.9298372864723206, -2.6393449306488037, -2.262521266937256, 3.1610026359558105, -1.3447810411453247, -2.328961133956909, -1.170893907546997, -2.5291669368743896, -0.16013331711292267, -3.787527322769165, 2.2011194229125977, 2.070230722427368, 0.8022129535675049, 3.5476224422454834, -0.9972091913223267, 1.0731102228164673, 0.2406175583600998, -3.7186801433563232, -2.944087028503418, 12.510017395019531, -2.298562526702881, -1.5660927295684814, 0.35169124603271484, 2.3065826892852783, 1.8930768966674805, 1.3475706577301025, -4.768709182739258, 2.1381618976593018, -1.0250808000564575, 1.187092900276184, -0.7073611617088318, 0.4088502824306488, -1.0477856397628784, 9.250051498413086, -2.636702537536621, -3.23117733001709, -0.6294367909431458, -0.9858583211898804, 3.7684643268585205, -0.30768242478370667, 1.931359052658081, 0.6786062121391296, -0.3412635922431946, -0.20887453854084015, 1.0598642826080322, 1.1156891584396362, 4.407458305358887, 2.8946399688720703, -0.5846690535545349, -2.0223982334136963, -4.016970157623291, 1.6537903547286987, 2.9167609214782715, 1.9771865606307983, 1.4950798749923706, 1.4532934427261353, -1.1817007064819336, 0.41118326783180237, 2.620554208755493, 0.2350606769323349, -1.4991718530654907, 2.121272325515747, -1.038002848625183, -5.066666126251221, 0.050933837890625, -1.3453444242477417, -2.6591131687164307, -7.549269199371338, -3.233358860015869, -2.9078307151794434, -0.42613792419433594, -2.6183643341064453, -0.6673247814178467, -0.878889262676239, 2.7374439239501953, -1.421223521232605, -4.577195644378662, 0.2979596257209778, -0.9093871712684631, -1.2072086334228516, -6.008236408233643, -2.6960959434509277, -0.7583881616592407, -1.5450191497802734, 0.6690940260887146, 0.4044799208641052, 0.6745807528495789, -1.5859040021896362, 1.2908393144607544, 1.131693959236145, -1.950098991394043, -10.564895629882812, -0.8293746709823608, -1.8180145025253296, 1.0544989109039307, 2.9771780967712402, -2.0215115547180176, 0.7161983251571655, -2.942410469055176, -4.577591896057129, -0.4214494526386261, -3.7902565002441406, 2.4193687438964844, 0.6361039876937866, -1.1446858644485474, 0.21051979064941406, -1.8156347274780273, 3.1779873371124268, -0.12834787368774414, 0.7596103549003601, 0.20441102981567383, 2.763517379760742, 0.4530889093875885, -2.5710699558258057, 0.1512860506772995, -0.02258237637579441, 9.799036026000977, 1.1878324747085571, 1.8333076238632202, 1.8810205459594727, 0.6084635853767395, -1.1707195043563843, 0.9980959296226501, 2.7834432125091553, -1.297623872756958, -4.611412525177002, -0.9295774698257446, -0.835878312587738, 1.9822056293487549, -2.5864131450653076, 5.412862300872803, -2.9803972244262695, -1.6079275608062744, -3.734367847442627, 0.7598934173583984, 1.213516116142273, -0.9531375765800476, 1.9202756881713867, 0.8468578457832336, 2.6616971492767334, -0.32624712586402893, 1.1421434879302979, -3.983919620513916, -0.578429102897644, 0.11419153958559036, 1.5656777620315552, 3.2403104305267334, -0.43378111720085144, 1.1904046535491943, 0.5534138679504395, -0.09146038442850113, -1.6978938579559326, -5.417703628540039, 5.01988410949707, 1.4788066148757935, 2.5310444831848145, -0.1241249293088913, -0.4195098876953125, -5.323048114776611, -1.8477500677108765, -0.5748777985572815, -1.424595594406128, 0.7868162393569946, -1.83393394947052, -0.39235591888427734, 0.7389166951179504, -1.6374051570892334, 1.291599988937378, -1.151351809501648, -1.0876537561416626, 1.5390212535858154, 1.9445961713790894, -2.0906741619110107, -2.9865641593933105, 0.5297666788101196, -1.1678122282028198, 0.6290494203567505, 0.9166114926338196, 0.16268564760684967, 0.7838320732116699, 1.9534083604812622, -5.0189619064331055, 3.324213981628418, 0.9608350396156311, -0.35929685831069946, -0.6919776201248169, -1.4354023933410645, -0.6564591526985168, 1.1632227897644043, 0.5027574300765991, -0.7255263924598694, 3.6508948802948, -0.31847161054611206, 2.6922011375427246, 1.4939284324645996, -2.463646411895752, -0.31220123171806335, 3.211639165878296, -1.2100868225097656, -2.1848223209381104, 3.2432515621185303, -0.16251502931118011, 3.7923989295959473, 0.47213074564933777, 0.9155093431472778, -0.9361506104469299, 0.45228344202041626, -0.6302608847618103, -0.04587806761264801, -6.955352306365967, -0.699816107749939, 0.7887070178985596, 0.09700246155261993, 2.2844038009643555, 1.7729377746582031, 1.6180263757705688, 3.2293708324432373, -3.9025721549987793, -4.016733169555664, 1.814159870147705, 0.13299377262592316, -4.487119674682617, -1.5182322263717651, 3.259679079055786, -0.5491212010383606, -2.551727056503296, 3.2993810176849365, -1.070789098739624, -0.024800393730401993, -0.01206043642014265, -0.30373615026474, -0.5667331218719482, -1.516832709312439, 2.1284308433532715, -1.258467435836792, 0.3798469007015228, -7.20203971862793, -2.153857946395874, -1.283748984336853, -0.28266027569770813, 0.7459697723388672, -0.21141491830348969, 0.5616667866706848, -1.8301448822021484, 0.16450774669647217, 2.7450413703918457, 1.4470173120498657, 0.6773435473442078, -2.419020175933838, 0.740720272064209, 2.870666265487671, 8.702858924865723, -3.0582542419433594, 1.7906231880187988, -1.0752243995666504, -0.22802044451236725, -1.750667691230774, -1.0831588506698608, 0.410448282957077, 0.9831854104995728, 0.33229541778564453, 1.9927160739898682, -1.5814090967178345, 0.22703726589679718, -1.664965033531189, -2.8510639667510986, -0.9418948292732239, -4.0177178382873535, 0.48390722274780273, -0.4202764332294464, -0.08631628006696701, -4.478215217590332, 2.510772228240967, 1.8811125755310059, -0.8276928067207336, 5.471214771270752, 2.219226121902466, 0.6631379127502441, -1.7687164545059204, -1.8140149116516113, -1.6307352781295776, 4.10972785949707, 1.5442053079605103, 0.4631717801094055, 2.6138174533843994, -0.0020172882359474897, -0.15769486129283905, 0.34808608889579773, -0.1203898936510086, -1.9554212093353271, -1.9864252805709839, -1.5510597229003906, 0.34012341499328613, 0.6644759774208069, -0.4626784920692444, -0.5139544010162354, -2.980306625366211, 0.955170750617981, 2.0580320358276367, -4.214272975921631, -0.25895896553993225, 3.4092297554016113, -3.859855890274048, 4.0082688331604, -0.2759658396244049, 4.061126232147217, -0.16366933286190033, 0.707851231098175, 1.0982544422149658, -2.33379864692688, -0.7612348198890686, 2.6705868244171143, 1.2352789640426636, 0.8800400495529175, -1.9398682117462158, 1.0234628915786743, -1.788962721824646, 1.7956181764602661, 0.07625560462474823, 2.085361957550049, -3.3227264881134033, 0.7864394783973694, -2.1350979804992676, -0.15054906904697418, -1.2170214653015137, 1.1155805587768555, 3.2004079818725586, -1.2918903827667236, -0.20488430559635162, -4.637441635131836, -0.5489848256111145, 2.0769290924072266, -1.9094293117523193, 2.0157270431518555, -1.91693115234375, -5.100884437561035, 0.1441098153591156, 2.8491992950439453, 4.721612453460693, 3.4444668292999268, -1.8479762077331543, 0.9114598631858826, -1.3145253658294678, -1.2642245292663574, -1.8567110300064087, 0.503128707408905, -0.5900328159332275, 3.0174896717071533, -2.4958083629608154, -0.7924434542655945, 2.232632875442505, -0.8212334513664246, -3.046842336654663, -0.3621848225593567, 3.021644115447998, 0.01460407953709364, -2.7532472610473633, 0.40820926427841187, 1.7525098323822021, 1.5049467086791992, 0.9178628921508789, 1.7789554595947266, 1.3679965734481812, -2.053455352783203, -0.9078307151794434, 1.561583161354065, -1.2780026197433472, -2.0162928104400635, -0.7662555575370789, -0.6932178735733032, -4.127883434295654, -2.2648603916168213, 0.9696303009986877, 0.983005702495575, -3.870774507522583, -2.351198673248291, -0.5916604995727539, -0.32393768429756165, -0.043161991983652115, -2.5871853828430176, -3.8555800914764404, 0.6257693767547607, -0.2445283681154251, -2.6337292194366455, 1.682175636291504, 0.04976877570152283, -1.1722378730773926, 1.1840118169784546, 4.9788594245910645, -0.31173667311668396, -4.76590633392334, 0.09379472583532333, -0.6413598656654358, -3.7080564498901367, -2.5734670162200928, 0.23744319379329681, 2.1088411808013916, 1.2114840745925903, 0.9559599161148071, 0.7978425025939941, -2.2832376956939697, -1.23482346534729, -0.39267781376838684, -2.8191776275634766, 2.512301445007324, -0.38477984070777893, 0.7921768426895142, 1.702121615409851, 0.9719135165214539, -2.3410749435424805, 0.2567425072193146, -0.5905325412750244, 0.40070340037345886, 0.7265986800193787, -1.7549989223480225, -0.5580612421035767, 2.957824468612671, 6.705124855041504, 0.644254744052887, -3.2392475605010986, -4.986215591430664, 0.4677744209766388, 1.2718844413757324, 0.2714749574661255, -3.1971120834350586, 2.548825979232788, -2.666994094848633, -0.0012752908514812589, -0.08835110813379288, -5.509708404541016, 1.6634823083877563, 0.24641068279743195, -0.4688394069671631, -4.486588954925537, -0.8322016596794128, -2.3209009170532227, 0.5739090442657471, 1.5602891445159912, 0.3938969373703003, -1.1755297183990479, -1.3784135580062866, -1.6176286935806274, 2.652129888534546, 1.19441556930542, -0.5405601859092712, 0.36420518159866333, -1.1010218858718872, 0.5610994100570679, -4.707846641540527, -1.2780486345291138, -1.683534860610962, -3.0418286323547363, 1.1373423337936401, -1.17726731300354, 1.7790638208389282, -0.9131358861923218, 0.6240704655647278, -3.222696542739868, -2.5817410945892334, -1.0689915418624878, -2.532665491104126, -0.777873158454895, 2.330639600753784, -1.2706598043441772, -1.7521923780441284, 1.8605506420135498, 3.3315658569335938, -1.6655093431472778, -2.9681248664855957, -0.22121760249137878, 0.24475058913230896, 3.342764139175415, -0.3866404891014099, 0.2634011209011078, -0.3892625868320465, 0.849992036819458, 0.7544712424278259, -0.5174570679664612, -0.3555733859539032, -0.2621435523033142, 2.404741048812866, 2.6200404167175293, 0.884440541267395, -2.2806262969970703, 1.800385594367981, -2.5086934566497803, -4.611011028289795, 1.138973355293274, 0.12278850376605988, 0.3085995614528656, -1.4484553337097168, 5.512558460235596, 1.2924104928970337, 2.4474823474884033, -0.792114794254303, -4.298117637634277, 2.1162238121032715, 2.2046806812286377, 0.890233039855957, -0.4661184251308441, 2.583246946334839, -0.9042239189147949, 2.5919747352600098, 1.8273158073425293, -1.441765308380127, 1.058531403541565, 1.0542271137237549, -2.1779062747955322, -0.16736172139644623, -6.223123550415039, -1.090970516204834, 0.06372695416212082, -1.4100455045700073, -0.22143085300922394, 0.10294591635465622, -2.398212432861328, 0.37462466955184937, 0.8141704201698303, -1.6830960512161255, 2.619887113571167, 1.928707242012024, 0.6894463896751404, 0.9886108636856079, 1.8084213733673096, -0.9344422221183777, 1.790684461593628, -1.4789283275604248, -1.4110089540481567, 0.26827478408813477, -0.9703308343887329, 0.12055669724941254, -5.075197219848633, -1.2177296876907349, -0.6823002696037292, -1.4584848880767822, -0.20850791037082672, -1.3358060121536255, -0.5745410919189453, -0.8894801735877991, -3.5526833534240723, 0.1849609762430191, -0.7089292407035828, -1.0615671873092651, -1.9903374910354614, 2.2468788623809814, 0.7088488340377808, 3.2480363845825195, 0.692319393157959, -0.8905009627342224, 1.1062148809432983, 7.321426868438721, 1.4435876607894897, -3.9508280754089355, -2.602041244506836, -0.7143267393112183, 0.7181946635246277, -2.117581844329834, 1.1335607767105103, -0.2381308674812317, 0.26734644174575806, -3.094697952270508, 1.5443425178527832, 0.6815630793571472, 2.3725836277008057, 2.1262056827545166, 1.6833932399749756, 3.1369898319244385, 0.22501713037490845, 0.01502442266792059, -2.582103729248047, -1.2022837400436401, 1.771978497505188, -0.8031330704689026, -1.5578391551971436, 1.8515056371688843, 1.1004581451416016, 3.8136022090911865, 2.1532788276672363, -3.457136631011963, 0.18099626898765564, -0.2848474979400635, 1.221053957939148, 2.8015074729919434, -0.3335840106010437, 0.5462377071380615, -0.45215925574302673, -2.289963483810425, 0.07216161489486694, 1.7351986169815063, 1.458738923072815, -1.5319416522979736, 1.0984258651733398, -3.2769935131073, -0.12339019030332565, 2.101783037185669, -10.395681381225586, -0.007650176528841257, -1.4347728490829468, 2.2570619583129883, 1.2943730354309082, 1.9421950578689575, 0.6884933710098267, -0.19417615234851837, -0.11739306151866913, -0.6025469899177551, 1.1343588829040527, 3.3539066314697266, 2.1059820652008057, -0.2766933739185333, 0.18031753599643707, 2.230374336242676, -2.5740599632263184, 1.2767438888549805, 0.9364815950393677, -2.166224956512451, 1.0652506351470947, 1.5096004009246826, 0.6872370839118958, -1.4540482759475708, -2.0633604526519775, -0.4367252588272095, -2.399052381515503, -1.282071590423584, -0.044155512005090714, 2.48884916305542, 0.023437438532710075, 0.8073763251304626, -2.8832268714904785, -8.07063102722168, -0.3965567648410797, 0.7023154497146606, -1.8586671352386475, -0.8421910405158997, -0.1611238270998001, 2.5079379081726074, -4.007284164428711, 1.6155879497528076, -5.157525062561035, -0.3624225854873657, 1.2320910692214966, 0.6480355262756348, -0.014505828730762005, 2.4554195404052734, -1.989598035812378, -0.5162073969841003, 3.6845650672912598, 1.6853426694869995, -0.8387237787246704, 1.3507075309753418, 2.0365657806396484, -3.046884536743164, 2.6776187419891357, 1.2818331718444824, 0.8351423144340515, 1.3083134889602661, -1.2438671588897705, 1.5654478073120117, 0.7088436484336853, 0.5027146339416504, -0.1130550429224968, -1.413216233253479, -0.6483591794967651, 1.0834083557128906, 1.891887903213501, 0.5030806660652161, -1.1554231643676758, 0.2658778429031372, 0.834608793258667, -1.427506685256958, 4.739391803741455, -0.9727756977081299, 1.5138412714004517, 0.9154967069625854, -2.2378926277160645, 0.3499266505241394, 0.8613677620887756, 13.716211318969727, -0.024663135409355164, -2.62848162651062, 0.8786887526512146, -0.8232128024101257, 3.001176357269287, -0.5639929175376892, -1.259843111038208, -1.0307694673538208, -0.9894213676452637, 3.1511151790618896, 1.4428691864013672, 1.5179673433303833, -1.2720630168914795, -2.0126101970672607, 1.0964728593826294, -0.050848767161369324, -0.40940308570861816, -0.6419931054115295, 0.17953501641750336, 4.002809524536133, -0.08484639972448349, -0.3918556272983551, -3.66619610786438, 1.2439440488815308, 0.8560100197792053, 0.9869580864906311, -1.4466854333877563, 1.566542625427246, -0.44180577993392944, 0.5210701823234558, 0.026366224512457848, -0.2625639736652374, -1.0335851907730103, 4.082411289215088, 3.9162745475769043, -1.8949956893920898, 1.4772109985351562, 1.5810624361038208, -2.734541177749634, -1.2242658138275146, 2.1986517906188965, -2.4386746883392334, -0.7827430963516235, 0.43202123045921326, -3.3882668018341064, 1.3284215927124023, 4.130292892456055, 0.5116564631462097, -2.386350393295288, 0.7615227103233337, 2.6928112506866455, 2.741827964782715, -1.6699600219726562, 2.041027545928955, 2.135084629058838, -0.7697069048881531, 6.2188401222229, -0.37027469277381897, -1.442643404006958, 2.624312162399292, -3.1849844455718994, -3.578702449798584, -1.9616942405700684, -0.6366727948188782, -0.40032699704170227, 1.9600207805633545, 0.725960373878479, -0.40329742431640625, 0.6876182556152344, -3.0081446170806885, 1.7669646739959717, 0.4953126907348633, -3.816932439804077, -0.00906843226402998, 0.019090967252850533, 1.090166449546814, -1.9998998641967773, 1.3356420993804932, -2.701986789703369, 0.9503477811813354, -1.21523916721344, 1.5391088724136353, 4.086294651031494, -0.5681966543197632, 1.5586626529693604, 0.23215630650520325, -2.8759684562683105, -1.190187931060791, -1.4921268224716187, 1.31522798538208, 3.783092737197876, -1.0239709615707397, -2.1388111114501953, 0.5641912817955017, 0.3231648802757263, -5.408095836639404, -1.249610424041748, -1.656131625175476, -1.9331467151641846, -3.783811092376709, -1.2231287956237793, 0.20508044958114624, 1.4017202854156494, -1.323378086090088, 0.6841934323310852, 1.7025094032287598, -2.297074556350708, 1.0002022981643677, -0.13914304971694946, -0.26943346858024597, 3.2101919651031494, -2.214017391204834, 0.6172571778297424, -4.220190048217773, -2.7363808155059814, -1.8922712802886963, -0.47356274724006653, -1.6204299926757812, 1.0750973224639893, 0.5907970070838928, 0.33106160163879395, -1.2776787281036377, 1.044416069984436, 3.5759923458099365, 2.5081899166107178, 3.947270393371582, -0.3815639019012451, -0.34801962971687317, 1.3628497123718262, -0.12517859041690826, 0.19083663821220398, 1.3875478506088257, 4.682065963745117, -2.2389187812805176, 0.43245580792427063, 0.3070617616176605, -0.009348197840154171, 6.818076133728027, 2.928586006164551, -4.066124439239502, -1.0997172594070435, -1.5741344690322876, -0.12388645857572556, -1.163758397102356, -1.7312763929367065, -0.6819502115249634, 0.6570924520492554, 1.0236763954162598, -1.2241543531417847, 1.2495362758636475, 0.7123939990997314, -0.9497723579406738, 0.9842475056648254, -0.5749776363372803, 0.05570518597960472, -1.5516078472137451, -1.2821515798568726, 0.7456982731819153, 1.931745171546936, -2.810570001602173, 2.2908318042755127, 0.41322678327560425, 0.36725518107414246, -1.9216513633728027, 2.8667283058166504, 0.1822109818458557, -0.24910838901996613, 2.283859968185425, -1.9310730695724487, -3.3634865283966064, -0.6532301306724548, -4.70237922668457, -1.12579345703125, -2.040825366973877, -3.3832974433898926, -1.0839720964431763, 3.3403565883636475, 3.822727680206299, 0.5342526435852051, 1.1357072591781616, 1.5592999458312988, -3.3333420753479004, 3.5327913761138916, -2.5539679527282715, -1.5175338983535767, -0.3708907663822174, -12.463946342468262, -0.9213336706161499, 2.2293319702148438, 1.398068904876709, 2.462724447250366, -0.7464604377746582, -1.5133693218231201, -0.36755022406578064, -3.2392663955688477, 0.6240562796592712, -0.7729895114898682, 0.5558847188949585, -0.8303931355476379, 1.1528762578964233, 0.5230839252471924, -0.1472703218460083, 3.449622392654419, 0.12665943801403046, 2.9168496131896973, -3.3318188190460205, -0.9287435412406921, -1.3577803373336792, -5.711543560028076, 2.883948802947998, -1.0756027698516846, 0.5378207564353943, -1.8930484056472778, -3.206451416015625, -2.2132697105407715, 5.058618068695068, -1.804747462272644, -0.2282872200012207, 1.4655096530914307, 0.8955243229866028, 0.301523357629776, 6.466285228729248, 1.945784091949463, 0.45523086190223694, -3.502366781234741, -0.11891143769025803, -0.6262398362159729, 0.8484516143798828, -0.32931259274482727, -0.42028892040252686, 1.675168752670288, -0.38432446122169495, 0.4947401285171509, -0.3949742913246155, -1.3229141235351562, 1.9281558990478516, 1.6107319593429565, 0.16650919616222382, 1.4470117092132568, -1.3005725145339966, 1.9273335933685303, 3.0863685607910156, -1.5995413064956665, 2.5314512252807617, 0.10245386511087418, 4.309769630432129, -4.0902252197265625, -0.31487390398979187, -4.544051647186279, 2.5837345123291016, 4.418003082275391, 1.5204626321792603, -0.4228420853614807, 2.013505697250366, 1.5680060386657715, -2.989995002746582, -1.3916229009628296, 0.1875404417514801, 0.9286680817604065, -0.0395982526242733, -1.1284763813018799, 0.4437063932418823, -0.8143901824951172, -0.8134555816650391, -1.6235551834106445, -1.6263840198516846, 1.9525787830352783, 1.1034938097000122, -8.717255592346191, 1.4937522411346436, -0.349617063999176, 1.0715340375900269, 2.147158622741699, -3.0903687477111816, -0.8252754807472229, 3.0069046020507812, -0.6979692578315735, -0.48904767632484436, 4.265597820281982, -1.8104647397994995, -0.6100952625274658, 0.8066357374191284, -1.1512173414230347, 1.5316277742385864, 0.1252065747976303, 3.1174588203430176, 2.542187213897705, 2.991629123687744, -5.110601425170898, -0.48710957169532776, -1.9535632133483887, 0.7153872847557068, 0.12419969588518143, -0.2656199634075165, 0.5092053413391113, -2.609516143798828, -1.8370811939239502, -5.229562759399414, -2.5335469245910645, 3.8033509254455566, -0.284759521484375, 3.5861053466796875, -1.6900355815887451, 0.6565672755241394, 3.486699342727661, -1.729464054107666, 1.8654218912124634, 1.2440614700317383, 1.4933671951293945, -0.9785898923873901, -3.079610586166382, 2.4139516353607178, -0.29621121287345886, 3.7440061569213867, 0.7092859148979187, 1.7413740158081055, -0.9076554775238037, 1.6674847602844238, 1.287865161895752, -2.2960543632507324, 1.7715214490890503, -0.2641471028327942, 8.167329788208008, -2.0263044834136963, 0.5593990087509155, 0.39249324798583984, 1.0601530075073242, -0.4858159124851227, -4.683915138244629, -0.5213146805763245, -1.7416198253631592, -2.990283966064453, -1.2409173250198364, 0.7051007747650146, 0.11596938967704773, 0.9516615867614746, 0.19274798035621643, 0.8495862483978271, -0.9856677055358887, -0.9277161359786987, 3.4419617652893066, 14.472667694091797, -2.2102131843566895, -1.6442638635635376, -1.7681670188903809, -0.4131341874599457, -1.1363463401794434, 2.4251184463500977, -0.43746712803840637, 3.972994089126587, -0.1318419873714447, -1.056019902229309, 1.7555656433105469, 2.7997663021087646, -4.304599761962891, 2.1411452293395996, 1.0004128217697144, 3.67427134513855, -1.657857894897461, -2.586104393005371, 0.4810795485973358, 0.6908578872680664, -3.168255090713501, -0.5378316044807434, 14.570016860961914, 3.1249186992645264, -0.12121376395225525, 1.0846680402755737, -2.9557368755340576, -5.034856796264648, -5.1041998863220215, 2.0942912101745605, -0.8606932163238525, 0.8112332224845886, -2.9160313606262207, -1.7898685932159424, -0.7321101427078247, 4.394458293914795, -2.727302312850952, -1.7645714282989502, 3.308013439178467, 0.3768421709537506, 0.600409746170044, 1.5649691820144653, -1.619080662727356, -1.0917795896530151, 1.391066074371338, 3.523925542831421, -0.25520578026771545, -1.4525595903396606, 0.41161012649536133, -1.264905571937561, 1.1050399541854858, -4.535818576812744, 1.979875922203064, -3.202632427215576, 2.1728172302246094, -0.11758963018655777, 0.2337736189365387, -0.9971612691879272, 3.386942148208618, -0.8723754286766052, 0.3580930233001709, 0.8906329870223999, 1.4193137884140015, -0.6854945421218872, 1.086416482925415, -1.4884363412857056, -0.9165447354316711, -1.6670769453048706, -2.1550588607788086, 0.6295282244682312, 5.916707992553711, 5.086348533630371, 1.2870584726333618, -4.202667236328125, 0.38834086060523987, -3.4828455448150635, 1.1609498262405396, 3.0407660007476807, 0.6540374755859375, 1.7353816032409668, 0.19802501797676086, -0.6163817644119263, 1.9317697286605835, 1.6042762994766235, -3.665048599243164, 0.7768906354904175, 3.366405963897705, 3.4709341526031494, -6.443081378936768, -2.0661282539367676, 4.324657917022705, 0.6470865607261658, 4.231536388397217, -0.30135443806648254, 1.7501721382141113, -0.2890607416629791, 1.2070163488388062, 0.3844335973262787, 2.8388705253601074, -0.5520831346511841, -1.3708150386810303, 1.511051058769226, -0.2419203668832779, 1.6756776571273804, 0.828872799873352, -0.6272377967834473, -1.0207611322402954, -1.5887625217437744, 0.6566981673240662, 1.913051724433899, -0.11921954900026321, -1.587217092514038, 3.205491065979004, 2.963395595550537, 0.25447648763656616, 3.3500895500183105, 0.0011852560564875603, -0.20465822517871857, 1.445924162864685, -1.3199782371520996, 1.8639761209487915, 1.0131362676620483, -1.0631523132324219, 0.4349328875541687, -0.1496729850769043, -1.2207533121109009, -11.034804344177246, -2.9236109256744385, 0.397918164730072, -4.915587425231934, 2.047562599182129, 3.2327003479003906, 1.705835223197937, -1.1656087636947632, -3.022463083267212, 1.3008933067321777, -0.26006388664245605, 1.7835063934326172, 2.347099781036377, -3.3509907722473145, -1.6843963861465454, 0.21283820271492004, -2.8408877849578857, -0.7590367794036865, -0.8653252124786377, 0.2704552710056305, -6.379304885864258, -0.36488816142082214, -2.667449951171875, -0.7147334218025208, -0.26092538237571716, -10.47561264038086, -0.12957844138145447, 1.1993448734283447, -2.9925973415374756, 3.278733015060425, 2.8640387058258057, -3.526357889175415, 0.7499355673789978, 4.841008186340332, -1.0102190971374512, 0.23530183732509613, 0.12328588962554932, 2.639430284500122, 1.1267786026000977, -1.5553920269012451, -0.02911207638680935]

Continue reading

DoLa – Decoding by Contrasting Layers Improves Factuality in Large Language Models

DoLa – Decoding by Contrasting Layers Improves Factuality in Large Language Models

Have you ever talked to an LLM and they answered you something that sounds like they've been drinking machine coffee all night long 😂 That's what we call a hallucination in the LLM world! But don't worry, because it's not that your language model is crazy (although it can sometimes seem that way 🤪). The truth is that LLMs can be a bit... creative when it comes to generating text. But thanks to DoLa, a method that uses contrast layers to improve the feasibility of LLMs, we can keep our language models from turning into science fiction writers 😂. In this post, I'll explain how DoLa works and show you a code example so you can better understand how to make your LLMs more reliable and less prone to making up stories. Let's save our LLMs from insanity and make them more useful! 🚀

Last posts -->

Have you seen these projects?

Subtify

Subtify Subtify

Subtitle generator for videos in the language you want. Also, it puts a different color subtitle to each person

View all projects -->

Do you want to apply AI in your project? Contact me!

Do you want to improve with these tips?

Last tips -->

Use this locally

Hugging Face spaces allow us to run models with very simple demos, but what if the demo breaks? Or if the user deletes it? That's why I've created docker containers with some interesting spaces, to be able to use them locally, whatever happens. In fact, if you click on any project view button, it may take you to a space that doesn't work.

View all containers -->

Do you want to apply AI in your project? Contact me!

Do you want to train your model with these datasets?

short-jokes-dataset

Dataset with jokes in English

opus100

Dataset with translations from English to Spanish

netflix_titles

Dataset with Netflix movies and series

View more datasets -->