Deep learning

Fine-Tuning LLaMA 2 Models with a single GPU and OVHcloud

Fine-Tuning LLaMA 2 Models using a single GPU, QLoRA and AI Notebooks

In this tutorial, we will walk you through the process of fine-tuning LLaMA 2 models, providing step-by-step instructions. All the code related to this article is available in our dedicated GitHub repository. You can reproduce all the experiments with OVHcloud AI Notebooks. Introduction On July 18, 2023, Meta released LLaMA 2, the latest version of […]

Fine-Tuning LLaMA 2 Models using a single GPU, QLoRA and AI Notebooks Read More »

AI Notebooks: analyze and classify sounds with AI

AI Notebooks: analyze and classify sounds with AI

A guide to analyze and classify marine mammal sounds. Since you’re reading a blog post from a technology company, I bet you’ve heard about AI, Machine and Deep Learning many times before. Audio or sound classification is a technique with multiple applications in the field of AI and data science. Use cases Acoustic data classification:

AI Notebooks: analyze and classify sounds with AI Read More »

Managing GPU pools efficiently in AI pipelines

Managing GPU pools efficiently in AI pipelines

A growing number of companies are using artificial intelligence on a daily basis — and dealing with the back-end architecture can reveal some unexpected challenges. Whether the machine learning workload involves fraud detection, forecasts, chatbots, computer vision or NLP, it will need frequent access to computing power for training and fine-tuning. GPUs have proven to

Managing GPU pools efficiently in AI pipelines Read More »

A journey through the wondrous land of Machine Learning or "Can I really buy a palace in Paris for 100,000€?" (Part 2)

A journey through the wondrous land of Machine Learning or “Can I really buy a palace in Paris for 100,000€?” (Part 2)

Spoiler alert, no you can’t. A few months ago, I explained how to use Dataiku – a well-known interactive AI studio – and how to use data, made available by the French government, to build a Machine Learning model predicting the market value of real estate. Sadly, it failed miserably: when I tried it on

A journey through the wondrous land of Machine Learning or “Can I really buy a palace in Paris for 100,000€?” (Part 2) Read More »

How PCI-Express works and why you should care? #GPU

How PCI-Express works and why you should care? #GPU

What is PCI-Express ? Everyone, and I mean everyone, should pay attention when they do intensive Machine Learning / Deep Learning Training. As I explained in a previous blog post, GPUs have accelerated Artificial Intelligence evolution massively. However, building a GPUs server is not that easy. And failing to create an appropriate infrastructure can have

How PCI-Express works and why you should care? #GPU Read More »

Distributed Learning in a Deep Learning context

Distributed Training in a Deep Learning Context

Previously on OVHcloud Blog … In previous blog posts we have discussed a high level approach to deep learning as well as what is meant by ‘training’ in relation to Deep Learning. Following the article, I had lots of questions entering my twitter inbox, especially regarding how GPUs actually works. I decided, therefore, to write

Distributed Training in a Deep Learning Context Read More »

What does training neural networks mean?

What does Training Neural Networks mean?

In a previous blog post we discussed general concepts surrounding Deep Learning. In this blog post, we will go deeper into the basic concepts of training a (deep) Neural Network. Where does “Neural” comes from ? As you should know, a biological neuron is composed of multiple dendrites, a nucleus and a axon (if only

What does Training Neural Networks mean? Read More »

Understanding the anatomy of GPUs using Pokémon

Please welcome this beautiful new born in GPGPU Nvidia Family Ampere BLOG UPDATE FROM MAY 14, 2020 In the previous episode… In our previous blog post about Deep Learning, we explained that this technology is all about massive parallel matrix computation, and that these computations are simplistic operations: + and x. Fact 1:  GPUs are good

Understanding the anatomy of GPUs using Pokémon Read More »

Deep Learning: A new hype

Deep Learning explained to my 8-year-old daughter

Machine Learning and especially Deep Learning are hot topics and you are sure to have come across the buzzword “Artificial Intelligence” in the media. Yet these are not new concepts. The first Artificial Neural Network (ANN) was introduced in the 40s. So why all the recent interest around neural networks and Deep Learning?  We will explore this

Deep Learning explained to my 8-year-old daughter Read More »