Blog &News
Discover our articles on IT performance, cloud, data science and industry best practices.
All articles
Fast Geographic Data Extraction from SQL Server to Parquet with FastBCP
SQL Server holds spatial data in geography and geometry columns.
Cycle diurne de la température d'été à Lyon-Bron, par décennie
Météo-France publie ses données climatologiques de base horaires en open data sur data.gouv.fr.
German-style strings in Apache Arrow
Version 1.4 of the Apache Arrow Columnar Format added a new way to store variable-length values, the Variable-size Binary View Layout.
PerformanceStudio: Better Query Store Analysis for SQL Server
PerformanceStudio is an open-source GUI for SQL Server performance troubleshooting.
Database Engines Trends Dashboard
DB-Engines.com is a website that reference and rank hundreds of database engines, threw the most famous ones likes Oracle, MySQL, SQL Server, PostGreSQL…
Running a private Qwen3.6 Coding Agent on Scaleway
This is the Scaleway sequel to two previous posts on self-hosted coding agents: the AWS run where we deployed a 27B model on a g5.xlarge, and the…
![Running a Local LLM on a Consumer GPU [8 GB VRAM]](/_next/image?url=%2Fblog%2F20260418_running-a-local-llm-on-a-consumer-gpu-8-gb-vram%2Fimg%2F04_gpu_poor.jpeg&w=3840&q=75)
Running a Local LLM on a Consumer GPU [8 GB VRAM]
In a previous post, we ran Qwen3.5-27B on an AWS g5.xlarge with an NVIDIA A10G (24 GB VRAM).
Running a Local LLM Coding Agent on AWS
We deploy Qwen3.5-27B on a single GPU instance, serve it with llama.cpp, wire it to OpenCode as a coding agent frontend, and run ToolCall-15 to measure…
Summation of Floating-Point Numbers in Cython
Adding up a list of floating-point numbers: seems simple. IEEE 754 double-precision floats (float64) carry about 15 to 17 significant decimal digits, and…
My First Lean 4 Proof: the Irrationality of √2
Formal verification uses computers to automatically check whether proofs are correct.
Improve SQL Server Performance with sp_UpdateStats2 Statistics Maintenance
Updating statistics is an important aspects of SQL Server performance tuning.
SQL Server Cumulative Updates Dashboard
Since the version 2017 Microsoft does not use Service Packs anymore: only Cumulative Updates.
An example ETL Pipeline with dlt + SQLMesh + DuckDB
In this post, we walk through building a basic ETL (Extract-Transform-Load) pipeline.
Get your embeddings on SQL Server 2025 with AI_GENERATE_EMBEDDINGS and EXTERNAL MODEL using OLLAMA local and your GPU
SQL Server 2025 introduces a powerful new feature: native vector embeddings generation using the AI_GENERATE_EMBEDDINGS function.
Evolution des prix de l'immobilier en France - DVF à l'iris
En croisant les données DVF (Demandes de Valeurs Foncières) maintenant disponibles en open data, nous avons construit ce dashboard.
sp_CompareTables : compare tables at column level in SQL Server
sp_CompareTables is a stored procedure for SQL Server that compares two tables (or views) defined in the configuration table T_COMPARE_CONFIG.
Performance Analysis of Parallel Data Replication Between Two PostgreSQL 18 Instances on OVH
Parallel data replication between PostgreSQL instances presents unique challenges at scale, particularly when attempting to maximize throughput on…
PG_FASTBCP Postgres Extension
Moving large volumes of data in and out of a PostgreSQL database has always been a critical challenge for developers, data engineers, and database…
Data Loading from S3 Parquet Files to PostgreSQL on OVH Cloud
Loading data efficiently from cloud storage into databases remains a critical challenge for data engineers.
FastTransfer Performance with Citus Columnar Storage in PostgreSQL
Data migration between database systems often becomes a bottleneck in modern data pipelines, particularly when dealing with analytical workloads.
High-Speed PostgreSQL Replication on OVH with FastTransfer
PostgreSQL-to-PostgreSQL replication at scale requires tools that can fully leverage modern cloud infrastructure and network capabilities.
Le Tour de France History Dashboard
After scraping historical data from the "Tour de France" website, we will leverage this data to build a beautiful dashboard.
Parallel Data Movement Made Simple: FastTransfer & FastBCP Explained
In this article, we’ll show you why traditional tools are no longer fit for today’s servers — and how FastTransfer and FastBCP were built from the ground…
A Git commit temporal analysis
In this Python notebook, we are going to analyze git commit timestamps across multiple repositories to identify temporal patterns in a git user coding…
SQL Server Features Comparison and Evolution
Let's concentrate on the last 3 versions to see features evolution and comparison between edition.
Oracle to PostgreSQL Data Transfer : pg_fasttransfer vs oracle_fdw
Migrating large tables from Oracle to PostgreSQL can be challenging when performance and reliability matter.
PostgreSQL Data Transfer: pg_fasttransfer vs postgres_fdw
Transferring large volumes of data between PostgreSQL databases can be challenging when performance, security, and simplicity matter.
SQL Server Schema Restore : structures and data
on github: (https://github.com/aetperf/dbatoolsScripts/blob/main/DBA/Restore/restoreSchema.ps1) All objects within a specific schema in a target database…
Computing and Visualizing Billions of Bohemian Eigenvalues with Python
In our case, we sample 5x5 matrix entries from the discrete set {-1, 0, 1}.
Zipf's Law on "La Comédie humaine"
In this Python notebook, we're going to explore Zipf's law as applied to words. This is the definition of Zipf's law from its wikipedia page.
FastTransfer VS BCP
In data engineering and database administration, efficiently transferring large volumes of data between SQL Server instances is a common and critical…
Powershell IOMeter Parser
When it comes to benchmarking disks, choosing the right tool can be a challenging task.
Licence to sp_kill on SQL Server
When it comes to administering SQL Server, you sometimes need to terminate (“kill”) an active session or process.
Arnold tongues with Numba, Numba CUDA and Datashader
This Python notebook explores Arnold tongues. Here is a short description from wikipedia: In simpler terms, Arnold tongues represent regions where two…
Spatial queries in DuckDB with R-tree and H3 indexing
This Python notebook explores the use of two indexing techniques, R-tree and H3, for performing spatial queries in DuckDB.
In-memory cosine distance calculation, NumPy vs DuckDB
This notebook compares the performance of NumPy and DuckDB for computing cosine distances on the same dataset.
Querying Private s3 Buckets with DuckDB
DuckDB is an in-process SQL database that allows you to query data from various sources, including private AWS s3 buckets.
Pizzerias Around the World
In November 2024, Foursquare released a new dataset called Foursquare Open Source Places.
Visualizing the Ulam Spiral with Python
The Ulam spiral arranges integers in a spiral and highlights prime numbers, revealing some diagonal alignment patterns.
Analyzing tramontane wind frequency
The tramontane wind, a defining feature of Pyrénées-Orientales region, is known for sweeping through the south of France with its characteristic force and…
Beyond LAST_VALUE IGNORE NULLS: Efficient Alternatives for Handling Missing Data in SQL Server
When working with SQL Server, managing missing data efficiently is crucial, especially in large datasets.
Using DuckDB with Tableau Desktop on Windows
DuckDB is an in-process SQL OLAP database management system. These database is very fast for OLAP queries and have several advantages: There is also…
LAST_VALUE performance issue on SQL Server
The story begins after migrating table structures and data from Netezza to SQL Server.
Finding the most concentrated areas of bakeries in Lyon
In this blog post, we'll use Python to analyze the distribution of bakeries in Lyon, France.
A Hybrid information retriever with DuckDB
When it comes to information retrieval, vector search methods have demonstrated some good performance, especially when the embedding models have been…
Databases Dashboard V2
A new version of the databases dashboard that allow you to visit near 1000 databases, writen in near 40 programming languages aver 55 countries and more…
La protection des données : partie 1 - les données
À l’ère numérique d’aujourd’hui, les données sont l’or noir de notre époque, le volume de données mondiale a été multiplié par 30 au cours des 10…
Enrich a digital terrain model
In this blog post, we will explore how to enrich a digital terrain model [DTM] using Python.
Calculating walking isochrones with Python
In this blog post, we'll explore how to calculate walking isochrones using Python, taking into account the slope of the terrain.
Fully Amortized Loan simulation with Numba and IPyWidgets
In this blog post, we will show how to use Python to simulate the amortization of a fully amortized loan, such as a mortgage or a car loan.
Create a routable pedestrian network with elevation
In this blog post, we will explore how to create a routable pedestrian network with elevation using Python and OSMnx.
Streaming data from PostgreSQL to a CSV file as fast as possible
In this post, we explore the process of streaming data from a PostgreSQL database to a CSV file using Python.
Lyon's Digital Terrain Model with IGN Data
In this post, we explore how to extract and merge data from a french high-resolution Digital Terrain Model [DTM].
SQL Server AlwaysOn Feature Tutorial : Part 3 - install SQL Server on a domain VM
In these articles, we’ll look at how to set up high availability on one or more databases with the AlwaysOn feature, using the « dbatools » PowerShell…
SQL Server AlwaysOn Feature Tutorial : Part 4 - Install and configure a Windows Failover Cluster
In these articles, we’ll look at how to set up high availability on one or more databases with the AlwaysOn feature, using the « dbatools » PowerShell…
SQL Server AlwaysOn Feature Tutorial : Part 5 - Activate AlwaysOn on SQL Server
In these articles, we’ll look at how to set up high availability on one or more databases with the AlwaysOn feature, using the « dbatools » PowerShell…
SQL Server AlwaysOn Feature Tutorial: Part 1 - Create a Windows Server 2022 Virtual Machine
In these articles, we'll look at how to set up high availability on one or more databases with AlwaysOn functionality, using the "dbatools" PowerShell…
A Transit graph for static macro assignment
This post is a description of a graph structure for a transit network, used for static, link-based, frequency-based assignment.
Methane Gaz Emissions
The Emissions Database for Global Atmospheric Research (EDGAR) provides independent estimates of the global anthropogenic emissions and emission trends…
Parquet file sorting test
Some time ago, we came across an intriguing Parquet sorting test shared by Mimoune Djouallah on Twitter @mim_djo.
Installing your Python package on a Windows machine that does not have internet access
Suppose you've developed a Python package called MyPackage on Linux, with specific package requirements, and need to install it on a Windows machine that…
How minimal is SQL Server Minimal Logging
One day, one of my clients complained about the size of his SQL Server log. He mentioned that it had reached 1GB for just 1 million inserted rows.
The Database of Databases Dashboard
After extensively delving into the database world through dbdb.io and enjoying numerous online courses that delve deep into databases (a subject I'm truly…
ROLLBACK DELETE vs TRUNCATE vs DROP in several RDBMS
What are the differences between DELETE vs TRUNCATE vs DROP? The first one is DML whereas the last two are DDL but can which are rollbackle and which are…
Oracle Database Features Evolution
From version 11.2 to the 23c version oracle database have more than 1600 features.
Calculating daily mean temperatures with scikit-learn
The goal is of this post is to predict the daily mean air temperature TAVG from the following climate data variables: maximum and minimum daily…
Oracle Database Editions Comparator
Oracle provide many informations about features that are available or not in their licensing page…
Vector similarity search with pgvector
In the realm of vector databases, pgvector emerges as a noteworthy open-source extension tailored for Postgres databases.
Dashboard sur les entreprises de Genève en Suisse
A partir des données open data du canton de Genève sur les entreprises j'ai réussi à faire un dashboard qui je l'espère vous sera utile.
Using a local sentence embedding model for similarity calculation
A simple yet powerful use case of sentence embeddings is computing the similarity between different sentences.
Python plot - Antarctic sea ice extent
Data source: https://ads.nipr.ac.jp/vishop/#/extent REGION SELECTOR = Antarctic At the bottom of the page: Download the sea ice extent (CSV file) -…
Semantic Vector Search with SQL Server and the help of KMeans indexing
In the previous article Semantic Vector Search with SQL Server we discuss about the possibility to make semantic search with vectors that comes from…
SQL Server vector search
Some time ago i read a blog article from a senior Microsoft azure programmer Davide Mauri: The article interest me because the current "semantic search"…
Python plot - North Atlantic daily water surface temperature
Data source: https://climatereanalyzer.org [NOAA Optimum Interpolation SST [OISST] dataset version 2.1] In the present dataset, the surface temperature is…
PostgreSQL Features Matrix GPT-Optimized
PostgreSQL is a hip and happening DBMS that's gaining more and more popularity.
Hyperpath routing in the context of transit assignment
How do transit passengers choose their routes in a complex network of lines and services?
TPC-H benchmark of DuckDB and Hyper on native files
In this blog post, we examine the performance of two popular SQL engines for querying large files: These engines have gained popularity due to their…
TPC-H benchmark of Hyper and DuckDB on Windows and Linux OS
In this blog post, we explore the use of two SQL engines, and specifically their Python API, for querying files.
TPCH with Snowflake : SF100
Snowflake is a fantastic Datawarehouse and Datalake SaaS Solution!
TPC-H benchmark of Hyper, DuckDB and Datafusion on Parquet files
In this blog post, we focus on directly querying Parquet files using three different SQL engines, and more specifically their Python API: The TPC-H…
TPCH SF10 : Query 13 and SQL Server Collations Performance Impact
After benchmarking several cloud databases (Snowflake, BigQuery, SingleStore, Databricks) using TPCH SF10 data, after benchmarking DuckDB and Tableau…
TPCH SF10 : Tableau Hyper Engine vs DuckDB vs Snowflake vs BigQuery vs Databricks vs SingleStore
After a first try with TPCH SF10 using DuckDB on 2 differents laptops and compare parquet storage vs native storage (see TPCH SF10 using DuckDB vs…
TPCH SF10 using DuckDB vs SnowFlake, Bigquery, SingleStore and Databricks
I was very interested in 2 articles of Mimoune Djouallah (aka mim) that compare Snowflake, BigQuery, Databricks, SingleStore, PowerBI Datamart and DuckDB…
Gender Equality Indexes : 2023 Edition
Gender equality index is an indicator created by EIGE. It measures the progress of gender equality in the European union countries.
SQL Server Extended Events Dashboard
SQL Server Extended Events is a powerful feature in Microsoft SQL Server that enables database administrators to capture and analyze events that occur…
SQL Server editions comparison dashboard by domains features and scale capacities
The article allow you to direct use the sql server editions comparison dashboardYou can select the version of SQL ServerYou can select a group of features…
Tour de France des revenus des français
A partir des données Fiscales (FiLoSoFi) fournies par l'INSEE en open data, nous avons voulus étudier les revenus médians des français au travers un…
Cartographie FiLoSoFi : données sur les revenus médians en France
Comme indiqué sur son site, l'INSEE fournit des informations socio-économiques sur près de 30 millions de ménages.
Dijkstra's algorithm in Cython, part 3/3
Running time of Dijkstra's algorithm on DIMACS networks with various implementations in Python.
Dijkstra's algorithm in Cython, part 1/3
In this post, we are going to present an implementation of Dijkstra's algorithm in Cython. Dijkstra's algorithm is a shortest path algorithm.
Dijkstra's algorithm in Cython, part 2/3
This post is the second part of a three-part series. In the first part, we looked at the Cython implementation of Dijkstra's algorithm.
A Cython implementation of a priority queue
Credit: Musée de l'illusion, Lyon [picture taken by myself] In this post, we describe a basic Cython implementation of a priority queue.
Visualizing some polynomial roots with Datashader
Last week-end I found this interesting tweet by sara: The above figure shows all the complex roots from the various polynomials of degree 10 with…
Forward and reverse stars in Cython
This notebook is the following of a previous one, where we looked at the forward and reverse star representations of a sparse directed graph in pure…
Forward and reverse star representation of a digraph
In this Python notebook, we are going to focus on a graph representation of directed graphs: the forward star representation [and its opposite, the…
Cloud Comparator : CPU, RAM, Price of VMs
Cloud-Mercato.com is a mine of information about pricing in the cloud world.
Query Parquet files with DuckDB and Tableau Hyper engines
In this notebook, we are going to query some Parquet files with the following SQL engines: Both of these tools are optimized for Online analytical…
Download some benchmark road networks for Shortest Paths algorithms
The goal of this Python notebook is to download and prepare a suite of benchmark networks for some shortest path algorithms.
Intel Processors Comparator
Intel Processor have several characteristics beyond frequency and number of cores.
Euler's number and the uniform sum distribution
Last year I stumbled upon this tweet from @fermatslibrary: I find it a little bit intriguing for Euler's number e to appear here!
Trying DuckDB with Discogs data
This notebook is a small example of using DuckDB with the Python API. It is a relational DBMS that supports SQL.
Talend Quick Tips : Increase BigQuery Talend timeout in components
In this article I will show you how to change a critical setting in Talend: the timeout.
Insert data from SQL Server into Excel crosstab
In this article, I will show you how to insert data into an Excel spreadsheet and safely keep your content.
Dynamic TaskGroup in Airflow 2.0
In this article we will uncover a way to use Airflow new feature called TaskGroup which allow you to manage your dependencies in a dynamic way.
Dynamic TaskGroup Scalability in Airflow 2.0
In the previous article I showed you how to instantiate TaskGroup in a Dynamic way.
SQL Server Standard vs Enterprise Edition Features History
Along the time Microsoft improve performance and add features to the SQL Server Database.
Reading a SQL table by chunks with Pandas
In this short Python notebook, we want to load a table from a relational database and write it into a CSV file.
Apache Airflow 2.0 : How it works
Airflow became in the last recent years a major actor for scheduling a wide variety of actions.
Loading data from CSV files into a Tableau Hyper extract
Hyper is Tableau’s in-memory data engine technology, designed for fast data ingest and analytical query processing on large or complex data sets.
More Heapsort in Cython
This post/notebook is the follow-up to a recent one: Heapsort with Numba and Cython, where we implemented heapsort in Python/Numba and Cython and compared…
Loading data from PostgreSQL to Pandas with ConnectorX
ConnectorX is a library, written in Rust, that enables fast and memory-efficient data loading from various databases to different dataframes.
Export data as fast as possible : from HANA to CSV
I want to export from HANA to CSV. As source, a table or a sql query, as target an external client, of course as fast as possible and using a command line…
Heapsort with Numba and Cython
Heapsort is a classical sorting algorithm. We are going into a little bit of theory about the algorithm, but refer to Corman et al.
Using Tableau to detect outliers and ruptures
To do that, we are going to get the outliers of a dataset, the change points and a piecewise approximation.
Tableau 2022 Optimize Workbook Feature : first test
"Optimize Workbook" is a new feature of Tableau 2022. .. but infortunatly the link redirect tableau.com root website where we could expect a technical…
Tableau Performance Tips #8 : Avoid using Tableau Groups
Tableau allow users to build their own custom groups very easily. This is a convenient way to regroup data on elements that users want to see regrouped.
Gartner Magic Quadrant BI 15 years History
Business Intelligence (BI) tools are competing for years. Gartner Magic Quadrant is one of the famous benchmark that classify mainstream BI tools.
SQL Server Trace Flags Classification
_Trace flags are used to set specific server characteristics or to alter a particular behavior.
Tableau Performance Tips #7 : Prefer to use a one row datasource to display static metadata informations
Tableau does not have really customisable buttons. I mean you can put image on your dashboard but you cannot display the text you want with the formatting…
Plotting population density with datashader
In this short post, we are using the Global Human Settlement Layer from the European Commission: The downloaded file has a worldwide resolution of 250m…
Tableau Performance Tips #6 : Avoid using NOW() for filtering or selecting against a fact datasource
Some databases implement a result cache (or query cache depending the name), it is a cache for the results of some queries.
Tableau Performance Tips #5 : Sort only with element(s) in the view
A performance issue that is not well known is that Tableau sorts is not done by the datasource but by tableau itself.
Compression des données XML dans SQL Server
On stocke des données XML dans une table qui commence à grossir sérieusement et il devient important de réfléchir à des solutions pour essayer de gagner…
Tableau Performance Tip #4 : Avoid using a big datasource to display semi-constant informations
More than often you will want to display semi-constant information like the current timestamp, the Tableau Username, a chosen currency or a simple single…
Tableau Performance Tips #3 : Avoid small list of values to be in the context
Let's begin with a definition of what a list of values is. A list of values is linked to a filter. The filter can be in the context or not. Hum...
8 mars 2022 : Journée internationale des droits des femmes
Après quelques semaines à étudier de l'open data sur le thème des inégalités homme/femme, voici une visualisation sur l'index d'egalité de genre de l'EIGE…
Tableau Performance Tips #2 : Avoid total and sub-totals when using a count distinct metric aggregate
If you use a total (or worse) sub-totals when you have metric(s) that is count distinct, this will lead to a second (or several) sequential pass for each…
Applying a row-wise function to a Pandas dataframe
More than 3 years ago, we posted a comparative study about Looping over Pandas data using a CPU.
Tableau Performance Tips #1 : Tableau Performance Recording
Introduction to Tableau Performance RecordingIn this article we will discover how to diagnose your performances with the Tableau performance recording.
A Parallel loop in Python with Joblib.Parallel
The goal of this post is to perform an embarrassingly parallel loop in Python, with the same code running on different platforms [Linux and Windows].
DataOops : le podcast francophone sur la data et le devops
Retrouvez Eric Duquesnoy pour des news et des explications autour du DevOps, Fabien Beaumont pour affuter vos connaissances sur la modélisation des…
150 T-SQL Bad Practices
Many times i was asking for given best practices for T-SQL code but I don't like best practices advices.
Tableau Server performance impacted by version history depth of datasources and workbooks
After several tests on real word tableau production environment (+1000 workbooks, +100 shared datasource) we discover that object version history have an…
Python Spatial Join with GeoPandas (and GEOS)
The purpose of this post is to perform an "efficient" spatial join in Python. What is a spatial join?
Built-in Expectations in Great Expectations
Great expectation is a Python tool for data testing, documentation, and profiling.
COVID Deaths Worldwide Evolution Dashboard
This dashboard show main key figures for COVID deaths wordwide and the evolution of number of deaths.
Tests, incidence, hospitalisations, réanimations et décès du au COVID en France par départements et par Régions
Filtrage via les cartes régions et département montrant l'incidence (hebdomadaire) du COVID en France pour la dernière semaine pleine (mise à jour le…
Incidence COVID en France par départements et par tranches d'âge dernière semaine
Grâce aux données fournies par le SidDep voici une analyse de Incidence COVID en France par départements et par tranches d'age pour la dernière semaine…
Goldbach's Comet with Numba and Datashader
This Python notebook is about computing and plotting Goldbach function. It requires some basic mathematical knowledge, nothing fancy!
Le tour de france history web scraping
This file downloads raw data about every rider of every Tour de France (from 1903 up to 2020).
Impact of food on CO2 production : Eat Better - Eat Local
A viz showing the Impact of food on CO2 production by showing how much Kg of CO2 is produced for 1 Kg of foods.
COVID Hospitalisations, Réanimations et Décès en France par départements
Afin de produire la visualisation montrant pour le COVID, les hospitalisations, réanimations et décès en France par départements, j'ai utilisé un web data…
Part des personnes testées positives au COVID en France
Après l'analyse des données COVID par régions et tranches d'âge, j'ai produit une nouvelle visualisation toujours basée sur les données Sidep sur…
Stack Overflow Trends
Starting using Brent Ozar Stack Overflow database extract i tried to build a dashboard that show evolution of Tags Trends over time and if possible…
Incidence COVID en France par départements et par tranches d'âge
Après l'analyse des données COVID par régions et tranches d'âge, j'ai récupéré les dernières données (mise à jour une fois par semaine) et détaillé…
Incidence COVID en France par région et par tranche d'age
Après l'analyse des données COVID France-Départements et tranches d'âge initiée par François j'ai décidée de relever le challenge et de faire un dashboard…
Some Pre-commit git hooks for Python
Pre-commit hooks are a great way to automatically check and clean the code. They are executed when committing changes to git.
Quick data exploration with pandas, matplotlib and seaborn
In this JupyterLab Python notebook we are going to look at the rate of coronavirus [COVID-19] cases in french departments [administrative divisions of…
Gartner analytics and Business Intelligence tools comparator
As promised here is an article on the Gartner® analytics and Business Intelligence tools comparator based on the capabilities and use cases of the tools.
Optuna and XGBoost on a tabular dataset
The purpose of this Python notebook is to give a simple example of hyperparameter optimization [HPO] using Optuna and XGBoost.
SQL Server CLR Functions vs SQL 2019 Function Inlining
Ce tutorial montre toutes les étapes pour: Découvrez également la nouvelle fonctionnalité SQL Server 2019: le "function inlining" et comment l'activer.
Saving a tf.keras model with data normalization
Training a DL model might take some time, and make use of some special hardware.
Benford's law and the population of french cities
In this Python notebook, we are going to look at Benford's law, which predicts the leading digit distribution, when dealing with some real-world…
Merge Sort with Cython and Numba
In this post, we present an implementation of the classic merge sort algorithm in Python on NumPy arrays, and make it run reasonably "fast" using Cython…
Logistic regression with JAX
JAX is a Python package for automatic differentiation from Google Research. It is a really powerful and efficient library.
Minimizing continuous non-convex functions with Optuna
In this post, we are going to deal with single-objective continuous optimization problems, using the open-source Optuna Python package.
Lunch break, fetching AROME temperature forecast in Lyon
Since a "small" heat wave is coming, I would like to get some temperature forecast for the next hours in my neighborhood, from my JupyterLab notebook.
Lunch break, ridge plots with Bokeh
Bokeh is a great visualization Python library. In this short post, we are going to use it to create a ridge plot.
Outlier and Change Point Detection in Data Integration Performance Metrics
Data integration involves combining data residing in different sources, and providing users with a unified view of them.
Some cool open-source Python packages for Machine Learning Ep 5
There is a very rich ecosystem of Python libraries related to ML.
Lunch break, plotting excess death in french department zones with Python
Daily deaths data are provided by INSEE - the national institute of statistics and economic studies.
A Quick study of air quality in Lyon with Python
The aim of this post is to use Python to fetch air quality data from a web service and to create a few plots.
Fitting a logistic curve to time series in Python
In this notebook we are going to fit a logistic curve to time series stored in Pandas, using a simple linear regression from scikit-learn to find the…
Cython and Numba applied to a simple algorithm: Insertion sort
The aim of this notebook is to show a basic example of Cython and Numba, applied to a simple algorithm: Insertion sort.
Lunch break: plotting traffic injuries with datashader
Well I love the datashader Python package and I am always happy to use it on some interesting datasets.
Gartner MQBI (Magic Quadrant BI) History
We had compiled Gartner BI Magic Quadrant data since 2007 in several dashboards that show the evolution of the Gartner MQBI history with BI vendors…
Fetching AROME weather forecasts and plotting temperatures
Accurate weather forecasts might be very usefull for various types of models.
Some cool open-source Python packages for Machine Learning Ep 4
There is a very rich ecosystem of Python libraries related to ML.
Some cool open-source Python packages for Machine Learning Ep 3
There is a very rich ecosystem of Python libraries related to ML.
First try of auto-sklearn
Since we are big users of scikit-learn and XGBoost, we wanted to try a package that would automate the process of building a machine learning model with…
Some cool open-source Python packages for Machine Learning Ep 2
There is a very rich ecosystem of Python libraries related to ML.
Loading data into a Pandas DataFrame - a performance study
Because doing machine learning implies trying many options and algorithms with different parameters, from data cleaning to model validation, the Python…
Some cool open-source Python packages for Machine Learning Ep 1
There is a very rich ecosystem of Python libraries related to ML.
GPU Analytics Ep 3, Apply a function to the rows of a dataframe
The goal of this post is to compare the execution time between Pandas (CPU) and RAPIDS (GPU) dataframes, when applying a simple mathematical function to…
GPU Analytics Ep 2, Load some data from OmniSci into a GPU dataframe
Although the post title is about loading some data from a GPU database into a GPU dataframe, most of it is about running JupyterLab on a GPU AWS instance…
GPU Analytics Ep 1, GPU installation of OmniSci on AWS
In this post, we are going to install the OmniSci 4.6 GPU database on an Ubuntu 18.04 AWS instance.
Nighttime Lights with Rasterio and Datashader
In this post, we are going to plot some satellite GeoTIFF data in Python.
Symmetric Chaos with Datashader and Numba
Map equation and coefficient values are taken from here. Some mathematical explainations can be found here, by Mike Field and Martin Golubitsky.
Plotting Hopalong attractor with Datashader and Numba
What is an attractor? Definition from wikipedia: Most of the following code comes from James Bednar's notebook about 2D strange attractor plotting with…
Looping over Pandas data
I recently stumbled on this interesting post on RealPython (excellent website by the way!): Fast, Flexible, Easy and Intuitive: How to Speed Up Your…
Pandas Time Series example with some historical land temperatures
The aim of this notebook is just to play with time series along with a couple of statistical and plotting libraries.
Lyon DataVis and AI mini-conference
Yesterday I went to this mini-conference at ENS Lyon and enjoyed it very much.