Blog – Database | Architecture & Performance

Databaseen13 août 2026

Exporting Teradata Data to Microsoft OneLake with FastBCP

FastBCP exports one table at a time from a source database to files, in parallel, and can stream those files straight to cloud object storage without…

#FastBCP#Teradata#OneLake

Databaseen11 août 2026

A tour of the ArrowTDS ADBC driver in C#

ArrowTDS is a commercial driver for Microsoft SQL Server, built on ADBC (Arrow Database Connectivity), a standard interface for drivers that exchange data…

#ArrowTDS#ADBC#Arrow

Databaseen13 juil. 2026

Fast Geographic Data Extraction from SQL Server to Parquet with FastBCP

SQL Server holds spatial data in geography and geometry columns.

#FastBCP#ArrowTDS#SQL Server

Databaseen27 nov. 2025

An example ETL Pipeline with dlt + SQLMesh + DuckDB

In this post, we walk through building a basic ETL (Extract-Transform-Load) pipeline.

#DuckDB#SQLMesh#dlt

Databaseen25 oct. 2025

Performance Analysis of Parallel Data Replication Between Two PostgreSQL 18 Instances on OVH

Parallel data replication between PostgreSQL instances presents unique challenges at scale, particularly when attempting to maximize throughput on…

#FastTransfer#PostgreSQL 18#Performance analysis

Databaseen4 oct. 2025

PG_FASTBCP Postgres Extension

Moving large volumes of data in and out of a PostgreSQL database has always been a critical challenge for developers, data engineers, and database…

#FastBCP#Performance#export

Databaseen29 sept. 2025

Data Loading from S3 Parquet Files to PostgreSQL on OVH Cloud

Loading data efficiently from cloud storage into databases remains a critical challenge for data engineers.

#FastTransfer#S3 Parquet files#PostgreSQL bulk loading

Databaseen29 sept. 2025

FastTransfer Performance with Citus Columnar Storage in PostgreSQL

Data migration between database systems often becomes a bottleneck in modern data pipelines, particularly when dealing with analytical workloads.

#FastTransfer#Citus PostgreSQL#Columnar storage

Databaseen29 sept. 2025

High-Speed PostgreSQL Replication on OVH with FastTransfer

PostgreSQL-to-PostgreSQL replication at scale requires tools that can fully leverage modern cloud infrastructure and network capabilities.

#FastTransfer#PostgreSQL replication#OVH

Databaseen14 juil. 2025

Parallel Data Movement Made Simple: FastTransfer & FastBCP Explained

In this article, we’ll show you why traditional tools are no longer fit for today’s servers — and how FastTransfer and FastBCP were built from the ground…

#FastTransfer#FastBCP

Databaseen30 juin 2025

Oracle to PostgreSQL Data Transfer : pg_fasttransfer vs oracle_fdw

Migrating large tables from Oracle to PostgreSQL can be challenging when performance and reliability matter.

#FastTransfer#pg_fasttransfer#Oracle

Databaseen26 juin 2025

PostgreSQL Data Transfer: pg_fasttransfer vs postgres_fdw

Transferring large volumes of data between PostgreSQL databases can be challenging when performance, security, and simplicity matter.

#PostgreSQL#COPY#FastTransfer

Databaseen4 mars 2025

Spatial queries in DuckDB with R-tree and H3 indexing

This Python notebook explores the use of two indexing techniques, R-tree and H3, for performing spatial queries in DuckDB.

#Python#DuckDB#Spatial

Databaseen1 mars 2025

In-memory cosine distance calculation, NumPy vs DuckDB

This notebook compares the performance of NumPy and DuckDB for computing cosine distances on the same dataset.

#Numpy#Cosine distance#vector

Databaseen18 févr. 2025

Querying Private s3 Buckets with DuckDB

DuckDB is an in-process SQL database that allows you to query data from various sources, including private AWS s3 buckets.

#Python#DuckDB#secrets

Databaseen4 nov. 2024

Using DuckDB with Tableau Desktop on Windows

DuckDB is an in-process SQL OLAP database management system. These database is very fast for OLAP queries and have several advantages: There is also…

#DuckDB#database#OLAP

Databaseen30 mai 2024

A Hybrid information retriever with DuckDB

When it comes to information retrieval, vector search methods have demonstrated some good performance, especially when the embedding models have been…

#Python#DuckDB#Hybrid information retriever

Databaseen8 janv. 2024

Streaming data from PostgreSQL to a CSV file as fast as possible

In this post, we explore the process of streaming data from a PostgreSQL database to a CSV file using Python.

#Python#SQL#PostgreSQL

Databaseen15 nov. 2023

Methane Gaz Emissions

The Emissions Database for Global Atmospheric Research (EDGAR) provides independent estimates of the global anthropogenic emissions and emission trends…

#database#GHG#OpenData

Databaseen15 nov. 2023

Parquet file sorting test

Some time ago, we came across an intriguing Parquet sorting test shared by Mimoune Djouallah on Twitter @mim_djo.

#Python#TPC-H#Benchmark

Databaseen12 oct. 2023

The Database of Databases Dashboard

After extensively delving into the database world through dbdb.io and enjoying numerous online courses that delve deep into databases (a subject I'm truly…

#database

Databaseen7 oct. 2023

ROLLBACK DELETE vs TRUNCATE vs DROP in several RDBMS

What are the differences between DELETE vs TRUNCATE vs DROP? The first one is DML whereas the last two are DDL but can which are rollbackle and which are…

#database

Databaseen25 sept. 2023

Oracle Database Features Evolution

From version 11.2 to the 23c version oracle database have more than 1600 features.

#database#Oracle

Databaseen13 sept. 2023

Oracle Database Editions Comparator

Oracle provide many informations about features that are available or not in their licensing page…

#database#Oracle

Databaseen30 août 2023

Vector similarity search with pgvector

In the realm of vector databases, pgvector emerges as a noteworthy open-source extension tailored for Postgres databases.

#Python#vector database#pgvector

Databaseen13 mai 2023

PostgreSQL Features Matrix GPT-Optimized

PostgreSQL is a hip and happening DBMS that's gaining more and more popularity.

#PostgreSQL#database

Databaseen27 avr. 2023

TPC-H benchmark of DuckDB and Hyper on native files

In this blog post, we examine the performance of two popular SQL engines for querying large files: These engines have gained popularity due to their…

#TPC-H#Benchmark#SQL

Databaseen4 avr. 2023

TPC-H benchmark of Hyper and DuckDB on Windows and Linux OS

In this blog post, we explore the use of two SQL engines, and specifically their Python API, for querying files.

#TPC-H#Benchmark#SQL

Databaseen3 avr. 2023

TPCH with Snowflake : SF100

Snowflake is a fantastic Datawarehouse and Datalake SaaS Solution!

#database#Benchmark#TPC-H

Databaseen30 mars 2023

TPC-H benchmark of Hyper, DuckDB and Datafusion on Parquet files

In this blog post, we focus on directly querying Parquet files using three different SQL engines, and more specifically their Python API: The TPC-H…

#TPC-H#Benchmark#SQL

Databaseen20 mars 2023

TPCH SF10 : Tableau Hyper Engine vs DuckDB vs Snowflake vs BigQuery vs Databricks vs SingleStore

After a first try with TPCH SF10 using DuckDB on 2 differents laptops and compare parquet storage vs native storage (see TPCH SF10 using DuckDB vs…

#database#Benchmark#DuckDB

Databaseen12 mars 2023

TPCH SF10 using DuckDB vs SnowFlake, Bigquery, SingleStore and Databricks

I was very interested in 2 articles of Mimoune Djouallah (aka mim) that compare Snowflake, BigQuery, Databricks, SingleStore, PowerBI Datamart and DuckDB…

#database#Benchmark

Databaseen4 oct. 2022

Query Parquet files with DuckDB and Tableau Hyper engines

In this notebook, we are going to query some Parquet files with the following SQL engines: Both of these tools are optimized for Online analytical…

#Python#SQL#DuckDB

Databaseen23 sept. 2022

Download some benchmark road networks for Shortest Paths algorithms

The goal of this Python notebook is to download and prepare a suite of benchmark networks for some shortest path algorithms.

#Python#Networks#Pandas

Databaseen6 juil. 2022

Trying DuckDB with Discogs data

This notebook is a small example of using DuckDB with the Python API. It is a relational DBMS that supports SQL.

#Python#SQL#Pandas

Databaseen20 juin 2022

Talend Quick Tips : Increase BigQuery Talend timeout in components

In this article I will show you how to change a critical setting in Talend: the timeout.

#Talend#BigQuery#Performance

Databaseen20 avr. 2022

Loading data from PostgreSQL to Pandas with ConnectorX

ConnectorX is a library, written in Rust, that enables fast and memory-efficient data loading from various databases to different dataframes.

#Python#Performance#Benchmark

Databaseen16 avr. 2022

Export data as fast as possible : from HANA to CSV

I want to export from HANA to CSV. As source, a table or a sql query, as target an external client, of course as fast as possible and using a command line…

#hana#database#Performance

Databaseen6 mai 2019

GPU Analytics Ep 2, Load some data from OmniSci into a GPU dataframe

Although the post title is about loading some data from a GPU database into a GPU dataframe, most of it is about running JupyterLab on a GPU AWS instance…

#SQL#Performance#GPU

Databaseen24 avr. 2019

GPU Analytics Ep 1, GPU installation of OmniSci on AWS

In this post, we are going to install the OmniSci 4.6 GPU database on an Ubuntu 18.04 AWS instance.

#GPU#SQL#Performance

Database

Tous les articles

Exporting Teradata Data to Microsoft OneLake with FastBCP

A tour of the ArrowTDS ADBC driver in C#

Fast Geographic Data Extraction from SQL Server to Parquet with FastBCP

An example ETL Pipeline with dlt + SQLMesh + DuckDB

Performance Analysis of Parallel Data Replication Between Two PostgreSQL 18 Instances on OVH

PG_FASTBCP Postgres Extension

Data Loading from S3 Parquet Files to PostgreSQL on OVH Cloud

FastTransfer Performance with Citus Columnar Storage in PostgreSQL

High-Speed PostgreSQL Replication on OVH with FastTransfer

Parallel Data Movement Made Simple: FastTransfer & FastBCP Explained

Oracle to PostgreSQL Data Transfer : pg_fasttransfer vs oracle_fdw

PostgreSQL Data Transfer: pg_fasttransfer vs postgres_fdw

Spatial queries in DuckDB with R-tree and H3 indexing

In-memory cosine distance calculation, NumPy vs DuckDB

Querying Private s3 Buckets with DuckDB

Using DuckDB with Tableau Desktop on Windows

A Hybrid information retriever with DuckDB

Streaming data from PostgreSQL to a CSV file as fast as possible

Methane Gaz Emissions

Parquet file sorting test

The Database of Databases Dashboard

ROLLBACK DELETE vs TRUNCATE vs DROP in several RDBMS

Oracle Database Features Evolution

Oracle Database Editions Comparator

Vector similarity search with pgvector

PostgreSQL Features Matrix GPT-Optimized

TPC-H benchmark of DuckDB and Hyper on native files

TPC-H benchmark of Hyper and DuckDB on Windows and Linux OS

TPCH with Snowflake : SF100

TPC-H benchmark of Hyper, DuckDB and Datafusion on Parquet files

TPCH SF10 : Tableau Hyper Engine vs DuckDB vs Snowflake vs BigQuery vs Databricks vs SingleStore

TPCH SF10 using DuckDB vs SnowFlake, Bigquery, SingleStore and Databricks

Query Parquet files with DuckDB and Tableau Hyper engines

Download some benchmark road networks for Shortest Paths algorithms

Trying DuckDB with Discogs data

Talend Quick Tips : Increase BigQuery Talend timeout in components

Loading data from PostgreSQL to Pandas with ConnectorX

Export data as fast as possible : from HANA to CSV

GPU Analytics Ep 2, Load some data from OmniSci into a GPU dataframe

GPU Analytics Ep 1, GPU installation of OmniSci on AWS

Besoin d'expertise sur votre projet ?