72 Blog Posts To Learn About Minio

MinIO is an open-source object storage server compatible with Amazon S3 APIs, designed for storing unstructured data like photos, videos, backups, and log files. It offers a high-performance, scalable solution for cloud-native applications and private cloud deployments.

1. Open-Source: The Next Step in AI Revolution

Explore the open-source revolution in AI development, distinguishing between genuine innovation and 'open-washing' attempts by Big Tech.

2. Supercharge TileDB Engine with MinIO

MinIO makes a powerful primary TileDB backend because both are built for performance and scale.

3. Smooth Sailing: Transitioning from Docker to Localhost

Understanding Docker networking is more than a technical necessity; it's a step toward mastering containerized environments.

4. LanceDB: Your Trusted Steed in the Duel Against Data Complexity

There are many ways to build on the foundation offered in this tutorial to create performant, scalable and future-proofed ML/AI architectures.

5. Hungry GPUs Need Fast Object Storage

MinIO is capable of the performance needed to feed your hungry GPUs; a recent benchmark achieved 325 GiB/s on GETs and 165 GiB/s on PUTs.

6. Data Migration from Dell ECS to MinIO

Dell ECS clusters allow you to migrate your data to any S3 compatible store. Dell ECS calls this feature “Data Movement”, also called copy-to-cloud.

7. An Architect’s Guide to Building Reference Architecture for an AI/ML Datalake

Organizations should not build an infrastructure dedicated to AI and AI only while leaving other workloads to fend for themselves.

8. An Architect’s Guide to the Top 10 Tools Needed to Build the Modern Data Lake

Here is a list of vendors and tools needed to build the modern data lake, with each entry a capability needed to support generative AI.

9. Never the One to Die: Persistent Data with a CDC MinIO Sink for CockroachDB

When you absolutely need to have a perfect replica of your data for data exploration, CockroachDB and MinIO is your winning strategy.

10. All You Need to Know to Repatriate from AWS S3 to MinIO

Let's dig a little deeper into the costs and savings associated with repatriation to make it easier for you to put together your own analysis.

11. Analyzing the Pros, Cons, and Risks of LLMs

LLMs cannot think, understand or reason. This is the fundamental limitation of LLMs.

12. Managing Large Data Volumes With MinIO, Langchain and OpenAI

A practical guide to integrating MinIO, Langchain and OpenAI’s GPT-3.5 model focusing on summarizing documents stored in MinIO buckets.

13. How To Deploy Grafana Loki and Save Data to MinIO Using Docker Containers or Direct from Source

Although commonplace, logs hold critical information about system operations and are a valuable source of debugging and troubleshooting information.

14. Backing Up Weaviate with MinIO S3 Buckets to Achieve Strategic Enhancement to Data Management

Combining the advanced vector database capabilities of Weaviate with the storage solutions of MinIO empowers users to unlock the full potential of their data.

15. How to Use MinIO as External Tables to Extend Snowflake

MinIO is a high-performance, cloud native object store. Because of this, MinIO can become the global datastore for Snowflake customers, wherever their data sits

16. Integrating Apache Druid and Apache Superset with MinIO

Prepare to be amazed at how quickly you can build a high-performance analytics and visualization stack with open source products.

17. Building Effective Modern Data Architectures with Iceberg, Tabular and MinIO

Modern datalakes provide a central hub for all your data needs. However, building and managing an effective data lake can be complex.

18. Leveraging MinIO and Apache Tika for Automated Text Extraction and Analysis

Discover how to leverage MinIO Bucket Notifications and Apache Tika for efficient text extraction and analysis in fine-tuning, LLM training, and RAG projects.

19. Data Lake Mysteries Revealed: Nessie, Dremio, and MinIO Make Waves

Let's see how Nessie, Dremio and MinIO work together to enhance data quality and collaboration in your data engineering workflows.

20. A Closer Look Into the MinIO Enterprise Object Store Firewall

The MinIO Enterprise Object Store Firewall is designed specifically to work with applications using MinIO object store and its API endpoints.

21. The MinIO DataPod: A Reference Architecture for Exascale Computing

MinIO has created a comprehensive blueprint for data infrastructure to support exascale AI and other large scale data lake workloads.

22. Setting Up MinIO With Quickwit

MinIO is the right choice for Quickwit because of its industry-leading performance and scalability.

23. Your Guide to Running Grafana Mimir with MinIO for Persistent Metrics Storage

Mimir stores data in object storage for persistence, allowing it to take advantage of ubiquitous, cost-effective and high-durability MinIO.

24. Your Definitive Guide to Lakehouse Architecture with Iceberg and MinIO

This post focuses on how Iceberg and MinIO complement each other and how various analytic frameworks (Spark, Flink, Trino, Dremio, Snowflake) can leverage them.

25. Combining Delta Lake With MinIO for Multi-Cloud Data Lakes

The combination of MinIO and Delta Lake enables enterprises to have a multi-cloud data lake that serves as a consolidated single source of truth.

26. The Real Reasons Why AI is Built on Object Storage

From no limits on unstructured data to having greater control over serving models, here are some reasons why AI is built on object storage.

27. Limit Cloud Data Costs with MinIO on Equinix

Companies who understand the cloud operating model and understand their workloads are voting with their feet.

28. The New Private Cloud From the Eyes of an Architect

The term “private cloud” used to have a negative connotation, but is now viewed a lot more positively.

29. The Economics of Public Cloud Repatriation and Why You Can't Stay in the Cloud at Scale

The public cloud doesn't deliver cost savings at scale. It delivers productivity gains, to a point, but it will not reduce your costs.

30. Creating a Data Lakehouse using Apache Iceberg and MinIO

The promise of Data Lakehouses is in their capabilities for structured and unstructured data, all in a centralized solution using Apache Iceberg and MinIO.

31. Developing Streaming Data Lakes with Hudi and MinIO

Using MinIO for Hudi storage paves the way for multi-cloud data lakes and analytics.

32. Everything You Need to Know to Deploy MinIO in Virtualized Environments

When deploying MinIO in virtualized environments, it’s important to make sure that the proper conditions are in place.

33. Installing and Configuring Kubeflow with MinIO Operator

Kubeflow is a modern solution to design, build and orchestrate Machine Learning pipelines using the latest and most popular frameworks.

34. Automating Cloud Storage Deployments With MinIO and SystemD

With the help of SystemD and MinIO you can automate your cloud object storage deployments and ensure the service lifecycle is managed smoothly and successfully.

35. Using MinIO to Build a Retrieval Augmented Generation Chat Application

Building a production-grade RAG application demands a suitable data infrastructure to store, version, process, evaluate, and query chunks of data.

36. Sailing the Waters: Developing Production-Grade RAG Applications with Data Lakes

In mid-2024, creating an AI demo that impresses and excites can be easy. Getting to production, though, is another matter.

37. Effortlessly Launch LangChain APIs with LangServe and MinIO Integration

Streamline LangChain app deployment with LangServe and MinIO, creating powerful, production-ready APIs for seamless data management.

38. Make it Rain: How Repatriating Your Public Cloud Workload Can Save You Millions

A high performance, cloud-native object store offers you economic benefits, performance benefits, control benefits - and they compound with scale.

39. How to Deploy MinIO and Trino with Kubernetes

With the ability to handle significant workloads across AI/ML and analytics, MinIO effortlessly supports Trino queries and beyond.

40. Architecting a Modern Data Lake in a Post-Hadoop World

This paper talks to the rise and fall of Hadoop HDFS and why high-performance object storage is a natural successor in the big data world.

41. Developing Next-Gen Data Solutions: SingleStore, MinIO, and the Modern Datalake Stack

The integration of SingleStore, a cloud-native database known for its speed and versatility, with MinIO forms an important brick in the modern datalake stack.

42. Migrating From Hadoop Without Rip and Replace Is Possible — Here's How

Here's how to migrate from Hadoop without the need to completely overhaul your existing systems.

43. Using MinIO and Python to Create Scalable and Efficient Event-driven Applications

Event notifications in MinIO may not seem thrilling at first, but once you harness their power, they illuminate the dynamics within your storage buckets.

44. Migrate to AI-Ready Infrastructure: Hitachi Content Platform to MinIO

Developed to support customers' evolving storage needs, the HCP-to-MinIO tool is freely available on GitHub and greatly simplifies the migration process.

45. An Architect's Guide to Machine Learning Operations and Required Data Infrastructure

MLOps is a set of practices and tools aimed at addressing the specific needs of engineers building models and moving them into production.

46. The Architect’s Guide to A Modern Datalake Reference Architecture

A Modern Datalake is one-half Data Warehouse and one- half Data Lake. It uses object storage in terms of scalability and performance.

47. The Noonification: Nintendo Breaks Its Silence On Palworld (2/18/2024)

2/18/2024: Top 5 stories on the HackerNoon homepage!

48. Meet MinIO: The HackerNoon Company of the Week

This week, we present our business blogging partner MinIO - a high-performance, S3 compatible object store, built for large scale AI/ML.

49. Hands-on with Apache Iceberg on Your Laptop: Deep Dive with Apache Spark, Nessie, Minio and more!

Get hands-on with Apache Iceberg by building a prototype data lakehouse on your laptop.

50. The Noonification: Opside’s NCRC Trustless Native Protocol in Focus (9/3/2023)

9/3/2023: Top 5 stories on the Hackernoon homepage!

51. Hands-on with Apache Iceberg & Dremio on Your Laptop within 10 Minutes

From creating and querying Iceberg tables to managing branches and snapshots with Nessie’s Git-like controls, you’ve seen how this stack can simplify complex da