Architecture & DesignIntermediate
Sharding
PronunciationSHAR-ding
Definition
Sharding is a database partitioning technique that splits a large dataset into smaller, more manageable chunks called shards, which are then distributed across multiple servers. This approach helps improve performance and scalability by reducing the load on any single database instance.
Where you hear it
In system design discussions, database administration meetings, and when planning for high-traffic application infrastructure.
Examples
We need to implement sharding to handle the rapid growth of our user data.
The database team is sharding the logs table across four different servers to improve query speed.
Common mistake
Thinking that sharding is a simple configuration change; it is a complex architectural decision that makes cross-shard queries and data consistency significantly harder to manage.
Keep exploring
More in Architecture & Design