利用Sharding-Jdbc進(jìn)行分庫(kù)分表的操作代碼
1. Sharding-Jdbc介紹
https://shardingsphere.apache.org/
- sharding-jdbc是一個(gè)分布式的關(guān)系型數(shù)據(jù)庫(kù)中間件
- 客戶端代理模式,不需要搭建服務(wù)器,只需要后端數(shù)據(jù)庫(kù)即可,有個(gè)IDE就行了
- 定位于輕量級(jí)的Java框架,以jar的方式提供服務(wù)
- 可以理解為增強(qiáng)版的jdbc驅(qū)動(dòng)
- 完全兼容主流的ORM框架
sharding-jdbc提供了4種配置
- Java API
- yaml
- properties
- spring命名空間
與MyCat的區(qū)別
- MyCat是服務(wù)端的代理,Sharding-Jdbc是客戶端代理
- 實(shí)際開(kāi)發(fā)中如果企業(yè)有DBA建議使用MyCat,都是開(kāi)發(fā)人員建議使用sharding-jdbc
- MyCat不支持在一個(gè)庫(kù)內(nèi)進(jìn)行水平分表,而sharding-jdbc支持在同一個(gè)數(shù)據(jù)庫(kù)中進(jìn)行水平分表
名詞解釋
- 邏輯表:物流的合并表
- 真實(shí)表:存放數(shù)據(jù)的地方
- 數(shù)據(jù)節(jié)點(diǎn):存儲(chǔ)數(shù)據(jù)的MySQL節(jié)點(diǎn)
- 綁定表:相當(dāng)于MyCat中的子表
- 廣播表:相當(dāng)于MyCat中的全局表
2. Sharding-Jdbc引入使用
# 0.首先在兩個(gè)MySQL上創(chuàng)建兩個(gè)數(shù)據(jù):shard_order # 1.分表給兩個(gè)庫(kù)創(chuàng)建兩個(gè)表order_info_1,order_info_2 CREATE TABLE `order_info_1` ( `id` int(11) NOT NULL, `order_amount` decimal(10,2) DEFAULT NULL, `order_status` int(255) DEFAULT NULL, `user_id` int(11) DEFAULT NULL, PRIMARY KEY (`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8; CREATE TABLE `order_info_2` ( `id` int(11) NOT NULL, `order_amount` decimal(10,2) DEFAULT NULL, `order_status` int(255) DEFAULT NULL, `user_id` int(11) DEFAULT NULL, PRIMARY KEY (`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8; # 2.切分規(guī)則,按照id的奇偶數(shù)切分到兩個(gè)數(shù)據(jù)庫(kù),在自己的數(shù)據(jù)庫(kù)按照user_id進(jìn)行表切分
代碼導(dǎo)入POM依賴
<dependency> <groupId>org.apache.shardingsphere</groupId> <artifactId>sharding-jdbc-spring-boot-starter</artifactId> <version>4.0.0-RC2</version> </dependency>
配置properties
# 給兩個(gè)數(shù)據(jù)源命名 spring.shardingsphere.datasource.names=ds0,ds1 # 數(shù)據(jù)源鏈接ds0要和命名一致 spring.shardingsphere.datasource.ds0.type=com.zaxxer.hikari.HikariDataSource spring.shardingsphere.datasource.ds0.driver-class-name=com.mysql.jdbc.Driver spring.shardingsphere.datasource.ds0.jdbcUrl=jdbc:mysql://39.103.163.215:3306/shard_order spring.shardingsphere.datasource.ds0.username=gavin spring.shardingsphere.datasource.ds0.password=123456 # 數(shù)據(jù)源鏈接ds1要和命名一致 spring.shardingsphere.datasource.ds1.type=com.zaxxer.hikari.HikariDataSource spring.shardingsphere.datasource.ds1.driver-class-name=com.mysql.jdbc.Driver spring.shardingsphere.datasource.ds1.jdbcUrl=jdbc:mysql://39.101.221.95:3306/shard_order spring.shardingsphere.datasource.ds1.username=gavin spring.shardingsphere.datasource.ds1.password=123456 # 具體的分片規(guī)則,基于數(shù)據(jù)節(jié)點(diǎn) spring.shardingsphere.sharding.tables.order_info.actual-data-nodes=ds$->{0..1}.order_info_$->{1..2} # 分庫(kù)的規(guī)則 spring.shardingsphere.sharding.tables.order_info.database-strategy.inline.sharding-column=id spring.shardingsphere.sharding.tables.order_info.database-strategy.inline.algorithm-expression=ds$->{id % 2} # 分表的規(guī)則 spring.shardingsphere.sharding.tables.order_info.table-strategy.inline.sharding-column=user_id spring.shardingsphere.sharding.tables.order_info.table-strategy.inline.algorithm-expression=order_info_$->{user_id % 2 + 1}
//測(cè)試代碼 @SpringBootTest class ShardingjdbcProjectApplicationTests { @Autowired JdbcTemplate jdbcTemplate; @Test void insertTest(){ String sql = "insert into order_info(id,order_amount,order_status,user_id) values(3,213.88,1,2)"; int i = jdbcTemplate.update(sql); System.out.println("影響行數(shù):"+i); } }
作業(yè):自己練習(xí)一下sharding-jdbc的分庫(kù)分表
3. 配置廣播表
先在兩個(gè)庫(kù)上創(chuàng)建廣播表province_info
CREATE TABLE `province_info` ( `id` int(11) NOT NULL, `name` varchar(255) DEFAULT NULL, PRIMARY KEY (`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8;
在properties里增加配置
spring.shardingsphere.sharding.broadcast-tables=province_info
測(cè)試插入和查詢的代碼
@Test void insertBroadcast(){ String sql = "insert into province_info(id,name) values(1,'beijing')"; int i = jdbcTemplate.update(sql); System.out.println("******* 影響的結(jié)果:"+i); } @Test void selectBroadcast(){ String sql = "select * from province_info"; List<Map<String,Object>> result = jdbcTemplate.queryForList(sql); for (Map<String,Object> val: result) { System.out.println("=========== "+val.get("id")+" ----- "+val.get("name")); } }
4. 配置綁定表
首先按照order_info的建表順序創(chuàng)建order_item分別在兩個(gè)庫(kù)上建立order_item_1,order_item_2
? @Test void insertBroadcast(){ String sql = "insert into province_info(id,name) values(1,'beijing')"; int i = jdbcTemplate.update(sql); System.out.println("******* 影響的結(jié)果:"+i); } @Test void selectBroadcast(){ String sql = "select * from province_info"; List<Map<String,Object>> result = jdbcTemplate.queryForList(sql); for (Map<String,Object> val: result) { System.out.println("=========== "+val.get("id")+" ----- "+val.get("name")); } } ?
配置綁定表,將兩個(gè)表的分表邏輯和order_info保持一致
# 給兩個(gè)數(shù)據(jù)源命名 spring.shardingsphere.datasource.names=ds0,ds1 # 數(shù)據(jù)源鏈接ds0要和命名一致 spring.shardingsphere.datasource.ds0.type=com.zaxxer.hikari.HikariDataSource spring.shardingsphere.datasource.ds0.driver-class-name=com.mysql.jdbc.Driver spring.shardingsphere.datasource.ds0.jdbcUrl=jdbc:mysql://39.103.163.215:3306/shard_order spring.shardingsphere.datasource.ds0.username=gavin spring.shardingsphere.datasource.ds0.password=123456 # 數(shù)據(jù)源鏈接ds1要和命名一致 spring.shardingsphere.datasource.ds1.type=com.zaxxer.hikari.HikariDataSource spring.shardingsphere.datasource.ds1.driver-class-name=com.mysql.jdbc.Driver spring.shardingsphere.datasource.ds1.jdbcUrl=jdbc:mysql://39.101.221.95:3306/shard_order spring.shardingsphere.datasource.ds1.username=gavin spring.shardingsphere.datasource.ds1.password=123456 # 具體的分片規(guī)則,基于數(shù)據(jù)節(jié)點(diǎn) spring.shardingsphere.sharding.tables.order_info.actual-data-nodes=ds$->{0..1}.order_info_$->{1..2} # 分庫(kù)的規(guī)則 spring.shardingsphere.sharding.tables.order_info.database-strategy.inline.sharding-column=id spring.shardingsphere.sharding.tables.order_info.database-strategy.inline.algorithm-expression=ds$->{id % 2} # 分表的規(guī)則 spring.shardingsphere.sharding.tables.order_info.table-strategy.inline.sharding-column=user_id spring.shardingsphere.sharding.tables.order_info.table-strategy.inline.algorithm-expression=order_info_$->{user_id % 2 + 1} # 具體的分片規(guī)則,基于數(shù)據(jù)節(jié)點(diǎn) spring.shardingsphere.sharding.tables.order_item.actual-data-nodes=ds$->{0..1}.order_item_$->{1..2} # 分庫(kù)的規(guī)則 spring.shardingsphere.sharding.tables.order_item.database-strategy.inline.sharding-column=order_id spring.shardingsphere.sharding.tables.order_item.database-strategy.inline.algorithm-expression=ds$->{order_id % 2} # 分表的規(guī)則 spring.shardingsphere.sharding.tables.order_item.table-strategy.inline.sharding-column=user_id spring.shardingsphere.sharding.tables.order_item.table-strategy.inline.algorithm-expression=order_item_$->{user_id % 2 + 1} # 綁定表關(guān)系 spring.shardingsphere.sharding.binding-tables=order_info,order_item # 廣播表 spring.shardingsphere.sharding.broadcast-tables=province_info
5. 讀寫分離配置
首先配置properties的數(shù)據(jù)源,如果有主機(jī)配置就必須要有從機(jī)配置
# 指定主從的配置節(jié)點(diǎn) spring.shardingsphere.datasource.names=master0,master0slave0,master1,master1slave0 # master0數(shù)據(jù)源鏈接配置 spring.shardingsphere.datasource.master0.type=com.zaxxer.hikari.HikariDataSource spring.shardingsphere.datasource.master0.driver-class-name=com.mysql.jdbc.Driver spring.shardingsphere.datasource.master0.jdbcUrl=jdbc:mysql://39.103.163.215:3306/shard_order spring.shardingsphere.datasource.master0.username=gavin spring.shardingsphere.datasource.master0.password=123456 # master0slave0數(shù)據(jù)源鏈接配置 spring.shardingsphere.datasource.master0slave0.type=com.zaxxer.hikari.HikariDataSource spring.shardingsphere.datasource.master0slave0.driver-class-name=com.mysql.jdbc.Driver spring.shardingsphere.datasource.master0slave0.jdbcUrl=jdbc:mysql://39.99.212.46:3306/shard_order spring.shardingsphere.datasource.master0slave0.username=gavin spring.shardingsphere.datasource.master0slave0.password=123456 # master1數(shù)據(jù)源鏈接配置 spring.shardingsphere.datasource.master1.type=com.zaxxer.hikari.HikariDataSource spring.shardingsphere.datasource.master1.driver-class-name=com.mysql.jdbc.Driver spring.shardingsphere.datasource.master1.jdbcUrl=jdbc:mysql://39.101.221.95:3306/shard_order spring.shardingsphere.datasource.master1.username=gavin spring.shardingsphere.datasource.master1.password=123456 # master1slave0數(shù)據(jù)源鏈接配置 spring.shardingsphere.datasource.master1slave0.type=com.zaxxer.hikari.HikariDataSource spring.shardingsphere.datasource.master1slave0.driver-class-name=com.mysql.jdbc.Driver spring.shardingsphere.datasource.master1slave0.jdbcUrl=jdbc:mysql://localhost:3306/shard_order spring.shardingsphere.datasource.master1slave0.username=root spring.shardingsphere.datasource.master1slave0.password=gavin # 具體的分片規(guī)則,基于數(shù)據(jù)節(jié)點(diǎn) spring.shardingsphere.sharding.tables.order_info.actual-data-nodes=ds$->{0..1}.order_info_$->{1..2} # 分庫(kù)的規(guī)則 spring.shardingsphere.sharding.tables.order_info.database-strategy.inline.sharding-column=id spring.shardingsphere.sharding.tables.order_info.database-strategy.inline.algorithm-expression=ds$->{id % 2} # 分表的規(guī)則 spring.shardingsphere.sharding.tables.order_info.table-strategy.inline.sharding-column=user_id spring.shardingsphere.sharding.tables.order_info.table-strategy.inline.algorithm-expression=order_info_$->{user_id % 2 + 1} # 具體的分片規(guī)則,基于數(shù)據(jù)節(jié)點(diǎn) spring.shardingsphere.sharding.tables.order_item.actual-data-nodes=ds$->{0..1}.order_item_$->{1..2} # 分庫(kù)的規(guī)則 spring.shardingsphere.sharding.tables.order_item.database-strategy.inline.sharding-column=order_id spring.shardingsphere.sharding.tables.order_item.database-strategy.inline.algorithm-expression=ds$->{order_id % 2} # 分表的規(guī)則 spring.shardingsphere.sharding.tables.order_item.table-strategy.inline.sharding-column=user_id spring.shardingsphere.sharding.tables.order_item.table-strategy.inline.algorithm-expression=order_item_$->{user_id % 2 + 1} # 綁定表關(guān)系 spring.shardingsphere.sharding.binding-tables=order_info,order_item # 廣播表 spring.shardingsphere.sharding.broadcast-tables=province_info # 讀寫分離主從關(guān)系綁定 spring.shardingsphere.sharding.master-slave-rules.ds0.master-data-source-name=master0 spring.shardingsphere.sharding.master-slave-rules.ds0.slave-data-source-names=master0slave0 spring.shardingsphere.sharding.master-slave-rules.ds0.load-balance-algorithm-type=round_robin spring.shardingsphere.sharding.master-slave-rules.ds1.master-data-source-name=master1 spring.shardingsphere.sharding.master-slave-rules.ds1.slave-data-source-names=master1slave0 spring.shardingsphere.sharding.master-slave-rules.ds1.load-balance-algorithm-type=random
到此這篇關(guān)于Sharding-Jdbc進(jìn)行分庫(kù)分表的文章就介紹到這了,更多相關(guān)Sharding-Jdbc分庫(kù)分表內(nèi)容請(qǐng)搜索腳本之家以前的文章或繼續(xù)瀏覽下面的相關(guān)文章希望大家以后多多支持腳本之家!
- SpringBoot 2.0 整合sharding-jdbc中間件實(shí)現(xiàn)數(shù)據(jù)分庫(kù)分表
- Spring Boot 集成 Sharding-JDBC + Mybatis-Plus 實(shí)現(xiàn)分庫(kù)分表功能
- Sharding-Jdbc 自定義復(fù)合分片的實(shí)現(xiàn)(分庫(kù)分表)
- Java使用Sharding-JDBC分庫(kù)分表進(jìn)行操作
- SpringBoot整合sharding-jdbc實(shí)現(xiàn)分庫(kù)分表與讀寫分離的示例
- SpringBoot整合sharding-jdbc實(shí)現(xiàn)自定義分庫(kù)分表的實(shí)踐
- SpringBoot+MybatisPlus+Mysql+Sharding-JDBC分庫(kù)分表
- Mybatis-Plus集成Sharding-JDBC與Flyway實(shí)現(xiàn)多租戶分庫(kù)分表實(shí)戰(zhàn)
- SpringBoot+MybatisPlus實(shí)現(xiàn)sharding-jdbc分庫(kù)分表的示例代碼
相關(guān)文章
Mybatis日志配置方式(slf4j、log4j、log4j2)
這篇文章主要介紹了Mybatis日志配置方式(slf4j、log4j、log4j2),具有很好的參考價(jià)值,希望對(duì)大家有所幫助,如有錯(cuò)誤或未考慮完全的地方,望不吝賜教2023-09-09java多線程編程之從線程返回?cái)?shù)據(jù)的兩種方法
從線程中返回?cái)?shù)據(jù)和向線程傳遞數(shù)據(jù)類似。也可以通過(guò)類成員以及回調(diào)函數(shù)來(lái)返回?cái)?shù)據(jù)。但類成員在返回?cái)?shù)據(jù)和傳遞數(shù)據(jù)時(shí)有一些區(qū)別,下面讓我們來(lái)看看它們區(qū)別在哪2014-01-01Spring ApplicationListener源碼解析
這篇文章主要為大家介紹了Spring ApplicationListener源碼解析,有需要的朋友可以借鑒參考下,希望能夠有所幫助,祝大家多多進(jìn)步,早日升職加薪2023-01-01Spring MVC前后端的數(shù)據(jù)傳輸?shù)膶?shí)現(xiàn)方法
這篇文章主要介紹了Spring MVC前后端的數(shù)據(jù)傳輸?shù)膶?shí)現(xiàn)方法,需要的朋友可以參考下2017-10-10spring boot實(shí)現(xiàn)上傳圖片并在頁(yè)面上顯示及遇到的問(wèn)題小結(jié)
最近在使用spring boot搭建網(wǎng)站的過(guò)程之中遇到了有點(diǎn)小問(wèn)題,最終解決方案是在main目錄下新建了一個(gè)webapp文件夾,并且對(duì)其路徑進(jìn)行了配置,本文重點(diǎn)給大家介紹spring boot實(shí)現(xiàn)上傳圖片并在頁(yè)面上顯示功能,需要的朋友參考下吧2017-12-12