MYSQL每隔10分鐘進(jìn)行分組統(tǒng)計(jì)的實(shí)現(xiàn)方法
前言
本文的內(nèi)容主要是介紹了MYSQL每隔10分鐘進(jìn)行分組統(tǒng)計(jì)的實(shí)現(xiàn)方法,在畫用戶登錄、操作情況在一天內(nèi)的分布圖時會非常有用,之前我只知道用「存儲過程」實(shí)現(xiàn)的方法(雖然執(zhí)行速度快,但真的是太不靈活了),后來學(xué)會了用高級點(diǎn)的「group by」方法來靈活實(shí)現(xiàn)類似功能。
正文:
-- time_str '2016-11-20 04:31:11' -- date_str 20161120 select concat(left(date_format(time_str, '%y-%m-%d %h:%i'),15),'0') as time_flag, count(*) as count from `security`.`cmd_info` where `date_str`=20161120 group by time_flag order by time_flag; -- 127 rows select round(unix_timestamp(time_str)/(10 * 60)) as timekey, count(*) from `security`.`cmd_info` where `date_str`=20161120 group by timekey order by timekey; -- 126 rows -- 以上2個SQL語句的思路類似——使用「group by」進(jìn)行區(qū)分,但是方法有所不同,前者只能針對10分鐘(或1小時)級別,后者可以動態(tài)調(diào)整間隔大小,兩者效率差不多,可以根據(jù)實(shí)際情況選用 select concat(date(time_str),' ',hour(time_str),':',round(minute(time_str)/10,0)*10), count(*) from `security`.`cmd_info` where `date_str`=20161120 group by date(time_str), hour(time_str), round(minute(time_str)/10,0)*10; -- 145 rows select concat(date(time_str),' ',hour(time_str),':',floor(minute(time_str)/10)*10), count(*) from `security`.`cmd_info` where `date_str`=20161120 group by date(time_str), hour(time_str), floor(minute(time_str)/10)*10; -- 127 rows (和 date_format 那個等價) select concat(date(time_str),' ',hour(time_str),':',ceil(minute(time_str)/10)*10), count(*) from `security`.`cmd_info` where `date_str`=20161120 group by date(time_str), hour(time_str), ceil(minute(time_str)/10)*10; -- 151 rows
&
DELIMITER // DROP PROCEDURE IF EXISTS `usp_cmd_info`; CREATE PROCEDURE `usp_cmd_info`(IN dates VARCHAR(12)) BEGIN SELECT count(*) from `cmd_info` where `time_str` BETWEEN CONCAT(dates, " 00:00:00") AND CONCAT(dates, " 00:10:00") INTO @count_0; SELECT count(*) from `cmd_info` where `time_str` BETWEEN CONCAT(dates, " 00:10:00") AND CONCAT(dates, " 00:20:00") INTO @count_1; ... SELECT count(*) from `cmd_info` where `time_str` BETWEEN CONCAT(dates, " 23:40:00") AND CONCAT(dates, " 23:50:00") INTO @count_142; SELECT count(*) from `cmd_info` where `time_str` BETWEEN CONCAT(dates, " 23:50:00") AND CONCAT(dates, " 23:59:59") INTO @count_143; select @count_0, @count_1, @count_2, @count_3, @count_4, @count_5, @count_6, @count_7, @count_8, @count_9, @count_10, @count_11, @count_12, @count_13, @count_14, @count_15, @count_16, @count_17, @count_18, @count_19, @count_20, @count_21, @count_22, @count_23, @count_24, @count_25, @count_26, @count_27, @count_28, @count_29, @count_30, @count_31, @count_32, @count_33, @count_34, @count_35, @count_36, @count_37, @count_38, @count_39, @count_40, @count_41, @count_42, @count_43, @count_44, @count_45, @count_46, @count_47, @count_48, @count_49, @count_50, @count_51, @count_52, @count_53, @count_54, @count_55, @count_56, @count_57, @count_58, @count_59, @count_60, @count_61, @count_62, @count_63, @count_64, @count_65, @count_66, @count_67, @count_68, @count_69, @count_70, @count_71, @count_72, @count_73, @count_74, @count_75, @count_76, @count_77, @count_78, @count_79, @count_80, @count_81, @count_82, @count_83, @count_84, @count_85, @count_86, @count_87, @count_88, @count_89, @count_90, @count_91, @count_92, @count_93, @count_94, @count_95, @count_96, @count_97, @count_98, @count_99, @count_100, @count_101, @count_102, @count_103, @count_104, @count_105, @count_106, @count_107, @count_108, @count_109, @count_110, @count_111, @count_112, @count_113, @count_114, @count_115, @count_116, @count_117, @count_118, @count_119, @count_120, @count_121, @count_122, @count_123, @count_124, @count_125, @count_126, @count_127, @count_128, @count_129, @count_130, @count_131, @count_132, @count_133, @count_134, @count_135, @count_136, @count_137, @count_138, @count_139, @count_140, @count_141, @count_142, @count_143; END // DELIMITER ; show PROCEDURE status\G CALL usp_cmd_info("2016-10-20");
上面的這段MySQL存儲過程的語句非常長,不可能用手工輸入,可以用下面的這段Python代碼按所需的時間間隔自動生成:
import datetime today = datetime.date.today() # 或 由給定格式字符串轉(zhuǎn)換成 # today = datetime.datetime.strptime('2016-11-21', '%Y-%m-%d') min_today_time = datetime.datetime.combine(today, datetime.time.min) # 2016-11-21 00:00:00 max_today_time = datetime.datetime.combine(today, datetime.time.max) # 2016-11-21 23:59:59 sql_procedure_arr = [] sql_procedure_arr2 = [] for x in xrange(0, 60*24/5, 1): start_datetime = min_today_time + datetime.timedelta(minutes = 5*x) end_datetime = min_today_time + datetime.timedelta(minutes = 5*(x+1)) # print x, start_datetime.strftime("%Y-%m-%d %H:%M:%S"), end_datetime.strftime("%Y-%m-%d %H:%M:%S") select_str = 'SELECT count(*) from `cmd_info` where `time_str` BETWEEN "{0}" AND "{1}" INTO @count_{2};'.format(start_datetime, end_datetime, x) # print select_str sql_procedure_arr.append(select_str) sql_procedure_arr2.append('@count_{0}'.format(x)) print '\n'.join(sql_procedure_arr) print 'select {0};'.format(', '.join(sql_procedure_arr2))
總結(jié)
以上就是這篇文章的全部內(nèi)容了,希望本文的內(nèi)容對大家的學(xué)習(xí)或者工作能帶來一定的幫助,如果有疑問大家可以留言交流。
- MySql如何按照日期進(jìn)行分組統(tǒng)計(jì)
- MySQL按天分組統(tǒng)計(jì)一定時間內(nèi)的數(shù)據(jù)實(shí)例(沒有數(shù)據(jù)補(bǔ)0)
- mysql如何分別按年/月/日/周分組統(tǒng)計(jì)數(shù)據(jù)詳解
- mysql如何分組統(tǒng)計(jì)并求出百分比
- mysql實(shí)現(xiàn)按照某個時間段分組統(tǒng)計(jì)
- Mysql出生日期轉(zhuǎn)換為年齡并分組統(tǒng)計(jì)人數(shù)的方法示例
- mysql按天/小時/半小時/N分鐘/分鐘進(jìn)行數(shù)據(jù)分組統(tǒng)計(jì)功能
相關(guān)文章
MySQL到Kafka實(shí)時數(shù)據(jù)同步
很多 DBA 同學(xué)經(jīng)常會遇到要從一個數(shù)據(jù)庫實(shí)時同步到另一個數(shù)據(jù)庫的問題,同構(gòu)數(shù)據(jù)還相對容易,遇上異構(gòu)數(shù)據(jù)、表多、數(shù)據(jù)量大等情況就難以同步,我自己親測了一種方式,可以非常方便的實(shí)現(xiàn)MySQL Kafka實(shí)時數(shù)據(jù)同步,需要的朋友可以參考下2024-01-01在MySQL中同時查找兩張表中的數(shù)據(jù)的示例
這篇文章主要介紹了在MySQL中同時查找兩張表中的數(shù)據(jù)的示例,即一次查詢操作返回兩張表的結(jié)果,需要的朋友可以參考下2015-07-07MYSQL數(shù)據(jù)庫Innodb?引擎mvcc鎖實(shí)現(xiàn)原理
這篇文章主要介紹了MYSQL數(shù)據(jù)庫Innodb?引擎mvcc鎖實(shí)現(xiàn)原理,但是mvcc?的實(shí)現(xiàn)原理是什么呢?下文我們就來實(shí)例說明來mvcc?的實(shí)現(xiàn)原理,感興趣的小伙伴可以參考一下2022-05-05查看 MySQL 已經(jīng)運(yùn)行多長時間的方法
查看MySQL啟動時間以及運(yùn)行了多長時間的方法有利用show與updtime或在linux中直接使用grep mysql 相關(guān)參數(shù)來查看,下面我們一起來看看2014-01-01Mysql使用on update current_timestamp問題
這篇文章主要介紹了Mysql使用on update current_timestamp問題,具有很好的參考價值,希望對大家有所幫助。如有錯誤或未考慮完全的地方,望不吝賜教2023-03-03Linux系統(tǒng)徹底卸載MySQL數(shù)據(jù)庫詳解
這篇文章主要介紹了Linux系統(tǒng)徹底卸載MySQL數(shù)據(jù)庫,首先查詢系統(tǒng)是否安裝了mysql,如果安裝需要提前卸載,并刪除mysql安裝的組建服務(wù),本文給大家介紹的非常詳細(xì),需要的朋友可以參考下2022-09-09