HiveSQL——统计当前时间段的有客人在住的房间数量-编程知识

注：参考文章：

HiveSQL一天一个小技巧：如何统计当前时间点状态情况【辅助变量+累计变换思路】_sql查询统计某状态出现的次数及累计时间-CSDN博客文章浏览阅读2k次，点赞6次，收藏8次。本文总结了一种当前时间点状态统计的思路和方法，对于此类问题主要采用构造辅助计数变量及累加变换思路进行求解。常见的场景有：直播同时在线人数、服务器实时并发数、公家车当前时间段人数、某个仓库的货物积压数量，某一段时间内的同时处于服务过程中的最大订单量等_sql查询统计某状态出现的次数及累计时间https://blog.csdn.net/godlovedaniel/article/details/129881211

0 需求描述

1 数据准备

create table if not exists table23
(user_id     int comment '用户id',room_num    string comment '房间号',in_time     string comment '入住时间',out_time    string comment '离店时间'
)comment '旅客入住离店表';insert overwrite table table23
values (7, '2004', '2021-03-05','2021-03-07'),(23,'2010', '2021-03-05','2021-03-06'),(7, '1003', '2021-03-07','2021-03-08'),(8, '2014', '2021-03-07','2021-03-08'),(14, '3001','2021-03-07','2021-03-10'),(18, '3002','2021-03-08','2021-03-10'),(23, '3020','2021-03-08','2021-03-09'),(25, '2006','2021-03-09','2021-03-12');

2 数据分析

需求：求出每个时间段，有客人在住的房间数量。

如果只考虑一人一房，可以借助于【直播间同时在线人数】统计的思路，相关sql逻辑指路：

HiveSQL题——聚合函数(sum/count/max/min/avg)-CSDN博客文章浏览阅读1.1k次，点赞19次，收藏19次。HiveSQL题——聚合函数(sum/count/max/min/avg)https://blog.csdn.net/SHWAITME/article/details/135918264?ops_request_misc=%257B%2522request%255Fid%2522%253A%2522170804307516800211583058%2522%252C%2522scm%2522%253A%252220140713.130102334.pc%255Fblog.%2522%257D&request_id=170804307516800211583058&biz_id=0&utm_medium=distribute.pc_search_result.none-task-blog-2~blog~first_rank_ecpm_v1~rank_v31_ecpm-1-135918264-null-null.nonecase&utm_term=%E7%9B%B4%E6%92%AD%E9%97%B4&spm=1018.2226.3001.4450 入住时间加辅助标记记为1，离店时间加辅助标记记为-1，并按照时间进行顺序排序，求当前累计值，具体SQL如下：

selectstart_time,end_time,acc_cnt
from (select`time`                               as start_time,lead(`time`) over ( order by `time`) as end_time,acc_cntfrom (select`time`,sum(flag) over (order by `time`) as acc_cntfrom (selectin_time as `time`,1   as flagfrom table23union allselectout_time as `time`,-1   as flagfrom table23) t1) t2group by `time`, acc_cnt) t
where end_time is not null;

上述代码需要考虑一个问题：如果有多个人共住一房间，今天退了一个人，明天又退了一个人，后天的时候才退完，虽然这期间一直有人在退，但房间还是有人住的，这种情况是不是也算【有客人在住的房间】? 如果考虑上述情况，需要对累加的状态进行调整，此时需要考虑每个房间中截止当前时间的人数情况。

第一步：先求出每个房间截至当前时间的人数累计值，作为状态判断辅助条件

select`time`,room_num,sum( user_cnt) over (partition by room_num order by `time`) user_cnt
from (selectin_time as  `time`,room_num,count(user_id) user_cntfrom table23group by in_time, room_numunion allselectout_time as   `time`,room_num,-1 * count(user_id) user_cntfrom table23group by out_time, room_num) t1

第二步：基于累计的每个房间人数进行判断：如果房间有人就标记1，没有人时候就标记为-1。代码为：case when user_cnt > 0 时标记1，否则标记-1

select`time`,room_num,user_cnt,case when user_cnt > 0 then 1 else -1 end flag
from (select`time`,room_num,sum(user_cnt) over (partition by room_num order by `time`) user_cntfrom (selectin_time as `time`,room_num,count(user_id) user_cntfrom table23group by in_time, room_numunion allselectout_time as `time`,room_num,-1 * count(user_id) user_cntfrom table23group by out_time, room_num) t1) t2;

第三步：基于第二步的结果，计算截止当前时间点的有人入住的房间数量 acc_cnt，SQL如下：

select`time`,room_num,user_cnt,case when user_cnt > 0 then 1 else -1 end flag,sum(case when user_cnt > 0 then 1 else -1 end) over (order by `time`) acc_cnt
from (select`time`,room_num,sum(user_cnt) over (partition by room_num order by `time`) user_cntfrom (selectin_time as `time`,room_num,count(user_id) user_cntfrom table23group by in_time, room_numunion allselectout_time as `time`,room_num,-1 * count(user_id) user_cntfrom table23group by out_time, room_num) t1) t2;

第四步：基于第三步的结果，对时间time 和截止当前时间点的有人入住的房间数量acc_cnt这两个字段进行去重，SQL如下：

select`time`,acc_cnt
from (select`time`,room_num,user_cnt,case when user_cnt > 0 then 1 else -1 end                             flag,sum(case when user_cnt > 0 then 1 else -1 end) over (order by `time`) acc_cntfrom (select`time`,room_num,sum(user_cnt) over (partition by room_num order by `time`) user_cntfrom (selectin_time as     `time`,room_num,count(user_id) user_cntfrom table23group by in_time, room_numunion allselectout_time as         `time`,room_num,-1 * count(user_id) user_cntfrom table23group by out_time, room_num) t1) t2) t3
group by `time`, acc_cnt

第五步：基于第四步的结果，通过lead函数（对time字段往后偏移一行）求出当前数据的结束时间end_time，SQL如下：

select`time` as start_time,lead(`time`, 1) over (order by `time`) as end_time,acc_cnt
from (select`time`,acc_cntfrom (select`time`,room_num,user_cnt,case when user_cnt > 0 then 1 else -1 end                             flag,sum(case when user_cnt > 0 then 1 else -1 end) over (order by `time`) acc_cntfrom (select`time`,room_num,sum(user_cnt) over (partition by room_num order by `time`) user_cntfrom (selectin_time as     `time`,room_num,count(user_id) user_cntfrom table23group by in_time, room_numunion allselectout_time as         `time`,room_num,-1 * count(user_id) user_cntfrom table23group by out_time, room_num) t1) t2) t3group by `time`, acc_cnt) t4

：基于第五步的结果，过滤掉end_time 是null的数据，SQL如下：

selectstart_time,end_time,acc_cnt
from (select`time`  as start_time,lead(`time`, 1) over (order by `time`) as end_time,acc_cntfrom (select`time`,acc_cntfrom (select`time`,room_num,user_cnt,case when user_cnt > 0 then 1 else -1 end as  flag,sum(case when user_cnt > 0 then 1 else -1 end) over (order by `time`) acc_cntfrom (select`time`,room_num,sum(user_cnt) over (partition by room_num order by `time`) user_cntfrom (selectin_time as `time`,room_num,count(user_id) user_cntfrom table23group by in_time, room_numunion allselectout_time as `time`,room_num,-1 * count(user_id) user_cntfrom table23group by out_time, room_num) t1) t2) t3group by `time`, acc_cnt) t4) t5
where end_time is not null;