{
  "paper_id": "e0be13801c02e4133479885fc49737d4",
  "paper_title": "REAL-TIME HUMAN DETECTION AND TRACKING IN COMPLEX ENVIRONMENTS USING SINGLE RGBD CAMERA",
  "paper_authors": [
    "Jun Liu",
    "Ye Liu",
    "Ying Cui",
    "Yan Qiu Chen"
  ],
  "publication_date": "",
  "publication_venue": "2013 IEEE International Conference on Image Processing",
  "abstract": "This paper presents a new approach to real-time human detection and tracking in cluttered and dynamic environments by integration of RGB and depth data. We introduce the notion of Point Ensemble Image, which fully encodes both RGB and depth information from a virtual plan-view perspective, and we reveal that human detection and tracking in 3D space can be performed very effectively based on this new representation. Our human detector is able to take advantage of depth data by effectively locate physically plausible candidates as a first step, and then both depth and color information is made full use of in a supervised learning manner at the second stage. 3D trajectories of humans are finally generated by data association in which joint statistics of color and height are computed and compared. Experimental results show that the system is able to work satisfactorily in complex real-world situations.",
  "keywords": [
    "Human detection",
    "Tracking",
    "RGBD"
  ],
  "paper_institutions": [
    "School of Computer Science, Fudan University"
  ],
  "output_language": "zh",
  "provider": "doubao",
  "model": "ark-code-latest",
  "prompt_template": "simple",
  "extracted_at": "2026-08-16T19:47:08.558313Z",
  "template_tag": "simple",
  "summary": "### 摘要\n该论文提出了一种利用单个RGBD摄像头在复杂动态环境中进行实时人体检测与跟踪的新方法。现有方法多依赖普通摄像头，缺乏深度信息，难以应对遮挡、外观变化和复杂背景等问题。论文引入了点集成图像（Point Ensemble Image）表示，将RGB和深度信息从虚拟俯视角度完整编码，有效减少重叠并保留所有三维点信息。检测采用两级策略：第一级通过局部高度最大值快速定位物理上合理的人体头部候选位置，第二级利用监督学习分类器（SVM）基于高度差直方图（HOHD）和颜色-高度联合直方图（JHCH）进行精细判别。跟踪阶段采用卡尔曼滤波和贪心数据关联，利用3D颜色-高度联合直方图度量相似性，并结合加权函数突出身体上部可靠性。实验在真实服装店场景（Kinect安装于2.2m高度，倾斜约30度，桌面CPU i5-2500，平均29Hz）上进行，检测器在精度-召回率曲线上全面优于HOG和模型拟合方法，达到93%的平衡点；跟踪误差（轨迹丢失和ID切换）较独立颜色或高度直方图显著减少。该方法能有效应对部分遮挡、深度数据缺失等挑战，为复杂环境下的实时人体感知提供了可行方案。\n\n### 关键要点\n- 提出点集成图像（Point Ensemble Image）表示，将每个网格单元中的点集完整保留，避免了高度图表示的信息丢失。\n- 检测第一阶段仅依靠深度信息寻找局部高度最大值作为候选头部位置，可快速排除大量物理上不合理的位置，减少搜索空间。\n- 检测第二阶段使用线性核SVM，结合HOHD和JHCH特征，对候选进行精细化判别，HOHD以统计直方图描述头部形状，对噪声和碎片数据鲁棒。\n- JHCH特征利用HSV颜色空间的色调分量和高度区间构建二维联合直方图，有效表征头部颜色与高度的相关性，适应不同发型和头部姿态。\n- 训练数据来自办公室、休息室和服装店等场景共3214帧，采集24997个候选位置并进行人工标注，涉及约100人多种姿态（站、走、坐、弯腰等）。\n- 检测性能评估使用400帧均匀采样自45分钟的真实服装店序列，与HOG和模型拟合方法对比，所提方法在整体精度-召回率范围内占优，BEP达到93%。\n- 跟踪采用卡尔曼滤波和贪心关联，相似性由3D JHCH（色调9区间、饱和度5区间、高度5区间）和空间距离加权组成，并利用指数权重函数w(x_i)=e^{0.2·h(x_i)}强调身体上部。\n- 实验结果显示，使用3D JHCH进行数据关联可显著减少轨迹丢失和ID切换错误，优于独立的颜色或高度直方图。\n- 系统在四核Intel i5-2500 CPU和8GB内存的台式机上平均运行速度达29Hz，满足实时应用需求。\n- 论文方法能够应对部分遮挡、深度数据缺失、动态背景和人群拥挤等现实挑战，验证了在真实商业环境（如服装店）中的有效性。"
}