XEngineers/CamTalk
2
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
50 Commits 2 Branches 0 Tags
093dc26fa0516fab267da313bcd17980333a8569
Commit Graph

50 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
cfy666
093dc26fa0 chore: 更新 .gitignore，忽略编译产物和临时文件 
- backend/server：Go 编译二进制
- .playwright-mcp/：浏览器测试临时日志
- *.png：调试截图

Co-Authored-By: Claude <noreply@anthropic.com>
 2026-06-13 16:21:04 +08:00
cfy666
dd64ed23ee style: 重构为 Web 端双栏布局，突出对话展示 
- 重构 App.tsx 为双栏布局：左侧视频面板 + 右侧聊天面板
- 左侧 340px 固定宽度视频区（4:3 比例）
- 右侧对话区 flex:1 占满剩余空间
- Header 改为导航栏风格：标题+副标题+状态标签+设置按钮
- 视频下方控制栏：观察模式/打断/结束对话按钮
- 优化间距、字号、配色，适配桌面端

Co-Authored-By: Claude <noreply@anthropic.com>
 2026-06-13 16:16:37 +08:00
cfy777
7e2537104d Merge pull request '实现观察模式，支持持续场景监控（US-05/US-10）' (#31) from develop-frontend5 into develop 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/31
 2026-06-13 14:51:57 +08:00
cfy666
f5536005f6 feat: 实现观察模式，支持持续场景监控（US-05/US-10） 
- 新增 useObservationMode Hook：定时 5s 采帧，similarity < 0.85 触发变化回调
- useVisionSession 新增 dialogue/observation 模式切换
- App Footer 加观察模式切换按钮（激活时蓝色脉冲）
- 视频区左上角显示'👁️ 观察中'绿色角标
- 观察模式下画面变化自动发送 query

Co-Authored-By: Claude <noreply@anthropic.com>
 2026-06-13 14:46:42 +08:00
cfy777
e18a2004a0 Merge pull request '实现关键帧检测与成本控制' (#30) from develop-frontend4 into develop 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/30
 2026-06-13 14:40:05 +08:00
cfy666
2c6489b9a6 feat: 实现关键帧检测与成本控制 
- EdgeProcessor：sampleFrame 降采样 160x120 + compareFrames 像素差异对比
- 重复画面跳过：similarity > 0.9 时不发送 query
- 混合采样策略：静默 5s / 用户说话 1s（docs/08-成本控制.md）
- 请求统计：queryCount + totalTokens 实时显示
- App 状态栏显示成本统计

Co-Authored-By: Claude <noreply@anthropic.com>
 2026-06-13 14:38:15 +08:00
cfy777
8dc59d2c09 Merge pull request '实现会话配置与多轮上下文' (#29) from develop-frontend3 into develop 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/29
 2026-06-13 14:24:11 +08:00
cfy666
7e3762b589 feat: 实现会话配置与多轮上下文
All checks were successful
Backend CI / ci (pull_request) Successful in 1m0s
Details
Frontend CI / ci (pull_request) Successful in 1m0s
Details 
- 新增 ConfigPanel 组件：TTS 开关、detail level、语言选择
- 新增 storage.ts：配置持久化到 localStorage
- useVisionSession：连接后自动发送 config，维护最近 10 轮对话历史
- App：齿轮按钮展开配置面板，HD 角标，TTS 播放联动 ttsEnabled

Co-Authored-By: Claude <noreply@anthropic.com>
 2026-06-13 14:19:47 +08:00
cfy777
8033807f7c Merge pull request 'feat: 实现 TTS 语音播放，完成 MVP P0 全部用户故事' (#27) from develop-frontend2 into develop 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/27
 2026-06-13 14:02:28 +08:00
cfy666
6a47c4dfbb feat: 实现 TTS 语音播放，完成 MVP P0 全部用户故事 
- 新增 TTSPlayer：收集流式 tts_audio 片段，is_last 时拼接解码播放
- useVisionSession 接入 TTS 播放器，interrupt/stopSession 时停止播放
- App 显示 '🔊 正在播放...' 指示器
- MVP P0 四个用户故事前端全部实现（US-01 ~ US-04）

Co-Authored-By: Claude <noreply@anthropic.com>
 2026-06-13 13:57:36 +08:00
huanghaosheng
0ef7aa657d Merge pull request 'docs' (#26) from docs into develop 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/26
 2026-06-13 13:40:44 +08:00
hhs
360b2a4f50 docs: 补充配置管理规范（Viper + 环境变量）
All checks were successful
Backend CI / ci (pull_request) Successful in 1m5s
Details
Frontend CI / ci (pull_request) Successful in 1m40s
Details 
- 03-接口文档: 新增第六章配置管理（Go 配置结构体、YAML 配置示例、环境变量覆盖规则、Viper 加载代码、启动命令示例）
- 03-接口文档: 原七~九章重新编号为八~十章
- 02-系统架构: 配置管理行补充交叉引用
- README.md: 索引补充配置管理关键词
 2026-06-13 13:31:48 +08:00
hhs
ee557eaa3d docs: 补充 Session Manager 接口规范与 Redis 数据结构 
- 03-接口文档: 新增第五章 Session Manager（Redis Hash+List 数据结构、TTL 策略、接口定义、Handler 集成、MVP 内存实现）
- 03-接口文档: 原五~八章重新编号为六~九章
- 02-系统架构: Session Manager 行补充 Redis 数据结构说明和交叉引用
- README.md: 索引补充 Session Manager 关键词
 2026-06-13 13:24:25 +08:00
hhs
87b6407e2e docs: 补充 AI 编排层接口规范与 tts_audio 音频播放方案 
- 03-接口文档: 新增第三章 AI 服务层接口（STT/LLM/TTS 三个 Service interface + 接入约定）
- 03-接口文档: 新增第四章 AI 编排器（句子级流式并行策略、Orchestrator 实现、错误降级表）
- 03-接口文档: 锁定 tts_audio 音频格式为 audio/mpeg（MP3 24kHz），新增前端 AudioPlayer 播放方案
- 02-系统架构: 更新 Orchestrator 代码为句子级流式并行实现
- README.md: 更新 03-接口文档描述，补充 AI 服务层和编排器关键词
 2026-06-13 13:18:17 +08:00
cfy777
2e222cbe73 Merge pull request '完善端到端对话闭环，增强消息渲染与错误处理;集成 VAD 语音活动检测，打通核心交互链路' (#24) from develop-frontend into develop 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/24
 2026-06-13 11:56:26 +08:00
huanghaosheng
dc5e49d216 Merge pull request 'build/actions' (#22) from build/actions into develop
Some checks failed
Backend CI / ci (pull_request) Successful in 1m5s
Details
Frontend CI / ci (pull_request) Has been cancelled
Details 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/22
 2026-06-13 11:46:47 +08:00
hhs
c7f741943d ci: 移除 health-test 工作流 2026-06-13 11:46:34 +08:00
hhs
8ce5c02730 ci: 统一 workflow 步骤名称为英文 2026-06-13 11:45:08 +08:00
cfy666
734c93a866 feat: 完善端到端对话闭环，增强消息渲染与错误处理 
- ChatPanel：流式光标动画、token/延迟元数据、自动滚动、三种空状态
- Toast 组件：错误码映射为中文友好文案，3 秒自动消失
- useVisionSession：stt_result 流式更新、防重复发送、打断保存未完成内容、结束清理全部状态
- App：断线提示、视频 loading 遮罩、按钮连接中状态
- ChatMessage 增加 latencyMs、model 字段

Co-Authored-By: Claude <noreply@anthropic.com>
 2026-06-13 11:43:16 +08:00
huanghaosheng
fc8b67be1a Merge pull request 'fix: 修正 install node 步骤的 working-directory 并使用阿里云镜像源' (#20) from build/actions into develop
All checks were successful
Backend CI / ci (pull_request) Successful in 1m11s
Details
Frontend CI / ci (pull_request) Successful in 30s
Details 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/20
 2026-06-13 11:41:47 +08:00
hhs
3d7d7d190c fix: 修正 install node 步骤的 working-directory 并使用阿里云镜像源 2026-06-13 11:41:08 +08:00
huanghaosheng
01e3eb421c Merge pull request 'fix: 使用 Alpine 容器镜像解决 checkout action 找不到 node 的问题' (#18) from build/actions into develop
Some checks failed
Backend CI / ci (pull_request) Failing after 42s
Details
Frontend CI / ci (pull_request) Successful in 1m7s
Details 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/18
 2026-06-13 11:39:16 +08:00
hhs
c5c9bf802f fix: 使用 Alpine 容器镜像解决 checkout action 找不到 node 的问题 2026-06-13 11:38:48 +08:00
huanghaosheng
2c9159afad Merge pull request 'fix: 移除 setup-go/setup-node，宿主机已预装 Go 和 Node' (#16) from build/actions into develop
Some checks failed
Backend CI / ci (pull_request) Failing after 0s
Details
Frontend CI / ci (pull_request) Failing after 1s
Details 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/16
 2026-06-13 11:31:18 +08:00
hhs
17c8ced6bd fix: 移除 setup-go/setup-node，宿主机已预装 Go 和 Node 2026-06-13 11:29:41 +08:00
cfy666
9ccd4d6238 feat: 集成 VAD 语音活动检测，打通核心交互链路 
- 重写 useVAD Hook，接入 @ricky0123/vad-web 的 MicVAD
- 支持 onSpeechStart/onSpeechEnd/onVADMisfire 回调
- useVisionSession 中串联摄像头→麦克风→WebSocket→VAD 完整流程
- App.tsx 新增 VAD 加载中和错误状态的 UI 指示
- VAD 参数对齐设计文档：positiveSpeechThreshold=0.5, minSpeechMs=250

Co-Authored-By: Claude <noreply@anthropic.com>
 2026-06-13 11:10:29 +08:00
cfy777
e372c0022d Merge pull request 'fix: 为 uses 的 URL 加引号修复 YAML 解析错误' (#14) from build/actions into develop
Some checks failed
Backend CI / ci (pull_request) Failing after 4s
Details
Frontend CI / ci (pull_request) Failing after 1m14s
Details 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/14
Reviewed-by: cfy777 <3087823110@qq.com>
 2026-06-13 10:48:29 +08:00
hhs
2ce04dcca1 fix: 为 uses 的 URL 加引号修复 YAML 解析错误 2026-06-13 10:46:32 +08:00
cfy777
cc8337bef6 Merge pull request 'build/actions' (#12) from build/actions into develop
Some checks failed
Backend CI / ci (pull_request) Failing after 1m25s
Details
Frontend CI / ci (pull_request) Failing after 1m36s
Details 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/12
Reviewed-by: cfy777 <3087823110@qq.com>
 2026-06-13 10:44:05 +08:00
hhs
8c9a9d6020 ci: 添加 health test 工作流用于验证 Gitea Actions 运行 2026-06-13 10:42:07 +08:00
hhs
324b3c9f8a fix: 移除 container 字段和 paths 过滤器，恢复 setup-go/setup-node 以兼容 Gitea Actions 2026-06-13 10:39:20 +08:00
cfy777
47af4cc114 Merge pull request 'fix: 修正 Gitea Actions 工作流目录名为复数形式 workflows' (#10) from build/actions into develop 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/10
Reviewed-by: cfy777 <3087823110@qq.com>
 2026-06-13 10:35:42 +08:00
hhs
ebbe33aeed fix: 修正 Gitea Actions 工作流目录名为复数形式 workflows 2026-06-13 10:34:36 +08:00
huanghaosheng
aac93f19ec Merge pull request 'ci: 配置 Docker 容器运行、镜像源及自建 checkout action' (#8) from build/actions into develop 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/8
Reviewed-by: cfy777 <3087823110@qq.com>
 2026-06-13 10:26:30 +08:00
hhs
63933a645f ci: 配置 Docker 容器运行、镜像源及自建 checkout action 2026-06-13 10:25:02 +08:00
huanghaosheng
54cf06e1d6 Merge pull request 'ci: 调整 CI 触发分支为 main，运行环境改为 aliyun' (#6) from build/actions into develop 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/6
Reviewed-by: cfy777 <3087823110@qq.com>
 2026-06-13 10:06:26 +08:00
hhs
4967de3556 ci: 调整 CI 触发分支为 main，运行环境改为 aliyun 2026-06-13 10:01:43 +08:00
cfy777
91cb12a47f Merge pull request 'ci: 添加前端与后端 Gitea Actions 持续集成工作流' (#4) from build/actions into develop 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/4
Reviewed-by: cfy777 <3087823110@qq.com>
 2026-06-13 09:44:40 +08:00
cfy777
fe23053564 Merge branch 'develop' into build/actions 2026-06-13 09:42:25 +08:00
hhs
0304c1d27f ci: 添加前端与后端 Gitea Actions 持续集成工作流 2026-06-12 23:39:42 +08:00
huanghaosheng
10c18038f2 Merge pull request 'fix: 修复 .gitignore 并降级 React 到 18 以对齐设计文档' (#3) from frontend into develop 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/3
Reviewed-by: huanghaosheng <386998068@qq.com>
 2026-06-12 21:47:40 +08:00
cfy666
81093555bb fix: 修复 .gitignore 并降级 React 到 18 以对齐设计文档 
- 补充 .gitignore：忽略 node_modules/、dist/、bin/、.env、.obsidian/ 等
- 降级 react、react-dom 到 18.3.1，@types/react、@types/react-dom 到 18.x
- 与 docs/02-系统架构.md 和 CLAUDE.md 中的 React 18 技术选型保持一致

Co-Authored-By: Claude <noreply@anthropic.com>
 2026-06-12 21:37:02 +08:00
huanghaosheng
14550d3aa2 Merge pull request 'feat: 初始化前端项目，搭建 React + TypeScript + Vite 工程结构' (#2) from build/frontend into develop 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/2
Reviewed-by: huanghaosheng <386998068@qq.com>
 2026-06-12 17:53:03 +08:00
cfy666
b5c0d40609 feat: 初始化前端项目，搭建 React + TypeScript + Vite 工程结构 
- 创建 Vite + React 18 + TypeScript 项目（严格模式）
- 安装 @ricky0123/vad-web、onnxruntime-web、uuid 依赖
- 定义全部 WebSocket 消息类型和数据模型（对齐接口文档）
- 实现 WebSocket 连接管理（心跳保活、指数退避重连）
- 实现音频编码工具（PCM↔Base64、DataURL 转换）
- 创建组件骨架：CameraManager、MicManager、EdgeProcessor、WebSocketManager、ChatPanel、VideoPreview
- 实现核心 useVisionSession Hook 骨架
- 配置 ESLint（_前缀变量忽略规则）

Co-Authored-By: Claude <noreply@anthropic.com>
 2026-06-12 17:46:25 +08:00
cfy777
a26e008f81 Merge pull request 'feat: 初始化 Go 后端项目骨架' (#1) from build/backend into develop 
Reviewed-on: http://8.161.227.145:3000/XEngineers/CamTalk/pulls/1
Reviewed-by: cfy777 <3087823110@qq.com>
 2026-06-12 17:40:19 +08:00
hhs
9f876df816 feat: 初始化 Go 后端项目骨架 
- 使用 Gin 框架替代原始 net/http，方便调试
- 实现 WebSocket 端点 (/ws)，支持 ping/query/config/interrupt 消息
- 实现健康检查 REST 接口 (/api/health)
- 定义协议数据结构 (models)
- 心跳检测（60 秒超时断开）
 2026-06-12 17:34:43 +08:00
hhs
10f676f3b4 docs: 扁平化目录结构，优化文档为 Coding Agent 可读格式 
- 移除 Obsidian 特有语法（callout、wikilinks、YAML frontmatter）
- 目录结构从 3 层嵌套扁平化为编号文件（01~09）
- 新增 docs/README.md 文档索引与推荐阅读顺序
- 精简冗余解释，保留所有代码块和实现参考
- CLAUDE.md 全面中文化
 2026-06-12 17:08:20 +08:00
hhs
8717a52ab7 docs: 提交信息改用中文描述，强化文档优先原则 2026-06-12 16:51:28 +08:00
hhs
33cce2a21c docs: add CLAUDE.md with project architecture and development guidelines 2026-06-12 16:49:01 +08:00
huanghaosheng
d17b85d78b Initial commit 2026-06-12 10:50:07 +08:00