Files
meida_backend/apps/worker/celery_app.py
T
xsl cd0ddb131b feat(report): 报告 PDF 导出管线(Phase A,WeasyPrint 服务端渲染)
- POST /reports/{id}/export:request_key 幂等 + hd_export 日配额三段式(reserve/commit/refund)+ tier2 熔断场景闸(BudgetGuardDep),仅 succeeded 报告可导
- GET /reports/{id}/export/download:归属校验 + 路径收敛(rendered_asset_key 必须落在 report_export_dir 内),FileResponse 携带 UTF-8 文件名
- celery 任务 meida.report.export(cpu 队列):渲染→落盘 var/exports→回写 rendered_asset_key;业务性拒绝(报告状态变化)结案退款不重试,基础设施异常重试一次后兜底结案退款
- packages/report/pdf:Jinja2 模板 + WeasyPrint 渲染器(url_fetcher 全拒外部资源防 SSRF;维度中文名按 DIMENSION_BY_KEY 回填;色板维度渲染色卡)
- 单测 10 例(资格/幂等/并发同键/下载校验/渲染);scripts/seed_pdf_e2e.sql 供本地 E2E 造数
2026-08-30 13:17:23 +08:00

55 lines
1.5 KiB
Python
Executable File

"""Celery application with the four queues from TD-11 / 架构文档 §3.1.
gpu 换装、发型、抠图 —— 并发上限由 GPU 容量决定,队列即容量 (§7.3)
cpu 报告视觉分析、渲染
io 外部 API 调用、推送、上传
beat 定时任务(单实例,防重)
Queue isolation is the point: 换装排队不能把报告生成拖慢。
"""
from __future__ import annotations
from celery import Celery
from kombu import Queue
from packages.shared.config import get_settings
from packages.shared.logging import configure_logging
settings = get_settings()
configure_logging(
level=settings.log_level,
json_output=settings.log_json,
extra_redact_keys=settings.extra_redact_keys,
)
celery_app = Celery(
"meida",
broker=settings.celery_broker_url,
backend=settings.celery_result_backend,
include=["apps.worker.tasks", "apps.worker.report_tasks", "apps.worker.export_tasks"],
)
celery_app.conf.update(
task_default_queue="cpu",
task_queues=(
Queue("gpu"),
Queue("cpu"),
Queue("io"),
Queue("beat"),
),
task_routes={
"meida.tryon.*": {"queue": "gpu"},
"meida.matting.*": {"queue": "gpu"},
"meida.report.*": {"queue": "cpu"},
"meida.notify.*": {"queue": "io"},
},
task_acks_late=True,
task_reject_on_worker_lost=True,
task_track_started=True,
worker_prefetch_multiplier=1,
broker_connection_retry_on_startup=True,
timezone="Asia/Shanghai",
result_expires=86400,
)