- POST /reports/{id}/export:request_key 幂等 + hd_export 日配额三段式(reserve/commit/refund)+ tier2 熔断场景闸(BudgetGuardDep),仅 succeeded 报告可导
- GET /reports/{id}/export/download:归属校验 + 路径收敛(rendered_asset_key 必须落在 report_export_dir 内),FileResponse 携带 UTF-8 文件名
- celery 任务 meida.report.export(cpu 队列):渲染→落盘 var/exports→回写 rendered_asset_key;业务性拒绝(报告状态变化)结案退款不重试,基础设施异常重试一次后兜底结案退款
- packages/report/pdf:Jinja2 模板 + WeasyPrint 渲染器(url_fetcher 全拒外部资源防 SSRF;维度中文名按 DIMENSION_BY_KEY 回填;色板维度渲染色卡)
- 单测 10 例(资格/幂等/并发同键/下载校验/渲染);scripts/seed_pdf_e2e.sql 供本地 E2E 造数
55 lines
1.5 KiB
Python
Executable File
55 lines
1.5 KiB
Python
Executable File
"""Celery application with the four queues from TD-11 / 架构文档 §3.1.
|
|
|
|
gpu 换装、发型、抠图 —— 并发上限由 GPU 容量决定,队列即容量 (§7.3)
|
|
cpu 报告视觉分析、渲染
|
|
io 外部 API 调用、推送、上传
|
|
beat 定时任务(单实例,防重)
|
|
|
|
Queue isolation is the point: 换装排队不能把报告生成拖慢。
|
|
"""
|
|
|
|
from __future__ import annotations
|
|
|
|
from celery import Celery
|
|
from kombu import Queue
|
|
|
|
from packages.shared.config import get_settings
|
|
from packages.shared.logging import configure_logging
|
|
|
|
settings = get_settings()
|
|
configure_logging(
|
|
level=settings.log_level,
|
|
json_output=settings.log_json,
|
|
extra_redact_keys=settings.extra_redact_keys,
|
|
)
|
|
|
|
celery_app = Celery(
|
|
"meida",
|
|
broker=settings.celery_broker_url,
|
|
backend=settings.celery_result_backend,
|
|
include=["apps.worker.tasks", "apps.worker.report_tasks", "apps.worker.export_tasks"],
|
|
)
|
|
|
|
celery_app.conf.update(
|
|
task_default_queue="cpu",
|
|
task_queues=(
|
|
Queue("gpu"),
|
|
Queue("cpu"),
|
|
Queue("io"),
|
|
Queue("beat"),
|
|
),
|
|
task_routes={
|
|
"meida.tryon.*": {"queue": "gpu"},
|
|
"meida.matting.*": {"queue": "gpu"},
|
|
"meida.report.*": {"queue": "cpu"},
|
|
"meida.notify.*": {"queue": "io"},
|
|
},
|
|
task_acks_late=True,
|
|
task_reject_on_worker_lost=True,
|
|
task_track_started=True,
|
|
worker_prefetch_multiplier=1,
|
|
broker_connection_retry_on_startup=True,
|
|
timezone="Asia/Shanghai",
|
|
result_expires=86400,
|
|
)
|