Aleksandr Meshchriakov
3d298ce352
Some checks failed
CI/CD Pipeline / Run Tests (pull_request) Successful in 1m53s
CI/CD Pipeline / Telegram Notify Success (push) Has been cancelled
CI/CD Pipeline / Run Tests (push) Has been cancelled
CI/CD Pipeline / Code Quality Checks (push) Has been cancelled
CI/CD Pipeline / Code Quality Checks (pull_request) Failing after 2m54s
CI/CD Pipeline / Telegram Notify Success (pull_request) Has been skipped
38 lines
872 B
Markdown
38 lines
872 B
Markdown
# ADR-003: Background Processing Architecture
|
|
|
|
## Status
|
|
Accepted
|
|
|
|
## Context
|
|
|
|
Обработка данных требует:
|
|
- асинхронности
|
|
- планирования задач
|
|
- устойчивости к сбоям
|
|
|
|
## Decision
|
|
|
|
Используется Celery:
|
|
|
|
- worker — выполнение задач
|
|
- beat — планировщик
|
|
- Redis — broker/backend
|
|
|
|
Типы задач:
|
|
- парсинг источников
|
|
- синхронизация данных
|
|
- обработка файлов
|
|
|
|
## Consequences
|
|
|
|
### Positive
|
|
- горизонтальное масштабирование
|
|
- разделение runtime и фоновых задач
|
|
|
|
### Negative
|
|
- сложность дебага
|
|
- необходимость контроля idempotency
|
|
|
|
## Alternatives
|
|
|
|
- RQ / Dramatiq — отклонены (меньше зрелости) |