Commit Graph

18 Commits

Author SHA1 Message Date
5da87c40f7 fix(ci): use system python3 instead of python3.11 (Ubuntu 24.04 has 3.12)
Some checks failed
CI/CD Pipeline / Build Docker Images (push) Has been cancelled
CI/CD Pipeline / Push to Gitea Registry (push) Has been cancelled
CI/CD Pipeline / Code Quality Checks (push) Has been cancelled
CI/CD Pipeline / Run Tests (push) Has been cancelled
2026-02-02 12:53:36 +01:00
3fab27b166 fix(ci): preserve http protocol in git clone URL
Some checks failed
CI/CD Pipeline / Run Tests (push) Failing after 11s
CI/CD Pipeline / Code Quality Checks (push) Failing after 18s
CI/CD Pipeline / Build Docker Images (push) Has been skipped
CI/CD Pipeline / Push to Gitea Registry (push) Has been skipped
2026-02-02 12:52:39 +01:00
2848bb2f5c fix(ci): use gitea.token instead of secrets for authentication
Some checks failed
CI/CD Pipeline / Code Quality Checks (push) Failing after 1s
CI/CD Pipeline / Run Tests (push) Failing after 0s
CI/CD Pipeline / Build Docker Images (push) Has been skipped
CI/CD Pipeline / Push to Gitea Registry (push) Has been skipped
2026-02-02 12:51:43 +01:00
72839995ce fix(ci): add GITEA_TOKEN for git clone authentication
Some checks failed
CI/CD Pipeline / Code Quality Checks (push) Failing after 1s
CI/CD Pipeline / Run Tests (push) Failing after 0s
CI/CD Pipeline / Build Docker Images (push) Has been skipped
CI/CD Pipeline / Push to Gitea Registry (push) Has been skipped
2026-02-02 12:50:17 +01:00
f68b4fbbf1 fix(ci): add dev branch to CI workflow triggers
Some checks failed
CI/CD Pipeline / Code Quality Checks (push) Failing after 0s
CI/CD Pipeline / Run Tests (push) Failing after 1s
CI/CD Pipeline / Build Docker Images (push) Has been skipped
CI/CD Pipeline / Push to Gitea Registry (push) Has been skipped
2026-02-02 12:49:06 +01:00
3f222a9141 fix(lint): resolve ruff errors in tests and run_tests.py
- Fix import sorting (I001)
- Remove unused imports and variables (F401, F841)
- Add noqa for test code (S106 hardcoded passwords, S314 XML parsing)
- Auto-format with ruff format
2026-02-02 12:44:37 +01:00
97a7764155 fix(ci): replace GitHub Actions with native bash commands
- Remove dependency on GitHub (network blocks access)
- Replace actions/checkout@v4 with git clone
- Replace actions/setup-python@v4 with apt-get install
- Replace docker/build-push-action with native docker commands
- Use config.settings.test (SQLite in-memory) for tests

Closes: network connectivity issue in CI
2026-02-02 12:39:06 +01:00
avm
12a4cb46d7 Merge pull request 'feature/fns' (#2) from feature/fns into dev
Reviewed-on: #2
2026-02-02 13:03:21 +03:00
efa5c3ae34 feat(api): полное API для всех парсеров с документацией 2026-02-01 15:19:21 +01:00
eacb1527c4 refactor(fns): переместить роуты /api/v1/parsers/fns → /api/v1/fns
- Упростить URL: /api/v1/fns/reports/, /api/v1/fns/upload/
- Добавить swagger теги для группировки в документации
2026-02-01 14:49:43 +01:00
cd0e21350b feat(fns): парсер ФНС бухгалтерской отчетности
- Модели FinancialReport и FinancialReportLine
- FNSExcelParser для файлов fin_{id}_{ogrn}.xlsx
- FNSReportService с дедупликацией по хешу файла
- Celery задачи для мониторинга папки (каждые 5 мин)
- API: POST /fns/upload/, GET /fns/reports/
- Django admin интеграция
- 25 unit-тестов
2026-02-01 14:44:19 +01:00
avm
eb0d6f2600 Merge pull request 'feat(parsers): добавлен парсер zakupki.gov.ru с SOAP API интеграцией' (#1) from feature/eis-zakypki into dev
Reviewed-on: #1
2026-02-01 15:44:56 +03:00
a369642459 feat(parsers): add SOAP API support for zakupki.gov.ru
- Add post() method to BaseHTTPClient for SOAP requests
- Update download_file() to support custom headers (for token)
- Add ZAKUPKI_TOKEN and PARSER_PROXIES settings
- Improve SOAP error parsing to show EIS error messages
- Update E2E tests to use token from settings
- Add data/ and .zed/ to gitignore
2026-01-28 13:13:10 +01:00
c6483d8427 feat(parsers): добавлен парсер zakupki.gov.ru с SOAP API интеграцией
Реализована полная интеграция с ЕИС Закупки через SOAP API
(FTP доступ закрыт с 01.01.2025).

Добавлено:
- ZakupkiClient с поддержкой SOAP методов getDocsByOrgRegionRequest
  и getDocsByReestrNumberRequest
- Модель ProcurementRecord (18 полей, 3 индекса)
- ProcurementService и ParserLoadLogService для бизнес-логики
- Celery задачи parse_procurements и sync_procurements
- Админка с цветовой индикацией статусов и фильтрами
- 71 тест (unit + E2E с RUN_E2E_TESTS=1)

Требования: токен SOAP API через Госуслуги

🤖 Generated with [Qoder][https://qoder.com]
2026-01-27 16:01:28 +01:00
199d871923 feat(parsers): add proverki.gov.ru parser with sync_inspections task
Some checks failed
CI/CD Pipeline / Code Quality Checks (push) Failing after 1m28s
CI/CD Pipeline / Build Docker Images (push) Has been cancelled
CI/CD Pipeline / Push to Gitea Registry (push) Has been cancelled
CI/CD Pipeline / Run Tests (push) Has been cancelled
- Add InspectionRecord model with is_federal_law_248, data_year, data_month fields
- Add ProverkiClient with Playwright support for JS-rendered portal
- Add streaming XML parser for large files (>50MB)
- Add sync_inspections task with incremental loading logic
  - Starts from 01.01.2025 if DB is empty
  - Loads both FZ-294 and FZ-248 inspections
  - Stops after 2 consecutive empty months
- Add InspectionService methods: get_last_loaded_period, has_data_for_period
- Add Minpromtorg parsers (certificates, manufacturers)
- Add Django Admin for parser models
- Update README with parsers documentation and changelog
2026-01-21 20:16:25 +01:00
f121445313 feat(core): add core module with mixins, services, and background jobs
- Add Model Mixins: TimestampMixin, SoftDeleteMixin, AuditMixin, etc.
- Add Base Services: BaseService, BulkOperationsMixin, QueryOptimizerMixin
- Add Base ViewSets with bulk operations
- Add BackgroundJob model for Celery task tracking
- Add BaseAppCommand for management commands
- Add permissions, pagination, filters, cache, logging
- Migrate tests to factory_boy + faker
- Add CHANGELOG.md
- 297 tests passing
2026-01-21 11:47:26 +01:00
06b30fca02 feat: implement CI/CD pipeline with Gitea Actions
- Add Gitea Actions workflow with 4 stages: lint, test, build, push
- Configure ruff linting and formatting checks
- Set up Django tests with PostgreSQL and Redis services
- Implement Docker image building for web and celery services
- Add requirements.txt and requirements-dev.txt generation
- Fix ipdb compatibility issues in test runner
- Update ruff configuration for Django compatibility
- Add comprehensive CI/CD documentation
2026-01-19 14:24:48 +01:00
cbfbd8652d feat: Add comprehensive Django user app with tests using model-bakery
- Implemented user authentication with JWT tokens
- Added user and profile models with OneToOne relationship
- Created service layer for business logic separation
- Implemented DRF serializers and views
- Added comprehensive test suite with model-bakery factories
- Fixed ipdb/pdbpp dependency conflicts with custom test runner
- Configured development and production environments
- Added deployment configurations for Apache, systemd, and Docker
2026-01-19 14:12:33 +01:00