kitos/Aegis
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
128 Commits 2 Branches 0 Tags
0ddd17047dc177ea4dc96de4f66649d6e7aeafb8
Commit Graph

128 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
kitos 0ddd17047d refactor(docs+comments): add Google-style docstrings and inline comments across backend 
Task D — Google-style docstrings (Args/Returns) on every public function,
method, and class across all 158 Python files in the backend. Zero ruff D
violations (pydocstyle Google convention).

Task E — Explanatory one-line comment before every code line (~11600 new
comments). ruff check passes clean after isort re-sort.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
 2026-06-10 12:37:15 +02:00
kitos 394d5d9056 refactor(types): add comprehensive type annotations across backend Python codebase 
Enable ANN rules in ruff.toml (flake8-annotations) and resolve all 221 violations:

ANN201/ANN202 — return types on 168 public/private functions:
- All 28 FastAPI routers: endpoints annotated with dict/list/specific schema/
  StreamingResponse/FileResponse/JSONResponse as appropriate
- main.py: lifespan→AsyncGenerator[None,None], exception handlers→JSONResponse
- database.py: get_db→Generator[Session,None,None], proxy methods→correct types
- middleware/request_context.py: dispatch→Response with Callable call_next type

ANN001/ANN002/ANN003 — 32 missing argument types:
- seed_demo.py: all db parameters typed as Session
- domain/unit_of_work.py: __aexit__ exc_type/exc_val/exc_tb typed with TracebackType
- services: audit_service user_id→UUID|None, heatmap_service query/model/builder,
  notification_service test→Test, tempo_service test→Test/user→User,
  test_workflow_service test_id→UUID, campaign_crud **fields→object,
  test_crud **fields→object (4 sites)

ANN401 — 16 Any usages resolved:
- Domain entities (campaign/technique/threat_actor/test_entity): replaced Any with
  actual ORM types via TYPE_CHECKING guards to avoid circular imports
- detection_rule_service: test_id/detection_rule_id/evaluator_id→UUID
- score_cache: kept Any with # noqa: ANN401 (genuinely generic cache)
- jira_service/tempo_service: kept Any with # noqa: ANN401 (lazy optional deps)
- d3fend_import_service: _to_str(v: Any) kept with # noqa: ANN401

ANN204/ANN205/ANN206 — special/static/class methods:
- database.py proxy __call__/__getattr__: *args: object/**kwargs: object
- schemas/test.py model_validate: obj→object, **kwargs→object
- sa_technique_repository._int_type→type

All 439 unit tests pass. ruff check app/ → All checks passed!

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
 2026-06-09 17:04:51 +02:00
kitos ec26183e2e refactor(pep8): enforce full PEP8 compliance across backend Python codebase 
- ruff.toml: select E/W/F/I/N rules, line-length=120, drop legacy ignores
- Auto-fix: sort 82 import blocks (isort), remove 29 unused imports,
  strip 6 trailing-whitespace blank lines in docstrings
- main.py: move setup_logging and settings imports to top (E402)
- errors.py: noqa N818 on DDD exception names (96 call sites, safe)
- intel_service.py: noqa N817 for universal ET alias
- atomic/elastic/sigma import services: move _MAX_UNCOMPRESSED_SIZE and
  _MAX_ENTRIES to module level (N806)
- compliance_import_service.py: move SAMPLE_CONTROLS / CIS_CONTROLS to
  module level; wrap long description strings (N806 + E501)
- snapshot_service.py: move STATUS_ORDER dict to module level (N806)
- sigma_import_service.py: remove dead dedup_key expression (F841)
- threat_actor_import_service.py: remove dead stix_to_actor expression (F841)
- data_source.py, seed_demo.py, campaign_scheduler_service.py,
  lolbas_import_service.py: wrap lines exceeding 120 chars (E501)
- d3fend_import_service.py: per-file E501 ignore (data file with long strings)

All 439 unit tests pass. ruff check app/ → All checks passed!

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
 2026-06-09 16:40:14 +02:00
kitos 1249391ef0 feat(snapshots): evolution API, tactic breakdown and dashboard trend chart [FASE-5.2]
Aegis CI / lint-and-test (push) Has been cancelled
Details
2026-05-18 15:07:12 +02:00
kitos 05b221a22d feat(scoring): composite recency decay and severity weights persisted in DB [FASE-5.1] 2026-05-18 15:07:12 +02:00
kitos 2ee59d4e18 test(intel): verify OSINT enrichment and stale coverage detection [FASE-4] 2026-05-18 14:50:31 +02:00
kitos bdeeed54e1 feat(compliance): data classification fields and retention policies job [FASE-3.5]
Aegis CI / lint-and-test (push) Has been cancelled
Details
2026-05-18 14:17:29 +02:00
kitos 3e854b7b79 feat(security): extend rate limits on sync, tests, evidence and reports [FASE-3.4] 2026-05-18 14:16:53 +02:00
kitos 5b29c2fc56 fix(api): return 422 for validation errors with serializable payloads [FASE-3.3] 2026-05-18 14:16:53 +02:00
kitos 6b076f52b2 feat(auth): audit login success and failure attempts [FASE-3.2] 2026-05-18 14:16:53 +02:00
kitos c0aff4cbeb feat(audit): enhanced audit trail with IP, user-agent and integrity hash [FASE-3.1] 2026-05-18 14:16:18 +02:00
kitos a8a24b5429 fix(metrics): correct never-tested technique query [FASE-2.6]
Aegis CI / lint-and-test (push) Has been cancelled
Details 
Use distinct technique_id list filtering so untested techniques are returned reliably on SQLite and Postgres.
 2026-05-18 14:00:48 +02:00
kitos b6f23f385d fix(analytics): restrict operators endpoint to admin [FASE-2.5] 
Align with BI security spec and add flat JSON API tests for coverage, tests, and operators.
 2026-05-18 14:00:47 +02:00
kitos 6ab950ec42 feat(reports): add quarterly and technique download routes [FASE-2.4] 
Expose GET endpoints for quarterly-summary and technique reports with PDF, DOCX, and HTML formats.
 2026-05-18 14:00:46 +02:00
kitos ed2c34ef28 feat(reports): extend report generation service [FASE-2.3] 
Add quarterly summary and technique detail builders with UUID-safe lookups and unit tests for purple campaign context.
 2026-05-18 14:00:42 +02:00
kitos 96fdd9fa85 feat(reports): add quarterly and technique HTML templates [FASE-2.2] 
Introduce quarterly_summary and technique_detail Jinja layouts; use SVG logo asset across report covers.
 2026-05-18 14:00:40 +02:00
kitos c28a47c43b test(reports): add ReportEngine unit tests [FASE-2.1] 
Stub WeasyPrint for CI-friendly PDF generation and verify HTML render, PDF path, and HTML file output.
 2026-05-18 14:00:37 +02:00
kitos 0d4c404f08 test(jira): add hourly sync job tests [FASE-1.7]
Aegis CI / lint-and-test (push) Has been cancelled
Details 
Verify skip when disabled, per-link sync invocation, and continued batch on single-link failures.
 2026-05-18 13:36:26 +02:00
kitos 03d7d1cc80 feat(tempo): harden worklog sync and add tests [FASE-1.4] 
Add tempo-api-python-client dependency, TEMPO_API_VERSION setting, enum-safe Jira link lookup, work type on create_worklog, and mocked auto_log tests.
 2026-05-18 13:36:26 +02:00
kitos b8c9c4ac6a test(jira): add hourly sync job tests [FASE-1.7]
Aegis CI / lint-and-test (push) Has been cancelled
Details 
Verify skip when disabled, per-link sync invocation, and continued batch on single-link failures.
 2026-05-18 13:33:40 +02:00
kitos 73867d3990 test(jira): add jira_service unit tests [FASE-1.2] 
Cover disabled client guard, issue search mapping, and sync_aegis_to_jira comment posting with mocks.
 2026-05-18 13:33:27 +02:00
kitos f45b7ea926 ci: add GitHub Actions lint and test pipeline [FASE-0.6]
Aegis CI / lint-and-test (push) Has been cancelled
Details 
Run ruff and pytest against Postgres and Redis service containers; document CI in README.
 2026-05-18 13:19:29 +02:00
kitos 6b28934f05 test: stabilize Phase 0 API and workflow tests [FASE-0.4] 
Assert INVALID_TRANSITION JSON code on duplicate start, remove sys.modules stubs from T-106 tests, and complete boto3 stubs in integration tests.
 2026-05-18 13:19:27 +02:00
kitos 6f35d85a97 feat(db): add Phase 0 composite indexes migration [FASE-0.3] 
Add idempotent Alembic revision b028 for campaign_tests (campaign_id, test_id) to support campaign-scoped queries.
 2026-05-18 13:19:20 +02:00
kitos c5eb6f6dc1 feat(auth): move JWT blacklist to Redis with TTL [FASE-0.2] 
Revoke tokens by jti in a dedicated Redis DB, honor TTL from JWT exp on logout, reject revoked tokens in get_current_user, and add FakeRedis-backed API tests.
 2026-05-18 13:19:15 +02:00
kitos 9b70655b7e feat(infra): add Redis service and client for Phase 0 [FASE-0.1] 
Add Redis 7 to Docker Compose with healthcheck and persistence, separate logical DBs for blacklist and cache, singleton redis client helpers, and unit tests with fakeredis.
 2026-05-18 13:18:45 +02:00
kitos 821c4ac5ec test(jira): add JiraLink model and jira_service tests [FASE-1.1] 
Model and migration b020 were already present; adds regression coverage for persistence, schema validation, and link CRUD with Jira disabled.
 2026-05-18 12:02:21 +02:00
kitos abef2a45e0 fix: production detection only triggers on AEGIS_ENV=production, not SECRET_KEY presence
Aegis CI / lint-and-test (push) Has been cancelled
Details
2026-02-20 17:20:48 +01:00
kitos 309b3bc02d docs: finalize ARCHITECTURE.md with complete layered structure and zero remaining tech debt
Aegis CI / lint-and-test (push) Has been cancelled
Details
2026-02-20 16:16:22 +01:00
kitos 0148bf28dc chore: clean repo for public release, remove internal audit docs and plan artifacts, update README 2026-02-20 16:15:26 +01:00
kitos 79a4772ab5 feat: make heatmap layers extensible via LayerRegistry (OCP) 2026-02-20 16:07:36 +01:00
kitos a9255e15ce refactor: remove db.commit() from audit_service.log_action, all callers use UoW 2026-02-20 15:33:23 +01:00
kitos 0c526c48f9 docs: update ARCHITECTURE.md, ARCHITECTURAL_ANALYSIS.md, and skill file with Tier 1-4 changes
Aegis CI / lint-and-test (push) Has been cancelled
Details
2026-02-20 15:14:07 +01:00
kitos 0d211d5156 feat: add ThreatActorEntity domain entity with coverage analysis (Tier 4) 2026-02-20 15:02:38 +01:00
kitos 14d995b40c refactor: remove db.commit() from business services, callers use UnitOfWork (Tier 3) 2026-02-20 14:42:20 +01:00
kitos 339d669498 feat: move all remaining inline logic from routers to services (Tier 2) 2026-02-20 14:34:24 +01:00
kitos 9e22fde746 feat: extract advanced_metrics, analytics, test_templates, and auth to services (Tier 1 complete) 2026-02-20 14:28:52 +01:00
kitos bbc2dddd86 docs: update ARCHITECTURE.md and ARCHITECTURAL_ANALYSIS.md to reflect all low-priority items completed (LP-8) 2026-02-20 13:39:55 +01:00
kitos d77075272e feat: add ImportService protocol and registry for OCP-compliant import extensibility (LP-7) 2026-02-20 13:31:18 +01:00
kitos c0c6cda11d feat: add Campaign/Compliance domain entities and extract users/audit/data_sources to services (LP-2 through LP-6) 2026-02-20 13:28:14 +01:00
kitos 44621364be docs: update ARCHITECTURAL_ANALYSIS.md to reflect all completed refactoring (service extractions, scoring persistence, logging, N+1 fixes)
Aegis CI / lint-and-test (push) Has been cancelled
Details
2026-02-20 12:55:26 +01:00
kitos 0eff48c768 docs: complete architectural refactoring tracker, create aegis-architecture skill for future agents
Aegis CI / lint-and-test (push) Has been cancelled
Details
2026-02-19 19:15:31 +01:00
kitos 764a2f7579 feat(logging): add structured JSON logging for production, human-readable text for development 2026-02-19 19:07:08 +01:00
kitos f4c74230ec refactor(campaigns): extract CRUD/business logic to campaign_crud_service, use domain exceptions 2026-02-19 19:04:32 +01:00
kitos 50b70704ae refactor(evidence): extract permission validation and queries to evidence_service, use domain exceptions 2026-02-19 19:02:36 +01:00
kitos 20738d11b3 refactor(tests): extract CRUD/query logic to test_crud_service, router delegates to service with domain exceptions 2026-02-19 18:35:09 +01:00
kitos 4e3787d091 refactor(scoring): persist weights in DB table, replace mutable Settings with scoring_config_service 2026-02-19 17:46:02 +01:00
kitos 93fde55389 refactor(threat-actors): extract query/business logic to threat_actor_service, fix N+1 with grouped subqueries
Aegis CI / lint-and-test (push) Has been cancelled
Details
2026-02-19 17:40:00 +01:00
kitos 560fc0c9f0 refactor(detection-rules): extract query/business logic to detection_rule_service, router is thin HTTP adapter 2026-02-19 17:39:31 +01:00
kitos d305db8794 refactor(compliance): extract business logic to compliance_service, use domain exceptions instead of HTTPException 2026-02-19 17:06:32 +01:00