Commit Graph

4 Commits

Author SHA1 Message Date
Joseph Doherty ff487aa99c docs: add pipeline viewer implementation plan
Detailed step-by-step implementation tasks:
1. Create Pipeline DTOs in Core
2. Add Pipeline Routes to ApiRoutes
3. Add Repository Methods
4. Implement Repository Methods
5. Create PipelineController
6. Add Missing Factory Methods
7. Create Client API Service
8. Create SqlQueryModal Component
9. Create PipelineScheduleSection Component
10. Create PipelineViewer Page
11. Register Services
12. Add Navigation Link
2026-01-07 07:53:54 -05:00
Joseph Doherty 9afecca957 docs: update pipeline viewer design based on Codex review
Addressed CLEAN architecture and best practices feedback:
- API loads config, returns DTO (not client loading JSON directly)
- Reuse existing DataSync Configuration types
- Add UpdateType filter to GetRecentUpdatesAsync
- Reuse existing IsOverdue() with grace period
- Add LastRun + LastRunWasSuccessful (not just LastSuccessfulRun)
- Follow ApiRoutes + ApiClientBase patterns
- Make Duration nullable for in-progress runs
- Use UpdateTypes enum instead of string
- Add [Authorize] to page and controller
2026-01-07 07:49:48 -05:00
Joseph Doherty 5040a8488f docs: add ETL pipeline viewer component design
Design document for admin monitoring component that visualizes:
- Pipeline configuration from pipelines.json
- Execution status (last run, next required, overdue)
- Recent execution history (last 10 per schedule type)
- Schedule sections for Mass/Daily/Hourly with defaults vs overrides
2026-01-07 07:40:49 -05:00
Joseph Doherty 6952f686fa perf: optimize ExcelIO tests with fixture-based consolidation
- Add WorkbookFixtureBase and 4 concrete fixtures for shared workbooks
- Add ExcelTestHelpers with shared utility methods
- Create Integration/ folder with 7 fixture-based test classes:
  - MinimalSearchTests (5 tests)
  - SearchResultsSheetTests (5 tests)
  - MisInfoSheetTests (11 tests)
  - InvestigationSheetTests (7 tests)
  - ProtectionAndStyleTests (7 tests)
  - LegacyFormatTests (5 tests)
  - LargeDataSetTests (1 test)
- Delete redundant ExcelExportIntegrationTests.cs (26 tests)
- Delete redundant LegacyComparisonTests.cs (16 tests)
- Reduce workbook generations from ~42 to 4 fixtures
- Test runtime reduced from ~18 min to ~4 min (76% improvement)
- All 122 ExcelIO tests pass
2026-01-07 03:55:33 -05:00