dohertj2/jdescopingtool
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
83 Commits 2 Branches 0 Tags
626b7a63f2fc3113bd63545ffbf2dfa7f7cfc8f2
Commit Graph

7 Commits

Author SHA1 Message Date
Joseph Doherty 81b07ce027 feat: extract DevEtl to JdeScoping.DataSync.Dev project 
- Create JdeScoping.DataSync.Dev for sandbox testing ETL code
- Create JdeScoping.DataSync.Dev.Tests for associated tests
- Move 22 source files and 8 test files
- Update namespaces from DevEtl to Dev
- Add both projects to solution
 2026-01-06 10:18:09 -05:00
Joseph Doherty bb21eb9468 docs: add ETL documentation implementation plan 
8-task plan to create comprehensive ETL pipeline documentation:
- Overview, Sources, Transformers, Destinations, Configuration, Troubleshooting
- Update ComponentMap with ETL source paths
- Final verification of links and commits
 2026-01-03 15:27:59 -05:00
Joseph Doherty 9103626ad4 docs: add ETL pipeline documentation design 
Design for 6 documentation files covering the DataSync ETL pipeline:
- Overview, Sources, Transformers, Destinations, Configuration, Troubleshooting

Target audience: developers extending the pipeline + operations/support.
 2026-01-03 15:22:57 -05:00
Joseph Doherty 61d4848955 docs: add ETL Pipeline Phase 2 implementation plan 
12-task TDD implementation plan covering:
- MapOrdinal interface and binary method overrides
- ColumnDropTransformer and JdeDateTransformer ordinal mapping
- JDE date validation with 1900-01-01 sentinel
- Column rename collision detection
- SqlScriptRunner parameters support
- CommonScripts with ParseTableName and QUOTENAME
- Destination command timeouts
- Column mapping with destination schema intersection
- EtlPipelineBuilder.WithCommandTimeout validation
- Full test suite verification
- Codex MCP final review
 2026-01-03 10:24:28 -05:00
Joseph Doherty 7ae2cd4882 docs: add ETL Pipeline Phase 2 design document 
Design addresses 7 issues identified in Phase 1 review:
- Bulk copy column mapping (by name, intersect with destination)
- Schema-qualified table names (parse tableName, QUOTENAME)
- Configurable timeouts (single commandTimeoutSeconds)
- JDE date sentinel (1900-01-01 default for invalid dates)
- TransformingDataReader ordinal mapping (MapOrdinal on interface)
- Transformer lifecycle (document single-use, no auto-dispose)
- Column rename collision validation (fail-fast on duplicates)

Reviewed by Codex MCP with all issues addressed.
 2026-01-03 10:21:02 -05:00
Joseph Doherty ec4c8fab87 refactor: relocate options classes to dedicated Options folders 
Move configuration options from Core/DataAccess/DataSync/ExcelIO to
dedicated Options folders within each project for better organization.
Update all references and tests accordingly.
 2026-01-03 08:55:08 -05:00
Joseph Doherty 26ff8d9b4f Initial commit: JDE Scoping Tool migration project 
Set up repository with legacy .NET Framework 4.8 source (OLD/),
new .NET 10 Blazor solution (NEW/), OpenSpec specifications,
documentation, and project configuration.
 2026-01-02 07:43:29 -05:00