Project :: Hologic, Inc.
Hologic Auto
Diagnostics Importer
.NET Application
Hologic Auto Diagnostics Importer
.NET Application
Hologic, Inc.
Project
The Hologic Auto Diagnostics Importer is a .NET application that automatically moves, extracts, parses, ingests, and archives Hologic instrument diagnostics data.
The Hologic Auto Diagnostics Importer is a .NET application that automatically moves, extracts, parses, ingests, and archives Hologic instrument diagnostics data.
Engineering Accomplishments
The Hologic Auto Diagnostics Importer is a .NET application I developed to automate the process of ingesting Hologic instrument data into a central database.
Hologic has a global install base of multiple instrument types which have their diagnostics files uploaded to a cloud based server in various ways.
Once a diagnostics zip file is uploaded to the server the Hologic Auto Diagnostics Importer will move it into a temporary folder, extract the needed data files, parse the data files, add the data to the local (central) database, archive the original zip file, delete the temporary folder, and log all activity.
I also developed a cleaning utility that runs daily to remove any incomplete data that may exist due to a failed import.
Power BI is then used on the front end for full data visualization.
Features
- Procedural .NET Application
- Automatically Close when Complete
- Read Upload Folder for New Zip Files
- Parse System File to Determine Instrument Type
- Extract Needed Data Files Based on Instrument Type
- Parse Data Files for Relevant Data
- Advanced Algorithms for Deterministic Data
- Ingest Only Non-dupliacate Data Into Local Database
- Archive Zip and Most Recent Data Files
- Log Program Activity
- Log Instrument Activity and Data
- Log Data Sizes for Future Comparison
Project List
Diagnostics Files
- Planned Server Architecture for Uploading Diagnostics Files
- Created Algorithm to Read System File to Determine Instrument Type
- Designed Workflow Process to Ensure Integrity of Original Zip File
Quality of Life Updates (GUI)
- Enabled Use of Accession IDs
- Updated Displays of Barcode IDs
- Added User Robotics Test
- Added User NAS Test
- Added Background NAS Verification
- Added Multiple System Settings Displays
Project List
Service Application
- Added Robotics Mapping
- Added Live Robotics Status Updates
- Added Regex Based Barcode Restrictions Wizard
- Updated Robotic Testing Controls
- Updated Entire User Interface to Improve Usability
Major Bug Fixes
- NAS Verification (Known)
- Accession ID Display (Known)
- Barcode Configuration (Unknown)
- Barcode Processing (Unknown)
- Slide Design Preview (Unknown)
Translations and Documentation
- Managed Entire GUI Translation Process
- Updated GUI for Improved Accessibility
- Documented All Software Design Changes
- Assisted in Operations Manual Updates
| Diagnostics Files |
- Planned Server Architecture for Uploading Diagnostics Files
- Created Algorithm to Read System File to Determine Instrument Type
- Designed Workflow Process to Ensure Integrity of Original Zip File
|
| Data File Extraction |
- Created Algorithm to Determine Needed Data Files Based on Instrument Type
- Created Algorithm to Find Needed Data Files Within Various Zip Folder Structures
- Log Extraction of All Needed and Optional Data Files
|
| Data Algorithms |
- Worked With Diagnostic Team to Create Algorithms for Deterministic and Probabilistic Data
|
| Database Ingestion |
- Implemented SQL Server Commands to Ingest Data
- Created Algorithm to Prevent Single Instrument Duplicates
- Created .NET Application to Remove Incomplete Data
- Log Ingestion of Each Data File
- Log Row Counts for Future Comparison
|
| Archiving |
- Created Algorithm to Archive Original Zip File and Newest Data Files
- Created Algorithm to Update Instrument README with Newest Data
- Log Archiving of All Files
|
| Visualization |
|
