/
General Batch Use Case
General Batch Use Case
Actors
- System of Record
- OpenRegistry
Pre-Conditions
- System of Record needs to have created a specification for the data they wish to send.
- OpenRegistry has defined specification format such that it can read the specification sent by System of Record and translate data.
- OpenRegistry System needs to have staging area created for the System of Record.
- OpenRegistry needs to map System of Record to staging area.
- OpenRegistry authorizes System of Record to write to particular staging area
Business Flow
- System of Record authenticates with the OpenRegistry system.
- System of Record composes a set of data to send to OpenRegistry
- System of Record sends information in format via transport negotiated between System of Record and OpenRegistry System.
- OpenRegistry determines if there is appropriate authorization to store data.
- Data is stored in staging stables (parsing and loading), and OpenRegistry starts to process data.
- Processing follows the general pipeline for processing, including reconciliation, identifier assignment, normalization, standardization, and pushing data to appropriate systems.
- Based on the feed specification, notifications of errors, success, results, etc. should be sent out via the appropriate methods.
Post Conditions
- System of Record receives detailed information on how the process went (via notification scheme).
- Any errors are logged and appropriate people notified.
- Every data change is audited and logged for debugging purposes.
Nonfunctional Considerations
- Everything that can be executed in parallel should be as a significant amount of data may be transmitted at once.
- Batch processing should not unfairly hold up real-time processing.