Incoming EDR File processing

The objective of this Use-Case is to provide a clear understanding of how Incoming EDR (Event Data Record) files will be processed within the OCS.io’s EDR Processor module. The Use-Case aims to outline the specific steps and mechanisms involved in handling these files, ensuring their proper ingestion, validation, and transformation for further processing.

The primary goals of the chapter are as follows:

  1. File Intake: Describe the process of receiving incoming EDR files from the designated directory and establishing a reliable and secure connection with the file source. This includes authentication, file transfer protocols, and any necessary configurations.

  2. File Validation: Explain the various validation checks that will be performed on incoming files, such as verifying the file name against predefined patterns, detecting duplicate files, and ensuring the file format adheres to the specified interface. Highlight the rejection mechanism for files that fail validation.

  3. Record Processing: Detail the steps involved in processing individual EDR records within the files. This may include parsing and extracting relevant data, performing data transformations or enrichments, and applying business rules or validations on each record.

  4. Error Handling: Discuss how errors or exceptions encountered during file or record processing will be handled. Describe the mechanisms for logging errors, generating error reports, and taking appropriate actions, such as marking records as erroneous or rejecting entire files.

  5. Statistics Generation: Specify the generation of comprehensive statistics for each processed file, including the count of processed records, successful records, rejected records, and any additional categorized statistics. Outline how these statistics will be stored and utilized for monitoring and reporting purposes.

By providing a clear and detailed explanation of the Incoming EDR file processing workflow, the chapter aims to ensure a smooth and efficient handling of EDR data within the OCS.io’s EDR Processor module, enabling accurate billing, revenue management, analysis, and reporting functionalities.