NUTRINTG File Sender [WORK IN PROGRESS]
- Sebastian Baltruszewicz
Simple explanation
Sender is responsible for upload of output files on CDP sftp folder. It is uploading files one by one to sftp folder which is based on the data in message. At the end of this process sender remove blockades placed by set analyzer
Infrastructure
All infrastructure are placed in AWS cloud.
Bucket on s3 - place where fetched files are being stored
NoSQL DB - MongoDB / DocumentDB - used to store metadata and errored metadata
Input Queue - SQS - queue with messages from encrypter
Most important process properties
Property | Description | Example |
|---|---|---|
| Number of threads pararelly sending files | 4 |
| Delay between checkings of queue | 10000 |
| Maximal number of retry attempt for uploading single file | 4 |
| Delay between attempt of reuploads of file after fail | fetched/${date}/${filename} |
| root directory where files are getting uploaded | data |