/
NUTRINTG Files from sftp to cdp

NUTRINTG Files from sftp to cdp

Owned by Sebastian Baltruszewicz
Aug 16, 2023
2 min read

Overview

Step by step what to do if one of below services have encountered problem:

  • cdp-to-sfmc-integration-eu-prod

  • cdp-to-sfmc-integration-prod-amer

  • cdp-to-sfmc-integration-prod-sea

Procedure

1. Connect to EC2

ssh -i ${key}.pem ${user}@${host}

where key name, user and host are in properties of exact project.

2. Check folder fixing_temp

Go to folder and check content. Count number of existing folders and remember it.

cd /fixing_temp ls

3. Connect to SFTP

sftp ${user}@${host}

Then terminal will ask for password to SFTP. If you do not have any ask someone from CDD team.

user, host are in properties of exact project.

4. Go to folder outgoing

Check if there are some files with suffix .pgp and .md5. Files contains also date in name.

5. Ensure that you are in /fixing_temp folder on EC2

To execute command on EC2 when you are connected to SFTP use “l” before each command.

6. Create folder on EC2

Folder name should be equal to a date in file name for example 20210222224052. Then go to folder.

7. Create folder on SFTP

Folder name should be like ${date}_old. First ensure that you are in /outgoing folder

8. Copy files to EC2

You should be in /outgoing folder. Copy files with command:

where prefix is repeating pattern in file names.

9. Go to folder ${date}_old

On SFTP go to folder with date that you have copied before and run command:

Now copy of files has been created on SFTP.

10. Remove backup-ed files

where prefix is repeating pattern in file names.

11. Repeat steps from 6 to 10 for each date in files name

12. Send files to CDP

Go to the folder with the oldest date in name (if has been already send then next) on EC2

Go to /outgoing folder on SFTP

Copy files from EC2 to SFTP

Count number of files. There should be no more, no less than 30 (for Europe).

13. Open AnypointPlatform

Open application that you are interested in, in Runtime Manager view. Click “Schedules”, mark process which name is like cdp-files-to-sfmc-integration Poll and click “Run now”.

Search for log: “Successfully finished the process of CDP to SFMC integration!” and wait few minutes after log appeared.

Files should be deleted from outgoing folder on SFTP.

14. Repeat steps 12-13