Fix SFTP multi-access ingestion error in ÃÛ¶¹ÊÓÆµ Experience Platform
ÃÛ¶¹ÊÓÆµ Experience Platform (AEP) fails to ingest data from SFTP when file access policies restrict multiple accesses. To fix this, avoid using the preview feature, configure ingestion settings via API with specific parameters, and verify SFTP credentials and server behavior.
Description description
Environment
ÃÛ¶¹ÊÓÆµ Experience Platform (AEP)
Issue/Symptoms
- Files become inaccessible after ÃÛ¶¹ÊÓÆµ Experience Platform (AEP) previews them during SFTP dataflow setup.
- The system fails to configure the dataflow because it cannot access the files.
- The issue affects both CSV and JSON files.
- Preview functionality triggers a download, causing the SFTP server to move or lock the file.
- File access policies on the SFTP server restrict multiple accesses or downloads.
Resolution resolution
To resolve this issue, follow these steps:
-
Confirm whether the SFTP setup follows one of these behaviors:
- Option A: The file becomes temporarily invisible while one connection is active.
- Option B: The file becomes permanently inaccessible after a single download (this matches the current behavior).
-
If the setup follows Option B, the AEP UI doesn’t support this workflow. Features like preview and schema inference require multiple file accesses. In this case:
-
Avoid using the Explore endpoint (used for previewing files in the UI) to preview the file.
-
Configure ingestion settings via APIÂ with the following parameters:
disableChunking
: truemaxConcurrentConnections
: 1
-
-
Compare working and non-working connections:
- Verify whether credentials associated with non-working connections can download files using an external SFTP client, such as Cyberduck or WinSCP.
- If the file remains inaccessible even when using external clients, check for possible misconfigurations on the SFTP server.
-
Collaborate with the internal SFTP team to confirm whether exceptions are configured for the affected nodes and ensure no restrictions block multiple accesses.
-
If another set of credentials works consistently, use them for AEP source connections while you troubleshoot the issue.