IBM Sterling
Hide about this portal


This portal is to open public enhancement requests for IBM Sterling products and services. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:

Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,

Post your ideas

  1. Post an idea.

  2. Get feedback from the IBM team and other customers to refine your idea.

  3. Follow the idea through the IBM Ideas process.


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

Add a new idea Subscribe
Status Not under consideration
Workspace Sterling B2B Integrator
Categories Usability
Created by Guest
Created on Sep 27, 2021

RELATED IDEAS

SFTP Client GET Service - input parameter to set a max number of files processed

See this idea on ideas.ibm.com

We are using the operation SFTPClientGet and the parameter RemoteFilePattern to do a multiple get. See the below example.

We would like to have an input parameter allowing us to set a maximum number of files processed during one sftp get operation.


<operation>

    <participant name="SFTPClientGet"/>

    <output message="xout">

        <assign to="RemoteFilePattern">myFiles.*.dat</assign>

        <assign to="RetrieveErrorSetSuccess">NO</assign>

        <assign to="SessionToken" from="SFTPtoken/text()"/>

    </output>

    <input message="xin">

        <assign to="." from="*"/>

    </input>

</operation>
What is your industry? Automotive
How will this idea be used?

During a multiple get with the parameter RemoteFilePattern, we cannot control the number of files retrieved. Then, if the remote sftp server produce thousands of files matching the RemoteFilePattern, it can lead us to a flood situation.

Therefore we would like to have an input paramter allowing us to set a maximum number of files processed during one sftp get operation.

At the moment the workaround is to first list the directory and count the number of files available before making the sftp get. If the number of files available is too high for us, we can decide to not execute the sftp get. But this workaround is not convenient because we never retrieve any file at all until human intervention on the remote sftp server.


  • Admin
    Mark Allen
    Reply
    |     Jan 15, 2025

    Thank you for taking the time to provide your ideas to IBM. We truly value our relationship with you and appreciate your willingness to share details about your experience, your recommendations, and ideas.

    IBM has evaluated the request and has determined that it cannot be implemented at this time or does not align with our current strategy or roadmap.

    Other customers have worked around this issue by using a Business Process to retrieve a list of files and limit the result set before executing a GET command. See the Sterling B2Bi Community for an example of this BP. https://community.ibm.com/community/user/dataexchange/discussion/sftp-client-getlist-service-with-a-directory-that-has-thousands-of-files#bm52c07eab-bf45-40b4-8d4e-0191d718b170


    As there is a workaround, this idea is lower on our priority list and is not likely to make it on our roadmap in the next 12-18 months.

    Thank you for bringing your ideas to us. If you have any additional feedback, thoughts or ideas, or if there is anything else I can do, please do not hesitate to reply to this message to continue the conversation.

  • Guest
    Reply
    |     Oct 17, 2024

    This enhancement would help a lot to secure the SI environment from slowdowns as there is no method to ensure the partner is cleaning up the source directory efficiently.  The SFTPClientGet generally pulls a selected wildcard list of files. As the command doesn't contain a restrictive setting, all files corresponding to the pattern will be pulled.  

    It is important to protect the server side as the remote side is out of control for the SI administrators !

  • Guest
    Reply
    |     Sep 6, 2024

    This should be done!!

  • Guest
    Reply
    |     Jan 24, 2024

    It is great idea. really appreciate if solution accommodate in product.

  • Guest
    Reply
    |     Mar 9, 2022

    Thank you for participating in the request for enhancement community. Your input is valuable in shaping the roadmap for the product. We agree that this idea would add value, and have added it to our backlog. We will continue to monitor this enhancement for interest and adjust priority if needed. If you have any additional questions or concerns please reach out.

  • Guest
    Reply
    |     Oct 27, 2021

    This is a great idea. I've built custom workflows to accomplish this ask; however, throttling mechanisms for all the SFTP Operations would be great. Extend this to file size as well. e.g. after picking up 1 GB worth of files, continue the rest of the BP.

    In the case of SFTP LS, a limit on the data coming back would be nice especially since Listing a directory too large will crash the adapter.

By clicking the "Post Comment" or "Submit Idea" button, you are agreeing to the IBM Ideas Portal Terms of Use.
Do not place IBM confidential, company confidential, or personal information into any field.