IBM Sterling


This portal is to open public enhancement requests for IBM Sterling products and services. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:

Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,

Post your ideas

  1. Post an idea.

  2. Get feedback from the IBM team and other customers to refine your idea.

  3. Follow the idea through the IBM Ideas process.


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

Add a new idea Subscribe
Status Not under consideration
Workspace Sterling B2B Integrator
Categories Global Mailbox
Created by Guest
Created on Oct 22, 2024

RELATED IDEAS

Utility to keep Cassandra tables in sync

There are times when Cassandra nodes may get out of sync and some of the nodes may deem it appropriate to bring back records that should no longer belong in the tables.


For example: mailbox.messages, mailbox.messages_by_name and mailbox.messages_by_id - these tables should all have the same information in slightly different forms, but what we have discovered is that it is possible for mailbox.messages and mailbox.messages_by_name to have duplicate records, even though mailbox.messages_by_id would have only one version of that same record.

This situation causes deleted files to be "resurrected" and downloaded again by the end users.


There needs to be a utility that will analyze Cassandra tables and take an action (or at the very least provide an alert) whenever this type of situation occurs. Especially, since in the Cassandra NoSQL world, it's virtually impossible to query for this type of information.

What is your industry? Healthcare
How will this idea be used?

This utility will be similar to the Sterling B2B "dataSweeper" or the Sterling FileGateway "sfgdbcheck" and will keep Cassandra tables in check before the table discrepancies cause business impact.

  • Admin
    Mark Allen
    Reply
    |     Nov 6, 2024

    Thank you for taking the time to provide your ideas to IBM. We truly value our relationship with you and appreciate your willingness to share details about your experience, your recommendations, and ideas.

    IBM has evaluated the request and has determined that it cannot be implemented at this time or does not align with our current strategy or roadmap.

    • The data issues observed in this case was due to a Cassandra node being down for an extended period of time, causing sync issues when the node was brought back up and the deleted data was restored

    • By default the window to restore a Cassandra node is 2 days and if the node comes back after this window, data resurrection issues may occur

    • Instead of writing a utility to clean up data inconsistencies after the problem occurs, we'd rather focus on preventing the problem from happening in the first place

    • Changes we will consider are:

      • increasing the gc_grace_seconds to allow for a longer downtime of a Cassandra node (i.e. increase from 2 days to 5 by default)

      • monitoring the reaper using Control Center or other tools like Prometheus to ensure that repairs are happening as expected

    Thank you for bringing your ideas to us. If you have any additional feedback, thoughts or ideas, or if there is anything else I can do, please do not hesitate to reply to this message to continue the conversation.

By clicking the "Post Comment" or "Submit Idea" button, you are agreeing to the IBM Ideas Portal Terms of Use.
Do not place IBM confidential, company confidential, or personal information into any field.