feat: Added in-memory storage for testing purposes #59

Harshdev098 · 2025-10-12T08:40:04Z

Have added in_memory store for testing purpose.
We can edit config file to use specific store either postgresql or memory

ldk-reviews-bot · 2025-10-12T08:40:06Z

👋 Thanks for assigning @tnull as a reviewer!
I'll wait for their review and will help manage the review process.
Once they submit their review, I'll check if a second reviewer would be helpful.

Harshdev098 · 2025-10-12T10:19:04Z

Hey @tnull @tankyleo Can you please review it

tnull

Thanks for looking into this!

Generally goes into the right direction, but we def. need to avoid re-allocating everything on every operation.

rust/Cargo.lock

rust/README.md

rust/impls/src/lib.rs

rust/impls/src/memory_store.rs

Harshdev098 · 2025-10-14T06:17:50Z

@tnull Have done the required changes

tnull

Looks much better, but I think we still need to handle global_version properly, even if we're currently not using it client-side.

rust/impls/src/in_memory_store.rs

ldk-reviews-bot · 2025-10-14T08:50:52Z

🔔 1st Reminder

Hey @tankyleo! This PR has been waiting for your review.
Please take a look when you have a chance. If you're unable to review, please let us know so we can find another reviewer.

ldk-reviews-bot · 2025-10-16T08:51:33Z

🔔 2nd Reminder

Hey @tnull @tankyleo! This PR has been waiting for your review.
Please take a look when you have a chance. If you're unable to review, please let us know so we can find another reviewer.

ldk-reviews-bot · 2025-10-16T16:44:43Z

🔔 1st Reminder

Hey @tnull @tankyleo! This PR has been waiting for your review.
Please take a look when you have a chance. If you're unable to review, please let us know so we can find another reviewer.

tnull

One comment, will take another look once @tankyleo also had a chance to do a review round here.

rust/impls/src/in_memory_store.rs

Harshdev098 · 2025-10-17T09:15:56Z

@tankyleo Can you please review it!

ldk-reviews-bot · 2025-10-18T08:52:14Z

🔔 3rd Reminder

Hey @tankyleo! This PR has been waiting for your review.
Please take a look when you have a chance. If you're unable to review, please let us know so we can find another reviewer.

ldk-reviews-bot · 2025-10-20T08:52:50Z

🔔 4th Reminder

Hey @tankyleo! This PR has been waiting for your review.
Please take a look when you have a chance. If you're unable to review, please let us know so we can find another reviewer.

ldk-reviews-bot · 2025-10-22T08:53:27Z

🔔 5th Reminder

Hey @tankyleo! This PR has been waiting for your review.
Please take a look when you have a chance. If you're unable to review, please let us know so we can find another reviewer.

tankyleo

Sorry for the delay !

rust/impls/src/in_memory_store.rs

rust/impls/src/migrations.rs

Harshdev098 · 2025-10-26T01:53:09Z

@tankyleo Have done with the required changes! Can you please review it

tnull

When testing integration with LDK Node locally I found that the tests are currently failing. I now opened #62 to add LDK Node integration tests to our CI here. It would be great if that could land first, and we could also add a CI job for the in-memory store as part of this PR then, ensuring the implementation actually works as expected.

ldk-reviews-bot · 2025-10-28T01:53:31Z

🔔 1st Reminder

Hey @tankyleo! This PR has been waiting for your review.
Please take a look when you have a chance. If you're unable to review, please let us know so we can find another reviewer.

ldk-reviews-bot · 2025-10-30T01:54:18Z

🔔 2nd Reminder

Hey @tankyleo! This PR has been waiting for your review.
Please take a look when you have a chance. If you're unable to review, please let us know so we can find another reviewer.

tnull · 2025-10-31T12:09:51Z

@Harshdev098 Please rebase now that #62 landed to make use of the new CI checks here.

Harshdev098 · 2025-11-03T03:44:29Z

Hey @tnull @tankyleo I have added the CI Job for the tests and also have updated the main function to accept in-memory flag to override the config file. Can you please review it!

tnull

Hey @tnull @tankyleo I have added the CI Job for the tests and also have updated the main function to accept in-memory flag to override the config file. Can you please review it!

Thanks, added some comments. Please also make sure that the LDK Node CI is run against the in-memory store.

rust/api/src/kv_store_tests.rs

rust/impls/Cargo.toml

rust/impls/src/in_memory_store.rs

rust/server/src/main.rs

rust/impls/src/in_memory_store.rs

tnull

Please also make sure that the LDK Node CI is run against the in-memory store.

AFAICT this is still missing the part that runs the LDK Node integration test against the in-memory store to check functionality in a realistic setting?

ldk-reviews-bot · 2025-11-05T01:55:32Z

🔔 5th Reminder

Hey @tankyleo! This PR has been waiting for your review.
Please take a look when you have a chance. If you're unable to review, please let us know so we can find another reviewer.

tnull

Right, and now you're hitting the errors that I originally found when running LDK Node against the in-memory store. Very likely, they are due to the in-memory implementation behaving in an unexpected manner. We need to fix this before this PR can get merged. Please take a look, but let me know if you end up getting stuck or need some assistance figuring this out.

ldk-reviews-bot · 2025-11-08T00:01:03Z

🔔 6th Reminder

Hey @tankyleo! This PR has been waiting for your review.
Please take a look when you have a chance. If you're unable to review, please let us know so we can find another reviewer.

Harshdev098 · 2025-11-08T09:36:32Z

Hey @tnull Have updated the code and the unit test are passing against the ldk node tests but didn't understand what is the cause of integration failures

Harshdev098 · 2025-11-09T03:53:12Z

Hey @tnull @tankyleo Have tested it locally, the test are working correctly now, don't know why its stuck in CI! Can you please review it

ldk-reviews-bot requested a review from tankyleo October 12, 2025 08:50

tnull self-requested a review October 13, 2025 07:10

tnull reviewed Oct 13, 2025

View reviewed changes

Harshdev098 force-pushed the memory_store branch 2 times, most recently from 4980a75 to 25d57e3 Compare October 14, 2025 06:16

Harshdev098 requested a review from tnull October 14, 2025 06:17

tnull reviewed Oct 14, 2025

View reviewed changes

rust/impls/src/in_memory_store.rs Show resolved Hide resolved

Harshdev098 force-pushed the memory_store branch from 25d57e3 to 9012e95 Compare October 14, 2025 12:24

Harshdev098 requested a review from tnull October 14, 2025 16:44

tnull reviewed Oct 17, 2025

View reviewed changes

rust/impls/src/in_memory_store.rs Outdated Show resolved Hide resolved

Harshdev098 force-pushed the memory_store branch from 9012e95 to 3b434d0 Compare October 17, 2025 09:14

tankyleo reviewed Oct 23, 2025

View reviewed changes

Harshdev098 force-pushed the memory_store branch from 3b434d0 to e0c31bb Compare October 26, 2025 01:51

Harshdev098 requested a review from tankyleo October 26, 2025 01:53

Harshdev098 force-pushed the memory_store branch from 8003119 to 5898609 Compare October 26, 2025 02:18

tnull reviewed Oct 27, 2025

View reviewed changes

tnull reviewed Nov 3, 2025

View reviewed changes

tnull mentioned this pull request Nov 3, 2025

Only use internal runtime in VssStore lightningdevkit/ldk-node#693

Closed

tnull reviewed Nov 3, 2025

View reviewed changes

rust/impls/src/in_memory_store.rs Outdated Show resolved Hide resolved

Harshdev098 force-pushed the memory_store branch 4 times, most recently from 2b64791 to 81ca808 Compare November 4, 2025 03:42

Harshdev098 requested a review from tnull November 4, 2025 03:45

tnull reviewed Nov 4, 2025

View reviewed changes

Harshdev098 force-pushed the memory_store branch from 81ca808 to 1f18bd8 Compare November 4, 2025 11:41

Harshdev098 force-pushed the memory_store branch 2 times, most recently from 84cfed6 to 939559f Compare November 5, 2025 03:34

tnull reviewed Nov 5, 2025

View reviewed changes

Harshdev098 force-pushed the memory_store branch 4 times, most recently from 51a791d to 0168750 Compare November 8, 2025 05:48

Harshdev098 force-pushed the memory_store branch 3 times, most recently from 92bd1e3 to bd3eca4 Compare November 9, 2025 03:41

Harshdev098 requested a review from tnull November 9, 2025 03:53

feat: Added in-memory storage for testing purposes

5351a00

Harshdev098 force-pushed the memory_store branch from bd3eca4 to 9ec0e79 Compare November 9, 2025 10:02

feat: Added CI for in_memory_testing

45fecd1

Harshdev098 force-pushed the memory_store branch from 9ec0e79 to 45fecd1 Compare November 9, 2025 10:18

feat: Added in-memory storage for testing purposes #59

Are you sure you want to change the base?

feat: Added in-memory storage for testing purposes #59

Uh oh!

Conversation

Harshdev098 commented Oct 12, 2025

Uh oh!

ldk-reviews-bot commented Oct 12, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Harshdev098 commented Oct 12, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

tnull left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Harshdev098 commented Oct 14, 2025

Uh oh!

tnull left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

ldk-reviews-bot commented Oct 14, 2025

Uh oh!

ldk-reviews-bot commented Oct 16, 2025

Uh oh!

ldk-reviews-bot commented Oct 16, 2025

Uh oh!

tnull left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Harshdev098 commented Oct 17, 2025

Uh oh!

ldk-reviews-bot commented Oct 18, 2025

Uh oh!

ldk-reviews-bot commented Oct 20, 2025

Uh oh!

ldk-reviews-bot commented Oct 22, 2025

Uh oh!

tankyleo left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Harshdev098 commented Oct 26, 2025

Uh oh!

tnull left a comment

Choose a reason for hiding this comment

Uh oh!

ldk-reviews-bot commented Oct 28, 2025

Uh oh!

ldk-reviews-bot commented Oct 30, 2025

Uh oh!

tnull commented Oct 31, 2025

Uh oh!

Harshdev098 commented Nov 3, 2025

Uh oh!

tnull left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

ldk-reviews-bot commented Oct 12, 2025 •

edited

Loading

Harshdev098 commented Oct 12, 2025 •

edited

Loading