Lost all scarabs when applying Memory Thread

I was running Haunted Mansion with the strongbox strat (low level - T16) and had over 10 scarabs in each slot.
I applied a Memory of Trauma to Haunted Mansion and ran the thread to complete it/get to boss and completed it, ran maven invitation, completed.

Now going back to Haunted Mansion to run normal maps, all scarabs are gone.

Sad.