Create a "trivial destructor if zero" trait which is true for smart pointers and optional types, and use it to avoid calling the destructor for those types when possible.