The script already creates a .profile that runs when a user logs in. We can have that script set the LD_LIBRARY_PATH to $HOME/debug/lib along with the existing modification to the PATH.

Have the binaries extract into the intended bin directory and symlink them into the top-level debug directory.