build system: Don't (accidentally) clear the LDFLAGS when checking for libxml2 or...