Este Q parece ter sido respondido nos comentários. Por do njsg comentário ,
LIBRARY_PATH is what you're looking for
"The value of LIBRARY_PATH is a colon-separated list of directories, [...] Linking using GCC also uses these directories when searching for ordinary libraries for the -l option (but directories specified with -L come first)."