Dear kchawla,
You can take a look at this post Slurm jobs are stuck in pending, despite GPUs being idle - #11 by csul