Embodiments for graphical processing unit (GPU) resource sharing in a computing cluster, by a processor device. Resource-specific stages are dynamically generated in a directed acyclic graph (DAG) using a DAG interpreter for a set of tasks by creating equivalence stages in the DAG having an associated inserted set of shuffle stages, the equivalence stages created based on a determined cost of each stage of the set of shuffle stages. Backlog tasks are scheduled and tasks within the set of tasks are shifted among respective stages in the equivalence stages according to the determined cost to avoid overlapping allocation of the GPU resource during central processing unit (CPU) execution of the respective tasks of the set of tasks.