Steel logistics platforms often need to split steel products into multiple waybills for transportation when handling customer orders. Less-Than-Truckload (LTL) cargo, which fails to meet the minimum load requirements of a truck, needs to be consolidated with goods from other customer orders to optimize transportation efficiency. Although previous studies had proposed some solutions for consolidation decision-making, none considered the issues of detour distance and prioritizing high-priority cargo simultaneously in consolidated shipments. Therefore, a multi-objective optimization framework for steel cargo consolidation under multiple constraints was proposed. The globally optimal cargo consolidation decisions were achieved by the framework through designing a hierarchical decision network and a representation enhancement module. Specifically, a hierarchical decision network based on Proximal Policy Optimization (PPO) was used to determine the priorities of the optimization objectives first, and then the LTL cargo was consolidated and selected on the basis of these priorities. Meanwhile, a representation enhancement module based on Graph ATtention network (GAT) was employed to represent cargo and LTL cargo information dynamically, which was then input into the decision network to maximize long-term multi-objective gains. Experimental results on a large-scale real-world cargo dataset show that compared to other online methods, the proposed method achieves a 17.3% increase in the proportion of high-priority cargo weight and a 7.8% reduction in average detour distance, with reducing the total shipping weight by 6.75% compared to the LTL cargo consolidation method that only maximizes cargo capacity. This enhances the efficiency of consolidated transportation effectively.