High-quality image registration is the basis of multimodal fusion in the field of industrial welds. Due to the influence of contrast, scale, and illumination, the registration accuracy and robustness of existing algorithms are not high enough for the industrial weld field, and registration performance still needs further improvement. In this case, we propose a hybrid double branch image registration (HDBR) algorithm for multisource images, which has a parallel composite structure. The experimental result demonstrates that compared with the radiation invariant feature transformation and histogram of absolute phase consistency gradients algorithms, HDBR algorithm has higher matching accuracy and lower registration loss, and the registration performance is improved by 1.12% and 15.55%. The composite structure registration algorithm we proposed is mainly applied to the multiview weld image field, and finally high-quality multiview weld data set is obtained.