Skip to content
This repository was archived by the owner on Jun 17, 2025. It is now read-only.
This repository was archived by the owner on Jun 17, 2025. It is now read-only.

Calculating weights for Gradient Blending for new datasets #133

@AntiLibrary5

Description

@AntiLibrary5

Hi,
Are there any additional resources about calculating the normalizing constants for the blending weights from a practical implementation point of view apart from the literature (what makes training multi-modal classification networks hard?).

The weights for the datasets used are given : https://github.com/facebookresearch/VMZ/blob/master/c2/tutorials/gradient_blending.md
But I couldn't find any code where their calculation is implemented.

But more importantly how to find them for a new dataset? The proof of the proposition for gradient blending is not helpful in this regard. Also going through the repo, they are considered an argument:

return model_builder.build_model(

in the "add_weighted_loss()" method and I couldn't find any helper functions which might have been used to calculate them.

Thank you for your response.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions