Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fine tuning LayoutLMV3 - YAML using layers 3, 5, 7, and 11 #1495

Open
mapinusRND opened this issue Apr 3, 2024 · 0 comments
Open

Fine tuning LayoutLMV3 - YAML using layers 3, 5, 7, and 11 #1495

mapinusRND opened this issue Apr 3, 2024 · 0 comments

Comments

@mapinusRND
Copy link

Describe
Model I am using LayoutLM3:

You understood that the model is using layers 3, 5, 7, and 11, according to the cascade_layoutlmv3.yaml file.

However, in the original text, it states: "We adopt the standard practice to extract single-scale features from different Transformer layers, such as layers 4, 6, 8, and 12 of the LayoutLMv3 base model."

Is there a reason for changing the layers?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant