Applying to other models

[huu4ontocord]

I understand this was written for autoregressive models, but do you think you could apply it to the decoder portion of an encoder to dcoder module? Like, if the input is "What is the capital of France?" and the decoder outputs "The capital of France is" and you change the appropriate MLP to point to Rome? with the subject being France?