Skip to content
#

from-scratch-in-python

Here are 15 public repositories matching this topic...

This repository explores building a character-level transformer decoder in PyTorch, similar to GPT while focusing more on understanding individual components. My goal is to gain deep transformer knowledge and see if character-level learning improves handling of unseen words. The code allows for hyperparameter tuning and experiment customization.

  • Updated Jun 17, 2024
  • Jupyter Notebook

Improve this page

Add a description, image, and links to the from-scratch-in-python topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the from-scratch-in-python topic, visit your repo's landing page and select "manage topics."

Learn more