Skip to content

Commit

Permalink
fix typos (#1113)
Browse files Browse the repository at this point in the history
  • Loading branch information
mdeff authored Jun 24, 2024
1 parent f200da5 commit 15c918d
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 3 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ def mistral(
rope_base: int = 10_000,
) -> TransformerDecoder:
"""
Build the decoder assoicated with the mistral model. This includes:
Build the decoder associated with the mistral model. This includes:
- Token embeddings
- num_layers number of TransformerDecoderLayer blocks
- RMS Norm layer applied to the output of the transformer
Expand Down
2 changes: 1 addition & 1 deletion torchtune/models/llama2/_component_builders.py
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ def llama2(
norm_eps: float = 1e-5,
) -> TransformerDecoder:
"""
Build the decoder assoicated with the Llama2 model. This includes:
Build the decoder associated with the Llama2 model. This includes:
- Token embeddings
- num_layers number of TransformerDecoderLayer blocks
- RMS Norm layer applied to the output of the transformer
Expand Down
2 changes: 1 addition & 1 deletion torchtune/models/mistral/_component_builders.py
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ def mistral(
rope_base: int = 10_000,
) -> TransformerDecoder:
"""
Build the decoder assoicated with the mistral model. This includes:
Build the decoder associated with the mistral model. This includes:
- Token embeddings
- num_layers number of TransformerDecoderLayer blocks
- RMS Norm layer applied to the output of the transformer
Expand Down

0 comments on commit 15c918d

Please sign in to comment.