decapoda-research/llama-7b-hf 的踩坑记录

使用transformers加载decapoda-research/llama-7b-hf的踩坑记录。

1. ValueError: Tokenizer class LLaMATokenizer does not exist or is not currently imported.

   解决办法：

   https://github.com/huggingface/transformers/issues/22222

   将tokenizer_config.json中LLaMATokenizer改为LlamaTokenizer。

2. RecursionError: maximum recursion depth exceeded while getting the str of an object.

   解决办法：

   https://github.com/huggingface/transformers/issues/22762

   使用tokenizer_config.json替换原本的tokenizer_config.json