Hugging Face Transformers and Meta Llama

Hugging Face Transformers and Meta Llama

  • [1. Transformers](#1. Transformers)
    • [1.1. `src/transformers/models`](#1.1. src/transformers/models)
    • [1.2. `src/transformers/models/llama`](#1.2. src/transformers/models/llama)
  • [2. Meta Llama](#2. Meta Llama)
    • [2.1. Llama 3](#2.1. Llama 3)
    • [2.2. Llama 2](#2.2. Llama 2)
    • [2.3. Llama Cookbook: The Official Guide to building with Llama Models](#2.3. Llama Cookbook: The Official Guide to building with Llama Models)
  • References

Hugging Face
https://github.com/huggingface

1. Transformers

https://github.com/huggingface/transformers

State-of-the-art Machine Learning for JAX, PyTorch and TensorFlow

1.1. src/transformers/models

https://github.com/huggingface/transformers/tree/main/src/transformers/models

1.2. src/transformers/models/llama

https://github.com/huggingface/transformers/tree/main/src/transformers/models/llama

https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/configuration_llama.py

https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/modeling_llama.py

2. Meta Llama

https://github.com/meta-llama

2.1. Llama 3

https://github.com/meta-llama/llama3

This repository is a minimal example of loading Llama 3 models and running inference.

2.2. Llama 2

https://github.com/meta-llama/llama

This repository is intended as a minimal example to load Llama 2 models and run inference.

2.3. Llama Cookbook: The Official Guide to building with Llama Models

https://github.com/meta-llama/llama-cookbook

Welcome to the official repository for helping you get started with inference, fine-tuning and end-to-end use-cases of building with the Llama Model family.

References

[1] Yongqiang Cheng, https://yongqiang.blog.csdn.net/

[2] huggingface/gguf, https://github.com/huggingface/huggingface.js/tree/main/packages/gguf

相关推荐
诸神缄默不语10 天前
Re78 读论文:GPT-4 Technical Report
chatgpt·llm·论文·openai·transformers·大规模预训练语言模型·gpt-4
养一只Trapped_beast10 天前
pip install transformers教程
pip·transformers
NLP工程化1 个月前
LLM模型的generate和chat函数区别
llm·chat·transformers·generate
HuggingFace2 个月前
开源开发者指南:欧盟《人工智能法案》解读
hugging face
obullxl2 个月前
Transformers 框架 Pipeline 任务详解:文本转音频(text-to-audio 或 text-to-speech)
人工智能·ai·pipeline·transformers·文本转音频
money05343 个月前
XLA中生成Causal Mask上三角-inf矩阵
pytorch·线性代数·矩阵·transformers·xla
obullxl3 个月前
深入解析 Transformers 框架(四):Qwen2.5/GPT 分词流程与 BPE 分词算法技术细节详解
人工智能·gpt·ai·transformers·qwen2.5·bpe
HuggingFace3 个月前
为数据集而生的 SQL 控制台
hugging face·sql sonsole
HuggingFace3 个月前
Hugging Face 与 TruffleHog 合作,实现风险预警
hugging face·trufflehog