Yam

Feeling, Coding, Thinking

跳至内容

Home
Series
Archives
About
Projects

2020

Transformer 代码笔记

•

Attention
Decoder
Encoder
Multi-Head Attention
NLP
Self-Attention
Transformer

Luong Attention 论文+代码笔记

•

Attention
Luong Attention
NLP

Bahdanau Attention 论文笔记

•

Attention
Bahdanau Attention
NLP

2019

Transformer 论文笔记

•

Attention
NLP
Position-Encoding
Self-Attention
Transformer

Categories

Coding71
Feeling107
Thinking28

Music

Recents

关于大语言模型的思考
ChatGPT 开发指南：Hugging LLM Hugging Future
ChatGPT 基础科普：知其一点所以然
「+AI」需要什么？
ChatGPT 影响冲击：职业、行业与产业

Tag Cloud

AE AI ALBERT AR AUC Accuracy Activation Algorithm Array Arrow Attention Automatic Speech Processing Automation BERT BIO BIOHD BM25 BPE Backtracking Backward Bahdanau Attention Bart Bayes Beam Search Bert-Flow Bi-LSTM Biasing Binary Search Blending Brain Brain Decoding Bridge Business C C4 CCG CE BERT CFG CKY CNN CRF CS CYK Calculus Camera Cascades Catalan ChatBot ChatGPT Chi2 Chunking Class Imbalance Loss Classification CoT Cognition Collaborative Filtering Collins Parser Computational Linguistics Computer Computer Science Confusing Labels Context-Free Grammars Contrastive-Learning Coordinate Ascent Cosine Cosine Similarity Cross Entropy Cross-brackets Cross-view Ctrl Culture DA DB DNN DP Data Augmentation Data Clearing Data Enhancement Data Preprocess Data Science Data Structure Database DeBERTa Debiasing Decoder Decoding Deep DeepGen DeepGraph DeepLearning Dependence Diary Disentangled Attention DistilBERT Distillation Django Docker Docker-Compose Dockerfile Dropout Dynamic-Mask EDA EMD ERNIE Economics Edit Distance Efficient-DeepLearning Elasticsearch Electra Elixir Ellipsis Embedding Embeddings Encoder Entropy Evaluation ExT5 F1 FDW FLAN FSM Faith Feature Engineering Feature-based Few-Shot Fine-tuning Formal Grammars Forward Full-Text-Search Function Syntax Funk MF Funnel Transformer GBTD GELU GP GPT-1 GPT-2 GPT-3 GPT3 GPU GRU GSG Gan Garden-path Git Global Pointer Glow Graceful Shutdown Gradient Descent Graph GraphQL Grid Grammar Growth HMM Hard-SVM Hinge Loss Hope Host-only HuggingLLM Human-in-Loop Human-in-the-Loop IDE IE IQR Imbalance Data Impossible-Triangle In-Context Learning Industry Information Extraction Information Theory Instruct InstructGPT Isolation Forest ItemCF Jaccard Java Jax Job Jupyter KKT KS Kernel Kernel Function Kernel Method Keyword Knowledge Graph LLM LM LOF LR LSTM Labeling Language Model Lexical Semantics Lexicalism Lexicalized CFG Lexicalized Grammars Life Linear Algebra Linear Sturcture Linked List LinkedList Linux Logistic Regression Lucene Luong Attention MEMM MF MTL Machine Machine Learning Machine Translation Manacher Managemnt MarkBERT Markov Materialized Views Math Matplotlib Matrix Factorization Median Meta Learning Metric Minimum Edit Distance Minkowski Model Evaluation Module Multi-Head Attention Multitask Multiway Tree NAT NER NLG NLM NLP NLU NMT NNW Naive Bayes Neo4j Network Ngram Normalizing Flow NumPy Numba Numpy Occupation One-Shot Orientation P-R PCCG PCFG PEGASUS PLM PPMI PTM PageRank Palindromic Pandarallel Pandas Partial Parsing Passion Pearson Philosophy Phrase Structure Grammar Phrase Structure Grammars PoS Polars Pooling Position-Encoding Postgres Pragmatic Automatic Processing Pre-Trained Pre-Training Pre-training Precision Pretrain Pretrained Pretraining Probabilistic Grammar Probabilistic Model Promote Prompt ProtoBERT Pruning Psychology PyPI Python QA Quant Quantization Query Queue R-Drop RELU RFE RLHF RMSE RNN ROC RWD Rank RaspberryPi Raspberrypi Recall Recommendation Recursion Reformer Regex Regular Expression Reinforcement Learning Relationship Extraction Representation Reqular Expressions Retrieving RoBERTa Rotated Sorted Array Rust SCFG SGD SMO SQL SRN STaR SVD++ SVM Seaborn Search Segmentation Selection-Inference Self-Attention Semantic Automatic Processing Semantic Similarity Senta Sentence Representation Sentence Similarity Sentence-BERT Sentiment Classification SentimentAnalysis Siamese Sigmoid SimCSE Similarity Simon Simpson Paradox Skill Slide Smoothing Soft-SVM Softmax Sort Span Spell Check SqueezeBERT Stack Stacking Statistics Stirling Strategic StratifiedKFold String Style Substring Summarization Supertagging Swap System T5 TF-IDF THW Tagging TanH TensorBay Tensorflow Test Text Classification Text Generation Text Normalization TextCNN TextRank Thought Transformer Transformer-XL Tree Treebank Tuning Tutorial Ubuntu UniLM Unity Operation Unix UserCF Vagrant Valence Vector Semantics Verifier Virtual Network VirtualBox Visualization Viterbi Vocabulary Learning Voting W2NER WOE Web Server Multithreaded Server Wide Word2vec Work XLNet Z-Score Zero-Short Zero-Shot Zero-shot ZhouZhihua Zipf binning emacs few-shot ffmpeg jpype knowledge Graph motion node2vec ssh str vim vlc

© 2023 Yam All rights reserved.

Powered by Hexo