Yam

Feeling, Coding, Thinking

跳至内容

Home
Series
Archives
About
Projects

2020

Transformer 代码笔记

•

Attention
Decoder
Encoder
Multi-Head Attention
NLP
Self-Attention
Transformer

Luong Attention 论文+代码笔记

•

Attention
Luong Attention
NLP

Bahdanau Attention 论文笔记

•

Attention
Bahdanau Attention
NLP

2019

Transformer 论文笔记

•

Attention
NLP
Position-Encoding
Self-Attention
Transformer

Categories

Coding73
Feeling145
Thinking37

Music

Recents

激活诱导LLM指令跟随
60小时备考高架擦边过经验
指令跟随近期工作梳理（2025年上半年）
GRPO优化在继续——CISPO和熵
Reward Model建模

Tag Cloud

AE AI AIGC ALBERT AR AUC Accuracy Activation Activation Steering Agent Aha Algorithm Array Arrow Attention Automatic Speech Processing Automation BERT BIO BIOHD BM25 BPE BabyGrow Backtracking Backward Bahdanau Attention Bart Bayes Beam Search Bert-Flow Bi-LSTM Biasing BigCodec Binary Search Blending Brain Brain Decoding Bridge Business C C4 CCG CE BERT CFG CISPO CKY CNN CRF CS CYK Calculus Camera Cascades Catalan ChatBot ChatGPT Chi2 Chunking Class Imbalance Loss Classification CoT Codec Cognition Collaborative Filtering Collins Parser Computational Linguistics Computer Computer Science Confusing Labels Context-Free Grammars Continual Pre-training Continual Pretraining Contrastive-Learning Coordinate Ascent Cosine Cosine Similarity Cross Entropy Cross-brackets Cross-view Ctrl Culture DA DAC DAPO DB DNN DP DPO Data Augmentation Data Clearing Data Enhancement Data Preprocess Data Science Data Structure DataManagement Database DeBERTa Debiasing Decoder Decoding Deep DeepGen DeepGraph DeepLearning DeepScaleR DeepSeek DeepSeek-GRM Dependence Diary Disentangled Attention DistilBERT Distillation Django Docker Docker-Compose Dockerfile Dr GRPO DrDAPO Dream Dropout Dynamic-Mask EDA EMD ERNIE Economics Edit Distance Efficient-DeepLearning Elasticsearch Electra Elixir Ellipsis Embedding Embeddings Embodied AI Encoder Entropy Evaluation ExT5 Exam F1 FDW FLAN FSM Faith FastCuRL Feature Engineering Feature-based Few-Shot Few-shot Prompting Fine-tuning Formal Grammars Forward Full-Text-Search Function Syntax Funk MF Funnel Transformer GAE GBTD GELU GP GPT-1 GPT-2 GPT-3 GPT3 GPU GRM GRPO GRU GSG Gan Garden-path Git Global Pointer Glow Graceful Shutdown Gradient Descent Graph GraphQL Grid Grammar Growth H2O-Danube HMM Hard-SVM Hinge Loss Hope Host-only HuggingLLM Human-in-Loop Human-in-the-Loop IDE IE IQR Imbalance Data Impossible-Triangle In-Context Learning Industry Inference Scaling Information Extraction Information Theory Instruct InstructGPT Instruction Following Instruction Inference Isolation Forest ItemCF Jaccard Java Jax Job Jupyter KKT KL KS Kernel Kernel Function Kernel Method Keyword Knowledge Graph L1 LCPO LIMD LIMO LIMR LLM LLM-Colosseum LM LOF LR LSTM Labeling Language Model Lexical Semantics Lexicalism Lexicalized CFG Lexicalized Grammars Life Linear Algebra Linear Sturcture Linked List LinkedList Linux Llama Logistic Regression Lucene Luong Attention MEMM MF MIO MM Fusion MTL Machine Machine Learning Machine Translation Manacher Managemnt MarkBERT Markov Materialized Views Math Matplotlib Matrix Factorization Median Meta Learning Metric Minimum Edit Distance Minkowski Model Evaluation Module Multi-Head Attention Multi-Modal MultiModal Multitask Multiway Tree NAT NER NLG NLM NLP NLU NMT NNW NTP Naive Bayes Neo4j Network Ngram NodeJS Normalizing Flow NumPy Numba Numpy OMNI ORZ Occupation One-Shot Online-DPO-R1 OpenSource Orientation P-R PCCG PCFG PEGASUS PLM PPMI PTM PageRank Palindromic Pandarallel Pandas Partial Parsing Passion Pearson Philosophy Phrase Structure Grammar Phrase Structure Grammars PoS Polars Pooling Position-Encoding Post-training Postgres Pragmatic Automatic Processing Pre-Trained Pre-Training Pre-training Precision Pretrain Pretrained Pretraining Probabilistic Grammar Probabilistic Model Promote Prompt ProtoBERT Pruning Psychology PyPI Python QA Quant Quantization Query Queue Qwen3 R-Drop R1 R1-Zero RAG RELU RFE RHO RHO-1 RL RLHF RM RM-R1 RMSE RNN ROC RWD Rank RaspberryPi Raspberrypi Recall Recommendation Recursion Reformer Regex Regular Expression Reinforcement Learning Relationship Extraction Representation Reqular Expressions Retrieving RoBERTa Rotated Sorted Array Rust SCFG SGD SLM SMO SQL SRN STaR SVD++ SVM Scaling Scaling Law Seaborn Search Seed-Thinking Segmentation Selection-Inference Self-Attention Semantic Automatic Processing Semantic Similarity Senta Sentence Representation Sentence Similarity Sentence-BERT Sentiment Classification SentimentAnalysis Siamese Sigmoid SimCSE Similarity Simon Simple-Zoo Simpson Paradox Skill Slide Smoothing Soft-SVM Softmax Sort Span Spell Check SqueezeBERT Stable LM Stack Stacking Statistics Stirling Strategic StratifiedKFold String Style Substring Summarization Supertagging Swap System T5 TF-IDF THW TS3-Codec TTRL TTS Tagging TanH TensorBay Tensorflow Test Text Classification Text Generation Text Normalization TextCNN TextRank Thought Transformer Transformer-XL Tree Treebank Tuning Tutorial Ubuntu UniLM Unity Operation Unix UserCF VAPO VITS Vagrant Valence Vector Semantics Verifier Virtual Network VirtualBox Visualization Viterbi Vocabulary Learning VoiceAgent Voila Voting W2NER WOE Web Server Multithreaded Server Wide Word2vec Work XLNet XTTS Z-Score Zero-Short Zero-Shot Zero-shot ZhouZhihua Zipf Ziya binning emacs few-shot ffmpeg jpype knowledge Graph motion node2vec oat-zero orz s1 ssh str vim vlc

© 2025 hscspring All rights reserved.

Powered by Hexo