长琴

... →

跳至内容

首页
导览
存档
拾文
资源
好玩
观点
关注
关于

2026

LLM 强化的“炼金术”：主流开源模型的 RL 优化策略赏析

2025

GRPO优化在继续——CISPO和熵

Recents

OmniDreams：实时世界模型背后的 Self Forcing 与 DMD
想做，但可以不做：AI 时代的注意力与自由
OPD-RL 新范式：diff 出圈——从目标，到奖励，再到梯度
良渚大屋顶半日闲——阅读与休憩
从Pass@k到advantage，一场意想不到的邂逅

Categories

Coding78
Feeling170
Thinking68

Tag Cloud

AAPO ACT AE AGAPO AGI AI AI-Coding AIGC ALBERT AR ASPO AUC Accuracy Activation Activation Steering Adam Age Agent Agentic-RL AgenticRL Aha Algorithm Array Arrow Attention Automatic Speech Processing Automation BAPO BERT BIO BIOHD BM25 BPE BabyGrow Backtracking Backward Bahdanau Attention Bart Bayes Beam Search Bert-Flow Bi-LSTM Biasing BigCodec Binary Search Blending Book Brain Brain Decoding Bridge Business C C.AI C4 CARD CCG CE BERT CFG CISPO CKY CNN COPO CRF CRL CS CYK Calculus Camera Cascades Catalan ChatBot ChatGPT Chi2 Chunking Class Imbalance Loss Classification Clip CoT Codec Cognition Collaborative Filtering Collins Parser CompoundEngineering Computational Linguistics Computer Computer Science Confusing Labels Context Engineering Context Learning Context-Free Grammars Continual Pre-training Continual Pretraining Continuous Learning Contrastive-Learning Coordinate Ascent Cosine Cosine Similarity Cross Entropy Cross-brackets Cross-view Ctrl Culture DA DAC DAPO DB DCPO DELTA DLM DMD DNN DP DPO Daily Darling Data Augmentation Data Clearing Data Enhancement Data Preprocess Data Science Data Structure DataManagement Database DeBERTa Debiasing Decoder Decoding Deep DeepGen DeepGraph DeepLearning DeepScaleR DeepSeek DeepSeek-GRM DeepSeek-V3.2 DeepSeekMath-V2 DeltaNet Dependence Diary Direct-OPD Disentangled Attention DistilBERT Distillation Django Docker Docker-Compose Dockerfile Dr GRPO DrDAPO DrGRPO Dream Dropout Dynamic-Mask EDA EM EMD EMPG EMPO ERL ERNIE ETTRL EVOL-RL EXAONE Economics Edit Distance Efficient-DeepLearning Elasticsearch Electra Elixir Ellipsis Embedding Embeddings Embodied Embodied AI EmbodiedAI Encoder Entropy Evaluation Eventlet ExT5 Exam F1 FD Leak FDW FLAN FSM Faith FastCuRL Feature Engineering Feature-based Few-Shot Few-shot Prompting FiberPO Fine-tuning Flash-Attention Formal Grammars Forward Freedom Full-Text-Search Function Syntax Funk MF Funnel Transformer Future GAE GAGPO GBTD GELU GFT GLU GMPO GP GPT-1 GPT-2 GPT-3 GPT3 GPU GRM GRPO GRPOEA GRU GSG GSPO GTPO GTPO-S Gan Garden-path Gated DeltaNet GiGPO Git Global Pointer Glow Graceful Shutdown Gradient Descent Graph GraphQL Grid Grammar Growth H2O-Danube HMM HPT Hard-SVM Hinge Loss Hope Host-only HuggingLLM Human-Attention Human-in-Loop Human-in-the-Loop ICL IDE IE IQR IcePop Imbalance Data Impossible-Triangle In-Context Learning Industry Inference Inference Scaling Information Extraction Information Theory Instruct InstructGPT Instruction Following Instruction Inference Intuitor Isolation Forest ItemCF JEPA Jaccard Java Jax Job Jupyter JustGRPO K2 KAT KKT KL KS Kernel Kernel Function Kernel Method Keyword Kimi Knowledge Graph L1 LCPO LIMD LIMO LIMR LLM LLM-Colosseum LLaDA LM LOF LR LSTM Labeling Language Model LayerNorm Lexical Semantics Lexicalism Lexicalized CFG Lexicalized Grammars Life Lightning OPD Linear Algebra Linear Sturcture Linked List LinkedList Linux Listen Llama LoRA LoRA-XS Real-time Learning Logistic Regression Lucene Luong Attention MDLM MEMM MF MIO MM Fusion MOPD MR-Search MTL Machine Machine Learning Machine Translation Manacher Managemnt MarkBERT Markov Materialized Views Math Matplotlib Matrix Factorization Median MemAPO Meta Learning Meta RL Metric MiCA MiMo MiniMax Minimum Edit Distance Minkowski MoE Model Evaluation Module Monad Monkey Patch Multi-Head Attention Multi-Modal MultiModal Multitask Multiway Tree NAT NER NLG NLM NLP NLU NMT NNW NOVER NTP Naive Bayes Neo4j Network Ngram NodeJS Normalizing Flow NumPy Numba Numpy OEL OMNI OPD OPRD OPSD ORZ Occupation OmniDreams One-Shot Online Learning Online Softmax Online-DPO-R1 OpenAI OpenClaw OpenSource OpenSpec Orientation P-R PCCG PCFG PEFT PEGASUS PLM PPMI PPO PTM PageRank Palindromic Pandarallel Pandas Partial Parsing Pass@k Passion Pearson Philosophy Phrase Structure Grammar Phrase Structure Grammars Physics Planning PoS Polars Poly-OPD Pooling Position-Encoding Post-Training Post-training Postgres Pragmatic Automatic Processing Pre-Trained Pre-Training Pre-training Precision Pretrain Pretrained Pretraining ProGRPO Probabilistic Grammar Probabilistic Model Promote Prompt ProtoBERT Pruning Psychology PyPI Python QA Quant Quantization Query Queue Qwen Qwen3 Qwen3-Next R-Drop R1 R1-Zero R3 RAG RAVR REER RELU RENT RESTRAIN RFE RGR RHO RHO-1 RL RLHF RM RM-R1 RMSE RMSProp RNN ROC RP-OPSD RWD Rank RaspberryPi Raspberrypi Reading Reasoning Recall Recommendation Recursion Reduction Reformer Regex Regular Expression Reinforce++ Reinforcement Learning Relationship Extraction Representation Reqular Expressions Retrieving Reward Reward Hack RoBERTa RolePlay Rotated Sorted Array Rust SAPO SCFG SFT SGD SIS SLM SMO SQL SRN SRT STAR-LDM STEP-OPD STaR SVD++ SVM Scaling Scaling Law Seaborn Search Seed-Thinking Segmentation Selection-Inference Self Forcing Self-Attention Self-Verified Semantic Automatic Processing Semantic Similarity Senta Sentence Representation Sentence Similarity Sentence-BERT Sentiment Classification SentimentAnalysis Sentry Siamese Sigmoid SimCSE Similarity Simon Simple-Zoo Simpson Paradox Skill Skywork Reward Slide Smoothing Soft-SVM Softmax Sort Span Sparse Attention Spell Check Spurious Reward SqueezeBERT Stability Stable LM Stack Stacking Statistics Stirling Strategic StratifiedKFold Streaming String Study Style Substring Summarization Supertagging Swap System T5 TF-IDF THW TIS TRPO TRT TS3-Codec TTRL TTS Tagging Talkie TanH TensorBay Tensorflow Test Text Classification Text Generation Text Normalization TextCNN TextRank Thinking Thought TiDAR TinyLoRA Tokenizer Transformer Transformer-XL Tree Treebank Tuning Tutorial Ubuntu UniLM Unity Operation Unix Unsupervised Elicitation UserCF VAD VAPO VITS VLA Vagrant Valence Vector Semantics Verifier Virtual Network VirtualBox Visualization Viterbi Vocabulary Learning VoiceAgent Voila Voting W2NER W2S OPD WOE Web Server Multithreaded Server Wide Word2vec Work World Model XLNet XTTS Z-Score Zero-Short Zero-Shot Zero-shot ZhouZhihua Zipf Ziya antigravity attention sink bias binning context emacs few-shot ffmpeg gated attention gpt-oss harmony format jpype kanban knowledge Graph lightinfer motion node2vec oat-zero off-by-one attention orz pararun promptlog s1 skill spec ssh str trae vim vlc

Music

© 2026 hscspring All rights reserved.

Powered by Hexo

搜索

输入关键词开始搜索