Yam

Feeling, Coding, Thinking

跳至内容
  • Home
  • Series
  • Archives
  • About
  • Projects
2025

从Voila看语音端到端发展

2025-05-14 •
Feeling
•
  • AI
  • OMNI
  • SLM
  • Voila

R1后范式最佳实践:Seed-Thinking和Qwen3

2025-05-01 •
Feeling
•
  • AI
  • LLM
  • NLP
  • Post-training
  • Qwen3
  • R1
  • R1-Zero
  • Seed-Thinking

Yarz-Logic:R1-Zero相关实验报告

2025-04-26 •
Feeling
•
  • AI
  • GRPO
  • LLM
  • NLP
  • Post-training
  • R1-Zero
  • RL

VAPO:基于价值方法的新突破

2025-04-19 •
Feeling
•
  • AI
  • DAPO
  • GAE
  • GRPO
  • LLM
  • NLP
  • Post-training
  • R1-Zero
  • VAPO

R1相关:R1-Zero的进一步理解和探索

2025-04-10 •
Feeling
•
  • AI
  • Aha
  • DAPO
  • Dr GRPO
  • FastCuRL
  • LLM
  • NLP
  • Post-training
  • R1-Zero
  • Simple-Zoo

异曲同工之妙的DrGRPO——DAPO几乎同时出现的又一GRPO优化!

2025-03-28 •
Feeling
•
  • AI
  • DAPO
  • DrDAPO
  • GRPO
  • LLM
  • NLP
  • Post-training

DAPO:为GRPO的锦上加四点花

2025-03-19 •
Feeling
•
  • AI
  • DAPO
  • GRPO
  • LLM
  • NLP
  • Post-training

DeepSeek R1后应用、职业与行业影响——2025年梳理

2025-03-15 •
Thinking
•
  • AI
  • Agent
  • DeepSeek
  • LLM

DeepSeek R1后LLM新范式

2025-03-15 •
Thinking
•
  • AI
  • Continual Pre-training
  • DeepScaleR
  • Inference Scaling
  • L1
  • LCPO
  • LIMD
  • LIMO
  • LIMR
  • LLM
  • NLP
  • Online-DPO-R1
  • Post-training
  • Pre-training
  • R1
  • R1-Zero
  • TTS
  • oat-zero
  • orz
  • s1

OMNI论文速览(2025)

2025-03-08 •
Feeling
•
  • AI
  • OMNI

R1相关:DPO数据选择与DPO等RL算法

2025-03-02 •
Feeling
•
  • AI
  • Continual Pre-training
  • DPO
  • LIMD
  • LLM
  • NLP
  • Online-DPO-R1
  • Post-training
  • RL

预训练:NTP和Scaling Law

2025-02-28 •
Feeling
•
  • AI
  • LLM
  • NLP
  • NTP
  • Pre-training
  • Scaling Law

LLM、强化、蒸馏讨论

2025-02-27 •
Feeling
•
  • AI
  • Distillation
  • LLM
  • NLP
  • RL

R1相关:RL数据选择与Scaling

2025-02-27 •
Feeling
•
  • AI
  • Continual Pre-training
  • KL
  • LIMR
  • LLM
  • NLP
  • ORZ
  • Post-training
  • RL
  • Scaling

R1相关:少量高质量数据SFT激活LLM推理能力

2025-02-18 •
Feeling
•
  • AI
  • Continual Pre-training
  • Inference Scaling
  • LIMO
  • LLM
  • NLP
  • Post-training
  • s1

DeepSeek R1深度技术解析及其影响

2025-02-17 •
Thinking
•
  • AI
  • Continual Pre-training
  • DeepScaleR
  • Inference Scaling
  • LIMO
  • LLM
  • NLP
  • Post-training
  • Pre-training
  • R1
  • R1-Zero
  • oat-zero
  • s1

我为什么做开源?

2025-01-12 •
Thinking
•
  • Diary
  • Dream
  • Growth
  • OpenSource

实时语音交互场景下RAG的机遇和挑战

2025-01-05 •
Feeling
•
  • AI
  • RAG
  • VoiceAgent

预训练:无处安放的躁动之心

2025-01-05 •
Feeling
•
  • AI
  • LLM
  • NLP
  • Pre-training
2024

LLM指令跟随论文速览

2024-12-31 •
Feeling
•
  • AI
  • Instruction Following
  • LLM

SLM论文速览

2024-12-31 •
Feeling
•
  • AI
  • MM Fusion
  • SLM

音频Codec论文速览

2024-12-31 •
Feeling
•
  • AI
  • Codec
  • TTS

VITS

2024-12-31 •
Feeling
•
  • AI
  • TTS
  • VITS

XTTS

2024-12-31 •
Feeling
•
  • AI
  • TTS
  • XTTS

OMNI论文速览(2024)

2024-12-31 •
Feeling
•
  • AI
  • OMNI

DAC

2024-12-30 •
Feeling
•
  • AI
  • Codec
  • DAC
  • TTS

TS3-Codec

2024-12-27 •
Feeling
•
  • AI
  • Codec
  • TS3-Codec
  • TTS

BigCodec

2024-12-26 •
Feeling
•
  • AI
  • BigCodec
  • Codec
  • TTS

关于AI前沿的思考

2024-12-20 •
Thinking
•
  • AI
  • Embodied AI
  • LLM
  • Multi-Modal

《真希望父母读过这本书》读书笔记

2024-09-30 •
Feeling
•
  • BabyGrow
  • Diary
  • Life

基础和取舍

2024-09-30 •
Thinking
•
  • Diary
  • Dream
  • Growth
  • Life

MIO

2024-09-28 •
Feeling
•
  • AI
  • MIO
  • MultiModal
  • NLP

Tiny LLM Continual Pre-training:RHO-1

2024-04-13 •
Feeling
•
  • AI
  • Continual Pre-training
  • LLM
  • NLP
  • Pre-training
  • RHO
  • RHO-1

LLM打街霸

2024-04-08 •
Coding
•
  • AI
  • LLM
  • LLM-Colosseum

LLM中的演绎推理、归纳推理和溯因推理

2024-04-06 •
Feeling
•
  • AI
  • Few-shot Prompting
  • Instruction Following
  • Instruction Inference
  • LLM
  • NLP

LLM极简科普

2024-03-16 •
Feeling
•
  • AI
  • AIGC
  • ChatGPT
  • LLM

Programming Language Environment Cheat Sheet

2024-03-06 •
Feeling
•
  • NodeJS
  • Python
  • Rust

LLM Tiny Pretrain:H2O-Danube and Stable LM

2024-02-03 •
Feeling
•
  • AI
  • H2O-Danube
  • LLM
  • NLP
  • Pre-training
  • Stable LM

LLM DataManagement:Weaver

2024-02-01 •
Feeling
•
  • AI
  • Continual Pretraining
  • DataManagement
  • LLM
  • NLP

LLM DataManagement:Ziya2

2024-01-29 •
Feeling
•
  • AI
  • Continual Pretraining
  • DataManagement
  • LLM
  • NLP
  • Ziya

LLM Continual Pre-training:Ziya2

2024-01-23 •
Feeling
•
  • AI
  • Continual Pre-training
  • LLM
  • NLP
  • Ziya
2023

【Rust与AI】LLM模型基本架构

2023-12-24 •
Thinking
•
  • AI
  • Decoding
  • LLM
  • Llama
  • Rust

【Rust与AI】概览和方向

2023-12-03 •
Thinking
•
  • AI
  • LLM
  • Rust

OpenAIGC大赛小结

2023-11-04 •
Feeling
•
  • AI
  • AIGC
  • ChatGPT
  • LLM

关于大语言模型的思考

2023-10-15 •
Thinking
•
  • AI
  • ChatGPT
  • LLM
  • NLP

ChatGPT 开发指南:Hugging LLM Hugging Future

2023-04-22 •
Thinking
•
  • AI
  • ChatGPT
  • HuggingLLM
  • LLM
  • LM
  • NLP

ChatGPT 基础科普:知其一点所以然

2023-04-15 •
Thinking
•
  • AI
  • ChatGPT
  • GPT-1
  • GPT-2
  • GPT-3
  • InstructGPT
  • LLM
  • LM
  • NLP
  • RLHF
  • Transformer

「+AI」需要什么?

2023-02-27 •
Thinking
•
  • AI
  • Business

ChatGPT 影响冲击:职业、行业与产业

2023-02-21 •
Feeling
•
  • AI
  • ChatGPT
  • NLP

ChatGPT 标注指南:任务、数据与规范

2023-02-19 •
Feeling
•
  • AI
  • ChatGPT
  • InstructGPT
  • Labeling
  • NLP
  • Prompt

ChatGPT Prompt 示例

2023-01-31 •
Feeling
•
  • AI
  • ChatGPT
  • NLP
  • Prompt

语言模型级联

2023-01-27 •
Feeling
•
  • AI
  • Cascades
  • CoT
  • NLP
  • STaR
  • Selection-Inference
  • Verifier

ChatGPT Prompt工程:设计、实践与思考

2023-01-25 •
Thinking
•
  • AI
  • ChatGPT
  • Few-Shot
  • In-Context Learning
  • Instruct
  • NLP
  • One-Shot
  • Prompt
  • Zero-Shot

Put Human in NLP Loop

2023-01-21 •
Feeling
•
  • AI
  • Human-in-Loop
  • Human-in-the-Loop
  • NLP

人生随笔

2023-01-21 •
Thinking
•
  • Diary
  • Growth
  • Life

GPT3 和它的 In-Context Learning

2023-01-20 •
Thinking
•
  • AI
  • Few-Shot
  • GPT3
  • In-Context Learning
  • NLP
  • One-Shot
  • Zero-Shot
2022

IDE Memo

2022-11-15 •
Coding
•
  • IDE
  • emacs
  • vim

W2NER解读

2022-10-30 •
Feeling
•
  • AI
  • BIO
  • BIOHD
  • NER
  • NLP
  • NNW
  • Span
  • THW
  • W2NER

《麦肯锡战略化思维》读书笔记

2022-10-23 •
Feeling
•
  • Strategic
  • Thought

Global Pointer:Novel Efficient Span-based Approach for NER

2022-10-16 •
Feeling
•
  • AI
  • Class Imbalance Loss
  • GP
  • Global Pointer
  • NER
  • NLP
  • Span

DeepGen:Diverse Search Ad Generation and Real-Time Customization

2022-10-15 •
Feeling
•
  • AI
  • DeepGen
  • NLG
  • NLP

只如初见的不只爱情

2022-09-11 •
Thinking
•
  • Diary
  • Growth
  • Life
  • Passion

FLAN:Fine-tuned Language Models are Zero-Shot Learners

2022-08-28 •
Feeling
•
  • AI
  • FLAN
  • MTL
  • NLG
  • NLP
  • Prompt
  • Zero-Shot

W2NER 代码

2022-07-17 •
Coding
•
  • AI
  • NER
  • NLP
  • NNW
  • THW
  • W2NER

跨视角大脑解码

2022-07-02 •
Feeling
•
  • AI
  • Brain
  • Brain Decoding
  • Cross-view
  • Zero-Short

统一NER为词词关系分类

2022-06-11 •
Feeling
•
  • AI
  • BIO
  • BIOHD
  • NER
  • NLP
  • NNW
  • Span
  • THW
  • W2NER

MarkBERT

2022-04-23 •
Feeling
•
  • AI
  • BERT
  • MarkBERT
  • NER
  • NLP
  • RWD

预训练模型与传统方法在排序上有啥不同?

2022-04-23 •
Feeling
•
  • AI
  • BM25
  • CE BERT
  • NLP
  • Pretrain
  • Rank

量化NLM模型的记忆力

2022-04-15 •
Feeling
•
  • AI
  • NLM
  • NLP
  • PLM

NLP预训练模型的不可能三角

2022-04-15 •
Feeling
•
  • AI
  • Impossible-Triangle
  • NLP
  • PLM

Training Data is More Valuable than You Think

2022-04-05 •
Feeling
•
  • NLP
  • QA
  • Retrieving
  • Summarization

句子表征综述

2022-03-27 •
Thinking
•
  • AI
  • NLP
  • Sentence Representation

T5:Exploring the limits of Transfer Learning with a Unified Text-to-Text Transformer

2022-03-05 •
Feeling
•
  • C4
  • MTL
  • NLP
  • T5
  • Transformer

ExT5:Towards Extreme Multi-Task Scaling for Transfer Learning

2022-02-19 •
Feeling
•
  • ExT5
  • MTL
  • NLP
  • T5
2021

《舞狮少年》观后——信念、文化与希望

2021-12-26 •
Thinking
•
  • Culture
  • Diary
  • Faith
  • Hope

Multitask Prompted Training Enables Zero-shot Task Generalization

2021-12-25 •
Coding
•
  • Multitask
  • Promote
  • Zero-shot

虚拟网络指南

2021-12-19 •
Coding
•
  • Bridge
  • CS
  • Host-only
  • NAT
  • Network
  • Virtual Network

Pretrain, Prompt and Predict, A Systematic Survey of Prompting Methods in NLP

2021-12-04 •
Feeling
•
  • NLP
  • Prompt

Data Augmentation Approaches in Natural Language Processing:A Survey

2021-11-28 •
Feeling
•
  • DA
  • Data Augmentation
  • Data Enhancement
  • NLP

Debiasing Techniques for Pre-Trained Language Models

2021-11-18 •
Feeling
•
  • Biasing
  • Debiasing
  • NLP

Python Ellipsis

2021-11-13 •
Coding
•
  • Ellipsis
  • Python

MetaICL:Learning to Learn In Context

2021-11-01 •
Feeling
•
  • Meta Learning

浅析文本分类——情感分析与自然语言处理

2021-10-27 •
Coding
•
  • AI
  • Classification
  • NLP
  • Senta
  • SentimentAnalysis
  • Text Classification

TensorBay 指南

2021-09-21 •
Coding
•
  • AI
  • NLP
  • TensorBay
  • Tensorflow
  • TextCNN

在 TextCNN 上实验 Dropout 和对比学习

2021-08-31 •
Coding
•
  • Dropout
  • R-Drop
  • SimCSE
  • TextCNN

R-Drop

2021-08-18 •
Feeling
•
  • Dropout
  • NLP
  • R-Drop

高性能数据处理

2021-08-12 •
Coding
•
  • Arrow
  • Jax
  • Numba
  • Numpy
  • Pandarallel
  • Pandas
  • Polars

Git Memo

2021-08-12 •
Coding
•
  • Git

Docker Memo

2021-08-05 •
Coding
•
  • Docker
  • Docker-Compose
  • Dockerfile

UniLM

2021-07-31 •
Feeling
•
  • BERT
  • NLP
  • Transformer
  • UniLM

通过最优转移进行词表学习:VOLT

2021-07-18 •
Feeling
•
  • BPE
  • NLP
  • NMT
  • Vocabulary Learning

简单的对比学习框架:SimCSE

2021-07-10 •
Feeling
•
  • Contrastive-Learning
  • Embedding
  • NLP
  • SimCSE

高效深度学习:让模型更小、更快、更好

2021-07-04 •
Feeling
•
  • Automation
  • DeepLearning
  • Distillation
  • Efficient-DeepLearning
  • Pruning
  • Quantization

机器之眼:树莓派摄像头

2021-07-03 •
Coding
•
  • Camera
  • RaspberryPi
  • ffmpeg
  • motion
  • vlc

Unix Cheat Sheet

2021-07-02 •
Coding
•
  • Linux
  • Raspberrypi
  • Unix

机器之脑:树莓派初使用

2021-07-01 •
Coding
•
  • RaspberryPi
  • Tutorial

预训练模型的过去、现在和未来

2021-06-20 •
Feeling
•
  • BERT
  • NLP
  • PTM
  • Pre-Trained
  • Pre-Training
  • Pretrained

Python 调用 Java

2021-06-14 •
Coding
•
  • Java
  • Python
  • jpype

对NLP预训练模型的思考

2021-06-10 •
Thinking
•
  • AI
  • NLP
  • Pretrain
  • Representation

Jupyter Notebook Cheat Sheet

2021-06-07 •
Feeling
•
  • Jupyter
  • Python

Few-Shot NER and BERT Noisy Learning:ProtoBERT Paper Note

2021-06-06 •
Feeling
•
  • BERT
  • NER
  • NLP
  • ProtoBERT
  • few-shot

Rust str 转 String

2021-06-06 •
Coding
•
  • Rust
  • String
  • str

深度探索 Bert:BERTology Paper Note

2021-05-22 •
Feeling
•
  • BERT
  • NLP

AI 工程师养成记(上)

2021-02-19 •
Thinking
•
  • AI
  • Skill

SqueezeBERT 论文笔记

2021-01-17 •
Feeling
•
  • BERT
  • NLP
  • SqueezeBERT
2020

从 Sentence-BERT 谈句子表征

2020-12-27 •
Feeling
•
  • BERT
  • Cosine Similarity
  • NLP
  • Semantic Similarity
  • Sentence Similarity
  • Sentence-BERT
  • Siamese

Bert-Flow 论文笔记

2020-12-13 •
Feeling
•
  • BERT
  • Bert-Flow
  • Glow
  • NLP
  • Normalizing Flow

NLP 表征的历史与未来

2020-12-12 •
Thinking
•
  • AI
  • NLP
  • Representation

分类与 AI

2020-11-28 •
Thinking
•
  • AI
  • Classification

GBTD + LR 论文笔记

2020-10-30 •
Coding
•
  • GBTD
  • LR
  • Recommendation

Wide and Deep Learning for Recommender System 论文笔记

2020-10-27 •
Coding
•
  • Deep
  • Recommendation
  • Wide

矩阵分解

2020-10-24 •
Coding
•
  • Funk MF
  • MF
  • Matrix Factorization
  • Recommendation
  • SVD++

协同过滤

2020-10-22 •
Coding
•
  • Collaborative Filtering
  • Cosine
  • ItemCF
  • Jaccard
  • Minkowski
  • Pearson
  • Recommendation
  • Similarity
  • UserCF

推荐系统概述

2020-10-19 •
Feeling
•
  • Embedding
  • Metric
  • Recommendation

Funnel Transformer 论文笔记

2020-10-13 •
Feeling
•
  • Funnel Transformer
  • NLP
  • Pooling
  • Self-Attention
  • Transformer

模型融合

2020-09-26 •
Coding
•
  • Blending
  • Data Science
  • Machine Learning
  • Stacking
  • StratifiedKFold
  • Voting

建模调参

2020-09-24 •
Coding
•
  • Data Preprocess
  • Data Science
  • Machine Learning
  • Model Evaluation
  • Tuning

特征工程

2020-09-21 •
Coding
•
  • Chi2
  • Data Science
  • Feature Engineering
  • IQR
  • Isolation Forest
  • LOF
  • Machine Learning
  • RFE
  • Z-Score
  • binning

EDA

2020-09-18 •
Coding
•
  • Data Science
  • EDA

Metrics

2020-09-15 •
Coding
•
  • AI
  • AUC
  • Accuracy
  • KS
  • Machine Learning
  • P-R
  • Precision
  • RMSE
  • ROC
  • Recall
  • WOE

PEGASUS 论文笔记

2020-09-13 •
Feeling
•
  • GSG
  • NLP
  • PEGASUS
  • Summarization
  • Transformer

核方法 和 SMO

2020-09-09 •
Feeling
•
  • Coordinate Ascent
  • Kernel
  • Kernel Function
  • Kernel Method
  • Machine Learning
  • SMO
  • SVM

Find First and Last Position of Element in Sorted Array (LeetCode 34)

2020-08-31 •
Coding
•
  • Binary Search

Search in Rotated Sorted Array (LeetCode 33, 81, 153)

2020-08-22 •
Coding
•
  • Binary Search
  • LinkedList
  • Rotated Sorted Array
  • Search

Swap Nodes in Paris (LeetCode 24)

2020-08-20 •
Coding
•
  • LinkedList
  • Recursion
  • Swap

Hard-SVM, Soft-SVM 和 KKT

2020-08-13 •
Feeling
•
  • Hard-SVM
  • Hinge Loss
  • KKT
  • Machine Learning
  • SVM
  • Soft-SVM

Generate Parentheses (LeetCode 22)

2020-08-12 •
Coding
•
  • Backtracking
  • Catalan
  • Recursion
  • Stirling

AI 小课堂:Activation Function

2020-07-05 •
Coding
•
  • AI
  • Activation
  • GELU
  • RELU
  • Sigmoid
  • Softmax
  • TanH

QA 小课堂:Introduction

2020-07-05 •
Coding
•
  • AI
  • Quant

DeBERTa 论文+代码笔记

2020-06-27 •
Feeling
•
  • BERT
  • DeBERTa
  • Disentangled Attention
  • EMD
  • NLP
  • Transformer

RoBERTa 论文+代码笔记

2020-06-25 •
Feeling
•
  • BERT
  • Dynamic-Mask
  • NLP
  • RoBERTa

Bart 论文+代码笔记

2020-06-13 •
Feeling
•
  • Bart
  • NLP
  • Transformer

中文分词系列一:思考分词

2020-05-13 •
Thinking
•
  • AI
  • NLP
  • Segmentation

ALBERT 论文+代码笔记

2020-05-10 •
Feeling
•
  • ALBERT
  • BERT
  • NLP

多贝里《清醒思考的艺术》读书笔记

2020-04-28 •
Feeling
•
  • Cognition
  • Psychology
  • Thought

DistilBERT 论文+代码笔记

2020-04-27 •
Feeling
•
  • BERT
  • DistilBERT
  • NLP

Transformer 代码笔记

2020-04-23 •
Feeling
•
  • Attention
  • Decoder
  • Encoder
  • Multi-Head Attention
  • NLP
  • Self-Attention
  • Transformer

Luong Attention 论文+代码笔记

2020-04-14 •
Feeling
•
  • Attention
  • Luong Attention
  • NLP

GPT-2 论文+代码笔记

2020-04-07 •
Feeling
•
  • GPT-2
  • Language Model
  • NLP
  • Transformer

Node2Vec 论文+代码笔记

2020-03-30 •
Feeling
•
  • DeepGraph
  • Graph
  • NLP
  • node2vec

TextRank Keyword Extraction 论文+代码笔记

2020-03-21 •
Feeling
•
  • Graph
  • Keyword
  • NLP
  • PageRank
  • TextRank

Reformer, The Efficient Transformer 论文笔记

2020-02-15 •
Feeling
•
  • NLP
  • Reformer
  • Transformer

Bahdanau Attention 论文笔记

2020-02-08 •
Feeling
•
  • Attention
  • Bahdanau Attention
  • NLP

Rust by Example Brief Note

2020-02-02 •
Coding
•
  • Rust

Encoder-Decoder Models Attention and Contextual Embedding Note (SLP Ch10)

2020-01-23 •
Feeling
•
  • AI
  • NLP
2019

The Rust Programming Language Brief Note (Vol2-Manage)

2019-12-31 •
Coding
•
  • Rust

The Rust Programming Language Brief Note (Vol1-Basic)

2019-12-31 •
Coding
•
  • Rust

Neural Architectures for Named Entity Recognition 论文笔记

2019-12-28 •
Feeling
•
  • Bi-LSTM
  • CRF
  • Embedding
  • NER
  • NLP

Rust Tutorial

2019-12-21 •
Coding
•
  • Rust

剑指 Offer2(Python 版)解析(Ch2)

2019-12-15 •
Coding
•
  • Algorithm
  • Data Structure
  • Python

剑指 Offer2(Python 版)解析(Ch5)

2019-12-15 •
Coding
•
  • Algorithm
  • Data Structure
  • Python

剑指 Offer2(Python 版)解析(Ch3)

2019-12-15 •
Coding
•
  • Algorithm
  • Data Structure
  • Python

剑指 Offer2(Python 版)解析(Ch4)

2019-12-15 •
Coding
•
  • Algorithm
  • Data Structure
  • Python

剑指 Offer2(Python 版)解析(Ch6)

2019-12-15 •
Coding
•
  • Algorithm
  • Data Structure
  • Python

Few-Shot Charge Prediction with Discriminative Legal Attributes 论文笔记

2019-12-15 •
Feeling
•
  • Confusing Labels
  • Few-Shot
  • Imbalance Data
  • NLP

关系提取简述

2019-12-11 •
Coding
•
  • Knowledge Graph
  • NLP
  • Relationship Extraction

AINLP GPU 使用体验指南

2019-12-09 •
Feeling
•
  • Computer
  • GPU
  • ssh

ELECTRA 论文笔记

2019-12-08 •
Feeling
•
  • Electra
  • NLP
  • Pre-training
  • Transformer

The Rust Programming Language Brief Note (Vol3-Style)

2019-12-03 •
Coding
•
  • Rust

The Rust Programming Language Brief Note (Vol4-Advance)

2019-12-03 •
Coding
•
  • Rust

The Rust Programming Language Brief Note (Vol5-Project)

2019-12-03 •
Coding
•
  • Graceful Shutdown
  • Rust
  • Web Server Multithreaded Server

自然语言记忆模块(NLM)

2019-12-02 •
Thinking
•
  • Knowledge Graph
  • NLM
  • NLP
  • Neo4j

Sort Based on Multiway Tree

2019-11-03 •
Coding
•
  • Elixir
  • Multiway Tree
  • Python
  • Sort
  • Tree

Python 小白快速从入门到放弃:使用框架

2019-10-10 •
Coding
•
  • Django
  • Python

Python 小白快速从入门到放弃:在结束后

2019-10-07 •
Coding
•
  • Python

Python 小白快速从入门到放弃:阅读源码

2019-10-06 •
Coding
•
  • Database
  • Python

Python 小白快速从入门到放弃:使用模块

2019-10-03 •
Coding
•
  • Module
  • PyPI
  • Python

Python 小白快速从入门到放弃:基础知识

2019-10-02 •
Coding
•
  • Python

CTRL 论文+代码+实践笔记

2019-09-28 •
Feeling
•
  • Ctrl
  • NLP
  • Text Generation
  • Transformer

GraphQL Elixir Glance

2019-08-24 •
Coding
•
  • Elixir
  • GraphQL

GraphQL Glance

2019-08-24 •
Coding
•
  • GraphQL
  • Query

Bert 论文笔记

2019-08-05 •
Feeling
•
  • BERT
  • Feature-based
  • Fine-tuning
  • NLP
  • Pre-training
  • Transformer

Transformer 论文笔记

2019-08-04 •
Feeling
•
  • Attention
  • NLP
  • Position-Encoding
  • Self-Attention
  • Transformer

Longest Palindromic Substring (LeetCode 5)

2019-08-03 •
Coding
•
  • DP
  • Manacher
  • Palindromic

ERNIE Tutorial(论文笔记 + 实践指南)

2019-08-02 •
Feeling
•
  • ERNIE
  • NLP
  • Pretraining

ChatBot 设计方案

2019-07-20 •
Thinking
•
  • AI
  • ChatBot
  • NLG
  • NLP
  • NLU
  • Probabilistic Model
  • knowledge Graph

Median of Two Sorted Arrays (LeetCode 4)

2019-07-18 •
Coding
•
  • Binary Search
  • Median

Statistical Parsing Note (SLP Ch14)

2019-07-17 •
Feeling
•
  • AI
  • CCG
  • Collins Parser
  • Cross-brackets
  • Formal Grammars
  • Garden-path
  • Lexicalized CFG
  • NLP
  • PCCG
  • PCFG
  • SCFG
  • Supertagging

随笔:命运

2019-07-15 •
Thinking
•
  • Diary

XLNet 论文笔记

2019-07-14 •
Feeling
•
  • AE
  • AR
  • NLP
  • Pretraining
  • Transformer-XL
  • XLNet

数据结构与算法:线性结构

2019-07-13 •
Coding
•
  • Array
  • Computer Science
  • Data Structure
  • Linear Sturcture
  • Linked List
  • Queue
  • Stack
  • String

Longest Substring Without Repeating Characters (LeetCode 3)

2019-07-13 •
Coding
•
  • Slide
  • Substring

《Elasticsearch 权威指南》之基础入门 Note(基于 7.x)

2019-07-09 •
Feeling
•
  • Elasticsearch
  • Full-Text-Search
  • Lucene
  • Search

Syntactic Parsing Note (SLP Ch13)

2019-07-08 •
Feeling
•
  • AI
  • CKY
  • CYK
  • Chunking
  • Formal Grammars
  • NLP
  • Partial Parsing

Formal Grammars of English Note (SLP Ch12)

2019-06-21 •
Feeling
•
  • AI
  • CCG
  • CFG
  • Context-Free Grammars
  • Formal Grammars
  • Lexicalized Grammars
  • NLP
  • Phrase Structure Grammars
  • Treebank

信息熵与选择:由三门问题想到的

2019-06-19 •
Thinking
•
  • Entropy
  • Information Theory

Sequence Processing with Recurrent Networks Note (SLP Ch09)

2019-06-17 •
Feeling
•
  • AI
  • GRU
  • LSTM
  • NLP
  • RNN
  • SRN

常用 DataBase 相关操作和资源

2019-06-15 •
Coding
•
  • DB
  • Postgres
  • SQL

Part-of-Speech Tagging Note (SLP Ch08)

2019-06-11 •
Feeling
•
  • AI
  • Beam Search
  • Decoding
  • HMM
  • MEMM
  • NLP
  • PoS
  • Tagging
  • Viterbi

一些关于工作的观点(From《华为工作法》)

2019-06-08 •
Feeling
•
  • Job
  • Occupation
  • Work

Neural Networks and Neural Language Models Note (SLP Ch07)

2019-05-31 •
Feeling
•
  • AI
  • DNN
  • Embeddings
  • LM
  • NLP

Vector Semantics Note (SLP Ch06)

2019-05-16 •
Feeling
•
  • AI
  • Cosine
  • Embeddings
  • Lexical Semantics
  • NLP
  • PPMI
  • TF-IDF
  • Vector Semantics
  • Word2vec

Logistic Regression Note (SLP Ch05)

2019-05-08 •
Feeling
•
  • AI
  • Cross Entropy
  • Gradient Descent
  • Logistic Regression
  • NLP
  • SGD

Naive Bayes and Sentiment Classification Note (SLP Ch04)

2019-05-05 •
Feeling
•
  • AI
  • Evaluation
  • F1
  • NLP
  • Naive Bayes
  • Sentiment Classification
  • Test

Regular Expressions, Text Normalization, and Edit Distance Note (SLP Ch02)

2019-04-22 •
Feeling
•
  • AI
  • Edit Distance
  • NLP
  • Reqular Expressions
  • Text Normalization

DataBase Foreign Data Wrapper

2019-04-21 •
Coding
•
  • DB
  • FDW
  • Materialized Views
  • Postgres
  • SQL

Python 小白快速从入门到放弃:在开始前

2019-04-10 •
Coding
•
  • Python

Information Extraction Note (SLP Ch18)

2019-04-09 •
Feeling
•
  • AI
  • IE
  • Information Extraction
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch18)

2019-04-08 •
Feeling
•
  • AI
  • NLP
  • Philosophy

自然语言计算机形式分析的理论与方法笔记(Ch17)

2019-04-08 •
Feeling
•
  • AI
  • Evaluation
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch16)

2019-04-04 •
Feeling
•
  • AI
  • Machine Translation
  • NLP

《纳博科夫最喜欢的词》读书笔记与思考

2019-03-31 •
Thinking
•
  • AI
  • Computational Linguistics
  • NLP
  • Style

自然语言计算机形式分析的理论与方法笔记(Ch15)

2019-03-29 •
Feeling
•
  • AI
  • Automatic Speech Processing
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch14)

2019-03-22 •
Feeling
•
  • AI
  • HMM
  • Markov
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch13)

2019-03-15 •
Feeling
•
  • AI
  • NLP
  • Ngram
  • Smoothing

自然语言计算机形式分析的理论与方法笔记(Ch12)

2019-03-11 •
Feeling
•
  • AI
  • Backward
  • Bayes
  • FSM
  • Forward
  • Minimum Edit Distance
  • NLP
  • Spell Check
  • Viterbi

自然语言计算机形式分析的理论与方法笔记(Ch11)

2019-03-01 •
Feeling
•
  • AI
  • NLP
  • Probabilistic Grammar

自然语言计算机形式分析的理论与方法笔记(Ch10)

2019-02-27 •
Feeling
•
  • AI
  • NLP
  • Pragmatic Automatic Processing

自然语言计算机形式分析的理论与方法笔记(Ch09)

2019-02-21 •
Feeling
•
  • AI
  • Function Syntax
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch08)

2019-02-15 •
Feeling
•
  • AI
  • NLP
  • Semantic Automatic Processing

自然语言计算机形式分析的理论与方法笔记(Ch07)

2019-01-31 •
Feeling
•
  • AI
  • Lexicalism
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch06)

2019-01-18 •
Feeling
•
  • AI
  • Grid Grammar
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch05)

2019-01-15 •
Feeling
•
  • AI
  • Dependence
  • NLP
  • Valence

自然语言计算机形式分析的理论与方法笔记(Ch04)

2019-01-09 •
Feeling
•
  • AI
  • NLP
  • Unity Operation
2018

数据结构与算法:思考排序

2018-12-31 •
Thinking
•
  • Computer Science
  • Data Structure
  • Sort

自然语言计算机形式分析的理论与方法笔记(Ch03)

2018-12-22 •
Feeling
•
  • AI
  • NLP
  • Phrase Structure Grammar

数据结构与算法:导论

2018-12-21 •
Coding
•
  • Computer Science
  • Data Structure

绘制文本分类数据

2018-12-15 •
Coding
•
  • Matplotlib
  • Python
  • Seaborn
  • Visualization

数据结构与算法:前言

2018-12-01 •
Coding
•
  • Computer Science
  • Data Structure

自然语言计算机形式分析的理论与方法笔记(Ch02)

2018-10-11 •
Feeling
•
  • AI
  • Entropy
  • NLP
  • Zipf

西蒙《人工科学》读书笔记

2018-09-30 •
Feeling
•
  • AI
  • Economics
  • Simon

自然语言计算机形式分析的理论与方法笔记(Ch01)

2018-09-19 •
Feeling
•
  • AI
  • NLP
  • Orientation

NG CNN 笔记

2018-08-14 •
Feeling
•
  • AI
  • CNN
  • DeepLearning

浙大翁恺老师《C 语言程序设计进阶》笔记

2018-07-31 •
Coding
•
  • C

NLP 与 AI

2018-07-22 •
Thinking
•
  • AI
  • NLP

2018CCF-GAIR:自然语言如何商业落地摘录及思考

2018-07-12 •
Thinking
•
  • NLP
  • System

浙大翁恺老师《程序设计入门——C语言》笔记

2018-06-20 •
Coding
•
  • C

线性代数的本质笔记

2018-05-13 •
Feeling
•
  • Linear Algebra
  • Math

微积分的本质笔记

2018-05-12 •
Feeling
•
  • Calculus
  • Math

“心有麟熙”《强化学习炼金术》系列笔记

2018-05-07 •
Coding
•
  • AI
  • Reinforcement Learning

机器学习概念

2018-04-22 •
Feeling
•
  • AI
  • Machine Learning
  • ZhouZhihua

人工智能哲学笔记

2018-04-07 •
Feeling
•
  • AI
  • Philosophy

Gan 原理、证明与实现

2018-03-26 •
Coding
•
  • AI
  • DeepLearning
  • Gan
2017

由一场供应链讲座引发的思考

2017-12-23 •
Thinking
•
  • Business
  • Industry
  • System

Language Model Note (SLP Ch03)

2017-10-14 •
Feeling
•
  • AI
  • LM
  • Language Model
  • NLP
  • Ngram
  • Smoothing

语言、AI、情感

2017-09-07 •
Thinking
•
  • AI
  • NLP

正则表达式笔记

2017-09-04 •
Coding
•
  • Python
  • Regex
  • Regular Expression

随笔:人生,当有所为有所不为

2017-08-31 •
Thinking
•
  • Diary

自然语言处理(NLP)知识地图

2017-04-09 •
Feeling
•
  • DeepLearning
  • NLP

Pandas 入门

2017-03-05 •
Coding
•
  • Data Science
  • Pandas
  • Python

Python 编码笔记整理

2017-03-05 •
Coding
•
  • Python

List, Dict, Array, Series, DataFrame 相互转换

2017-02-15 •
Coding
•
  • Data Clearing
  • Data Science
  • Python
2016

Numpy 入门

2016-09-19 •
Coding
•
  • Data Science
  • NumPy
  • Python

Ubuntu16.04 安装 VirtualBox & Vagrant 管理 VirtualBox 各种问题总结

2016-09-04 •
Feeling
•
  • Ubuntu
  • Vagrant
  • VirtualBox

辛普森悖论及其哲学思考

2016-09-03 •
Thinking
•
  • Simpson Paradox
  • Statistics

《与机器人共舞》读后感兼谈 AI 与 IA

2016-03-31 •
Thinking
•
  • AI
  • Machine

《自私的基因》读书笔记

2016-02-27 •
Feeling
•
  • Cognition
  • Psychology
2015

《管人的真理》读书笔记

2015-12-01 •
Feeling
•
  • Managemnt

《基业长青》读书笔记

2015-11-30 •
Feeling
•
  • Business
  • Managemnt

《海底捞你学不会》读书笔记

2015-11-30 •
Feeling
•
  • Business
  • Managemnt

Categories

  • Coding72
  • Feeling142
  • Thinking36

Music

Recents

  • 从Voila看语音端到端发展
  • R1后范式最佳实践:Seed-Thinking和Qwen3
  • Yarz-Logic:R1-Zero相关实验报告
  • VAPO:基于价值方法的新突破
  • R1相关:R1-Zero的进一步理解和探索

Tag Cloud

AE AI AIGC ALBERT AR AUC Accuracy Activation Agent Aha Algorithm Array Arrow Attention Automatic Speech Processing Automation BERT BIO BIOHD BM25 BPE BabyGrow Backtracking Backward Bahdanau Attention Bart Bayes Beam Search Bert-Flow Bi-LSTM Biasing BigCodec Binary Search Blending Brain Brain Decoding Bridge Business C C4 CCG CE BERT CFG CKY CNN CRF CS CYK Calculus Camera Cascades Catalan ChatBot ChatGPT Chi2 Chunking Class Imbalance Loss Classification CoT Codec Cognition Collaborative Filtering Collins Parser Computational Linguistics Computer Computer Science Confusing Labels Context-Free Grammars Continual Pre-training Continual Pretraining Contrastive-Learning Coordinate Ascent Cosine Cosine Similarity Cross Entropy Cross-brackets Cross-view Ctrl Culture DA DAC DAPO DB DNN DP DPO Data Augmentation Data Clearing Data Enhancement Data Preprocess Data Science Data Structure DataManagement Database DeBERTa Debiasing Decoder Decoding Deep DeepGen DeepGraph DeepLearning DeepScaleR DeepSeek Dependence Diary Disentangled Attention DistilBERT Distillation Django Docker Docker-Compose Dockerfile Dr GRPO DrDAPO Dream Dropout Dynamic-Mask EDA EMD ERNIE Economics Edit Distance Efficient-DeepLearning Elasticsearch Electra Elixir Ellipsis Embedding Embeddings Embodied AI Encoder Entropy Evaluation ExT5 F1 FDW FLAN FSM Faith FastCuRL Feature Engineering Feature-based Few-Shot Few-shot Prompting Fine-tuning Formal Grammars Forward Full-Text-Search Function Syntax Funk MF Funnel Transformer GAE GBTD GELU GP GPT-1 GPT-2 GPT-3 GPT3 GPU GRPO GRU GSG Gan Garden-path Git Global Pointer Glow Graceful Shutdown Gradient Descent Graph GraphQL Grid Grammar Growth H2O-Danube HMM Hard-SVM Hinge Loss Hope Host-only HuggingLLM Human-in-Loop Human-in-the-Loop IDE IE IQR Imbalance Data Impossible-Triangle In-Context Learning Industry Inference Scaling Information Extraction Information Theory Instruct InstructGPT Instruction Following Instruction Inference Isolation Forest ItemCF Jaccard Java Jax Job Jupyter KKT KL KS Kernel Kernel Function Kernel Method Keyword Knowledge Graph L1 LCPO LIMD LIMO LIMR LLM LLM-Colosseum LM LOF LR LSTM Labeling Language Model Lexical Semantics Lexicalism Lexicalized CFG Lexicalized Grammars Life Linear Algebra Linear Sturcture Linked List LinkedList Linux Llama Logistic Regression Lucene Luong Attention MEMM MF MIO MM Fusion MTL Machine Machine Learning Machine Translation Manacher Managemnt MarkBERT Markov Materialized Views Math Matplotlib Matrix Factorization Median Meta Learning Metric Minimum Edit Distance Minkowski Model Evaluation Module Multi-Head Attention Multi-Modal MultiModal Multitask Multiway Tree NAT NER NLG NLM NLP NLU NMT NNW NTP Naive Bayes Neo4j Network Ngram NodeJS Normalizing Flow NumPy Numba Numpy OMNI ORZ Occupation One-Shot Online-DPO-R1 OpenSource Orientation P-R PCCG PCFG PEGASUS PLM PPMI PTM PageRank Palindromic Pandarallel Pandas Partial Parsing Passion Pearson Philosophy Phrase Structure Grammar Phrase Structure Grammars PoS Polars Pooling Position-Encoding Post-training Postgres Pragmatic Automatic Processing Pre-Trained Pre-Training Pre-training Precision Pretrain Pretrained Pretraining Probabilistic Grammar Probabilistic Model Promote Prompt ProtoBERT Pruning Psychology PyPI Python QA Quant Quantization Query Queue Qwen3 R-Drop R1 R1-Zero RAG RELU RFE RHO RHO-1 RL RLHF RMSE RNN ROC RWD Rank RaspberryPi Raspberrypi Recall Recommendation Recursion Reformer Regex Regular Expression Reinforcement Learning Relationship Extraction Representation Reqular Expressions Retrieving RoBERTa Rotated Sorted Array Rust SCFG SGD SLM SMO SQL SRN STaR SVD++ SVM Scaling Scaling Law Seaborn Search Seed-Thinking Segmentation Selection-Inference Self-Attention Semantic Automatic Processing Semantic Similarity Senta Sentence Representation Sentence Similarity Sentence-BERT Sentiment Classification SentimentAnalysis Siamese Sigmoid SimCSE Similarity Simon Simple-Zoo Simpson Paradox Skill Slide Smoothing Soft-SVM Softmax Sort Span Spell Check SqueezeBERT Stable LM Stack Stacking Statistics Stirling Strategic StratifiedKFold String Style Substring Summarization Supertagging Swap System T5 TF-IDF THW TS3-Codec TTS Tagging TanH TensorBay Tensorflow Test Text Classification Text Generation Text Normalization TextCNN TextRank Thought Transformer Transformer-XL Tree Treebank Tuning Tutorial Ubuntu UniLM Unity Operation Unix UserCF VAPO VITS Vagrant Valence Vector Semantics Verifier Virtual Network VirtualBox Visualization Viterbi Vocabulary Learning VoiceAgent Voila Voting W2NER WOE Web Server Multithreaded Server Wide Word2vec Work XLNet XTTS Z-Score Zero-Short Zero-Shot Zero-shot ZhouZhihua Zipf Ziya binning emacs few-shot ffmpeg jpype knowledge Graph motion node2vec oat-zero orz s1 ssh str vim vlc

© 2025 hscspring All rights reserved.

Powered by Hexo