Yam

Feeling, Coding, Thinking

跳至内容
  • Home
  • Series
  • Archives
  • About
  • Projects
2023

ChatGPT 影响冲击:职业、行业与产业

2023-02-21 •
Feeling
•
  • AI
  • ChatGPT
  • NLP

ChatGPT 标注指南:任务、数据与规范

2023-02-19 •
Feeling
•
  • AI
  • ChatGPT
  • InstructGPT
  • Labeling
  • NLP
  • Prompt

ChatGPT Prompt 示例

2023-01-31 •
Feeling
•
  • AI
  • ChatGPT
  • NLP
  • Prompt

语言模型级联

2023-01-27 •
Feeling
•
  • AI
  • Cascades
  • CoT
  • NLP
  • STaR
  • Selection-Inference
  • Verifier

Put Human in NLP Loop

2023-01-21 •
Feeling
•
  • AI
  • Human-in-Loop
  • Human-in-the-Loop
  • NLP
2022

W2NER解读

2022-10-30 •
Feeling
•
  • AI
  • BIO
  • BIOHD
  • NER
  • NLP
  • NNW
  • Span
  • THW
  • W2NER

《麦肯锡战略化思维》读书笔记

2022-10-23 •
Feeling
•
  • Strategic
  • Thought

Global Pointer:Novel Efficient Span-based Approach for NER

2022-10-16 •
Feeling
•
  • AI
  • Class Imbalance Loss
  • GP
  • Global Pointer
  • NER
  • NLP
  • Span

DeepGen:Diverse Search Ad Generation and Real-Time Customization

2022-10-15 •
Feeling
•
  • AI
  • DeepGen
  • NLG
  • NLP

FLAN:Fine-tuned Language Models are Zero-Shot Learners

2022-08-28 •
Feeling
•
  • AI
  • FLAN
  • MTL
  • NLG
  • NLP
  • Prompt
  • Zero-Shot

跨视角大脑解码

2022-07-02 •
Feeling
•
  • AI
  • Brain
  • Brain Decoding
  • Cross-view
  • Zero-Short

统一NER为词词关系分类

2022-06-11 •
Feeling
•
  • AI
  • BIO
  • BIOHD
  • NER
  • NLP
  • NNW
  • Span
  • THW
  • W2NER

MarkBERT

2022-04-23 •
Feeling
•
  • AI
  • BERT
  • MarkBERT
  • NER
  • NLP
  • RWD

预训练模型与传统方法在排序上有啥不同?

2022-04-23 •
Feeling
•
  • AI
  • BM25
  • CE BERT
  • NLP
  • Pretrain
  • Rank

量化NLM模型的记忆力

2022-04-15 •
Feeling
•
  • AI
  • NLM
  • NLP
  • PLM

NLP预训练模型的不可能三角

2022-04-15 •
Feeling
•
  • AI
  • Impossible-Triangle
  • NLP
  • PLM

Training Data is More Valuable than You Think

2022-04-05 •
Feeling
•
  • NLP
  • QA
  • Retrieving
  • Summarization

T5:Exploring the limits of Transfer Learning with a Unified Text-to-Text Transformer

2022-03-05 •
Feeling
•
  • C4
  • MTL
  • NLP
  • T5
  • Transformer

ExT5:Towards Extreme Multi-Task Scaling for Transfer Learning

2022-02-19 •
Feeling
•
  • ExT5
  • MTL
  • NLP
  • T5
2021

Pretrain, Prompt and Predict, A Systematic Survey of Prompting Methods in NLP

2021-12-04 •
Feeling
•
  • NLP
  • Prompt

Data Augmentation Approaches in Natural Language Processing:A Survey

2021-11-28 •
Feeling
•
  • DA
  • Data Augmentation
  • Data Enhancement
  • NLP

Debiasing Techniques for Pre-Trained Language Models

2021-11-18 •
Feeling
•
  • Biasing
  • Debiasing
  • NLP

MetaICL:Learning to Learn In Context

2021-11-01 •
Feeling
•
  • Meta Learning

R-Drop

2021-08-18 •
Feeling
•
  • Dropout
  • NLP
  • R-Drop

UniLM

2021-07-31 •
Feeling
•
  • BERT
  • NLP
  • Transformer
  • UniLM

通过最优转移进行词表学习:VOLT

2021-07-18 •
Feeling
•
  • BPE
  • NLP
  • NMT
  • Vocabulary Learning

简单的对比学习框架:SimCSE

2021-07-10 •
Feeling
•
  • Contrastive-Learning
  • Embedding
  • NLP
  • SimCSE

高效深度学习:让模型更小、更快、更好

2021-07-04 •
Feeling
•
  • Automation
  • DeepLearning
  • Distillation
  • Efficient-DeepLearning
  • Pruning
  • Quantization

预训练模型的过去、现在和未来

2021-06-20 •
Feeling
•
  • BERT
  • NLP
  • PTM
  • Pre-Trained
  • Pre-Training
  • Pretrained

Jupyter Notebook Cheat Sheet

2021-06-07 •
Feeling
•
  • Jupyter
  • Python

Few-Shot NER and BERT Noisy Learning:ProtoBERT Paper Note

2021-06-06 •
Feeling
•
  • BERT
  • NER
  • NLP
  • ProtoBERT
  • few-shot

深度探索 Bert:BERTology Paper Note

2021-05-22 •
Feeling
•
  • BERT
  • NLP

SqueezeBERT 论文笔记

2021-01-17 •
Feeling
•
  • BERT
  • NLP
  • SqueezeBERT
2020

从 Sentence-BERT 谈句子表征

2020-12-27 •
Feeling
•
  • BERT
  • Cosine Similarity
  • NLP
  • Semantic Similarity
  • Sentence Similarity
  • Sentence-BERT
  • Siamese

Bert-Flow 论文笔记

2020-12-13 •
Feeling
•
  • BERT
  • Bert-Flow
  • Glow
  • NLP
  • Normalizing Flow

推荐系统概述

2020-10-19 •
Feeling
•
  • Embedding
  • Metric
  • Recommendation

Funnel Transformer 论文笔记

2020-10-13 •
Feeling
•
  • Funnel Transformer
  • NLP
  • Pooling
  • Self-Attention
  • Transformer

PEGASUS 论文笔记

2020-09-13 •
Feeling
•
  • GSG
  • NLP
  • PEGASUS
  • Summarization
  • Transformer

核方法 和 SMO

2020-09-09 •
Feeling
•
  • Coordinate Ascent
  • Kernel
  • Kernel Function
  • Kernel Method
  • Machine Learning
  • SMO
  • SVM

Hard-SVM, Soft-SVM 和 KKT

2020-08-13 •
Feeling
•
  • Hard-SVM
  • Hinge Loss
  • KKT
  • Machine Learning
  • SVM
  • Soft-SVM

DeBERTa 论文+代码笔记

2020-06-27 •
Feeling
•
  • BERT
  • DeBERTa
  • Disentangled Attention
  • EMD
  • NLP
  • Transformer

RoBERTa 论文+代码笔记

2020-06-25 •
Feeling
•
  • BERT
  • Dynamic-Mask
  • NLP
  • RoBERTa

Bart 论文+代码笔记

2020-06-13 •
Feeling
•
  • Bart
  • NLP
  • Transformer

ALBERT 论文+代码笔记

2020-05-10 •
Feeling
•
  • ALBERT
  • BERT
  • NLP

多贝里《清醒思考的艺术》读书笔记

2020-04-28 •
Feeling
•
  • Cognition
  • Psychology
  • Thought

DistilBERT 论文+代码笔记

2020-04-27 •
Feeling
•
  • BERT
  • DistilBERT
  • NLP

Transformer 代码笔记

2020-04-23 •
Feeling
•
  • Attention
  • Decoder
  • Encoder
  • Multi-Head Attention
  • NLP
  • Self-Attention
  • Transformer

Luong Attention 论文+代码笔记

2020-04-14 •
Feeling
•
  • Attention
  • Luong Attention
  • NLP

GPT-2 论文+代码笔记

2020-04-07 •
Feeling
•
  • GPT-2
  • Language Model
  • NLP
  • Transformer

Node2Vec 论文+代码笔记

2020-03-30 •
Feeling
•
  • DeepGraph
  • Graph
  • NLP
  • node2vec

TextRank Keyword Extraction 论文+代码笔记

2020-03-21 •
Feeling
•
  • Graph
  • Keyword
  • NLP
  • PageRank
  • TextRank

Reformer, The Efficient Transformer 论文笔记

2020-02-15 •
Feeling
•
  • NLP
  • Reformer
  • Transformer

Bahdanau Attention 论文笔记

2020-02-08 •
Feeling
•
  • Attention
  • Bahdanau Attention
  • NLP

Encoder-Decoder Models Attention and Contextual Embedding Note (SLP Ch10)

2020-01-23 •
Feeling
•
  • AI
  • NLP
2019

Neural Architectures for Named Entity Recognition 论文笔记

2019-12-28 •
Feeling
•
  • Bi-LSTM
  • CRF
  • Embedding
  • NER
  • NLP

Few-Shot Charge Prediction with Discriminative Legal Attributes 论文笔记

2019-12-15 •
Feeling
•
  • Confusing Labels
  • Few-Shot
  • Imbalance Data
  • NLP

AINLP GPU 使用体验指南

2019-12-09 •
Feeling
•
  • Computer
  • GPU
  • ssh

ELECTRA 论文笔记

2019-12-08 •
Feeling
•
  • Electra
  • NLP
  • Pre-training
  • Transformer

CTRL 论文+代码+实践笔记

2019-09-28 •
Feeling
•
  • Ctrl
  • NLP
  • Text Generation
  • Transformer

Bert 论文笔记

2019-08-05 •
Feeling
•
  • BERT
  • Feature-based
  • Fine-tuning
  • NLP
  • Pre-training
  • Transformer

Transformer 论文笔记

2019-08-04 •
Feeling
•
  • Attention
  • NLP
  • Position-Encoding
  • Self-Attention
  • Transformer

ERNIE Tutorial(论文笔记 + 实践指南)

2019-08-02 •
Feeling
•
  • ERNIE
  • NLP
  • Pretraining

Statistical Parsing Note (SLP Ch14)

2019-07-17 •
Feeling
•
  • AI
  • CCG
  • Collins Parser
  • Cross-brackets
  • Formal Grammars
  • Garden-path
  • Lexicalized CFG
  • NLP
  • PCCG
  • PCFG
  • SCFG
  • Supertagging

XLNet 论文笔记

2019-07-14 •
Feeling
•
  • AE
  • AR
  • NLP
  • Pretraining
  • Transformer-XL
  • XLNet

《Elasticsearch 权威指南》之基础入门 Note(基于 7.x)

2019-07-09 •
Feeling
•
  • Elasticsearch
  • Full-Text-Search
  • Lucene
  • Search

Syntactic Parsing Note (SLP Ch13)

2019-07-08 •
Feeling
•
  • AI
  • CKY
  • CYK
  • Chunking
  • Formal Grammars
  • NLP
  • Partial Parsing

Formal Grammars of English Note (SLP Ch12)

2019-06-21 •
Feeling
•
  • AI
  • CCG
  • CFG
  • Context-Free Grammars
  • Formal Grammars
  • Lexicalized Grammars
  • NLP
  • Phrase Structure Grammars
  • Treebank

Sequence Processing with Recurrent Networks Note (SLP Ch09)

2019-06-17 •
Feeling
•
  • AI
  • GRU
  • LSTM
  • NLP
  • RNN
  • SRN

Part-of-Speech Tagging Note (SLP Ch08)

2019-06-11 •
Feeling
•
  • AI
  • Beam Search
  • Decoding
  • HMM
  • MEMM
  • NLP
  • PoS
  • Tagging
  • Viterbi

一些关于工作的观点(From《华为工作法》)

2019-06-08 •
Feeling
•
  • Job
  • Occupation
  • Work

Neural Networks and Neural Language Models Note (SLP Ch07)

2019-05-31 •
Feeling
•
  • AI
  • DNN
  • Embeddings
  • LM
  • NLP

Vector Semantics Note (SLP Ch06)

2019-05-16 •
Feeling
•
  • AI
  • Cosine
  • Embeddings
  • Lexical Semantics
  • NLP
  • PPMI
  • TF-IDF
  • Vector Semantics
  • Word2vec

Logistic Regression Note (SLP Ch05)

2019-05-08 •
Feeling
•
  • AI
  • Cross Entropy
  • Gradient Descent
  • Logistic Regression
  • NLP
  • SGD

Naive Bayes and Sentiment Classification Note (SLP Ch04)

2019-05-05 •
Feeling
•
  • AI
  • Evaluation
  • F1
  • NLP
  • Naive Bayes
  • Sentiment Classification
  • Test

Regular Expressions, Text Normalization, and Edit Distance Note (SLP Ch02)

2019-04-22 •
Feeling
•
  • AI
  • Edit Distance
  • NLP
  • Reqular Expressions
  • Text Normalization

Information Extraction Note (SLP Ch18)

2019-04-09 •
Feeling
•
  • AI
  • IE
  • Information Extraction
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch18)

2019-04-08 •
Feeling
•
  • AI
  • NLP
  • Philosophy

自然语言计算机形式分析的理论与方法笔记(Ch15)

2019-03-29 •
Feeling
•
  • AI
  • Automatic Speech Processing
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch14)

2019-03-22 •
Feeling
•
  • AI
  • HMM
  • Markov
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch13)

2019-03-15 •
Feeling
•
  • AI
  • NLP
  • Ngram
  • Smoothing

自然语言计算机形式分析的理论与方法笔记(Ch12)

2019-03-11 •
Feeling
•
  • AI
  • Backward
  • Bayes
  • FSM
  • Forward
  • Minimum Edit Distance
  • NLP
  • Spell Check
  • Viterbi

自然语言计算机形式分析的理论与方法笔记(Ch11)

2019-03-01 •
Feeling
•
  • AI
  • NLP
  • Probabilistic Grammar

自然语言计算机形式分析的理论与方法笔记(Ch10)

2019-02-27 •
Feeling
•
  • AI
  • NLP
  • Pragmatic Automatic Processing

自然语言计算机形式分析的理论与方法笔记(Ch09)

2019-02-21 •
Feeling
•
  • AI
  • Function Syntax
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch08)

2019-02-15 •
Feeling
•
  • AI
  • NLP
  • Semantic Automatic Processing

自然语言计算机形式分析的理论与方法笔记(Ch07)

2019-01-31 •
Feeling
•
  • AI
  • Lexicalism
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch06)

2019-01-18 •
Feeling
•
  • AI
  • Grid Grammar
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch05)

2019-01-15 •
Feeling
•
  • AI
  • Dependence
  • NLP
  • Valence

自然语言计算机形式分析的理论与方法笔记(Ch04)

2019-01-09 •
Feeling
•
  • AI
  • NLP
  • Unity Operation
2018

自然语言计算机形式分析的理论与方法笔记(Ch03)

2018-12-22 •
Feeling
•
  • AI
  • NLP
  • Phrase Structure Grammar

自然语言计算机形式分析的理论与方法笔记(Ch02)

2018-10-11 •
Feeling
•
  • AI
  • Entropy
  • NLP
  • Zipf

西蒙《人工科学》读书笔记

2018-09-30 •
Feeling
•
  • AI
  • Economics
  • Simon

自然语言计算机形式分析的理论与方法笔记(Ch01)

2018-09-19 •
Feeling
•
  • AI
  • NLP
  • Orientation

自然语言计算机形式分析的理论与方法笔记(Ch16)

2018-09-05 •
Feeling
•
  • AI
  • Machine Translation
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch17)

2018-09-05 •
Feeling
•
  • AI
  • Evaluation
  • NLP

NG CNN 笔记

2018-08-14 •
Feeling
•
  • AI
  • CNN
  • DeepLearning

线性代数的本质笔记

2018-05-13 •
Feeling
•
  • Linear Algebra
  • Math

微积分的本质笔记

2018-05-12 •
Feeling
•
  • Calculus
  • Math

机器学习概念

2018-04-22 •
Feeling
•
  • AI
  • Machine Learning
  • ZhouZhihua

人工智能哲学笔记

2018-04-07 •
Feeling
•
  • AI
  • Philosophy
2017

Language Model Note (SLP Ch03)

2017-10-14 •
Feeling
•
  • AI
  • LM
  • Language Model
  • NLP
  • Ngram
  • Smoothing

自然语言处理(NLP)知识地图

2017-04-09 •
Feeling
•
  • DeepLearning
  • NLP
2016

Ubuntu16.04 安装 VirtualBox & Vagrant 管理 VirtualBox 各种问题总结

2016-09-04 •
Feeling
•
  • Ubuntu
  • Vagrant
  • VirtualBox

《自私的基因》读书笔记

2016-02-27 •
Feeling
•
  • Cognition
  • Psychology
2015

《管人的真理》读书笔记

2015-12-01 •
Feeling
•
  • Managemnt

《海底捞你学不会》读书笔记

2015-11-30 •
Feeling
•
  • Business
  • Managemnt

《基业长青》读书笔记

2015-11-30 •
Feeling
•
  • Business
  • Managemnt

Categories

  • Coding71
  • Feeling107
  • Thinking27

Music

Recents

  • ChatGPT 开发指南:Hugging LLM Hugging Future
  • ChatGPT 基础科普:知其一点所以然
  • 「+AI」需要什么?
  • ChatGPT 影响冲击:职业、行业与产业
  • ChatGPT 标注指南:任务、数据与规范

Tag Cloud

AE AI ALBERT AR AUC Accuracy Activation Algorithm Array Arrow Attention Automatic Speech Processing Automation BERT BIO BIOHD BM25 BPE Backtracking Backward Bahdanau Attention Bart Bayes Beam Search Bert-Flow Bi-LSTM Biasing Binary Search Blending Brain Brain Decoding Bridge Business C C4 CCG CE BERT CFG CKY CNN CRF CS CYK Calculus Camera Cascades Catalan ChatBot ChatGPT Chi2 Chunking Class Imbalance Loss Classification CoT Cognition Collaborative Filtering Collins Parser Computational Linguistics Computer Computer Science Confusing Labels Context-Free Grammars Contrastive-Learning Coordinate Ascent Cosine Cosine Similarity Cross Entropy Cross-brackets Cross-view Ctrl Culture DA DB DNN DP Data Augmentation Data Clearing Data Enhancement Data Preprocess Data Science Data Structure Database DeBERTa Debiasing Decoder Decoding Deep DeepGen DeepGraph DeepLearning Dependence Diary Disentangled Attention DistilBERT Distillation Django Docker Docker-Compose Dockerfile Dropout Dynamic-Mask EDA EMD ERNIE Economics Edit Distance Efficient-DeepLearning Elasticsearch Electra Elixir Ellipsis Embedding Embeddings Encoder Entropy Evaluation ExT5 F1 FDW FLAN FSM Faith Feature Engineering Feature-based Few-Shot Fine-tuning Formal Grammars Forward Full-Text-Search Function Syntax Funk MF Funnel Transformer GBTD GELU GP GPT-1 GPT-2 GPT-3 GPT3 GPU GRU GSG Gan Garden-path Git Global Pointer Glow Graceful Shutdown Gradient Descent Graph GraphQL Grid Grammar Growth HMM Hard-SVM Hinge Loss Hope Host-only HuggingLLM Human-in-Loop Human-in-the-Loop IDE IE IQR Imbalance Data Impossible-Triangle In-Context Learning Industry Information Extraction Information Theory Instruct InstructGPT Isolation Forest ItemCF Jaccard Java Jax Job Jupyter KKT KS Kernel Kernel Function Kernel Method Keyword Knowledge Graph LLM LM LOF LR LSTM Labeling Language Model Lexical Semantics Lexicalism Lexicalized CFG Lexicalized Grammars Life Linear Algebra Linear Sturcture Linked List LinkedList Linux Logistic Regression Lucene Luong Attention MEMM MF MTL Machine Machine Learning Machine Translation Manacher Managemnt MarkBERT Markov Materialized Views Math Matplotlib Matrix Factorization Median Meta Learning Metric Minimum Edit Distance Minkowski Model Evaluation Module Multi-Head Attention Multitask Multiway Tree NAT NER NLG NLM NLP NLU NMT NNW Naive Bayes Neo4j Network Ngram Normalizing Flow NumPy Numba Numpy Occupation One-Shot Orientation P-R PCCG PCFG PEGASUS PLM PPMI PTM PageRank Palindromic Pandarallel Pandas Partial Parsing Passion Pearson Philosophy Phrase Structure Grammar Phrase Structure Grammars PoS Polars Pooling Position-Encoding Postgres Pragmatic Automatic Processing Pre-Trained Pre-Training Pre-training Precision Pretrain Pretrained Pretraining Probabilistic Grammar Probabilistic Model Promote Prompt ProtoBERT Pruning Psychology PyPI Python QA Quant Quantization Query Queue R-Drop RELU RFE RLHF RMSE RNN ROC RWD Rank RaspberryPi Raspberrypi Recall Recommendation Recursion Reformer Regex Regular Expression Reinforcement Learning Relationship Extraction Representation Reqular Expressions Retrieving RoBERTa Rotated Sorted Array Rust SCFG SGD SMO SQL SRN STaR SVD++ SVM Seaborn Search Segmentation Selection-Inference Self-Attention Semantic Automatic Processing Semantic Similarity Senta Sentence Representation Sentence Similarity Sentence-BERT Sentiment Classification SentimentAnalysis Siamese Sigmoid SimCSE Similarity Simon Simpson Paradox Skill Slide Smoothing Soft-SVM Softmax Sort Span Spell Check SqueezeBERT Stack Stacking Statistics Stirling Strategic StratifiedKFold String Style Substring Summarization Supertagging Swap System T5 TF-IDF THW Tagging TanH TensorBay Tensorflow Test Text Classification Text Generation Text Normalization TextCNN TextRank Thought Transformer Transformer-XL Tree Treebank Tuning Tutorial Ubuntu UniLM Unity Operation Unix UserCF Vagrant Valence Vector Semantics Verifier Virtual Network VirtualBox Visualization Viterbi Vocabulary Learning Voting W2NER WOE Web Server Multithreaded Server Wide Word2vec Work XLNet Z-Score Zero-Short Zero-Shot Zero-shot ZhouZhihua Zipf binning emacs few-shot ffmpeg jpype knowledge Graph motion node2vec ssh str vim vlc

© 2023 Yam All rights reserved.

Powered by Hexo