Yam

Feeling, Coding, Thinking

跳至内容
  • Home
  • Series
  • Archives
  • About
  • Projects
2022

W2NER 代码

2022-07-17 •
Coding
•
  • AI
  • NER
  • NLP
  • NNW
  • THW
  • W2NER

统一NER为词词关系分类

2022-06-11 •
Feeling
•
  • AI
  • BIO
  • BIOHD
  • NER
  • NLP
  • NNW
  • Span
  • THW
  • W2NER

预训练模型与传统方法在排序上有啥不同?

2022-04-23 •
Feeling
•
  • AI
  • BM25
  • CE BERT
  • NLP
  • Pretrain
  • Rank

MarkBERT

2022-04-23 •
Feeling
•
  • AI
  • BERT
  • MarkBERT
  • NER
  • NLP
  • RWD

量化NLM模型的记忆力

2022-04-15 •
Feeling
•
  • AI
  • NLM
  • NLP
  • PLM

NLP预训练模型的不可能三角

2022-04-15 •
Feeling
•
  • AI
  • Impossible-Triangle
  • NLP
  • PLM

Training Data is More Valuable than You Think

2022-04-05 •
Feeling
•
  • NLP
  • QA
  • Retrieving
  • Summarization

句子表征综述

2022-03-27 •
Thinking
•
  • AI
  • NLP
  • Sentence Representation

T5:Exploring the limits of Transfer Learning with a Unified Text-to-Text Transformer

2022-03-05 •
Feeling
•
  • C4
  • MTL
  • NLP
  • T5
  • Transformer

ExT5:Towards Extreme Multi-Task Scaling for Transfer Learning

2022-02-19 •
Feeling
•
  • ExT5
  • MTL
  • NLP
  • T5
2021

Pretrain, Prompt and Predict, A Systematic Survey of Prompting Methods in NLP

2021-12-04 •
Feeling
•
  • NLP
  • Prompt

Data Augmentation Approaches in Natural Language Processing:A Survey

2021-11-28 •
Feeling
•
  • DA
  • Data Augmentation
  • Data Enhancement
  • NLP

Debiasing Techniques for Pre-Trained Language Models

2021-11-18 •
Feeling
•
  • Biasing
  • Debiasing
  • NLP

浅析文本分类——情感分析与自然语言处理

2021-10-27 •
Coding
•
  • AI
  • Classification
  • NLP
  • Senta
  • SentimentAnalysis
  • Text Classification

TensorBay 指南

2021-09-21 •
Coding
•
  • AI
  • NLP
  • TensorBay
  • Tensorflow
  • TextCNN

R-Drop

2021-08-18 •
Feeling
•
  • Dropout
  • NLP
  • R-Drop

UniLM

2021-07-31 •
Feeling
•
  • BERT
  • NLP
  • Transformer
  • UniLM

通过最优转移进行词表学习:VOLT

2021-07-18 •
Feeling
•
  • BPE
  • NLP
  • NMT
  • Vocabulary Learning

简单的对比学习框架:SimCSE

2021-07-10 •
Feeling
•
  • Contrastive-Learning
  • Embedding
  • NLP
  • SimCSE

预训练模型的过去、现在和未来

2021-06-20 •
Feeling
•
  • BERT
  • NLP
  • PTM
  • Pre-Trained
  • Pre-Training
  • Pretrained

对NLP预训练模型的思考

2021-06-10 •
Thinking
•
  • AI
  • NLP
  • Pretrain
  • Representation

Few-Shot NER and BERT Noisy Learning:ProtoBERT Paper Note

2021-06-06 •
Feeling
•
  • BERT
  • NER
  • NLP
  • ProtoBERT
  • few-shot

深度探索 Bert:BERTology Paper Note

2021-05-22 •
Feeling
•
  • BERT
  • NLP

SqueezeBERT 论文笔记

2021-01-17 •
Feeling
•
  • BERT
  • NLP
  • SqueezeBERT
2020

从 Sentence-BERT 谈句子表征

2020-12-27 •
Feeling
•
  • BERT
  • Cosine Similarity
  • NLP
  • Semantic Similarity
  • Sentence Similarity
  • Sentence-BERT
  • Siamese

Bert-Flow 论文笔记

2020-12-13 •
Feeling
•
  • BERT
  • Bert-Flow
  • Glow
  • NLP
  • Normalizing Flow

NLP 表征的历史与未来

2020-12-12 •
Thinking
•
  • AI
  • NLP
  • Representation

Funnel Transformer 论文笔记

2020-10-13 •
Feeling
•
  • Funnel Transformer
  • NLP
  • Pooling
  • Self-Attention
  • Transformer

PEGASUS 论文笔记

2020-09-13 •
Feeling
•
  • GSG
  • NLP
  • PEGASUS
  • Summarization
  • Transformer

DeBERTa 论文+代码笔记

2020-06-27 •
Feeling
•
  • BERT
  • DeBERTa
  • Disentangled Attention
  • EMD
  • NLP
  • Transformer

RoBERTa 论文+代码笔记

2020-06-25 •
Feeling
•
  • BERT
  • Dynamic-Mask
  • NLP
  • RoBERTa

Bart 论文+代码笔记

2020-06-13 •
Feeling
•
  • Bart
  • NLP
  • Transformer

中文分词系列一:思考分词

2020-05-13 •
Thinking
•
  • AI
  • NLP
  • Segmentation

ALBERT 论文+代码笔记

2020-05-10 •
Feeling
•
  • ALBERT
  • BERT
  • NLP

DistilBERT 论文+代码笔记

2020-04-27 •
Feeling
•
  • BERT
  • DistilBERT
  • NLP

Transformer 代码笔记

2020-04-23 •
Feeling
•
  • Attention
  • Decoder
  • Encoder
  • Multi-Head Attention
  • NLP
  • Self-Attention
  • Transformer

Luong Attention 论文+代码笔记

2020-04-14 •
Feeling
•
  • Attention
  • Luong Attention
  • NLP

GPT-2 论文+代码笔记

2020-04-07 •
Feeling
•
  • GPT-2
  • Language Model
  • NLP
  • Transformer

Node2Vec 论文+代码笔记

2020-03-30 •
Feeling
•
  • DeepGraph
  • Graph
  • NLP
  • node2vec

TextRank Keyword Extraction 论文+代码笔记

2020-03-21 •
Feeling
•
  • Graph
  • Keyword
  • NLP
  • PageRank
  • TextRank

Reformer, The Efficient Transformer 论文笔记

2020-02-15 •
Feeling
•
  • NLP
  • Reformer
  • Transformer

Bahdanau Attention 论文笔记

2020-02-08 •
Feeling
•
  • Attention
  • Bahdanau Attention
  • NLP

Encoder-Decoder Models Attention and Contextual Embedding Note (SLP Ch10)

2020-01-23 •
Feeling
•
  • AI
  • NLP
2019

Neural Architectures for Named Entity Recognition 论文笔记

2019-12-28 •
Feeling
•
  • Bi-LSTM
  • CRF
  • Embedding
  • NER
  • NLP

Few-Shot Charge Prediction with Discriminative Legal Attributes 论文笔记

2019-12-15 •
Feeling
•
  • Confusing Labels
  • Few-Shot
  • Imbalance Data
  • NLP

关系提取简述

2019-12-11 •
Coding
•
  • Knowledge Graph
  • NLP
  • Relationship Extraction

ELECTRA 论文笔记

2019-12-08 •
Feeling
•
  • Electra
  • NLP
  • Pre-training
  • Transformer

自然语言记忆模块(NLM)

2019-12-02 •
Thinking
•
  • Knowledge Graph
  • NLM
  • NLP
  • Neo4j

CTRL 论文+代码+实践笔记

2019-09-28 •
Feeling
•
  • Ctrl
  • NLP
  • Text Generation
  • Transformer

Bert 论文笔记

2019-08-05 •
Feeling
•
  • BERT
  • Feature-based
  • Fine-tuning
  • NLP
  • Pre-training
  • Transformer

Transformer 论文笔记

2019-08-04 •
Feeling
•
  • Attention
  • NLP
  • Position-Encoding
  • Self-Attention
  • Transformer

ERNIE Tutorial(论文笔记 + 实践指南)

2019-08-02 •
Feeling
•
  • ERNIE
  • NLP
  • Pretraining

ChatBot 设计方案

2019-07-20 •
Thinking
•
  • AI
  • ChatBot
  • NLG
  • NLP
  • NLU
  • Probabilistic Model
  • knowledge Graph

Statistical Parsing Note (SLP Ch14)

2019-07-17 •
Feeling
•
  • AI
  • CCG
  • Collins Parser
  • Cross-brackets
  • Formal Grammars
  • Garden-path
  • Lexicalized CFG
  • NLP
  • PCCG
  • PCFG
  • SCFG
  • Supertagging

XLNet 论文笔记

2019-07-14 •
Feeling
•
  • AE
  • AR
  • NLP
  • Pretraining
  • Transformer-XL
  • XLNet

Syntactic Parsing Note (SLP Ch13)

2019-07-08 •
Feeling
•
  • AI
  • CKY
  • CYK
  • Chunking
  • Formal Grammars
  • NLP
  • Partial Parsing

Formal Grammars of English Note (SLP Ch12)

2019-06-21 •
Feeling
•
  • AI
  • CCG
  • CFG
  • Context-Free Grammars
  • Formal Grammars
  • Lexicalized Grammars
  • NLP
  • Phrase Structure Grammars
  • Treebank

Sequence Processing with Recurrent Networks Note (SLP Ch09)

2019-06-17 •
Feeling
•
  • AI
  • GRU
  • LSTM
  • NLP
  • RNN
  • SRN

Part-of-Speech Tagging Note (SLP Ch08)

2019-06-11 •
Feeling
•
  • AI
  • Beam Search
  • Decoding
  • HMM
  • MEMM
  • NLP
  • PoS
  • Tagging
  • Viterbi

Neural Networks and Neural Language Models Note (SLP Ch07)

2019-05-31 •
Feeling
•
  • AI
  • DNN
  • Embeddings
  • LM
  • NLP

Vector Semantics Note (SLP Ch06)

2019-05-16 •
Feeling
•
  • AI
  • Cosine
  • Embeddings
  • Lexical Semantics
  • NLP
  • PPMI
  • TF-IDF
  • Vector Semantics
  • Word2vec

Logistic Regression Note (SLP Ch05)

2019-05-08 •
Feeling
•
  • AI
  • Cross Entropy
  • Gradient Descent
  • Logistic Regression
  • NLP
  • SGD

Naive Bayes and Sentiment Classification Note (SLP Ch04)

2019-05-05 •
Feeling
•
  • AI
  • Evaluation
  • F1
  • NLP
  • Naive Bayes
  • Sentiment Classification
  • Test

Regular Expressions, Text Normalization, and Edit Distance Note (SLP Ch02)

2019-04-22 •
Feeling
•
  • AI
  • Edit Distance
  • NLP
  • Reqular Expressions
  • Text Normalization

Information Extraction Note (SLP Ch18)

2019-04-09 •
Feeling
•
  • AI
  • IE
  • Information Extraction
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch18)

2019-04-08 •
Feeling
•
  • AI
  • NLP
  • Philosophy

《纳博科夫最喜欢的词》读书笔记与思考

2019-03-31 •
Thinking
•
  • AI
  • Computational Linguistics
  • NLP
  • Style

自然语言计算机形式分析的理论与方法笔记(Ch15)

2019-03-29 •
Feeling
•
  • AI
  • Automatic Speech Processing
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch14)

2019-03-22 •
Feeling
•
  • AI
  • HMM
  • Markov
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch13)

2019-03-15 •
Feeling
•
  • AI
  • NLP
  • Ngram
  • Smoothing

自然语言计算机形式分析的理论与方法笔记(Ch12)

2019-03-11 •
Feeling
•
  • AI
  • Backward
  • Bayes
  • FSM
  • Forward
  • Minimum Edit Distance
  • NLP
  • Spell Check
  • Viterbi

自然语言计算机形式分析的理论与方法笔记(Ch11)

2019-03-01 •
Feeling
•
  • AI
  • NLP
  • Probabilistic Grammar

自然语言计算机形式分析的理论与方法笔记(Ch10)

2019-02-27 •
Feeling
•
  • AI
  • NLP
  • Pragmatic Automatic Processing

自然语言计算机形式分析的理论与方法笔记(Ch09)

2019-02-21 •
Feeling
•
  • AI
  • Function Syntax
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch08)

2019-02-15 •
Feeling
•
  • AI
  • NLP
  • Semantic Automatic Processing

自然语言计算机形式分析的理论与方法笔记(Ch07)

2019-01-31 •
Feeling
•
  • AI
  • Lexicalism
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch06)

2019-01-18 •
Feeling
•
  • AI
  • Grid Grammar
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch05)

2019-01-15 •
Feeling
•
  • AI
  • Dependence
  • NLP
  • Valence

自然语言计算机形式分析的理论与方法笔记(Ch04)

2019-01-09 •
Feeling
•
  • AI
  • NLP
  • Unity Operation
2018

自然语言计算机形式分析的理论与方法笔记(Ch03)

2018-12-22 •
Feeling
•
  • AI
  • NLP
  • Phrase Structure Grammar

自然语言计算机形式分析的理论与方法笔记(Ch02)

2018-10-11 •
Feeling
•
  • AI
  • Entropy
  • NLP
  • Zipf

自然语言计算机形式分析的理论与方法笔记(Ch01)

2018-09-19 •
Feeling
•
  • AI
  • NLP
  • Orientation

自然语言计算机形式分析的理论与方法笔记(Ch16)

2018-09-05 •
Feeling
•
  • AI
  • Machine Translation
  • NLP

自然语言计算机形式分析的理论与方法笔记(Ch17)

2018-09-05 •
Feeling
•
  • AI
  • Evaluation
  • NLP

NLP 与 AI

2018-07-22 •
Thinking
•
  • AI
  • NLP

2018CCF-GAIR:自然语言如何商业落地摘录及思考

2018-07-12 •
Thinking
•
  • NLP
  • System
2017

Language Model Note (SLP Ch03)

2017-10-14 •
Feeling
•
  • AI
  • LM
  • Language Model
  • NLP
  • Ngram
  • Smoothing

语言、AI、情感

2017-09-07 •
Thinking
•
  • AI
  • NLP

自然语言处理(NLP)知识地图

2017-04-09 •
Feeling
•
  • DeepLearning
  • NLP

Categories

  • Coding70
  • Feeling97
  • Thinking20

Music

Recents

  • W2NER 代码
  • 跨视角大脑解码
  • 统一NER为词词关系分类
  • 预训练模型与传统方法在排序上有啥不同?
  • MarkBERT

Tag Cloud

AE AI ALBERT AR AUC Accuracy Activation Algorithm Array Arrow Attention Automatic Speech Processing Automation BERT BIO BIOHD BM25 BPE Backtracking Backward Bahdanau Attention Bart Bayes Beam Search Bert-Flow Bi-LSTM Biasing Binary Search Blending Brain Brain Decoding Bridge Business C C4 CCG CE BERT CFG CKY CNN CRF CS CYK Calculus Camera Catalan ChatBot Chi2 Chunking Classification Cognition Collaborative Filtering Collins Parser Computational Linguistics Computer Computer Science Confusing Labels Context-Free Grammars Contrastive-Learning Coordinate Ascent Cosine Cosine Similarity Cross Entropy Cross-brackets Cross-view Ctrl Culture DA DB DNN DP Data Augmentation Data Clearing Data Enhancement Data Preprocess Data Science Data Structure Database DeBERTa Debiasing Decoder Decoding Deep DeepGraph DeepLearning Dependence Diary Disentangled Attention DistilBERT Distillation Django Docker Docker-Compose Dockerfile Dropout Dynamic-Mask EDA EMD ERNIE Economics Edit Distance Efficient-DeepLearning Elasticsearch Electra Elixir Ellipsis Embedding Embeddings Encoder Entropy Evaluation ExT5 F1 FDW FSM Faith Feature Engineering Feature-based Few-Shot Fine-tuning Formal Grammars Forward Full-Text-Search Function Syntax Funk MF Funnel Transformer GBTD GELU GPT-2 GPU GRU GSG Gan Garden-path Git Glow Graceful Shutdown Gradient Descent Graph GraphQL Grid Grammar HMM Hard-SVM Hinge Loss Hope Host-only IE IQR Imbalance Data Impossible-Triangle Industry Information Extraction Information Theory Isolation Forest ItemCF Jaccard Java Jax Job Jupyter KKT KS Kernel Kernel Function Kernel Method Keyword Knowledge Graph LM LOF LR LSTM Language Model Lexical Semantics Lexicalism Lexicalized CFG Lexicalized Grammars Linear Algebra Linear Sturcture Linked List LinkedList Linux Logistic Regression Lucene Luong Attention MEMM MF MTL Machine Machine Learning Machine Translation Manacher Managemnt MarkBERT Markov Materialized Views Math Matplotlib Matrix Factorization Median Meta Learning Metric Minimum Edit Distance Minkowski Model Evaluation Module Multi-Head Attention Multitask Multiway Tree NAT NER NLG NLM NLP NLU NMT NNW Naive Bayes Neo4j Network Ngram Normalizing Flow NumPy Numba Numpy Occupation Orientation P-R PCCG PCFG PEGASUS PLM PPMI PTM PageRank Palindromic Pandarallel Pandas Partial Parsing Pearson Philosophy Phrase Structure Grammar Phrase Structure Grammars PoS Polars Pooling Position-Encoding Postgres Pragmatic Automatic Processing Pre-Trained Pre-Training Pre-training Precision Pretrain Pretrained Pretraining Probabilistic Grammar Probabilistic Model Promote Prompt ProtoBERT Pruning Psychology PyPI Python QA Quant Quantization Query Queue R-Drop RELU RFE RMSE RNN ROC RWD Rank RaspberryPi Raspberrypi Recall Recommendation Recursion Reformer Regex Regular Expression Reinforcement Learning Relationship Extraction Representation Reqular Expressions Retrieving RoBERTa Rotated Sorted Array Rust SCFG SGD SMO SQL SRN SVD++ SVM Seaborn Search Segmentation Self-Attention Semantic Automatic Processing Semantic Similarity Senta Sentence Representation Sentence Similarity Sentence-BERT Sentiment Classification SentimentAnalysis Siamese Sigmoid SimCSE Similarity Simon Simpson Paradox Skill Slide Smoothing Soft-SVM Softmax Sort Span Spell Check SqueezeBERT Stack Stacking Statistics Stirling StratifiedKFold String Style Substring Summarization Supertagging Swap System T5 TF-IDF THW Tagging TanH TensorBay Tensorflow Test Text Classification Text Generation Text Normalization TextCNN TextRank Thought Transformer Transformer-XL Tree Treebank Tuning Tutorial Ubuntu UniLM Unity Operation Unix UserCF Vagrant Valence Vector Semantics Virtual Network VirtualBox Visualization Viterbi Vocabulary Learning Voting W2NER WOE Web Server Multithreaded Server Wide Word2vec Work XLNet Z-Score Zero-Short Zero-shot ZhouZhihua Zipf binning few-shot ffmpeg jpype knowledge Graph motion node2vec ssh str vlc

© 2022 Yam All rights reserved.

Powered by Hexo