Yam

Feeling, Coding, Thinking

跳至内容
  • Home
  • Series
  • Archives
  • About
  • Projects
2022

NLP预训练模型的不可能三角

2022-04-15 •
Feeling
•
  • AI
  • Impossible-Triangle
  • NLP
  • PLM

Categories

  • Coding69
  • Feeling96
  • Thinking20

Music

Recents

  • 统一NER为词词关系分类
  • 预训练模型与传统方法在排序上有啥不同?
  • MarkBERT
  • 量化NLM模型的记忆力
  • NLP预训练模型的不可能三角

Tag Cloud

AE AI ALBERT AR AUC Accuracy Activation Algorithm Array Arrow Attention Automatic Speech Processing Automation BERT BIO BIOHD BM25 BPE Backtracking Backward Bahdanau Attention Bart Bayes Beam Search Bert-Flow Bi-LSTM Biasing Binary Search Blending Bridge Business C C4 CCG CE BERT CFG CKY CNN CRF CS CYK Calculus Camera Catalan ChatBot Chi2 Chunking Classification Cognition Collaborative Filtering Collins Parser Computational Linguistics Computer Computer Science Confusing Labels Context-Free Grammars Contrastive-Learning Coordinate Ascent Cosine Cosine Similarity Cross Entropy Cross-brackets Ctrl Culture DA DB DNN DP Data Augmentation Data Clearing Data Enhancement Data Preprocess Data Science Data Structure Database DeBERTa Debiasing Decoder Decoding Deep DeepGraph DeepLearning Dependence Diary Disentangled Attention DistilBERT Distillation Django Docker Docker-Compose Dockerfile Dropout Dynamic-Mask EDA EMD ERNIE Economics Edit Distance Efficient-DeepLearning Elasticsearch Electra Elixir Ellipsis Embedding Embeddings Encoder Entropy Evaluation ExT5 F1 FDW FSM Faith Feature Engineering Feature-based Few-Shot Fine-tuning Formal Grammars Forward Full-Text-Search Function Syntax Funk MF Funnel Transformer GBTD GELU GPT-2 GPU GRU GSG Gan Garden-path Git Glow Graceful Shutdown Gradient Descent Graph GraphQL Grid Grammar HMM Hard-SVM Hinge Loss Hope Host-only IE IQR Imbalance Data Impossible-Triangle Industry Information Extraction Information Theory Isolation Forest ItemCF Jaccard Java Jax Job Jupyter KKT KS Kernel Kernel Function Kernel Method Keyword Knowledge Graph LM LOF LR LSTM Language Model Lexical Semantics Lexicalism Lexicalized CFG Lexicalized Grammars Linear Algebra Linear Sturcture Linked List LinkedList Linux Logistic Regression Lucene Luong Attention MEMM MF MTL Machine Machine Learning Machine Translation Manacher Managemnt MarkBERT Markov Materialized Views Math Matplotlib Matrix Factorization Median Meta Learning Metric Minimum Edit Distance Minkowski Model Evaluation Module Multi-Head Attention Multitask Multiway Tree NAT NER NLG NLM NLP NLU NMT NNW Naive Bayes Neo4j Network Ngram Normalizing Flow NumPy Numba Numpy Occupation Orientation P-R PCCG PCFG PEGASUS PLM PPMI PTM PageRank Palindromic Pandarallel Pandas Partial Parsing Pearson Philosophy Phrase Structure Grammar Phrase Structure Grammars PoS Polars Pooling Position-Encoding Postgres Pragmatic Automatic Processing Pre-Trained Pre-Training Pre-training Precision Pretrain Pretrained Pretraining Probabilistic Grammar Probabilistic Model Promote Prompt ProtoBERT Pruning Psychology PyPI Python QA Quant Quantization Query Queue R-Drop RELU RFE RMSE RNN ROC RWD Rank RaspberryPi Raspberrypi Recall Recommendation Recursion Reformer Regex Regular Expression Reinforcement Learning Relationship Extraction Representation Reqular Expressions Retrieving RoBERTa Rotated Sorted Array Rust SCFG SGD SMO SQL SRN SVD++ SVM Seaborn Search Segmentation Self-Attention Semantic Automatic Processing Semantic Similarity Senta Sentence Representation Sentence Similarity Sentence-BERT Sentiment Classification SentimentAnalysis Siamese Sigmoid SimCSE Similarity Simon Simpson Paradox Skill Slide Smoothing Soft-SVM Softmax Sort Span Spell Check SqueezeBERT Stack Stacking Statistics Stirling StratifiedKFold String Style Substring Summarization Supertagging Swap System T5 TF-IDF THW Tagging TanH TensorBay Tensorflow Test Text Classification Text Generation Text Normalization TextCNN TextRank Thought Transformer Transformer-XL Tree Treebank Tuning Tutorial Ubuntu UniLM Unity Operation Unix UserCF Vagrant Valence Vector Semantics Virtual Network VirtualBox Visualization Viterbi Vocabulary Learning Voting W2NER WOE Web Server Multithreaded Server Wide Word2vec Work XLNet Z-Score Zero-shot ZhouZhihua Zipf binning few-shot ffmpeg jpype knowledge Graph motion node2vec ssh str vlc

© 2022 Yam All rights reserved.

Powered by Hexo