Encoder-Decoder Models Attention and Contextual Embedding Note (SLP Ch10)

Encoder takes an input sequence and create a contextualized representation of it, then passed to a decoder which generates a task-specific output sequence.

1 Getting Started
3 Common Concepts
4 Understanding Ownership
5 Using Structs to Structure Related Data
6 Enums and Pattern Matching
8 Common Collections
9 Error Handling
10 Generic Types, Traits, and Lifetimes
11 Writing Automated Tests
18 Patterns and Matching

## 1 Getting Started

$ cargo new proj

// build
$ cargo build //dev
$ cargo check
// build result
$ ./target/debug/proj
// build + run
$ cargo run	

$ cargo build --release  //prod

7 Managing Growing Projects with Packages Crates and Modules
14 More About Cargo and Crates io

## 7 Managing Growing Projects with Packages Crates and Modules

In addition to grouping functionality, encapsulating implementation details lets you reuse code at a higher level: once you’ve implemented an operation, other code can call that code via the code’s public interface without knowing how the implementation works. The way you write code defines which parts are public for other code to use and which parts are private implementation details that you reserve the right to change. This is another way to limit the amount of detail you have to keep in your head.

Packages: A Cargo feature that lets you build, test, and share crates
Crates: A tree of modules that produces a library or executable
Modules and use: Let you control the organization, scope, and privacy of paths
Paths: A way of naming an item, such as a struct, function, or module

Neural Architectures for Named Entity Recognition 论文笔记

Paper: 1603.01360.pdf

code:

核心思想：pretrained + character-based 词表示分别学习形态和拼写，Bi-LSTM + CRF 和基于转移的模型均可以对输出标签的依赖关系建模。

看了 Related Work 后发现很多想法其实早就冒出来了，不同的论文在不同点上使用了不同的方法，本篇恰好用这样的方法取得了最好的效果。其实，我觉得更加有意思的是基于转移的模型，它构建了一个 action 的时间序列，感觉更加抽象，想法更加精妙。

The Rust Programming Language

Recently, I have read The Rust Programming Language book which is really a comprehensive combination. I prefer to write some brief note when I am reading a book, just for times of reviews in the future. Here is the same.