JavaScript is executed by a JavaScript engine, which is a program that interprets and executes JavaScript code. Most modern web browsers, such as Google Chrome, Mozilla Firefox, and Safari, include a built-in JavaScript engine that can execute JavaScript code in web pages.
[Read More]
Coreference Resolution
Coref Notes on my work so far
Coreference resolution is a natural language processing task that involves identifying and linking all expressions in a text that refer to the same entity. For example, consider the following sentence: “John went to the store. He bought some groceries.” The pronoun “he” in the second sentence refers back to “John”...
[Read More]
PyTorch Notes
Common Mistakes: Forgot to overfit on a single batch first Forgot to toggle train/eval mode for the net. Forgot to .zero_grad() before .backward(). you passed softmaxed outputs to a loss that expects raw logits. you didn’t use bias=False for your Linear/Conv2d layer when using BatchNorm, or conversely forget to include...
[Read More]
Linguistic Structure
Dependency parsing
Linguistic Structure
Constituency = Phrase Structure Grammar = Context-free grammar
Phrase Structure organises words into nested constituents.
[Read More]
Motivating Beam Search
Problems with the decoder on an nmt system
Training Auto-regressive model
Feeding the correct output and learning to decode from it.
[Read More]