Home

The Idea :- Complex Recurrent neural networks include an encoder and a decoder which are connected through an attention mechanism . The paper proposes that we don’t need recurrence but only attention mechanism can produce great result .This is called a Transformer model architecture which is a paradigm shift in sequence processing as attention reduces … Continue reading Paper Review :- Attention is all you need

Wisdom is not a product of schooling but of lifelong attempt to acquire it Collate resources on the topic Extract only vital information (abstract and Conclusion ) even if you don’t understand the whole paper Take structured notes and then re-read the Paper with all details Read supplemental material as needed .

Portfolio Theory – some salient points Risk of the average is not equal to the average of the risk shifting the efficient frontier to North west , the portfolio can be optimised to an extent efficient frontier :- standard way of showing return and risk relationship Expand the universe of investible asset classes to produce … Continue reading Portfolio Theory

“I don’t run for trains” This is the career advice that I read and liked the most in the excellent book “The Black Swan” 1. Teach yourself to resist running to keep on schedule . In refusing to run to catch the trains ( at various stages in your life) , lies the true value … Continue reading Don’t run for trains