- formatting
- images
- links
- math
- code
- blockquotes
- external-services
•
•
•
•
•
•
-
A few Bit-Twiddling Tricks
When working with bit-fields, there are several techniques that can significantly speed up code — beyond the inherent performance benefits that bit-fields provide for many problems. In this post, I will introduce a few bit-twiddling tricks that I occasionally use, which can be useful for a variety of tasks.
-
The Monkey and Coconut Problem
Three sailors and a monkey are stranded on a deserted island. They gather a pile of coconuts to divide the next morning. During the night, each sailor wakes up, divides the pile into three parts, gives the extra coconut to the monkey, hides his share, and restacks the remaining coconuts. In the morning, the remaining coconuts are again divided into three parts, with one coconut left over, which is given to the monkey. The question is: how many coconuts were originally in the pile?
-
Short Notes: Gradient of the Softmax Function for the Cross-Entropy Loss
The softmax function in neural networks ensures outputs sum to one and are within [0,1]. Here's how to compute its gradients when the cross-entropy loss is applied.
-
Obfuscating a Function – How not to write Code
A while back, I created a straightforward function to convert an integer into a new format, resulting in clear code. However, I inexplicably chose to obscure its purpose, leading to the following outcome: Read more in this post...
-
Short Notes: Eigendecomposition of a Matrix
The derivation of the eigendecomposition is surprisingly simple. Read more here!