Useful tips for everyday
How do I add a button to my Arduino? Just connect the 5V from Arduino to the one side of the button and connect the…
How do I program my Arduino Uno board? Table of Contents Use your Arduino Uno on the Arduino Web IDE. Use your Arduino Uno on…
Why is my micro servo not working? If your servo stopped working, there might be direct damage. To make a quick diagnosis, plug in a…
How do you use a 2 channel relay module? Two Channel Relay Module Pinout VCC pin supplies power to the built-in optocoupler and optionally to…
How do you prove a heuristic is consistent? To check whether a heuristic is consistent, ensure that for all paths, h(N) h(L) path(N !…
What is non-local attention? The non-local network basically follows the self-attention design, which looks like the following: Image from the original non-local network paper. And…
How do you write a good evaluation function? How do I write a good evaluation function for a board game? field index should be high.…
What is Epsilon in Q-learning? Epsilon is used when we are selecting specific actions base on the Q values we already have. As an example…
What is an agent how does the agent interact with the environment? More specifically, the agent and environment interact at each of a sequence of…
Why is the Q-loss not converging for DQN? The Q-loss is calculated as MSE. Do you have ideas why the Q-loss is not converging? Does…