Function: Upper-Confidence-Bound — func_delta • multiRL

$$ \text{Bias} = \delta \cdot \sqrt{\frac{\log(N + e)}{N + 10^{-10}}} $$

Usage

func_delta(count, params, ...)

Arguments

count: How many times this action has been executed
params: Parameters used by the model’s internal functions, see params
...: Subject ID, Block ID, Trial ID, and any additional information defined by the user.

Body

func_delta <- function(
    count,
    params,
    ...
){
  # if you need extra information
  # e.g.
  # Trial <- idinfo["Trial"]
  # Frame <- exinfo["Frame"]

  delta     <-  multiRL:::get_param(params, "delta")

  bias <- delta * sqrt(log(count + exp(1)) / (count + 1e-10))

  return(bias)
}