scope_rl.ope.estimators_base.BaseOffPolicyEstimator#

class scope_rl.ope.estimators_base.BaseOffPolicyEstimator[source]#

Base class for (basic) OPE estimators.

Imported as: scope_rl.ope.BaseOffPolicyEstimator

Note

This abstract base class also implements the following private methods.

abstract _estimate_trajectory_value:

Estimate the trajectory-wise expected reward.

_calc_behavior_policy_pscore_discrete:

Calculate the behavior policy pscore (action choice probability) in the case of discrete action spaces.

_calc_behavior_policy_pscore_continuous:

Calculate the behavior policy pscore (action choice probability) in the case of continuous action spaces.

_calc_evaluation_policy_pscore_discrete:

Calculate the evaluation policy pscore (action choice probability) in the case of discrete action spaces.

_calc_similarity_weight:

Calculate the similarity weight (for continuous action case) in the case of continuous action spaces.

property _estimate_confidence_interval:

Dictionary containing names and functions of ci methods.

key: [
    bootstrap,
    hoeffding,
    bernstein,
    ttest,
]

property _kernel_function:

Dictionary containing names and functions of kernels.

key: [
    gaussian,
    epanechnikov,
    triangular,
    cosine,
    uniform,
]

Methods

`estimate_interval`()	Estimate the confidence interval of the policy value.
`estimate_policy_value`()	Estimate the policy value of the evaluation policy.

abstract estimate_policy_value()[source]#

Estimate the policy value of the evaluation policy.

abstract estimate_interval()[source]#

Estimate the confidence interval of the policy value.

Methods