scml.oneshot.rl.agent

Classes

OneShotRLAgent

A oneshot agent that can execute trained RL models in appropriate worlds. It falls back to the given agent type otherwise

Module Contents

class scml.oneshot.rl.agent.OneShotRLAgent(*args, models: list[scml.oneshot.rl.common.RLModel] | tuple[scml.oneshot.rl.common.RLModel, Ellipsis] = tuple(), observation_managers: list[scml.oneshot.rl.observation.ObservationManager] | tuple[scml.oneshot.rl.observation.ObservationManager, Ellipsis] = tuple(), action_managers: list[scml.oneshot.rl.action.ActionManager] | tuple[scml.oneshot.rl.action.ActionManager, Ellipsis] | None = None, fallback_type: type[scml.oneshot.agent.OneShotAgent] | None = GreedyOneShotAgent, fallback_params: dict[str, Any] | None = None, dynamic_context_switching: bool = False, randomize_test_order: bool = False, **kwargs)

Bases: scml.oneshot.policy.OneShotPolicy

A oneshot agent that can execute trained RL models in appropriate worlds. It falls back to the given agent type otherwise

Parameters:

• models – List of models to choose from.

• observation_managers – List of observation managers. Must be the same length as models

• action_managers – List of action managers of the same length as models or None to use the default action manager.

• fallback_type – A OneShotAgent type to use as a fall-back if the current world is not compatible with any observation/action managers

• fallback_params – Parameters of the fallback_type

• dynamic_context_switching – If True, the world is tested each step (instead of only at init) to find the appropriate model

• randomize_test_order – If True, the order at which the observation/action managers are checked for compatibility with the current world is randomized.

• **kwargs – Any other OneShotPolicy parameters

_models = ()

_action_managers = None

_obs_managers = ()

_fallback_type

_dynamic_context_switching = False

_randomize_test_order = False

_fallback_params = None

_valid_context: scml.oneshot.context.Context = None

_valid_action_manager: scml.oneshot.rl.action.ActionManager = None

_valid_obs_manager: scml.oneshot.rl.observation.ObservationManager = None

_valid_index: int = -1

_fallback_agent: scml.oneshot.agent.OneShotAgent = None

setup_fallback()

has_no_valid_model()

context_switch()

init()

Called once after the AWI is set.

Remarks:

• Use this for any proactive initialization code.

encode_state(mechanism_states: dict[str, negmas.sao.common.SAOState]) → scml.oneshot.rl.common.RLState

Called to generate a state to be passed to the act() method. The default is all of awi of type OneShotState

decode_action(action: scml.oneshot.rl.common.RLAction) → dict[str, negmas.sao.common.SAOResponse]

Generates offers to all partners from an encoded action. Default is to return the action as it is assuming it is a dict[str, SAOResponse]

act(state: scml.oneshot.rl.common.RLState) → scml.oneshot.rl.common.RLAction

The main policy. Generates an action given a state

propose(*args, **kwargs) → negmas.outcomes.Outcome | None

Called when the agent is asking to propose in one negotiation

respond(*args, **kwargs) → negmas.gb.common.ResponseType

Called when the agent is asked to respond to an offer

before_step()

Called at at the BEGINNING of every production step (day)

step()

Called at at the END of every production step (day)

on_negotiation_failure(*args, **kwargs) → None

Called when a negotiation the agent is a party of ends without agreement

on_negotiation_success(*args, **kwargs) → None

Called when a negotiation the agent is a party of ends with agreement