Crossing the Cyber Divide: Sim-to-Sim and Sim-to-Real Transfer for RL Agents

Excerpt

arXiv:2610.00759v1 Announce Type: cross Abstract: Cyber attack agents are typically trained and evaluated within a single simulator, making it unclear whether learned policies transfer beyond the environments in which they were developed. This limitation hinders both deployment and fair comparison, as cyber simulators differ substantially in their state representations, observation models, and action spaces. In this paper, we study policy transfer across cyber environments and argue that simulat