Efficient Hierarchical Transformers for Representing Log Data

Excerpt

arXiv:2408.16803v2 Announce Type: replace-cross Abstract: Transformers have gained widespread acclaim for their versatility in handling diverse data structures, yet their application to log data remains underexplored. Log data, characterized by its hierarchical, dictionary-like structure, poses unique challenges when processed using conventional transformer models. Traditional methods often rely on manually crafted templates for parsing logs, a process that is labor-intensive and lacks generaliz