LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

Information-Directed Random Walk for Rare Event Detection in Hierarchical Processes

Photo from wikipedia

The problem of detecting a few anomalous processes among a large number of data streams is considered. At each time, aggregated observations can be taken from a chosen subset of… Click to show full abstract

The problem of detecting a few anomalous processes among a large number of data streams is considered. At each time, aggregated observations can be taken from a chosen subset of the processes, where the chosen subset conforms to a given tree structure. The random observations are drawn from a general distribution that may depend on the size of the chosen subset and the number of anomalous processes in the subset. We propose a sequential search strategy by devising an information-directed random walk on the tree-structured observation hierarchy. The proposed policy is shown to be asymptotically optimal with respect to the detection accuracy and order-optimal with respect to the size of the search space. Effectively localizing the data processing to small subsets of the search space, the proposed strategy is also efficient in terms of computation and memory requirement.

Keywords: random walk; random; directed random; information directed; information

Journal Title: IEEE Transactions on Information Theory
Year Published: 2021

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.