Join BookitisSave favorites, build lists, and follow creators.

Using local optimality criteria for efficient information retrieval with redundant information filters

Work detail

Bookitis Pick
Cover for Using local optimality criteria for efficient information retrieval with redundant information filters
UL
Image source: Open Library
Neil C. Rowe1 editions

We consider information retrieval when the data, for instance multimedia, is computationally expensive to fetch. Our approach uses information filters to considerably narrow the universe of possibilities before retrieval. Then decisions must be made about the necessity, order, and concurrent processing of proposed filters (an execution plan ). We develop simple polynomial-time local criteria for optimal execution plans, and show that most forms of concurrency are suboptimal with information filters. Although the general problem of finding an optimal execution plan is likely exponential in the numbers of filters, we show experimentally that our local optimality criteria, used in a polynomial-time algorithm, nearly always find the global optimum with 15 filters or less, sufficient number of filters for most applications. Our methods do not require special hardware and avoid the high processor idleness that is characteristic of massive-parallelism solutions to this problem. We apply our ideas to an important application, information retrieval of captioned data using natural-language understanding, a problem for which the natural-language processing can be the bottleneck if not implemented well. Filters, Optimization, Queries, Conjunction, Boolean algebra, Natural lan guage.

Overview

Shared work-level identity and catalog context.

1 credited authorSearch language english

Bookitis keeps work pages focused on the shared book identity and the editions that actually belong to it. Unrelated books should not appear here as primary content.

Contributors

People credited with this work in the active catalog.

  • Neil C. Rowe

    Author profile in the active Bookitis catalog

    Open Author

Editions

Publication-specific versions linked to this work only.