{"id":238,"date":"2017-07-10T15:17:28","date_gmt":"2017-07-10T15:17:28","guid":{"rendered":"http:\/\/eurekadata.net\/?page_id=238"},"modified":"2017-08-08T15:37:44","modified_gmt":"2017-08-08T15:37:44","slug":"introduction","status":"publish","type":"page","link":"https:\/\/eurekadata.net\/index.php\/introduction\/","title":{"rendered":"Introduction To Eureka"},"content":{"rendered":"

token data<\/h4>\n

With large to exceedingly large amounts of free form, semi-structured, structured or mixed data, Eureka renders the corpus into its token form, organizing those tokens in a recursive manner around frequencies, relational closeness and retaining the original value and ordering. \u00a0With attention to memory proximity, compression, and data conservation the resulting format is encoded to provide near direct access while offering flexibility and generality.<\/p>\n

Considering your data as being wholly comprised of tokens affords that scope, context, and meaning may be elucidated instead of specified. \u00a0In such a data system capable of real-time and general access discovery and application of that structure may be dynamic.<\/p>\n

Eureka does not require a schema, as if that any such structure exists it can be quickly determined and intuitively utilized. \u00a0Likewise in contrast to general practice of indexing in databases or search engines even the concept of context or type (record or field) is unnecessary. \u00a0For example, from the set of all hits for any token the context of field or record can be defined with relative positions of other tokens (e.g. whitespace delimiter indicating record or field, json key, xml marking, etc.) and joined to produce the same constraints imposed by a schema dynamically.<\/p>\n

In the Eureka perspective, all data is equal. \u00a0 Tokens are classified but otherwise non differentiated and all tokens are indexed (including sub-token indexing). \u00a0All tokens are directly relatable to all other tokens via lexical closeness, statistics, and\/or position.<\/p>\n

binary data<\/h4>\n

Tokens are of course made up of binary bytes, but what the lex rules cannot make sense of would be processed and integrated just the same along with possibly of purely coincidental matching due to lexical ambiguity. \u00a0Bookending binary data with magic tokens may provide for a practical applications for retrieval, but allow for the potential of the resulting collisions.<\/p>\n

This introduction will proceed with a<\/p>\n