MULTI_LEXER and Querying Multi-Language Tables

At query time, the multi-lexer examines the language setting and uses the sub-lexer preference for that language to parse the query.

If the language is not set, then the default lexer is used. Otherwise, the query is parsed and run as usual. The index contains tokens from multiple languages, so such a query can return documents in several languages. To limit your query to a given language, use a structured clause on the language column.

If the language column is set to AUTO, then the multi-lexer detects the language of the document for the supported languages shown in Table 2-21.

Table 21 Languages Supported for MULTI_LEXER Auto-detection

Language	Language
Arabic	Japanese
Bokmal (Norwegian)	Korean
Catalan	Latin Serbian
Croatian	Nynorsk (Norwegian)
Czech	Polish
Danish	Portuguese
Dutch	Romanian
English	Russian
German	Slovak
Greek	Swedish
Hebrew	Thai
Hungarian	Traditional Chinese
Italian	Turkish