-
Notifications
You must be signed in to change notification settings - Fork 327
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
peewee.OperationalError: unknown tokenizer: mozporter when opening Thunderbirds global-messages.sqlite #138
Comments
Well without the full traceback this was really not helpful as to debugging where exactly sqlite-web is running into problems with the missing tokenizer. Even if sqlite-browser can open the database file, I'm dubious whether you can actually query the full-text index table without the custom tokenizer. In order to query the full-text search tables, you'll need Mozilla's custom To install the tokenizer automatically in a loadable extension, you'll want to modify the module registration function to register the tokenizer directly, e.g. /* no error checking, just an example */
sqlite3_stmt *pStmt;
const char zSql[] = "SELECT fts3_tokenizer(?, ?)";
sqlite3_prepare_v2(db, zSql, -1, &pStmt, 0);
const static sqlite3_tokenizer_module* module;
sqlite3Fts3PorterTokenizerModule(&module);
sqlite3_bind_text(pStmt, 1, "mozporter", -1, SQLITE_STATIC);
sqlite3_bind_blob(pStmt, 2, &module, sizeof(module), SQLITE_STATIC);
sqlite3_step(pStmt);
sqlite3_finalize(pStmt); I built such an extension locally and it works just fine:
In order to get it working with the loadable extension support in Once that was done, though, I had no problem running sqlite-web with the loadable extension, and viewing a FTS table using the mozporter tokenizer: |
I am trying
and get
i have searched the web for a solution but didn't find any.
https://sqlitebrowser.org/dl/ can open the database.
The text was updated successfully, but these errors were encountered: