Operating system: | macOS / OS X, Linux, Windows |
Python version: | Python 3.8+ |
This is the repository for the T2WMl server-based GUI. You may be looking for the T2WML API
For developing t2wml you need both the t2wml-api repository and the t2wml (this) repository.
Create a directory called t2wml-root
and clone both repositories under it:
cd t2wml-root
git clone https://github.com/usc-isi-i2/t2wml-api
cd t2wml-api
git checkout development
cd t2wml-root
git clone https://github.com/usc-isi-i2/t2wml
cd t2wml
git checkout development
First you have to make sure you have Node version 12 or higher installed. Then you can run:
cd t2wml-root/t2wml/electron
yarn install
Note for developers adding package dependencies: The electron builder takes all the prod dependencies from package.json and adds them to the installation, even though webpack already takes care of everything. It is very important not to add prod dependencies, use yarn add --dev to add more packages.
cd t2wml-root/t2wml/backend
python3.6 -m venv env
source env/bin/activate # on Windows just run env/bin/activate.ps1
pip install --upgrade pip
pip install -e ../../t2wml-api # Install t2wml-api from the cloned repository at t2wml-root/t2wml-api
pip install -r requirements.txt
Note: Python 3.6 and higher are supported.
cd t2wml-root/t2wml/backend
python t2wml-server.py
cd t2wml-root/t2wml/backend
pytest tests
cd t2wml-root/t2wml/backend
pytest --cov=. --cov-report html:htmlcov tests
open htmlcov/index.html
Since we're using Electron, you need to run two scripts to run the GUI on development:
cd t2wml-root/t2wml/electron
yarn dev
This script compiles all the frontend files, making them ready for electron. Wait until the compilation reaches 100% (you may see some warnings, that's fine). The script will keep running, recompiling as the frontend files are updated.
Open another shell window and run
cd t2wml-root/t2wml/electron
yarn start
This script starts Electron, and you should see the GUI.
Note that in development, the GUI will wait for the backend to start on port 13000, so you will need to run it.
The project has preconfigured settings file for Visual Studio Code. Before starting you need to copy the settings template appropriate for your OS.
On Macs and Linux machines, copy .vscode/settings.linux.json
to .vscode/settings.json
. On Windows, copy .vscode/settings.windows.json
to .vscode/settings.json
Start Visual Studio Code and open it in the t2wml-root/t2wml directory.
To develop the GUI you need to run three tasks:
Backend
- runs the Python backend.Build Dev GUI Continiously
- this task runs the npmdev
script which builds the GUI and contiously watches for changes.Report GUI Coding Errors
- this tasks continuously scans the sources for errors and updates the Problems pane.Start GUI
- opens the Electron based GUI.
The GUI will not work unless the backend is up and running.
When updating the GUI code, it will be automatically rebuilt by the Build and Watch GUI task
. You will need to reload the GUI - you can use Reload
from the Debug
menu.
You can also open the Chrome Developers Tools from the GUI's Debug
menu.
To develop the backend, you need to launch the Backend
from the debug menu. You will be able to set breakpoints and debug properly. If you want to run the GUI, start the Build and Watch GUI
and t2wml GUI
tasks, as well.
To run the backend as a service on windows:
Download the file windows-service.exe, and run with Administrator privilges:
Install:
t2wml-service.exe install
Start:
t2wml-service.exe start
Debug:
t2wml-service.exe debug
Stop:
t2wml-service.exe stop
Uninstall:
t2wml-service.exe remove
- Open the GUI
- In Table Viewer,
- click Upload to open a table file (.csv/.tsv/.xls/.xlsx)
- In Wikifier,
- In YAML Editor,
- type/paste in T2WML code, or
- click Upload to open a YAML file (.yaml)
- click Apply to highlight some regions in Table Viewer
- In Output,
- preview result by clicking cell in Table Viewer [demo], or
- click Download to get all results
Check out the grammar guide
Note: All screenshots below are captured in GUI v1.3. Minor inconsistencies may appear.
-
Installation failed due to
etk
?Run the following commands in terminal/cmd:
pip uninstall etk pip install https://github.com/usc-isi-i2/etk/archive/development.zip
-
Login failed or encountered an authentication error like
400 (OAuth2 Error)
?Access T2WML at
https://localhost:13000/
instead ofhttps://127.0.0.1:13000
. -
Error saying can't find static/index.html?
Make sure you install t2wml-standalone in a folder that does not contain the T2WML repo or there will be a configurations clash.
-
Encountered any other error not mentioned in the FAQs?
Post the issue in the T2WML repository along with a detailed description.