-
Notifications
You must be signed in to change notification settings - Fork 548
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[meta/discussion] Import/Export functionality #771
Comments
I'm going to do a brain dump here on my thoughts on this issue:
|
@Monirzadeh I know about that. My question about how I can use Shiori now. How I can move Chrome and Firefox Bookmarks to Shiori now any cases. For example there is converter Netscape Bookmark File<->Chrome/Firefox Bookmark File or I have to use other steps. Or I have to write this converter. What would my steps to get temporary solution during you decide how it'll work? I do not know Go but I know other laguages include SQL. I'm interested in Shiori 'cause it's bookmarks keeper in local cloud. But it'll become unuseful for me and for other users if we cannot move our bookmarks to Shiory from top browsers. I have no opportunity move ~100 thousand bookmarks by hand. |
@LLKoder you can use and modify scripts that we have in documentation. for example
#!/bin/bash
grep -Eoi '<a [^>]+>' $1 | grep -Eo 'HREF="[^\"]+"' | cut -d'=' -f 2- | tr -d '"' | tac > firefox2shiori.txt
# Reading the URLs one by one and adding to shiori
while IFS= read -r line; do
shiori add $line
done < firefox2shiori.txt
rm firefox2shiori.txt
exit 0 i don't have chrome base browser(so i don't have accesses to the bookmark export sample) to update script for that too but general concept is simple. |
@Monirzadeh Thanks. |
yes. |
Major support for either an export functionality, or saving the files in some kind of format that ANY other software can read. I thought they might have been warc or mhtml, but nope. They are some kind of binary that only shiori can access?? And yet there is no API to use shiori from the CLI to push them out into anything that any other application can access? This makes Shiori a walled garden -- we can easily add things, but cannot get anything out except manually opening it and saving it as a file in the browser. DownThemAll! kinda works -- but they lose all the css, so not true archives. This has come up before: #337 I'm puzzled by the choice to save the files as (apparently?) a unique binary format? Why not just save them in the standard warc format, or perhaps mhtml? That is still a single file. PDFs are stored not as pdf either. I'm very curious about these design choices. Anyway, sadly cannot use shiori because of this. It's far better than the other tools I've been trying today but the fact that one cannot get one's data out makes it unusable for the main purpose: archiving stuff for reliably accessing later. |
@Monirzadeh I add PR (#794) but it was blocked. |
@fmartingr @Monirzadeh I'm writing Python script for Import Chrome/Firefox Bookmarks to Shiori. Script will convert folder structure to tags structure. If it need I can do PR as temparary solve. |
But what if I have both folder and tag structure in my Firefox? |
@mpr1255 Completely agree, that's a mess! I'm hoping that the concept will change in the future.. |
@Goosegit11 How do you have tags in Firefox? Chrome/Firefox don't support tags. Or am I wrong? |
@Goosegit11 I'll able to post a script here when I have a time to finish it, if need. Just developers not say merge the script to main branch or not. I not want to do waste PR. |
Hey people, trying to address all of the comments here. Thanks a lot to @Monirzadeh for chiming in and helping people move forward. When I started using Shiori I noticed this "walled garden" problem, but for me at the time supposed no issue (I could just write a script to move things in and out), but now that I am here, the steps to move out of that problem are:
This is the current roardmap, and along the way some other issues had been found. We would love support in those areas if people are interested, I can provide guidance in issues for contributors. If you have any more concerns about this please raise them here, the more we know before doing changes the better. |
@Goosegit11 Ahahaha... I have not known it till today. I don't have tags field when I save bookmarks, 'cause I have no active tags. But there is tags in bookmarks manager as I have seen. :) Thanks. I try add Firefox tags to my script. @fmartingr Thanks to you. Say me pls how I understant, it all in plans. I.e. it is not released for now. And so as you know I write Python script. It'll export from Firefox/Crhome Bookmarks to Shiori CLI (with convert folder structure to tags) this is temporary solve as I see. Can I make PR or put it here is better? |
If you make a script to work with Shiori bookmarks you can create a repository/gist for it and we can link it from the documentation under community supported tooling. |
this feature request a better way to import from other service as we talk about them in different issue and discussion like:
#768 #762
What is the problem?
currently shiori just can import some service like wallabag and pocket from terminal.
we need a better solution that solve multiple problem
https://github.com/go-shiori/shiori/tree/master/internal/cmd
that is too more specific. we should combine all of them in one general function (terminal and webui) for easier maintainWhat we can do?
with this workflow we don't change code each time to support new service.
What about UI?
when user upload file and press import in settings menu. while it importing a bell icon show up above logout buttom.
![bell](https://private-user-images.githubusercontent.com/25131576/278867690-1b6649b9-1464-4578-a2f8-785f67771dc2.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjUzNDMyMDEsIm5iZiI6MTcyNTM0MjkwMSwicGF0aCI6Ii8yNTEzMTU3Ni8yNzg4Njc2OTAtMWI2NjQ5YjktMTQ2NC00NTc4LWEyZjgtNzg1ZjY3NzcxZGMyLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MDMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTAzVDA1NTUwMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTRiYzc2OWY4OTAzZTFmMGMzZWEwYzZhYzNlNmZhZjQwMDVhOWI5NjljM2IzYTljNGRjMzQ1NjU3MDFiZDAwOGImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.rk1_Vyo7ANIGALXZZI9DXJkE8bol4SUECZri9IQAt_A)
maybe it can show progress as a ring around that. when it is finish bell icon disappear.
What should be consider?
some service has reading status and tag. how should we handle that? (as shiori don't have reading status yet)
currently showing progress percentage in UI is the problem that i can't imperilment yet.
is there anybody better idea for import functionality?
The text was updated successfully, but these errors were encountered: