Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Language support for other languages (not english) #97

Open
Janithpm opened this issue Feb 21, 2024 · 2 comments
Open

Language support for other languages (not english) #97

Janithpm opened this issue Feb 21, 2024 · 2 comments

Comments

@Janithpm
Copy link

Janithpm commented Feb 21, 2024

Some of posts I'm scraping has sentences in another language (specifically in the Sinhala language). when export as a csv it's not showing as symbols. is there any feature to support all languages?

@Janithpm Janithpm changed the title goes to Facebook sign in page Language support for other languages (not english) Feb 21, 2024
@Janithpm
Copy link
Author

Janithpm commented Feb 21, 2024

this is one line of CSV file

pfbid02zX2FVAaCwr8TWQmE9u4p8eW2jTfc7dWteG4m1R3zygpnrFn4smpJ6EyFgKRvi7UTl | බියගම | 23 | 202 | 34 | 0 | 0 | 0 | 0 | 0 | 236 | 32 | ගà·�à·„à·�නු අපි එක මිටට....බියගම ආසනයේ මà·�කොළ  උතුර  පහළ NPP කà·�න්තà·� සභà·�à·€ පිහිටුවීම | 2024-02-05T11:37:00

@shaikhsajid1111
Copy link
Owner

I assume that's content part of data. I have not tested this with Sinhala language so yeah it might be something related to encoding. You can tweak and check if something work for you by editing this line. I will look into this issue in my availability

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants