A simple node module for scraping Open Graph info off a site.
npm install open-graph-scraper
var ogs = require('open-graph-scraper');
var options = {'url': 'https://ogp.me/'};
ogs(options, function (err, results) {
console.log('err:', err); // This is returns true or false. True if there was a error. The error it self is inside the results object.
console.log('results:', results);
});
You can set custom headers. For example scraping data in a specific language:
var ogs = require('open-graph-scraper');
var options = {'url': 'https://ogp.me/', 'headers': { 'accept-language': 'en' }};
ogs(options, function (err, results) {
console.log('err:', err); // This is returns true or false. True if there was a error. The error it self is inside the results object.
console.log('results:', results);
});
You can also set a timeout flag like... Example four seconds:
var ogs = require('open-graph-scraper');
var options = {'url': 'https://ogp.me/', 'timeout': 4000};
ogs(options, function (err, results) {
console.log('err:', err); // This is returns true or false. True if there was a error. The error it self is inside the results object.
console.log('results:', results);
});
Note: By default if page dose not have something like a og:title tag it will try and look for it in other places and return that. If you truely only want open graph info you can use the option onlyGetOpenGraphInfo and set it to true.
Check the return for a success flag. If success is set to true, then the url input was valid. Otherwise it will be set to false. The above example will return something like...
{
data: {
ogTitle: 'Open Graph protocol',
ogType: 'website',
ogUrl: 'https://ogp.me/',
ogDescription: 'The Open Graph protocol enables any web page to become a rich object in a social graph.',
ogImage: {
url: 'https://ogp.me/logo.png',
width: '300',
height: '300',
type: 'image/png'
}
},
success: true
}
- This will also scrape twitter info!
- There is a
allMediaflag you can set totrueif you want all the images/videos send back.
You have to have mocha running. To install it run...
npm install mocha -g
Then you can run the tests by turning on the server and run...
mocha tests/
This will install the all of the dependencies, then run the tests
make test