Skip to content

gather metadata from 3 different scholarly publication APIs: SciGraph, Springer & CrossRef

Notifications You must be signed in to change notification settings

LetianFeng/makeDataset

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 

Repository files navigation

makeDataset

This little program is used to gather metadata from 3 different scholarly publication APIs: SciGraph, Springer & CrossRef.

The current input is a json list of scigraph urls, the program resolves firstly the DOI from the SciGraph-response, and then requests metadata from the other 2 APIs based on the DOI.

Please specify your configurations in the 'config.json', especially the springer_key, without a valid key, this program cannot work at all. The config file should have the following format:

{
    "springer_key": "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX",
    "daily_amount": 5000,
    "retry": 1,
    "url_path": "path/to/urls.json",
    "db_path": "path/to/database.sqlite"
}

The program is currently still in development, the next feature is:

  1. add feature --log
  2. get metadata from 3 different APIs based on DOI instead of SciGraph-url

About

gather metadata from 3 different scholarly publication APIs: SciGraph, Springer & CrossRef

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages