This is a modified version of one of the examples from gathercontent: https://github.com/gathercontent/api-examples

This is still very much a sample utility for the time being.

There are a handful of differences between this and the original example

• All of the import information can be configured in a configuration file for repeated runs
• Ability to map multiple fields to fields in gathercontent
• Ability to use a template in gathercontent during import

This is an example interactive command line application, which takes a url to a sitemap.xml file, creates a list of web pages on that website, then parses the text from a chosen CSS selector on each web page and creates a corresponding item in GatherContent.

• PHP 5.5+
• Composer (PHP package management tool)

Clone this package from GitHub

$ git clone https://github.com/atlanticbt/gathercontent-import

Move into this project directory

Install the package dependencies

$ composer install

Execute the application with

$ bin/scrape --configfile=configfilename

You will be prompted for a username and API key (found in your personal settings).

If you are a member of multiple accounts on GatherContent you will be asked to choose which account you are importing to.

You can then choose to create a new project, or import content into an existing project.

Give the application a link to your sitemap.xml file, e.g. https://yourwebsite.com/sitemap.xml

You should see a number of pages that will be scraped.

Next choose a CSS selector - e.g. 'article' or css class '.content', '#main-content' to denote which block of content you want imported.

Then confirm and watch the content be pulled and posted back to GatherContent through the public API.

To run the phpspec test suite run

$ vendor/bin/phpspec run