Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support reconciliation (e.g. via nomenklatura) #2

Open
pudo opened this issue Apr 9, 2013 · 14 comments
Open

Support reconciliation (e.g. via nomenklatura) #2

pudo opened this issue Apr 9, 2013 · 14 comments

Comments

@pudo
Copy link
Contributor

pudo commented Apr 9, 2013

Suggest we set up some kind of autopush to nomenklatura ...

@rufuspollock
Copy link
Member

What about just loading the data to nomenklatura and redirecting there?

@pudo
Copy link
Contributor Author

pudo commented Apr 10, 2013

I like where this is going. You realize that nomenklatura supports a random data={} dict on all entries which could be used to store template input for a static site generator?

@rufuspollock
Copy link
Member

I don't think you want the site itself in nomenklatura - that can stay in a dedicated site - but all the reconciliation can be nomenklatura. I think this is a nice model of one dedicated tool for one dedicated function :-)

So e.g. publicbodies site front page would say for reconciliation against this dataset visit nomenklatura/publicbodies (or whatever the url is!)

@pudo
Copy link
Contributor Author

pudo commented Apr 10, 2013

Yeah, thats what I understood. I really like this model. However, I'm not sure about the lack of FTS for a site like publicbodies. What do you think: can the JS solr clones handle this?

@rufuspollock
Copy link
Member

@pudo on FTS I've booted a new ticket #3

@rufuspollock
Copy link
Member

This should definitely go to nomenklatura (IMO).

@pudo if you could give me simple instructions (or point me to them) I'd like to have a go at doing this so i can learn more about nomenklatura - so don't do it for me ;-)

@davidread
Copy link

Ha I've put the UK body names in Nomen: http:https://nomenklatura.pudo.org/uk-public-bodies and will be adding the DGU ones too, which are reasonably reconciled already.

@rufuspollock
Copy link
Member

@davidread perfect - and it makes me think that it may be worth splitting by country.

One super minor think for consistency: let's use iso codes (which, confusingly, for the uk is "gb"). That would suggest this be gb-public-bodies in nomenklatura :-)

@davidread
Copy link

I've now added DGU to Nomen and will move on to merging the fields into gb.csv using a Refine recipe that can be done again in the future.

I hear you about calling it gb-public-bodies - @pudo is it easy for you rename the project on nomenklatura with a cheeky SQL UPDATE?

@rufuspollock
Copy link
Member

@davidread @pudo @markbrough @... anyone else. Have some questions here:

  • Should we have one big consolidated entry on nomenklatura or should we partition by jurisdiction?
  • What's the best way to automate the process of getting this stuff into nomenklatura and then regularly syncing back (my sense is that nomenklatura is probably best for being the authoritative location for creating new entries (though not for adding info to entries ... - cf Support for sending corrections / additions #8))

@davidread
Copy link

I like the partitioning by jurisdiction. Bodies do this very well naturally. And no doubt the schemas and tags are going to have a lot of local conventions. Why, do you have any use-cases for looking at bodies cross-jurisdiction?

I agree on using Nomenklatura for just reconcilliation. I put the UK ones into Nomen with a script which could be run regularly - should I check it into publicbodies/scripts or is this repo just for the web app?

@rufuspollock
Copy link
Member

@davidread I'm very happy with partitioning - and it means we can have per-jurisdiction maintainers.

Re Nomenklatura definitely put this into publicbodies/scripts (need to recreate the directory). Also if you have any instructions or a short tutorial on how to do this it would be great to have so others can follow it too - just add it to the README or other suitable place!

@rufuspollock
Copy link
Member

@davidread any suggestions for best way to push to nomenklatura (including your current practice) very welcome ...

@todrobbins
Copy link
Contributor

@rufuspollock @pudo @davidread any interest in reviving work on Nomenklatura integrations? What is the current status of Nomenklatura project?

Cheers!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants