Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

📊 Update faostat data #2416

Merged
merged 62 commits into from
Mar 25, 2024
Merged

📊 Update faostat data #2416

merged 62 commits into from
Mar 25, 2024

Commits on Mar 13, 2024

  1. Adapt create new snapshots script

    @pabloarosado
    pabloarosado committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    22e5dec View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2024

  1. Fix create_new_snapshots

    @pabloarosado
    pabloarosado committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    418274d View commit details
    Browse the repository at this point in the history

  2. Add snapshots and meadow steps, and remove wcad

    @pabloarosado
    pabloarosado committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    7508ad4 View commit details
    Browse the repository at this point in the history

  3. Remove faostat_gn and fix issues

    @pabloarosado
    pabloarosado committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    79e1784 View commit details
    Browse the repository at this point in the history

  4. Fix meadow faostat_sdgb

    @pabloarosado
    pabloarosado committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    3d0eaf2 View commit details
    Browse the repository at this point in the history

  5. Update docs

    @pabloarosado
    pabloarosado committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    ac6e691 View commit details
    Browse the repository at this point in the history

  6. Add garden steps and minor improvements on meadow

    @pabloarosado
    pabloarosado committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    17de3c2 View commit details
    Browse the repository at this point in the history

  7. Fix issues with item code changes in faostat_fs

    @pabloarosado
    pabloarosado committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    273de4f View commit details
    Browse the repository at this point in the history

  8. Add new flag, and increase number of characters for item codes of fao… 

    …stat_sdgb
    @pabloarosado
    pabloarosado committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    6277a02 View commit details
    Browse the repository at this point in the history

  9. Remove unused excluded country, fix new element mismatch between fbsh… 

    … and fbs, and replace assertions with log errors
    @pabloarosado
    pabloarosado committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    660ed7f View commit details
    Browse the repository at this point in the history

  10. Fix issue with categorical columns in script that updates custom meta… 

    …data
    @pabloarosado
    pabloarosado committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    a9c5fc4 View commit details
    Browse the repository at this point in the history

  11. Update custom metadata files

    @pabloarosado
    pabloarosado committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    c4169f8 View commit details
    Browse the repository at this point in the history

  12. Add element amendments for fbsc

    @pabloarosado
    pabloarosado committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    c7dd40a View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2024

  1. Merge branch 'master' of github.com:owid/etl into update-faostat-data

    @pabloarosado
    pabloarosado committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    196e9db View commit details
    Browse the repository at this point in the history

  2. Fix various issues

    @pabloarosado
    pabloarosado committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    8a39331 View commit details
    Browse the repository at this point in the history

  3. Remove anomaly fix on cocoa beans, which is no longer in the data

    @pabloarosado
    pabloarosado committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    9ff00b5 View commit details
    Browse the repository at this point in the history

  4. Fix issues with region aggregates in fbsc

    @pabloarosado
    pabloarosado committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    eb45fab View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. Merge branch 'master' of github.com:owid/etl into update-faostat-data

    @pabloarosado
    pabloarosado committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    27ffd25 View commit details
    Browse the repository at this point in the history

  2. Explicitly use regions, population and income groups datasets

    @pabloarosado
    pabloarosado committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    d4606b8 View commit details
    Browse the repository at this point in the history

  3. Fix anomaly of spinach area harvested in China

    @pabloarosado
    pabloarosado committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    2966376 View commit details
    Browse the repository at this point in the history

  4. Fix errors on missing units

    @pabloarosado
    pabloarosado committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    91f8f43 View commit details
    Browse the repository at this point in the history

  5. Minor fixes

    @pabloarosado
    pabloarosado committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    649303d View commit details
    Browse the repository at this point in the history

  6. Fix missing metadata in latest faostat_qv, big refactor

    @pabloarosado
    pabloarosado committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    d906ba8 View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. Fix changed item in qcl and global food explorer

    @pabloarosado
    pabloarosado committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    a109206 View commit details
    Browse the repository at this point in the history

  2. Add grapher steps (WIP)

    @pabloarosado
    pabloarosado committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    e4cc4d7 View commit details
    Browse the repository at this point in the history

  3. Use tables instead of dataframes

    @pabloarosado
    pabloarosado committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    3da102e View commit details
    Browse the repository at this point in the history

  4. Use tables instead of dataframes in fbsc and qcl steps

    @pabloarosado
    pabloarosado committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    4aad908 View commit details
    Browse the repository at this point in the history

  5. Use tables instead of dataframes in garden metadata step

    @pabloarosado
    pabloarosado committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    38d5a4a View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' of github.com:owid/etl into update-faostat-data

    @pabloarosado
    pabloarosado committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    eb45770 View commit details
    Browse the repository at this point in the history

  7. Improve metadata handling of meadow steps

    @pabloarosado
    pabloarosado committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    ef0a19a View commit details
    Browse the repository at this point in the history

  8. Ensure origins are properly propagated

    @pabloarosado
    pabloarosado committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    deffc1d View commit details
    Browse the repository at this point in the history

  9. Fix various issues to ensure origins are propagated

    @pabloarosado
    pabloarosado committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    210f059 View commit details
    Browse the repository at this point in the history

  10. Fix missing origins

    @pabloarosado
    pabloarosado committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    da3d6a7 View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2024

  1. Raise warning if domains do not exist any longer in FAOSTAT, and remo… 

    …ve those
    @pabloarosado
    pabloarosado committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    424f50e View commit details
    Browse the repository at this point in the history

  2. Update docs

    @pabloarosado
    pabloarosado committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    1f5c48d View commit details
    Browse the repository at this point in the history

  3. 🐛 retry on SSLError

    @Marigold
    Marigold committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    8e2431c View commit details
    Browse the repository at this point in the history

  4. Remove steps that do not exist anymore in FAOSTAT

    @pabloarosado
    pabloarosado committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    3b0c8e4 View commit details
    Browse the repository at this point in the history

  5. Ensure origins are propagated

    @pabloarosado
    pabloarosado committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    632a27e View commit details
    Browse the repository at this point in the history

  6. Fix changed country names

    @pabloarosado
    pabloarosado committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    5963b81 View commit details
    Browse the repository at this point in the history

  7. Avoid repetitive warning on missing units

    @pabloarosado
    pabloarosado committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    5b63f9e View commit details
    Browse the repository at this point in the history

  8. Check discrepant item name definitions and improve warning messages a… 

    …nd documentation
    @pabloarosado
    pabloarosado committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    c8f00c5 View commit details
    Browse the repository at this point in the history

  9. Improve warning messages

    @pabloarosado
    pabloarosado committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    5aee362 View commit details
    Browse the repository at this point in the history

  10. Inspect remaining warnings and improve warning handling

    @pabloarosado
    pabloarosado committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    7ac08af View commit details
    Browse the repository at this point in the history

  11. Add garden and grapher step of additional variables

    @pabloarosado
    pabloarosado committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    acd456a View commit details
    Browse the repository at this point in the history

  12. Adapt garden and grapher steps of additional variables

    @pabloarosado
    pabloarosado committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    5a54af1 View commit details
    Browse the repository at this point in the history

  13. Add multi_merge function to owid catalog

    @pabloarosado
    pabloarosado committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    06ae673 View commit details
    Browse the repository at this point in the history

  14. Update metadata of additional variables dataset

    @pabloarosado
    pabloarosado committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    751594c View commit details
    Browse the repository at this point in the history

  15. Improve metadata of additional variables dataset

    @pabloarosado
    pabloarosado committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    5de6499 View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2024

  1. Improve function that finds dataset id from name

    @pabloarosado
    pabloarosado committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    1b5febd View commit details
    Browse the repository at this point in the history

  2. Improve script to submit faostat chart revisions

    @pabloarosado
    pabloarosado committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    95c11e4 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of github.com:owid/etl into update-faostat-data

    @pabloarosado
    pabloarosado committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    6c28550 View commit details
    Browse the repository at this point in the history

  4. Fix errors in script that creates chart revisions

    @pabloarosado
    pabloarosado committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    c98ef24 View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2024

  1. Delete unused faostat script

    @pabloarosado
    pabloarosado committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    cfc3a5e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:owid/etl into update-faostat-data

    @pabloarosado
    pabloarosado committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    4f4ecb1 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of github.com:owid/etl into update-faostat-data

    @pabloarosado
    pabloarosado committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    a817da2 View commit details
    Browse the repository at this point in the history

  4. Fix bad format of description_key

    @pabloarosado
    pabloarosado committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    ed19a50 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' of github.com:owid/etl into update-faostat-data

    @pabloarosado
    pabloarosado committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    195d7cb View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. Improve snapshot descriptions

    @pabloarosado
    pabloarosado committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    c029fd3 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:owid/etl into update-faostat-data

    @pabloarosado
    pabloarosado committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    c19fb04 View commit details
    Browse the repository at this point in the history

  3. Update custom metadata files and documentation

    @pabloarosado
    pabloarosado committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    f0924be View commit details
    Browse the repository at this point in the history

  4. Improve metadata

    @pabloarosado
    pabloarosado committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    6289859 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' of github.com:owid/etl into update-faostat-data

    @pabloarosado
    pabloarosado committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    8ea47e2 View commit details
    Browse the repository at this point in the history