transformTemplate format with version stored into plain file

[fmunteanu]

What would you like help with?

I would like help with my configuration

How are you running Renovate?

Mend Renovate hosted app on github.com

If you're self-hosting Renovate, tell us which platform (GitHub, GitLab, etc) and which version of Renovate.

No response

Please tell us more about your question or problem

Right now I use the following customDatasource:

  "customDatasources": {
    "cilium": {
      "defaultRegistryUrlTemplate": "https://raw.githubusercontent.com/cilium/cilium/main/stable.txt",
      "format": "plain"
    }
  }

Which returns the Cilium stable release. My goal is to use a transformTemplate, which allows me to include the release changelog details, however, I'm not sure how to define the version (note VERSION_HERE) contained into stable.txt file:

  "customDatasources": {
    "cilium": {
      "defaultRegistryUrlTemplate": "https://raw.githubusercontent.com/cilium/cilium/main/stable.txt",
      "format": "plain",
      "transformTemplates": [
        "{\"releases\": [{\"version\": VERSION_HERE, \"changelogUrl\": $join([\"https://github.com/cilium/cilium/releases/tag/\", VERSION_HERE]), \"sourceUrl\": \"https://github.com/cilium/cilium\"}], \"sourceUrl\": \"https://github.com/cilium/cilium\", \"homepage\": \"https://cilium.io/\"}"
      ]
    }
  }

Logs (if relevant)

Logs

Replace this text with your logs, between the starting and ending triple backticks

[fmunteanu]

@rarkins I know you previously helped me to address other Renovate issues, I was wondering if you can take few minutes of your busy time to see if there is a possible fix for my configuration. I looked at the documentation examples, but none of them show how to grab the version from a plain text file.

I tried this mapping without success:

    "cilium": {
      "defaultRegistryUrlTemplate": "https://raw.githubusercontent.com/cilium/cilium/main/stable.txt",
      "format": "plain",
      "transformTemplates": [
        "{\"releases\": [{\"version\": $., \"changelogUrl\": $join([\"https://github.com/cilium/cilium/releases/tag/\", $.]), \"sourceUrl\": \"https://github.com/cilium/cilium\"}], \"homepage\": \"https://cilium.io/\", \"sourceUrl\": \"https://github.com/cilium/cilium\"}"
      ]
    }

DEBUG: Datasource connection error
{
  "datasource": "custom"
  "packageName": "cilium/cilium"
  "errCode": "S0211"
}

Looking at the docs, I'm also not sure why sourceUrl is present twice into template, is it necessary?

[viceice]

try just data and remove the $$.() stuff

[viceice]

there's also a missing escape before }

[viceice]

wait, your input is already in right format

renovate/lib/modules/datasource/custom/formats/plain.ts

Line 11 in 26337ac

return { version: value };

you'll get an object with releases property where every line from text file is a version.

[viceice]

try this

   "cilium": {
      "defaultRegistryUrlTemplate": "https://raw.githubusercontent.com/cilium/cilium/main/stable.txt",
      "format": "plain",
      "transformTemplates": [
        "{\"releases\": $.releases, \"homepage\": \"https://cilium.io/\", \"sourceUrl\": \"https://github.com/cilium/cilium\"}"
      ]
    }

[github-actions[bot]]

Hi there,

Get your discussion fixed faster by creating a minimal reproduction. This means a repository dedicated to reproducing this issue with the minimal dependencies and config possible.

Before we start working on your issue we need to know exactly what's causing the current behavior. A minimal reproduction helps us with this. Discussions without reproductions are less likely to be converted to Issues.

To get started, please read our guide on creating a minimal reproduction.

Good luck,

The Renovate team

[fmunteanu]

@viceice, that fixed the issue, thank you!

I'm still having issues with the release notes in Cilium, same thing as described into in #29670, they are not displayed. I'm marking this discussion as answered.

[viceice]

it's because your custom datasource doesn't return all versions, so renovate can't compute the diff. mainly the current version is missing.

that's the same issue on the other discussion.
I'll post another description there.