Radish alpha
r
radicle-ci-broker
rad:zwTxygwuz5LDGBq255RA2CbNGrz8
Radicle CI broker
Radicle
Git
Issues › 490e84f3
The broker appears to not produce any job COB updates when adapter exits with non-zero exit code
Open levitte opened 9 months ago needs-reproduction

Looking at it with rad job list, the result appears like this:

    {
      "job_id": "ab2cd5462704ff19da53c4082d11bb790a891ef0",
      "oid": "29043134a361aa8931cd069a1c72e3d2e8deae97",
      "runs": []
    },

On my CI node, the broker reported this:

Jul 15 18:50:21 svc service-start.sh[3918825]: {"timestamp":"2025-07-15T16:50:21.280289Z","level":"INFO","fields":{"message":"running adapter on event picked from queue","msg_id":"QueueProcPickedEvent","kind":"got_event","id":"QueueId { id: \"87e77be9-37ba-499b-b01c-7bd8e4ff5478\" }","event":"QueuedCiEvent { id: QueueId { id: \"87e77be9-37ba-499b-b01c-7bd8e4ff5478\" }, ts: \"2025-07-15 16:50:21.274077Z\", event: V1(BranchUpdated { from_node: PublicKey(z6MkireRatUThvd3qzfKht1S44wpm4FEWSSa4PRMTSQZ3voM), repo: RepoId(rad:z3gqcJUoA1n9HaHKufZs5FCSGazv5), branch: RefString(\"master\"), tip: Oid(29043134a361aa8931cd069a1c72e3d2e8deae97), old_tip: Oid(4e08eef8d5a7c3eacf18dcd17456a2d48809151c) }) }","adapter":"Adapter { bin: \"/usr/local/bin/radicle-container-ci\", env: {\"RAD_CCI_CONFIG\": \"/opt/radcis/ci.rad.levitte.org/cci.yaml\"}, config: {}, config_env: None }"}}
Jul 15 18:50:21 svc service-start.sh[3918825]: {"timestamp":"2025-07-15T16:50:21.280337Z","level":"INFO","fields":{"message":"Action: run","msg_id":"QueueProcActionRun","kind":"debug","event":"V1(BranchUpdated { from_node: PublicKey(z6MkireRatUThvd3qzfKht1S44wpm4FEWSSa4PRMTSQZ3voM), repo: RepoId(rad:z3gqcJUoA1n9HaHKufZs5FCSGazv5), branch: RefString(\"master\"), tip: Oid(29043134a361aa8931cd069a1c72e3d2e8deae97), old_tip: Oid(4e08eef8d5a7c3eacf18dcd17456a2d48809151c) })"}}
Jul 15 18:50:21 svc service-start.sh[3918825]: {"timestamp":"2025-07-15T16:50:21.283960Z","level":"INFO","fields":{"message":"trigger request result","msg_id":"QueueProcTrigger","kind":"got_event","result":"Ok(Trigger { common: EventCommonFields { version: 1, event_type: Push, repository: Repository { id: RepoId(rad:z3gqcJUoA1n9HaHKufZs5FCSGazv5), name: \"heartwood\", description: \"Radicle Heartwood Protocol & Stack\", private: false, default_branch: \"master\", delegates: [Did(\"did:key:z6MksFqXN3Yhqk8pTJdUGLwATkRfQvwZXPqR2qMEhbS9wzpT\"), Did(\"did:key:z6MktaNvN1KVFMkSRAiN4qK5yvX1zuEEaseeX5sffhzPZRZW\"), Did(\"did:key:z6MkireRatUThvd3qzfKht1S44wpm4FEWSSa4PRMTSQZ3voM\"), Did(\"did:key:z6MkgFq6z5fkF2hioLLSNu1zP2qEL1aHXHZzGH1FLFGAnBGz\"), Did(\"did:key:z6MkkPvBfjP4bQmco5Dm7UGsX2ruDBieEHi8n9DVJWX5sTEz\")] } }, push: Some(PushEvent { pusher: Author { id: Did(\"did:key:z6MkireRatUThvd3qzfKht1S44wpm4FEWSSa4PRMTSQZ3voM\"), alias: Some(Alias (\"fintohaps\")) }, before: Oid(29043134a361aa8931cd069a1c72e3d2e8deae97), after: Oid(29043134a361aa8931cd069a1c72e3d2e8deae97), branch: \"master\", commits: [Oid(29043134a361aa8931cd069a1c72e3d2e8deae97)] }), patch: None })"}}
Jul 15 18:50:21 svc service-start.sh[3918825]: {"timestamp":"2025-07-15T16:50:21.284040Z","level":"INFO","fields":{"message":"start CI run","msg_id":"BrokerRunStart","kind":"start_run"}}
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: wanted=29043134a361aa8931cd069a1c72e3d2e8deae97
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 045192cbc21cb74f4da0ba5db493a1130df9d724 with oid 4e429e4408293b6bbfb0909e07cd48181d5dc874
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 2195d36c42c3f6fe1bca35370d9c52c0ae223958 with oid 34939253f77c85bcb055a0d9deba6bd08e7f1b39
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 30a6a8f1845a2dc57bd13cf1b2c1e9e38cf19aa6 with oid b77809ae9d41d09b4f3053e2c35a723c29c2897e
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 3eb6c5997e399f55690df31447933ecf82ea7131 with oid 3a47003578e33a1cf6dff40885325bbe66bcab35
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 7b79cecd88587ee432aaf45491f2a0498b7fc923 with oid aee3975bddafd95577393cf6ded50c2a0980c58b
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 89ba77fc52887f6b5e51cd29b9b50652cffeb83d with oid 059c80458897e5c678611e22ed34b9531faeeda8
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 92a083d793b0897c598802b7a47044f150394dbd with oid 3ae2737a8f76be997e7db1bea54c313f2d383e5b
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 97d3fd5bbb98d0246b809025c701cb9ab60d5d20 with oid 29043134a361aa8931cd069a1c72e3d2e8deae97
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: wanted=29043134a361aa8931cd069a1c72e3d2e8deae97 => 97d3fd5bbb98d0246b809025c701cb9ab60d5d20
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: wanted=29043134a361aa8931cd069a1c72e3d2e8deae97
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 045192cbc21cb74f4da0ba5db493a1130df9d724 with oid 4e429e4408293b6bbfb0909e07cd48181d5dc874
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 2195d36c42c3f6fe1bca35370d9c52c0ae223958 with oid 34939253f77c85bcb055a0d9deba6bd08e7f1b39
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 30a6a8f1845a2dc57bd13cf1b2c1e9e38cf19aa6 with oid b77809ae9d41d09b4f3053e2c35a723c29c2897e
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 3eb6c5997e399f55690df31447933ecf82ea7131 with oid 3a47003578e33a1cf6dff40885325bbe66bcab35
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 7b79cecd88587ee432aaf45491f2a0498b7fc923 with oid aee3975bddafd95577393cf6ded50c2a0980c58b
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 89ba77fc52887f6b5e51cd29b9b50652cffeb83d with oid 059c80458897e5c678611e22ed34b9531faeeda8
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 92a083d793b0897c598802b7a47044f150394dbd with oid 3ae2737a8f76be997e7db1bea54c313f2d383e5b
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: consider 97d3fd5bbb98d0246b809025c701cb9ab60d5d20 with oid 29043134a361aa8931cd069a1c72e3d2e8deae97
Jul 15 18:50:22 svc service-start.sh[3918825]: job_for_commit: wanted=29043134a361aa8931cd069a1c72e3d2e8deae97 => 97d3fd5bbb98d0246b809025c701cb9ab60d5d20
Jul 15 18:54:00 svc service-start.sh[3918825]: job_for_commit: wanted=29043134a361aa8931cd069a1c72e3d2e8deae97
Jul 15 18:54:00 svc service-start.sh[3918825]: job_for_commit: consider 045192cbc21cb74f4da0ba5db493a1130df9d724 with oid 4e429e4408293b6bbfb0909e07cd48181d5dc874
Jul 15 18:54:00 svc service-start.sh[3918825]: job_for_commit: consider 2195d36c42c3f6fe1bca35370d9c52c0ae223958 with oid 34939253f77c85bcb055a0d9deba6bd08e7f1b39
Jul 15 18:54:00 svc service-start.sh[3918825]: job_for_commit: consider 30a6a8f1845a2dc57bd13cf1b2c1e9e38cf19aa6 with oid b77809ae9d41d09b4f3053e2c35a723c29c2897e
Jul 15 18:54:00 svc service-start.sh[3918825]: job_for_commit: consider 3eb6c5997e399f55690df31447933ecf82ea7131 with oid 3a47003578e33a1cf6dff40885325bbe66bcab35
Jul 15 18:54:00 svc service-start.sh[3918825]: job_for_commit: consider 7b79cecd88587ee432aaf45491f2a0498b7fc923 with oid aee3975bddafd95577393cf6ded50c2a0980c58b
Jul 15 18:54:00 svc service-start.sh[3918825]: job_for_commit: consider 89ba77fc52887f6b5e51cd29b9b50652cffeb83d with oid 059c80458897e5c678611e22ed34b9531faeeda8
Jul 15 18:54:00 svc service-start.sh[3918825]: job_for_commit: consider 92a083d793b0897c598802b7a47044f150394dbd with oid 3ae2737a8f76be997e7db1bea54c313f2d383e5b
Jul 15 18:54:00 svc service-start.sh[3918825]: job_for_commit: consider 97d3fd5bbb98d0246b809025c701cb9ab60d5d20 with oid 29043134a361aa8931cd069a1c72e3d2e8deae97
Jul 15 18:54:00 svc service-start.sh[3918825]: job_for_commit: wanted=29043134a361aa8931cd069a1c72e3d2e8deae97 => 97d3fd5bbb98d0246b809025c701cb9ab60d5d20
Jul 15 18:54:00 svc service-start.sh[3918825]: {"timestamp":"2025-07-15T16:54:00.698463Z","level":"ERROR","fields":{"message":"failed to run adapter or it failed to run CI: child process failed with wait status ExitStatus(unix_wait_status(25856))"}}
Jul 15 18:54:00 svc service-start.sh[3918825]: {"timestamp":"2025-07-15T16:54:00.698548Z","level":"INFO","fields":{"message":"Finish CI run","msg_id":"BrokerRunEnd","kind":"finish_run","run":"Run { broker_run_id: RunId { id: \"9a54beac-3ec5-401a-bf5f-1b57f1114c91\" }, adapter_run_id: Some(RunId { id: \"c212f7db-8376-4c60-9a2e-84a27ac7f312\" }), adapter_info_url: Some(\"https://cci.rad.levitte.org//c212f7db-8376-4c60-9a2e-84a27ac7f312.html\"), repo_id: RepoId(rad:z3gqcJUoA1n9HaHKufZs5FCSGazv5), repo_name: \"heartwood\", timestamp: \"2025-07-15 16:50:21Z\", whence: Branch { name: \"master\", commit: Oid(29043134a361aa8931cd069a1c72e3d2e8deae97), who: Some(\"did:key:z6MkireRatUThvd3qzfKht1S44wpm4FEWSSa4PRMTSQZ3voM (fintohaps)\") }, state: Finished, result: Some(Failure) }"}}

However, the job was actually run correctly, and did pass back a “triggered” and a “failure” message, see https://cci.rad.levitte.org//c212f7db-8376-4c60-9a2e-84a27ac7f312.html

However, as that report suggests, the adapter exited with exit code 101, which translate into the wait status 25856 (101 * 256).

Ideally, the job COB should have been updated, just like the broker HTML report gets updated, regardless of adapter exit code.

liw commented 8 months ago

I don’t seem to be able to reproduce this, even with the 0.19.1 release. I’m adding a test scenario to verify this works and continues to work, though.

Sign in with GitHub to comment