Coconut Upload Failures

One possible solution to this is to create a workflow where I can manually upload files through coconut to be stored on digital ocean, and the add a video playlist manually using the digital ocean url …

The complexity of the full process — uploaded to one folder in digital ocean which triggers a coconut job on a watched folder which then causes a file to be written in another digital ocean folder which then causes the fv player front end to create a video in a playlist is just too complex to make it all work right consistently.

There should be an alternative to this complex process that works more consistently than what we’re forced to use right now.

In this case the file name was 1.8.f.2.mp4. The third time I uploaded it–from the same location on my hard drive, the same file–it succeeded. The first two times it failed. It’s 1,406,670 kb (so 1.34g).

According to the property details:

12:36 length
1920×1080
14921kbps data rate
15239kbps total bit rate
29.97 fps

The error (bad url) seems to indicate the file is uploaded to the “to be processed” folder on DO, and then is somehow unavailable when Coconut tries to access it. The job normally fails on the https timeout, so a few second (I think it’s 6 here). Rerunning the job has the same result, so it doesn’t look time bound.

What it looks like is Coconut picks up the wrong url or some such when trying to access the file.

I’ve not tried to upload the files directly as there aren’t any instructions on how to do that … I’m not entirely certain which directory I’d put the file in, nor is there an “add new” when I look at “coconut jobs” on wpadmin. When I select “coconut jobs” on wpadmin I only have the existing jobs. The “add new” button flashes, but then it’s disappears, so I assume that has been disabled to force users to upload through the fv player interface.

I just received another failure —

We couldn’t transfer the input file, please check the following:

This is after the file is uploaded to the staging directory … the directory and files are there on digital ocean, and yet it “fails to upload,” and fails to process.

There is a defect in your processing pipeline (like so many other places with this software) that needs to be fixed.

(log file link, redacted)

is the log, which says:

2024-8-05 02:13:44 - multiupload_complete: S3 completeMultipartUpload done: nyc3.digitaloceanspaces.com/rule11-ac-source-vids-to-convert/3.5.a.mp4
2024-8-05 02:13:44 - job_submit: stdClass Object
(
  [settings] => stdClass Object
    (
      [ultrafast] => 1
    )

  [input] => stdClass Object
    (
      [url] => https://nyc3.digitaloceanspaces.com/rule11-ac-source-vids-to-convert/3.5.a.mp4?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=DO...AT4%2F20240805%2Fnyc3%2Fs3%2Faws4_request&X-Amz-Date=20240805T021344Z&X-Amz-Expires=14400&X-Amz-SignedHeaders=host&X-Amz-Signature=18...28
    )
  [notification] => stdClass Object
    (
      [type] => http
      [url] => https://rule11.ac?fv_player_coconut_job_id=31
    )
  [outputs] => stdClass Object
    (
      [jpg:320x] => stdClass Object
        (
          [path] => //cdn.foliovision.com/3-5-a/sprite-ec5785f76c.jpg
          [interval] => 0
          [sprite] => stdClass Object
            (
              [limit] => 1000
            )
          [vtt] => stdClass Object
            (
              [filename] => sprite-ec5785f76c.vtt
            )
        )
      [jpg:300x] => stdClass Object
        (
          [path] => //cdn.foliovision.com/3-5-a/thumbnail-f69800fbd9.jpg
        )
      [jpg:1280x] => stdClass Object
        (
          [path] => //cdn.foliovision.com/3-5-a/thumbnail-large-49edb4dcc1.jpg
        )
      [httpstream] => stdClass Object
        (
          [if] => {{ input.height }} <= 2160
          [hls] => stdClass Object
            (
              [path] => /3-5-a
              [version] => 3
            )
          [playlist_name] => index
          [variants] => Array
            (
              [0] => mp4:240p_320k::maxrate=960k
              [1] => mp4:480p_700k::maxrate=2100k
              [2] => mp4:720p_4000k::maxrate=12000k
              [3] => mp4:1080p_6000k::maxrate=18000k
              [4] => mp4:0x1440_10000k::maxrate=30000k
              [5] => mp4:2160p_16000k::maxrate=48000k
            )
        )
      [httpstream#above4K] => stdClass Object
        (
          [if] => {{ input.height }} > 2160
          [hls] => stdClass Object
            (
              [path] => /3-5-a
              [version] => 3
            )
          [playlist_name] => index
          [variants] => Array
            (
              [0] => mp4:240p_320k::maxrate=960k
              [1] => mp4:480p_700k::maxrate=2100k
              [2] => mp4:720p_4000k::maxrate=12000k
              [3] => mp4:1080p_6000k::maxrate=18000k
              [4] => mp4:0x1440_10000k::maxrate=30000k
              [5] => mp4:2160p_16000k::maxrate=48000k
            )
        )
    )
)

The file uploaded, but for whatever reason coconut fails to connect to the object storage on digital ocean … that needs to be fixed.