Missing Data and Linux OOM killing odf_SL_plugin

Technical Support
1

Hi!

I have a Raspberry Shake m Boom that I’ve recently discovered seems to have some issues. I’m trying to determine the best approach based on log files, before I have to either replace the pi, or reformat and restart. This Pi is located fairly remotely, so it is not a simple job to get to id and do a quick change.

The data is streamed via seedlink, but also stored locally. I can see there are lots of gaps of missing data in the miniseed files, both onboard as well as the recieved files via seedlink. I’m trying to sort out if this issue with missing data is to do with the memory issues as in the logs, or something else.

I’ve attached the RShake logs, as well as the dmesg log file.

In the dmesg log file, it appears that the instrument keeps running into an out of memory issues, with the Linux OOM killing the odf_SL_plugin continuously.

Is there any obvious fix to this, apart from reformatting the card and trying again?

Thanks,
Andrew
dmesg.log (128.8 KB)
RA382.tgz (347.1 KB)

2

Hello Andrew, and welcome back to the community!

Thank you for the logs and the details, as usual. From what I can see, the Shake boots up without issues, but some of the log files appear incomplete, as if truncated.

Also, there are some issues as you can see from this series of errors:

2022 274 00:07:41>>	No Data has been received from the MCU in 12 read attempts.It appears the MCU is not transmitting data.  This is a fatal condition and should be investigated if this condition persists!
2022 274 00:07:41>>	Data has been successfully received, fatal condition resolved.
2022 274 00:07:41>>	internal error: buffer overflow!  cannot process read data...
2022 274 00:07:41>>	buf: {ÿOk3‚aSEUEBiƒaQÿOk¨M¸²„Q'TI I]ª'”E2AQ0ZE
2022 274 00:07:41>>	XAëœJ]Šä,Yà„EAAºEBaƒà®ÔUEÙªQŠ$QŒ‘EEU

The gibberish above, paired with buffer overflow and MCU errors, is usually a symptom of insufficient power supply, where the Shake cannot get enough power to either start or work properly.

Furthermore, the OOM errors that you are seeing could also be related to microSD card corruption. Thus, in the end, I advise you to

  1. check whether the current power supply continues to deliver a stable voltage between 5.0 and 5.2V and a current of at least 2.5A at all times (3.0A if the Raspberry Pi board being used is an RPi4), as a decrease in power could lead to data service interruption. If you have another Pi power supply that you know is in working condition, please try exchanging the current one with that and see if the Shake now appears more stable.

and also

  1. re-burning a completely new microSD after formatting and erasing all its data/partitions (you can use DISKPART for this, as it is very efficient), and then see how the Shake behaves with the newly installed system, possibly resolving the issues we are seeing. I will leave the burning instructions link here for your convenience: microSD card topics .

Since, from what I understand, you’ll have to go to the Shake installation location, a good check you can do to see if all the connections between the sensor, the blue Shake board, and the Pi board are still solid and free of dirt or other elements that could compromise transmission could be a good idea. If you decide to disassemble the Shake during this process, please refer to our recommended ESD (ElectroStatic Discharge) guidelines and assembly/disassembly video guides here.

In our experience, the problem is usually related to insufficient power supply, so the first test should help.

Let me know how everything goes.

3

Thank you very much @Stormchaser , for the really detailed reply.

When I have seen the voltage issue in the past, I often seen the undervoltage warnings in the dmesg log. I didn’t see it in this one, though I suppose not having that message isn’t necessarily diagnostic of the actual issue.

I’ll get back to you, thank you! (It may be some time until we can affect a change, as the instrument is currently inaccessible due to snow accumulation on the road to get to it).

1 Like