Fragmented data arriving at RS Servers

[SchoolShake]

Hello,

This is a new ticket on a more broad issue that stems from two past tickets:

Shake Runs Connected to the server, then disconnects

Hi! I’m having an issue with one of our RS instruments. It is in a private home, not behind any specifically restrictive firewalls. It runs for a while (this amount of time can vary, but usually 10-24 hrs). During this period of time, it is successfully connected to the RS Data Server. You can view the data there. However, at a certain point, it loses the connection to the RS data server. The webpage and myshake.log output show no server connection. I can see during this time frame that the in…

AND

Data display on the dataview page

Hi! While I know it is not uncommon to get datagaps in the RS data as viewed on the dataview page, I have a station that has almost no data on the RS dataview webpage. I know that it does have complete data, as I obtain the data from it via seedlink. In looking at the instrument itself, ie viewing the myshake.log output, it says it has a connection to the raspberry shake server on ports 5555 and 5556. Any thoughts? Log files attached. The station in question is AM.R54F7. Screenshot of the data…

I’ll note, I do not believe this is an RS issue, but rather a firewall issue on the RS instrument side. The instruments affected are all installed in one specific school district. Instruments we have in other School Districts to not appear to have this issue, nor do ones in private homes or networks. I’m wondering if you see anything in the RS logs or from your server side that can help me track down why this is happening (and resolve it) with the School District IT.

The stations affected are:
RAB72 (offline for a long time)
RF5C1
R664C
R1B48
R4081 (doesn’t show up)
R54F7 (doesn’t show up)

Here are a couple of example screen shots from the RS Dataview page. You can see the much missing, and small bits of fragmented data.
RF5C1

R664C

These screenshots are taken right now.
However, via our seedlink streams, I can see that we are receiving the data these stations:

You can see the data in our mseed archive during the month of February so far. While there are some gaps, the data is 99% complete for R664C and 95% complete for RF5C1.

Here are the corresponding log files (plus dmesg output in the log folder) for RF5C1 and R664C, attached to this message.

Thanks very much for any insight! Again, I don’t think this is a problem on your/RS end, but I’m looking for any specific insights you might have that I can take to the firewall team at the school district. I had given them the various ports, most specifically the 5555 and 5556 that are needed for RS streaming Data and Metadata, and I’ve been told those are open…

RF5C1_logs.tgz (398.7 KB)
R664C_log.tgz (265.1 KB)

[Stormchaser]

Hello SchoolShake,

Great presentation of all the details that you have, it really helps!

We are checking the logs (thank you for them!) to see if we can offer some advice.

For now, just as a check, is this a typo?

most specifically the 5555 and 5556 that are needed

as the correct ports are 55555 and 55556, maybe you can ask your IT managers to crosscheck?

Yes, data is definitely there as the Seedlinks show, so something must be interfering with your ability to communicate to our servers. The pattern that emerges from DataView is very regular…

I’ll keep you updated.

[SchoolShake]

Thanks @Stormchaser.

That was my typo, they are 55555 and 55556. I provided the IT department essentially the contents of your Raspberry Shake Information Page that discusses the networking port requirements, and I added the SSH ports that I use.

Thanks for looking into this!
Best,
Andrew