2 RS1D Connected to server, but no data showing

Technical Support
1

Hi,

On Wednesday I installed two RS1D in two Victoria Schools. In our Shakenet account, it shows the two instruments as online, but there is no data in the feed. Similarly when I look at the dataview webpage (dataview.raspberryshake.org), the stations appear to be online, but I don’t see any data in the realitime (live) view.

Logging into both RS and view the output of the command “myshake”, it shows that they have a Server Connection and that data forwarding is enabled.

Are you able to help troubleshoot why they all seem to be online and running, but the data isn’t visible from the Raspberry Shake website?

Note, I have them connected to our own SchoolShake server using seedlink, and there I can see the data streaming in in realtime.

Thanks very much for any insights,
Andrew

1 Like
2

Just an FYI, the first thing they are going to ask for is the logs from each device - you download them from the web page. I would suggest uploading those here to avoid delay.

1 Like
3

Hello Andrew,

Thank you for contacting us about this issue you are experiencing. However, as Philip said, I would at least need the Shake codes and logs to be able to help you.

Please, when you have the chance, download and post them here so that I can take a look. If needed, instructions on how to do so can be found on this page: Please read before posting!

Thank you for your collaboration.

4

Thanks @Stormchaser , @PhilipPeake. I realize of course you need those.

Can you guys remind me, is there a method for collecting the necessary log files from the command line, equivalent to the “Download Log Files”.

Or can I just tgz the log direction in /opt and submit that.

Note, here is the output of “myshake”.

System Report:  Mon Mar 27 15:46:04 UTC 2023

Versioning
----------

      OS Version : Raspbian GNU/Linux 10 (buster)
  Kernel version : Linux r4081 4.14.79-v7+ #1159 SMP Sun Nov 4 17:50:20 GMT 2018 armv7l GNU/Linux
Software Version : v0.20
Firmware Version : RS1D-10-4.18
     ODF Version : 2020.045

Computer Info
-------------

   RPi revision : a020d3 (3 Model B+)
ODF Serial Port : /dev/ttyS0
    MAC Address : b8:27:eb:bd:40:81
         UpTime : 15:46:04 up 4 days, 21:40,  1 user,  load average: 0.10, 0.09, 0.03
    System time : Mon Mar 27 15:46:04 UTC 2023:
     Disc usage : /dev/root  7.4G  3.1G  4.3G  42% /
       CPU Temp : 48 C

System Info
-----------

heli_ewII : NOT Running
      OWS : Running
 SeedLink : Running
      ODF : Running
slarchive : Running
SL info:

AM R4081 00 EHZ D 2023/03/27 15:44:19.6740  -  2023/03/27 15:46:04.1440

crontab Info:
-----------

@daily /usr/local/bin/myShake
@hourly /usr/local/bin/clean-logs
51 17 * * 0  /usr/local/bin/rsh-sw-fetcher C >/dev/null 2>&1

Station Info
------------

Data-Sharing Mode : ON
 Data Server Conn : ON
   Save Data Days : 30
       Heli Scale : 0.5
     Station Name : AM.R4081.00.EHZ
         Geophone : OSOP

Clock Info
-----------

* ntpdate.service - Network Time Service
   Loaded: loaded (/lib/systemd/system/ntpdate.service; enabled; vendor preset: enabled)
   Active: active (exited) since Wed 2023-03-22 18:07:29 UTC; 4 days ago
   CGroup: /system.slice/ntpdate.service

Mar 22 18:07:22 r4081 ntpd[1323]: Listen normally on 4 docker0 172.17.0.2:123
Mar 22 18:07:22 r4081 ntpd[1323]: Listen normally on 5 lo [::1]:123
Mar 22 18:07:22 r4081 ntpd[1323]: Listen normally on 6 eth0 [fe80::ba27:ebff:febd:4081%2]:123
Mar 22 18:07:22 r4081 ntpd[1323]: Listen normally on 7 docker0 [fe80::42:42ff:fe97:d676%4]:123
Mar 22 18:07:22 r4081 ntpd[1323]: Listen normally on 8 veth602d438 [fe80::6c1d:2fff:fe13:e0dc%6]:123
Mar 22 18:07:22 r4081 ntpd[1323]: Listening on routing socket on fd #25 for interface updates
Mar 22 18:07:29 r4081 ntpd[1323]: ntpd: time slew +7.291337 s
Mar 22 18:07:29 r4081 ntpd[1323]: 22 Mar 18:07:29 ntpd[1323]: ntpd: time slew +7.291337 s
Mar 22 18:07:29 r4081 ntpd[1323]: ntpd: time slew +7.291337s
Mar 22 18:07:29 r4081 systemd[1]: Started Network Time Service.

* ntpd.service - Network Time Service
   Loaded: loaded (/lib/systemd/system/ntpd.service; enabled; vendor preset: enabled)
   Active: active (running) since Wed 2023-03-22 18:07:32 UTC; 4 days ago
 Main PID: 1349 (ntpd)
   CGroup: /system.slice/ntpd.service
           `-1349 /usr/sbin/ntpd -u ntp:ntp -f /etc/ntp.conf -p /run/ntpd.pid

Mar 25 11:31:15 r4081 ntpd[1349]: Deleting interface #14 veth46f24ae, 169.254.103.53#123, interface stats: received=0, sent=0, dropped=0, active_time=231028 secs
Mar 27 15:44:12 r4081 ntpd[1349]: Deleting interface #13 veth90c6143, fe80::28ca:ebff:fe6b:307e%10#123, interface stats: received=0, sent=0, dropped=0, active_time=419011 secs
Mar 27 15:44:12 r4081 ntpd[1349]: Deleting interface #15 veth90c6143, 169.254.177.79#123, interface stats: received=0, sent=0, dropped=0, active_time=419003 secs
Mar 27 15:44:18 r4081 ntpd[1349]: Listen normally on 16 veth180f827 [fe80::cc19:ddff:fe4e:1711%12]:123
Mar 27 15:44:18 r4081 ntpd[1349]: Listen normally on 17 veth5286ddd [fe80::9450:5ff:fede:d0c5%14]:123
Mar 27 15:44:18 r4081 ntpd[1349]: new interface(s) found: waking up resolver
Mar 27 15:44:25 r4081 ntpd[1349]: Listen normally on 18 veth180f827 169.254.141.157:123
Mar 27 15:44:25 r4081 ntpd[1349]: new interface(s) found: waking up resolver
Mar 27 15:44:27 r4081 ntpd[1349]: Listen normally on 19 veth5286ddd 169.254.27.238:123
Mar 27 15:44:27 r4081 ntpd[1349]: new interface(s) found: waking up resolver

     remote           refid      st t when poll reach   delay   offset  jitter
==============================================================================
 SHM(0)          .GPS.            0 l    -   16    0    0.000    0.000   0.000
 SHM(1)          .PPS.            0 l    -   16    0    0.000    0.000   0.000
+dns3.switch.ca  206.108.0.131    2 u  557 1024  377   17.245    1.401   0.708
*speedtest.switc 206.108.0.131    2 u  172 1024  377   17.204    1.431   0.110
+time.cloudflare 10.69.8.92       3 u  113 1024  377    4.470   -2.089   0.136

Network Info
--------------------

  Stand-Alone Mode : OFF
       Ethernet UP : YES
           WiFi UP : YES
     DNS Available : YES
Network Accessible : YES
       Nameservers : 10.0.112.18,10.0.112.19,8.8.8.8, 8.8.4.4, 180.76.76.76

=== Shake Data Server ===
 Name: raspberryshakedata.com
 Port 55555 : YES
 Port 55556 : YES

=== ifconfig =======
docker0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 172.17.0.2  netmask 255.255.0.0  broadcast 0.0.0.0
        inet6 fe80::42:42ff:fe97:d676  prefixlen 64  scopeid 0x20<link>
        ether 02:42:42:97:d6:76  txqueuelen 0  (Ethernet)
        RX packets 2353666  bytes 543773344 (518.5 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 730746  bytes 140685672 (134.1 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 10.68.127.101  netmask 255.255.255.0  broadcast 10.68.127.255
        inet6 fe80::ba27:ebff:febd:4081  prefixlen 64  scopeid 0x20<link>
        ether b8:27:eb:bd:40:81  txqueuelen 1000  (Ethernet)
        RX packets 225619  bytes 17417614 (16.6 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 243940  bytes 74490465 (71.0 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 284553  bytes 58274123 (55.5 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 284553  bytes 58274123 (55.5 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

veth180f827: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 169.254.141.157  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::cc19:ddff:fe4e:1711  prefixlen 64  scopeid 0x20<link>
        ether ce:19:dd:4e:17:11  txqueuelen 0  (Ethernet)
        RX packets 1103  bytes 284748 (278.0 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 404  bytes 51694 (50.4 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

veth5286ddd: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 169.254.27.238  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::9450:5ff:fede:d0c5  prefixlen 64  scopeid 0x20<link>
        ether 96:50:05:de:d0:c5  txqueuelen 0  (Ethernet)
        RX packets 100  bytes 7137 (6.9 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 106  bytes 29506 (28.8 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

veth602d438: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 169.254.155.58  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::6c1d:2fff:fe13:e0dc  prefixlen 64  scopeid 0x20<link>
        ether 6e:1d:2f:13:e0:dc  txqueuelen 0  (Ethernet)
        RX packets 133  bytes 9784 (9.5 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 13529  bytes 3985091 (3.8 MiB)
        TX errors 0  dropped 1 overruns 0  carrier 0  collisions 0

===== END ========

=== /etc/network/interfaces FILE ==========
# interfaces(5) file used by ifup(8) and ifdown(8)

# Please note that this file is written to be used with dhcpcd
# For static IP, consult /etc/dhcpcd.conf and 'man dhcpcd.conf'

# Include files from /etc/network/interfaces.d:
source-directory /etc/network/interfaces.d

auto lo
iface lo inet loopback

iface eth0 inet manual

 # Start wlan0 definition
 allow-hotplug wlan0
 iface wlan0 inet dhcp

 wpa-conf /etc/wpa_supplicant/wpa_supplicant.conf
===== END ========

WiFi Info
--------------------

Kernel modules loaded : NO
           Enablement : OFF

Bluetooth Info
--------------------

Kernel modules loaded : NO
                State : inactive
           Enablement : disabled

Docker Info
--------------------

Docker version 1.11.1, build 5604cbe

IMAGE ID      CREATED AT                     SIZE      REPOSITORY
93374cd693bd  2021-09-17 20:39:31 +0000 UTC  95.46 MB  registry.gitlab.com/rshake-public/rsh-fe-config
7b20e90e6a6a  2020-02-14 13:25:56 +0000 UTC  159.5 MB  registry.gitlab.com/rshake-public/rsh-data-producer
992d3d7c940f  2017-06-10 16:40:10 +0000 UTC  144.8 MB  registry.gitlab.com/rshake-public/rsh-data-consumer

CONTAINER                                             STATUS              CREATED AT
registry.gitlab.com/rshake-public/rsh-data-consumer   Up About a minute   2023-03-27 15:44:13 +0000 UTC
registry.gitlab.com/rshake-public/rsh-data-producer   Up About a minute   2023-03-27 15:44:11 +0000 UTC
registry.gitlab.com/rshake-public/rsh-fe-config:v19   Up 4 days           2023-03-22 18:07:16 +0000 UTC
2 Likes
5

Hello gscShake,

Yes, there is an alternative to the Download Log Files from rs.local/.

As you have already surmised, the logs are inside the /opt/log folder of the Shakes, so if you could download both Shake’s log sets, zip/tgz them, and post them here, that would be great!

Thank you.

6

Thanks very much. Please find the two sets of log files attached. Note that I have discovered that one was no longer streaming seedlink this morning, though it had been for a number of days.

These two stations are within the same network as two other stations that seem to periodically stop talking to the NTP server (ie, their clocks drift). I don’t have control over that network. A reboot allows them to reconnect to the time server.

Please let me know if you see anything helpful in these logs. Although we are still able to access the data usually by our connection to the seedlink server, we are using the RaspberryShake online tools for the Classrooms to view their data, so I would like to sort out getting these sites on your website and server.

Thanks,
Andrew (SchoolShake)

r1b48.tgz (125.5 KB) r4081.tgz (94.6 KB)

2 Likes
7

Let me also add two other schools in the same school district. They both are connected and streaming to our system (through seedlink), but, they don’t show up as online for RS.

rf5c1.tgz (336.5 KB) rab72.tgz (339.3 KB)

2 Likes
8

Hello Andrew,

Thank you very much for all the logs from the interested Shakes. From what I can see, the booting up process proceeds smoothly, with the Shakes finding an internet & a NTP time synchronization server connection. Everything else also appears to be fine, so the Shake are operating nominally.

Regarding the transmission errors, some data manages to pass every now and then, but after that, this messages appear continuously:

023 081 17:47:37>>	DDSsendDP(): message send failed after 61 retries, closing connection.
2023 081 17:47:37>>	DDSsend(): Send error: 0
2023 081 17:47:37>>	sendDClientDP(): Error sending data ...

To verify that the Shake is in working order, I advise you trying to connect the Shake (a single one of them should be enough to start with) to another network (home, another office, or similar) and see if the unit manages to reach our servers in a stable manner from there.

If it does, then I advise you to reach again to your IT department and ask them to crosscheck what they have done, because there is still something missing with data transmission permissions in their firewalls. In some circumstances it has been needed to add both the Shake(s) IP(s) and MAC address(es) to a school network’s firewalls for them to be able to fully communicate with our servers, and this could be one of such cases, if this step hasn’t already been done.

9

Thanks very much @Stormchaser.

I will see about getting one of these stations back. Can you advise what specific ports are needed for that communication. Is it just 5555 and 5556 as listed in the output of myshake. Is both incoming and outgoing traffic on those ports need to be enabled.

The School Districts tend to be quite tight in terms of firewall permissions, so I want to make sure I have the complete list of ports and the directivity. I know I did look in the forum before and found a list of ports. I did request those previously, but just wanted to confirm.

I know that both RAB72 and RF5C1 did work previously (they did show up before with streaming data), but for some reason they no longer do. Perhaps something changed on the firewall side of things.

2 Likes
10

You’re very welcome Andrew.

Absolutely, the complete list of all the necessary ports (55555 and 55556 included) can be found here on our manual: Firewall issues? — Instructions on Setting Up Your Raspberry Shake

Yes, we know that schools, as also offices and other organizations can be restrictive in terms of firewall allowances, but these should be enough (together with the Shakes’ IP and MAC addresses) to get them back online.

And also yes, it is possible that something has changed on ther side, with some firewall upgrade or rework. I hope that your IT team will be able to assist. For anything else, I remain available.