Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Broker process running, but not accepting connections #629

Closed
kumar003vinod opened this issue Nov 23, 2017 · 30 comments
Closed

Broker process running, but not accepting connections #629

kumar003vinod opened this issue Nov 23, 2017 · 30 comments
Labels
Component: mosquitto-broker Status: Blocked Another issue needs to be resolved first Type: Bug

Comments

@kumar003vinod
Copy link
Contributor

Hi,

I have one broker process running from long time and with ps I can see the process, but it is not accepting connections.

vinod_kumar@mqtt-broker-2:~$ ps aux|grep -i mosquitto
vinod_k+  3865  0.0  0.0   8212  2164 pts/2    S+   05:11   0:00 grep --color=auto -i mosquitto
mosquit+ 25389  0.1  0.1  39688  5652 ?        R     2016 594:16 mosquitto -c mosquitto.conf -d

vinod_kumar@mqtt-broker-2:~$ mosquitto_sub -t hello -d
Error: Connection refused

The process is using far more than normal cpu usage
Output of top -

  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND                                                                                                          
25389 mosquit+  20   0   39688   5652   4188 R 99.9  0.1 584:37.48 mosquitto

I am using old version of mosquitto, so not sure if this issue is fixed in newer releases, though I checked and could not find any fix directly stating the problem I am facing.
Mosquitto version

mosquitto version 1.4.5 (build date Mon, 09 Nov 2015 15:00:46 +0000)
mosquitto is an MQTT v3.1 broker.

OS version

vinod_kumar@mqtt-broker-2:~$ lsb_release -a
No LSB modules are available.
Distributor ID:	Ubuntu
Description:	Ubuntu 15.04
Release:	15.04
Codename:	vivid

Mosquitto conf

vinod_kumar@mqtt-broker-2:~$ cat mosquitto.conf 
autosave_interval 100
persistence true
persistence_file m2.db
persistence_location ./
connection_messages true
log_timestamp true
listener 1883
listener 1884 127.0.0.1
protocol websockets
allow_duplicate_messages false
max_connections -1
max_inflight_messages 50
max_queued_messages 1000
persistent_client_expiration 3m
sys_interval 1

Output of memleax

vinod_kumar@mqtt-broker-2:~$ sudo memleax 25389
Warning: no debug-line found for /usr/sbin/mosquitto
== Begin monitoring process 25389...
CallStack[1]: memory expires with 80 bytes, backtrace:
    0x00007fb3dcc5d4a0  libc-2.21.so  __libc_malloc()+0  /build/buildd/glibc-2.21/malloc/hooks.c:77
    0x000000000040e666  mosquitto
    0x000000000040c291  mosquitto
    0x000000000040c566  mosquitto
    0x000000000041a783  mosquitto
    0x000000000040daac  mosquitto
    0x0000000000404a58  mosquitto
    0x00007fb3dcbf9a40  libc-2.21.so  __libc_start_main()+240  /build/buildd/glibc-2.21/stdio-common/_i18n_number.h:117
    0x0000000000404c87  mosquitto
CallStack[2]: memory expires with 1 bytes, backtrace:
    0x00007fb3dcc5d4a0  libc-2.21.so  __libc_malloc()+0  /build/buildd/glibc-2.21/malloc/hooks.c:77
    0x00007fb3dcc6442a  libc-2.21.so  strdup()+26  /build/buildd/glibc-2.21/string/strdup.c:42
    0x000000000040e736  mosquitto
    0x000000000040c2ba  mosquitto
    0x000000000040c566  mosquitto
    0x000000000041a783  mosquitto
    0x000000000040daac  mosquitto
    0x0000000000404a58  mosquitto
    0x00007fb3dcbf9a40  libc-2.21.so  __libc_start_main()+240  /build/buildd/glibc-2.21/stdio-common/_i18n_number.h:117
    0x0000000000404c87  mosquitto
CallStack[3]: memory expires with 19 bytes, backtrace:
    0x00007fb3dcc5d4a0  libc-2.21.so  __libc_malloc()+0  /build/buildd/glibc-2.21/malloc/hooks.c:77
    0x00007fb3dcc6442a  libc-2.21.so  strdup()+26  /build/buildd/glibc-2.21/string/strdup.c:42
    0x000000000040e736  mosquitto
    0x000000000040c2f8  mosquitto
    0x000000000040c566  mosquitto
    0x000000000041a783  mosquitto
    0x000000000040daac  mosquitto
    0x0000000000404a58  mosquitto
    0x00007fb3dcbf9a40  libc-2.21.so  __libc_start_main()+240  /build/buildd/glibc-2.21/stdio-common/_i18n_number.h:117
    0x0000000000404c87  mosquitto
CallStack[4]: memory expires with 16 bytes, backtrace:
    0x00007fb3dcc5d4a0  libc-2.21.so  __libc_malloc()+0  /build/buildd/glibc-2.21/malloc/hooks.c:77
    0x000000000040e666  mosquitto
    0x000000000040c3c6  mosquitto
    0x000000000040c566  mosquitto
    0x000000000041a783  mosquitto
    0x000000000040daac  mosquitto
    0x0000000000404a58  mosquitto
    0x00007fb3dcbf9a40  libc-2.21.so  __libc_start_main()+240  /build/buildd/glibc-2.21/stdio-common/_i18n_number.h:117
    0x0000000000404c87  mosquitto
CallStack[2]: expired-memory frees after 101 seconds
CallStack[3]: expired-memory frees after 101 seconds
CallStack[4]: expired-memory frees after 101 seconds
CallStack[1]: expired-memory frees after 101 seconds
CallStack[1]: memory expires with 80 bytes, 2 times again
CallStack[2]: memory expires with 1 bytes, 2 times again
CallStack[3]: memory expires with 19 bytes, 2 times again
CallStack[4]: memory expires with 16 bytes, 2 times again
CallStack[2]: expired-memory frees after 101 seconds
CallStack[3]: expired-memory frees after 101 seconds
CallStack[4]: expired-memory frees after 101 seconds
CallStack[1]: expired-memory frees after 101 seconds
CallStack[1]: memory expires with 80 bytes, 3 times again
CallStack[2]: memory expires with 1 bytes, 3 times again
CallStack[3]: memory expires with 19 bytes, 3 times again
CallStack[4]: memory expires with 16 bytes, 3 times again
CallStack[2]: expired-memory frees after 101 seconds
Warning: too many expired-free at CallStack[2]. will not show this CallStack later
CallStack[3]: expired-memory frees after 101 seconds
Warning: too many expired-free at CallStack[3]. will not show this CallStack later
CallStack[4]: expired-memory frees after 101 seconds
Warning: too many expired-free at CallStack[4]. will not show this CallStack later
CallStack[1]: expired-memory frees after 101 seconds
Warning: too many expired-free at CallStack[1]. will not show this CallStack later

Output of strace -

Process 25389 attached
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473126553}) = 0
poll([{fd=6, events=POLLIN}], 1, 0)     = 0 (Timeout)
clock_gettime(CLOCK_MONOTONIC, {34451458, 473166932}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473183767}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473200917}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473217392}) = 0
rt_sigprocmask(SIG_SETMASK, [INT], [], 8) = 0
poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN}, {fd=7, events=POLLIN}, {fd=9, events=POLLIN}], 4, 100) = 1 ([{fd=3, revents=POLLNVAL}])
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473295297}) = 0
poll([{fd=6, events=POLLIN}], 1, 0)     = 0 (Timeout)
clock_gettime(CLOCK_MONOTONIC, {34451458, 473352136}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473379862}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473397232}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473413209}) = 0
rt_sigprocmask(SIG_SETMASK, [INT], [], 8) = 0
poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN}, {fd=7, events=POLLIN}, {fd=9, events=POLLIN}], 4, 100) = 1 ([{fd=3, revents=POLLNVAL}])
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473486496}) = 0
poll([{fd=6, events=POLLIN}], 1, 0)     = 0 (Timeout)
clock_gettime(CLOCK_MONOTONIC, {34451458, 473518710}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473534360}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473550677}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473566255}) = 0
rt_sigprocmask(SIG_SETMASK, [INT], [], 8) = 0
poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN}, {fd=7, events=POLLIN}, {fd=9, events=POLLIN}], 4, 100) = 1 ([{fd=3, revents=POLLNVAL}])
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473637297}) = 0
poll([{fd=6, events=POLLIN}], 1, 0)     = 0 (Timeout)
clock_gettime(CLOCK_MONOTONIC, {34451458, 473677707}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473693527}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473709630}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473725872}) = 0
rt_sigprocmask(SIG_SETMASK, [INT], [], 8) = 0
poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN}, {fd=7, events=POLLIN}, {fd=9, events=POLLIN}], 4, 100) = 1 ([{fd=3, revents=POLLNVAL}])

Please let me know if I can provide anything else to help debug the issue.
@toast-uz
Copy link
Contributor

Is it your first time running mosquitto on this environment?
The mosquitto.conf is too complicated to clarify the issue. Could you replace mosuqitto.conf to "log_type all" only and report the console log?

@kumar003vinod
Copy link
Contributor Author

kumar003vinod commented Nov 23, 2017 •
edited

@toast-uz this is not first time. This issue does not occur often, I have faced this multiple times in this environment, it randomly occurs when broker is running from a long time (can be months). Once I restart the broker, it works fine.
And I am able to connect fine on 1884 port with websocket, the issue is only with 1883 port.
If I run netstat on instance running the broker fine vs on broker which is not accepting connection, I get this.
Instance with broker working fine

vinod_kumar@mqtt-broker:~$ sudo netstat -tulpn | grep :1883
tcp        0      0 0.0.0.0:1883            0.0.0.0:*               LISTEN      26368/mosquitto 
tcp6       0      0 :::1883                 :::*                    LISTEN      26368/mosquitto 
vinod_kumar@mqtt-broker:~$ sudo netstat -tulpn | grep :1884
tcp        0      0 0.0.0.0:1884            0.0.0.0:*               LISTEN      26368/mosquitto

Instance with broker not working fine

vinod_kumar@mqtt-broker-2:~$ sudo netstat -tulpn | grep :1883
tcp6       0      0 :::1883                 :::*                    LISTEN      25389/mosquitto 
vinod_kumar@mqtt-broker-2:~$ sudo netstat -tulpn | grep :1884
tcp        0      0 0.0.0.0:1884            0.0.0.0:*               LISTEN      25389/mosquitto

Seems like broker is not even listening on 1883 port.

@toast-uz
Copy link
Contributor

Any valid log of mosquitto?

@kumar003vinod
Copy link
Contributor Author

Logs were disabled on server, so I do not have any mosquitto logs.

@toast-uz
Copy link
Contributor

You can find some important hints of resolving your issue after setting logs of mosquitto. I guess some socket errors occurred on your environment. You can see "Error in poll" log with the description of the detailed cause when the issue is reproduced.

@edwin-oetelaar
Copy link

It seems like the first listening socket (with fd=3 which is likely the IPv4 listening socket) is invalid, that is why poll returns [{fd=3, revents=POLLNVAL}])
Maybe it got closed somehow?
Maybe it is related to #647
Using docker ?

@kumar003vinod
Copy link
Contributor Author

@edwin-oetelaar I am not using docker. I have enabled logs on instance. I will update in case I face this issue again.

@PierreF
Copy link
Contributor

PierreF commented Jan 4, 2018

I'm done a quick looks, and I don't find any reason why Mosquitto could close the listening socket :(
In addition to logs, I would also be interested in:

  • netstat -tanp | grep :1883 : this will also list established connection. Here I'm interested in the count. If non-zero, the number with and without process associated is interesting. (I don't care about IPs value)
  • lsof of the process. At least I'm interested to known if FD 3 is still open.

What I'm trying is to confirm is the listening socket is indeed closed or if it's still "open" but no longer listening.

Finally, are you able to reproduce this issue without websockets ? There are issue about Websockets listener that stop working, I would like to eliminate the possibility for Websockets to interfere in this issue.

@PierreF PierreF mentioned this issue Jan 5, 2018
Open
@PierreF PierreF added Type: Bug Component: mosquitto-broker Status: Blocked Another issue needs to be resolved first labels Jan 5, 2018
@PierreF PierreF mentioned this issue Jan 5, 2018
Closed
@kumar003vinod
Copy link
Contributor Author

I did not check the instance for long now as this is backup server and we almost never use it. Today checked and found that broker is again not accepting connections, but this time it's a throwing network protocol error. netstat output looks fine, but in process fds there is no fd 3.

Client mosqsub/24267-mqtt-brok sending CONNECT
Error: A network protocol error occurred when communicating with the broker.
vinod@mqtt-broker-2:~$ sudo netstat -tanp | grep :1883
tcp        0      0 0.0.0.0:1883            0.0.0.0:*               LISTEN      4988/mosquitto  
tcp        0      0 127.0.0.1:42058         127.0.0.1:1883          ESTABLISHED 15818/nodejs    
tcp        0      0 127.0.0.1:1883          127.0.0.1:42058         ESTABLISHED 4988/mosquitto  
tcp        0      0 127.0.0.1:42057         127.0.0.1:1883          ESTABLISHED 1432/nodejs     
tcp        0      0 127.0.0.1:1883          127.0.0.1:42057         ESTABLISHED 4988/mosquitto  
tcp6       0      0 :::1883                 :::*                    LISTEN      4988/mosquitto  
vinod@mqtt-broker-2:~$ ps aux|grep -i mosquitto
mosquit+  4988  0.0  0.1  38908  4788 ?        S     2017  67:11 mosquitto -c mosquitto.conf -d
vinod    24287  0.0  0.0   8212  2240 pts/0    S+   18:34   0:00 grep --color=auto -i mosquitto
vinod@mqtt-broker-2:/var/log/mosquitto$ sudo ls /proc/4988/fd
0  1  11  2  4	5  6  7  8  9
vinod@mqtt-broker-2:~$ sudo ls -l /proc/4988/fd
total 0
lrwx------ 1 root root 64 Mar  2 18:26 0 -> /dev/pts/1 (deleted)
lrwx------ 1 root root 64 Mar  2 18:26 1 -> /dev/pts/1 (deleted)
lrwx------ 1 root root 64 Mar  2 18:26 11 -> socket:[40962151]
lrwx------ 1 root root 64 Mar  2 18:26 2 -> /dev/pts/1 (deleted)
lrwx------ 1 root root 64 Mar  2 18:26 4 -> socket:[40337702]
lrwx------ 1 root root 64 Mar  2 18:26 5 -> socket:[40337703]
lr-x------ 1 root root 64 Mar  2 18:26 6 -> /dev/urandom
lrwx------ 1 root root 64 Mar  2 18:26 7 -> socket:[40337704]
lrwx------ 1 root root 64 Mar  2 18:26 8 -> socket:[40337707]
lrwx------ 1 root root 64 Mar  2 18:26 9 -> socket:[40337708]
vinod@mqtt-broker-2:~$ sudo lsof -i:1883
COMMAND     PID        USER   FD   TYPE   DEVICE SIZE/OFF NODE NAME
nodejs     1432 vinod_kumar   11u  IPv4 40337705      0t0  TCP localhost:42057->localhost:1883 (ESTABLISHED)
mosquitto  4988   mosquitto    4u  IPv4 40337702      0t0  TCP *:1883 (LISTEN)
mosquitto  4988   mosquitto    5u  IPv6 40337703      0t0  TCP *:1883 (LISTEN)
mosquitto  4988   mosquitto    8u  IPv4 40337707      0t0  TCP localhost:1883->localhost:42057 (ESTABLISHED)
mosquitto  4988   mosquitto    9u  IPv4 40337708      0t0  TCP localhost:1883->localhost:42058 (ESTABLISHED)
nodejs    15818 vinod_kumar    9u  IPv4 40337706      0t0  TCP localhost:42058->localhost:1883 (ESTABLISHED)
vinod@mqtt-broker-2:~$ cd /var/log/mosquitto/
vinod@mqtt-broker-2:/var/log/mosquitto$ ls
mosquitto.log  mosquitto.log.1.gz  mosquitto.log.2.gz  mosquitto.log.3.gz  mosquitto.log.4.gz  mosquitto.log.5.gz  mosquitto.log.6.gz  mosquitto.log.7.gz

Somehow it does not have write permission for db file, but that should not stop it from accepting connections ??

1513514556: Saving in-memory database to ./m2.db.
1513514556: Error saving in-memory database, unable to open ./m2.db.new for writing.
1513514556: Error: Permission denied.
1513514657: Saving in-memory database to ./m2.db.
1513514657: Error saving in-memory database, unable to open ./m2.db.new for writing.
1513514657: Error: Permission denied.
1513514701: New connection from 127.0.0.1 on port 1883.
1513514701: New client connected from 127.0.0.1 as mosqsub/13478-mqtt-brok (c1, k60).
1513514701: Sending CONNACK to mosqsub/13478-mqtt-brok (0, 0)
1513514701: Received SUBSCRIBE from mosqsub/13478-mqtt-brok
1513514701: 	test (QoS 0)
1513514701: mosqsub/13478-mqtt-brok 0 test
1513514701: Sending SUBACK to mosqsub/13478-mqtt-brok
1513514701: Socket error on client mosqsub/13478-mqtt-brok, disconnecting.
1513514758: Saving in-memory database to ./m2.db.

@Mixerito
Copy link

Mixerito commented Mar 16, 2018 •
edited

I have the same problem, practically periodically.

Mosquitto service is runninq but refuses any new connections.

$ mosquitto_sub -h localhost -u user -P pass -t '#'
Error: A network protocol error occurred when communicating with the broker.

Mosquitto version

mosquitto version 1.4.15 (build date Sun, 04 Mar 2018 21:04:15 +0000)
mosquitto is an MQTT v3.1.1/v3.1 broker.

Last log file lines:

1521158396: Client NODE_165 has exceeded timeout, disconnecting.
**1521158396: Socket error on client NODE_165, disconnecting.** // this one is same as in comment above
1521158396: New connection from 213.192.25.217 on port 1883.
1521158396: Client NODE_165 disconnected.
1521158396: New client connected from 213.192.25.217 as NODE_165 (c0, k60, u'Writer_00165').
1521158396: Sending CONNACK to NODE_165 (1, 0)
1521158397: Received SUBSCRIBE from NODE_165
1521158397: 	165/NODE/# (QoS 2)
1521158397: NODE_165 2 165/NODE/#
1521158397: Sending SUBACK to NODE_165
1521158397: Received PUBLISH from NODE_165 (d0, q0, r0, m0, '165/JS/HELLO', ... (26 bytes))
1521158437: accepted new conn  port 2024 on fd=17

@ralight
Copy link
Contributor

ralight commented Aug 15, 2018

@Mixerito Are you using websockets, and if so which version of libwebsockets do you have?

@QueenAnnie
Copy link

Im able to turn on my sonoff basic via tasmoadmin but when i try to switch it from hassio via mosquitto add in, i get the following error in the log:

1538815077: New connection from 192.168.1.8 on port 1883.
1538815077: Socket error on client , disconnecting.

This is all i can see in the log. over and over.

I have very little coding experience, but Google has gotten me this far and now I'm stuck. Please, if anyone could point me in the right direction i would greatly appreciate it!!

Here is the error im seeing in the sonoff's console:

stat/sonoff/STATUS11 = {"StatusSTS":{"Time":"2018-10-06T09:29:56","Uptime":"0T01:58:06","Vcc":3.225,"POWER":"OFF","Wifi":{"AP":1,"SSId":"myNetwork","RSSI":80,"APMac":"D0:17:C2:8D:8D:11"}}}
09:30:04 MQT: Attempting connection...
09:30:04 MQT: Connect failed to 192.168.1.7:1883, rc 5. Retry in 10 sec

It seems to be doing reads, but then fails the connection for some reason.

@pawisoon
Copy link

I have same issue here.. It worked yesterday after setting it up. Today in the morning Im getting:
Error: Connection refused

@kumar003vinod
Copy link
Contributor Author

@pawisoon please share logs, it might help locate the issue
Also check if FD 3 is open and share the output of netstat -tanp | grep :1883 to confirm that you are having the same issue as I faced.

@slimcdk
Copy link

slimcdk commented Jan 9, 2019

I'm having this issue too. No succesful connection yet.

Fresh install of raspbian stretch and mosquitto via apt.

@TheDevMinerTV
Copy link

Same issue here.
I'm using docker with latest image.

@kaneghost
Copy link

i use apt to install mosquitto and i have the same problem. But if i start mosquitto with just: mosquitto -v every thing is ok. service mosquitto start not working. stange....

@webash
Copy link

webash commented Feb 16, 2019

I'm also seeing this on Ubuntu, where it has been installed through apt. Existing clients are unable to send/receive messages suddenly without any warning. There are about 3 instances of this sudden lock out below from the logs:

ashley@brokerhost:~$ sudo tail -n400 /var/log/mosquitto/mosquitto.log
1549821203: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549821203: Client sensor01_energenie already connected, closing old connection.
1549821203: Client sensor01_energenie disconnected.
1549821203: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549821205: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549821215: Socket error on client sensor01_energenie, disconnecting.
1549821313: New connection from 10.135.35.36 on port 1883.
1549821313: New connection from 10.135.35.36 on port 1883.
1549821313: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549821313: Client sensor01_energenie already connected, closing old connection.
1549821313: Client sensor01_energenie disconnected.
1549821313: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549821327: Socket error on client sensor01_energenie, disconnecting.
1549822038: New connection from 10.135.35.36 on port 1883.
1549822038: New connection from 10.135.35.36 on port 1883.
1549822038: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549822038: Client sensor01_energenie already connected, closing old connection.
1549822038: Client sensor01_energenie disconnected.
1549822038: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549822039: New connection from 10.135.35.36 on port 1883.
1549822039: Client sensor01_energenie already connected, closing old connection.
1549822039: Client sensor01_energenie disconnected.
1549822039: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549822047: Socket error on client sensor01_energenie, disconnecting.
1549822114: New connection from 10.135.35.36 on port 1883.
1549822114: New connection from 10.135.35.36 on port 1883.
1549822114: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549822114: Client sensor01_energenie already connected, closing old connection.
1549822114: Client sensor01_energenie disconnected.
1549822114: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549822126: Socket error on client sensor01_energenie, disconnecting.
1549822670: New connection from 10.135.35.36 on port 1883.
1549822670: New connection from 10.135.35.36 on port 1883.
1549822670: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549822670: Client sensor01_energenie already connected, closing old connection.
1549822670: Client sensor01_energenie disconnected.
1549822670: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549822671: New connection from 10.135.35.36 on port 1883.
1549822671: Client sensor01_energenie already connected, closing old connection.
1549822671: Client sensor01_energenie disconnected.
1549822671: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549823006: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549824518: Socket error on client sensor01_energenie, disconnecting.
1549824807: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549826608: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549826869: New connection from 10.135.35.36 on port 1883.
1549826869: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549826871: Socket error on client sensor01_energenie, disconnecting.
1549827156: New connection from 10.135.35.36 on port 1883.
1549827156: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549827160: Socket error on client sensor01_energenie, disconnecting.
1549827314: New connection from 10.135.35.36 on port 1883.
1549827315: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549827319: Socket error on client sensor01_energenie, disconnecting.
1549827409: New connection from 10.135.35.36 on port 1883.
1549827409: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549827419: Socket error on client sensor01_energenie, disconnecting.
1549827478: New connection from 10.135.35.36 on port 1883.
1549827478: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549827550: Socket error on client sensor01_energenie, disconnecting.
1549827779: New connection from 10.135.35.36 on port 1883.
1549827779: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549827868: Client sensor01_energenie has exceeded timeout, disconnecting.
1549827868: Socket error on client sensor01_energenie, disconnecting.
1549827955: New connection from 10.135.35.36 on port 1883.
1549827955: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549827984: Socket error on client sensor01_energenie, disconnecting.
1549828409: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549830135: New connection from 10.135.35.36 on port 1883.
1549830135: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549830141: Socket error on client sensor01_energenie, disconnecting.
1549830210: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549830270: New connection from 10.135.35.36 on port 1883.
1549830270: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549830360: Client sensor01_energenie has exceeded timeout, disconnecting.
1549830360: Socket error on client sensor01_energenie, disconnecting.
1549830573: New connection from 10.135.35.36 on port 1883.
1549830573: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549830662: Client sensor01_energenie has exceeded timeout, disconnecting.
1549830662: Socket error on client sensor01_energenie, disconnecting.
1549830685: New connection from 10.135.35.36 on port 1883.
1549830685: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549830774: Client sensor01_energenie has exceeded timeout, disconnecting.
1549830774: Socket error on client sensor01_energenie, disconnecting.
1549831107: New connection from 10.135.35.36 on port 1883.
1549831107: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549831149: Socket error on client sensor01_energenie, disconnecting.
1549832011: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549832632: New connection from 10.135.35.36 on port 1883.
1549832632: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549832655: Socket error on client sensor01_energenie, disconnecting.
1549832842: New connection from 10.135.35.36 on port 1883.
1549832842: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549832845: Socket error on client sensor01_energenie, disconnecting.
1549833002: New connection from 10.135.35.36 on port 1883.
1549833002: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549833619: Socket error on client sensor01_energenie, disconnecting.
1549833629: New connection from 10.135.35.36 on port 1883.
1549833629: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549833812: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549834123: Socket error on client sensor01_energenie, disconnecting.
1549834128: New connection from 10.135.35.36 on port 1883.
1549834128: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549834208: Socket error on client sensor01_energenie, disconnecting.
1549834218: New connection from 10.135.35.36 on port 1883.
1549834218: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549834240: Socket error on client sensor01_energenie, disconnecting.
1549834337: New connection from 10.135.35.36 on port 1883.
1549834337: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549834524: Socket error on client sensor01_energenie, disconnecting.
1549834662: New connection from 10.135.35.36 on port 1883.
1549834662: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549834771: Socket error on client sensor01_energenie, disconnecting.
1549834776: New connection from 10.135.35.36 on port 1883.
1549834776: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549835613: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549837414: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549839215: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549841016: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549841542: Socket error on client sensor01_energenie, disconnecting.
1549842644: New connection from 10.135.35.36 on port 1883.
1549842644: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549842817: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549844618: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549846045: Client brokerhost_node-red disconnected.
1549846045: New connection from 127.0.0.1 on port 1883.
1549846045: Client brokerhost_node-red disconnected.
1549846045: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1549846072: Client brokerhost_node-red disconnected.
1549846072: New connection from 127.0.0.1 on port 1883.
1549846072: Client brokerhost_node-red disconnected.
1549846072: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1549846087: Client brokerhost_node-red disconnected.
1549846419: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549848220: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549850021: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549851822: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549853623: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549855424: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549857225: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549859026: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549860274: Client sensor01_energenie has exceeded timeout, disconnecting.
1549860274: Socket error on client sensor01_energenie, disconnecting.
1549860827: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549862628: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549864429: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549866230: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549868031: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549869832: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549871633: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549873434: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549874942: New connection from 10.135.35.36 on port 1883.
1549874942: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549875235: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549877036: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549878837: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549880638: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549880808: Socket error on client sensor01_energenie, disconnecting.
1549880957: New connection from 10.135.35.36 on port 1883.
1549880957: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1549882439: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549884240: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549886041: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549887842: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549889643: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549891444: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549893245: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549895046: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549896847: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549898648: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549900449: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549902250: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549904051: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549905852: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549907653: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549909454: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549911255: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549913056: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549914857: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549916658: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549918459: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549920260: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549922061: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549923862: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549925663: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549927464: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549929265: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549931066: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549932867: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549934668: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549936469: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549938270: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549940071: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549941872: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549943673: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549945474: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549947275: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549949076: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549950877: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1549951921: mosquitto version 1.4.15 (build date Wed, 06 Feb 2019 17:03:31 +0000) starting
1549951921: Config loaded from /etc/mosquitto/mosquitto.conf.
1549951921: Opening ipv4 listen socket on port 1883.
1549951921: Error: Address already in use
1549951921: mosquitto version 1.4.15 terminating
1550065317: mosquitto version 1.4.15 (build date Wed, 06 Feb 2019 17:03:31 +0000) starting
1550065317: Config loaded from /etc/mosquitto/mosquitto.conf.
1550065317: Opening ipv4 listen socket on port 1883.
1550065317: Opening ipv6 listen socket on port 1883.
1550065321: New connection from 127.0.0.1 on port 1883.
1550065321: New client connected from 127.0.0.1 as emoncms (c1, k5, u'').
1550065394: New connection from 10.135.35.36 on port 1883.
1550065394: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1550067117: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550068918: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550070719: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550072520: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550074321: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550076122: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550077923: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550079724: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550081525: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550083326: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550085127: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550086928: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550088729: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550090530: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550092331: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550094132: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550095933: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550097734: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550099535: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550101336: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550102325: New connection from 127.0.0.1 on port 1883.
1550102325: Client brokerhost_node-red disconnected.
1550102325: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550102611: Client brokerhost_node-red disconnected.
1550102611: New connection from 127.0.0.1 on port 1883.
1550102611: Client brokerhost_node-red disconnected.
1550102611: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550102682: Client brokerhost_node-red disconnected.
1550102682: New connection from 127.0.0.1 on port 1883.
1550102682: Client brokerhost_node-red disconnected.
1550102682: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550102711: Client brokerhost_node-red disconnected.
1550102711: New connection from 127.0.0.1 on port 1883.
1550102711: Client brokerhost_node-red disconnected.
1550102711: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550102749: Client brokerhost_node-red disconnected.
1550102749: New connection from 127.0.0.1 on port 1883.
1550102750: Client brokerhost_node-red disconnected.
1550102750: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550102780: Client brokerhost_node-red disconnected.
1550102780: New connection from 127.0.0.1 on port 1883.
1550102780: Client brokerhost_node-red disconnected.
1550102780: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550102882: Client brokerhost_node-red disconnected.
1550102882: New connection from 127.0.0.1 on port 1883.
1550102882: Client brokerhost_node-red disconnected.
1550102882: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550102938: Client brokerhost_node-red disconnected.
1550103137: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550104361: New connection from 127.0.0.1 on port 1883.
1550104361: Client brokerhost_node-red disconnected.
1550104361: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550104398: Client brokerhost_node-red disconnected.
1550104398: New connection from 127.0.0.1 on port 1883.
1550104398: Client brokerhost_node-red disconnected.
1550104398: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550104440: Client brokerhost_node-red disconnected.
1550104440: New connection from 127.0.0.1 on port 1883.
1550104440: Client brokerhost_node-red disconnected.
1550104440: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550104474: Client brokerhost_node-red disconnected.
1550104474: New connection from 127.0.0.1 on port 1883.
1550104474: Client brokerhost_node-red disconnected.
1550104474: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550104502: Client brokerhost_node-red disconnected.
1550104502: New connection from 127.0.0.1 on port 1883.
1550104502: Client brokerhost_node-red disconnected.
1550104502: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550104548: Client brokerhost_node-red disconnected.
1550104549: New connection from 127.0.0.1 on port 1883.
1550104549: Client brokerhost_node-red disconnected.
1550104549: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550104584: Client brokerhost_node-red disconnected.
1550104584: New connection from 127.0.0.1 on port 1883.
1550104584: Client brokerhost_node-red disconnected.
1550104584: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550104643: Client brokerhost_node-red disconnected.
1550104643: New connection from 127.0.0.1 on port 1883.
1550104643: Client brokerhost_node-red disconnected.
1550104643: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550104938: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550105272: Client brokerhost_node-red disconnected.
1550105272: New connection from 127.0.0.1 on port 1883.
1550105272: Client brokerhost_node-red disconnected.
1550105272: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550105316: Client brokerhost_node-red disconnected.
1550105316: New connection from 127.0.0.1 on port 1883.
1550105316: Client brokerhost_node-red disconnected.
1550105316: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550105394: Client brokerhost_node-red disconnected.
1550105394: New connection from 127.0.0.1 on port 1883.
1550105394: Client brokerhost_node-red disconnected.
1550105394: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550105628: Client brokerhost_node-red disconnected.
1550105628: New connection from 127.0.0.1 on port 1883.
1550105628: Client brokerhost_node-red disconnected.
1550105628: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550106739: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550108540: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550110341: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550112142: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550113943: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550115744: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550117545: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550119346: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550121147: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550122948: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550124749: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550126550: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550128351: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550130152: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550131953: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550133754: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550135555: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550136757: Socket error on client sensor01_energenie, disconnecting.
1550136758: New connection from 10.135.35.36 on port 1883.
1550136758: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1550137356: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550139157: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550140958: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550142411: Client brokerhost_node-red disconnected.
1550142411: New connection from 127.0.0.1 on port 1883.
1550142411: Client brokerhost_node-red disconnected.
1550142411: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550142439: Client brokerhost_node-red disconnected.
1550142439: New connection from 127.0.0.1 on port 1883.
1550142439: Client brokerhost_node-red disconnected.
1550142439: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550142759: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550144560: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550146361: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550148162: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550149963: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550151764: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550153565: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550155366: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550157167: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550158968: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550160769: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550162570: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550164371: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550166172: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550167973: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550169774: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550171575: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550173376: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550175177: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550176978: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550178779: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550180580: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550182381: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550184182: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550185724: Client sensor01_energenie has exceeded timeout, disconnecting.
1550185724: Socket error on client sensor01_energenie, disconnecting.
1550185983: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550187784: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550189585: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550191386: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550193187: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550194988: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550196789: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550198590: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550200391: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550202192: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550203993: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550205794: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550207595: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550209396: Saving in-memory database to /var/lib/mosquitto/mosquitto.db.
1550211122: mosquitto version 1.4.15 (build date Wed, 13 Feb 2019 00:27:01 +0000) starting
1550211122: Config loaded from /etc/mosquitto/mosquitto.conf.
1550211122: Opening ipv4 listen socket on port 1883.
1550211122: Error: Address already in use
1550211122: mosquitto version 1.4.15 terminating
1550329161: mosquitto version 1.4.15 (build date Wed, 13 Feb 2019 00:27:01 +0000) starting
1550329161: Config loaded from /etc/mosquitto/mosquitto.conf.
1550329161: Opening ipv4 listen socket on port 1883.
1550329161: Opening ipv6 listen socket on port 1883.
1550329162: New connection from 127.0.0.1 on port 1883.
1550329162: Client brokerhost_node-red disconnected.
1550329162: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60).
1550329167: New connection from 127.0.0.1 on port 1883.
1550329167: New client connected from 127.0.0.1 as emoncms (c1, k5, u'').
1550329173: New connection from 10.135.35.36 on port 1883.
1550329173: New client connected from 10.135.35.36 as mosqpub/4403-agn-sensor (c1, k60).
1550329173: Client mosqpub/4403-agn-sensor disconnected.
1550329200: New connection from 10.135.35.36 on port 1883.
1550329200: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60).
1550329850: Client brokerhost_node-red disconnected.
ashley@brokerhost:~$

The status of the systemd unit at this point is still 'running'

ashley@brokerhost:~$ sudo systemctl status mosquitto
● mosquitto.service - LSB: mosquitto MQTT v3.1 message broker
   Loaded: loaded (/etc/init.d/mosquitto; generated)
   Active: active (running) since Fri 2019-02-15 06:12:02 UTC; 1 day 8h ago
     Docs: man:systemd-sysv-generator(8)
    Tasks: 0 (limit: 1152)
   CGroup: /system.slice/mosquitto.service

Feb 15 06:12:02 brokerhost systemd[1]: Stopped LSB: mosquitto MQTT v3.1 mes
Feb 15 06:12:02 brokerhost systemd[1]: mosquitto.service: Found left-over p
Feb 15 06:12:02 brokerhost systemd[1]: This usually indicates unclean termi
Feb 15 06:12:02 brokerhost systemd[1]: Starting LSB: mosquitto MQTT v3.1 me
Feb 15 06:12:02 brokerhost mosquitto[28854]:  * Starting network daemon: mo
Feb 15 06:12:02 brokerhost mosquitto[28854]:    ...done.
Feb 15 06:12:02 brokerhost systemd[1]: Started LSB: mosquitto MQTT v3.1 mes

Restarting the systemd unit brings the service back up, and everything is fine again, despite no changes.

1550329161: mosquitto version 1.4.15 (build date Wed, 13 Feb 2019 00:27:01 +0000) starting
1550329161: Config loaded from /etc/mosquitto/mosquitto.conf.
1550329161: Opening ipv4 listen socket on port 1883.
1550329161: Opening ipv6 listen socket on port 1883.
1550329162: New connection from 127.0.0.1 on port 1883.
1550329162: Client localhost_node-red disconnected.
1550329162: New client connected from 127.0.0.1 as localhost_node-red (c0, k60).
1550329167: New connection from 127.0.0.1 on port 1883.
1550329167: New client connected from 127.0.0.1 as emoncms (c1, k5, u'').
1550329173: New connection from 10.135.35.36 on port 1883.
1550329173: New client connected from 10.135.35.36 as mosqpub/4403-agn-sensor (c1, k60).
1550329173: Client mosqpub/4403-agn-sensor disconnected.
1550329200: New connection from 10.135.35.36 on port 1883.
ashley@brokerhost:~$

@pauldeng
Copy link

i use apt to install mosquitto and i have the same problem. But if i start mosquitto with just: mosquitto -v every thing is ok. service mosquitto start not working. stange....

I had the same issue, fixed it by comment this line in mosquitto.conf file:
log_dest file /var/log/mosquitto/mosquitto.log

I have Armbian running on NanoPi M1 Plus
Distributor ID: Ubuntu
Description: Ubuntu 18.04.2 LTS
Release: 18.04
Codename: bionic

@dasbaumwolltier
Copy link

I had the same problem. After I disabled the WebSocket it is working again like a breeze.

@strautins
Copy link

strautins commented Mar 5, 2020 •
edited

Windows 10
Post to thingsboard.
image
Payload receives endpoint.
Data gets till thingsboard interface.

@alexjolly28
Copy link

"mosquitto -v -d " works for me -ubuntu 18.4

@mukilanmws
Copy link

I also have this problem. Sometimes I get a connection failed and the broker does not publish a topic at the time. When I restart the broker it's working normally a few minutes later I got the same problem. `pid_file /var/run/mosquitto.pid

persistence true
persistence_location /var/lib/mosquitto/

log_dest file /var/log/mosquitto/mosquitto.log

include_dir /etc/mosquitto/conf.d

max_connections -1

log_type error
log_type warning
log_type notice

connection_messages true`. I am using the ubuntu 18.04 LTS server and a broker version is 1.6.12. Last one week I try to solve this issue. But I can't get a solution. Please support me and teach the right way to solve this problem.

@mukilanmws
Copy link

"mosquitto -v -d " works for me -ubuntu 18.4

what is the work of this command? why you used it?

@ralight
Copy link
Contributor

ralight commented Jan 8, 2021

@mukilanmws Did you have any configuration in /etc/mosquitto/conf.d? Did you install from the mosquitto ppa?

@Stokestack
Copy link

Stokestack commented Feb 22, 2021 •
edited

After installing Mosquitto on a Mac with Homebrew, I have the same problem; except it has never worked.

I've changed the setup to run as a daemon, too.

I can open two terminal windows and subscribe from one and publish from the other if I use "localhost" as the host. But if I use the computer's assigned IP address, I get "Connection refused." I get the same thing from other computers on the same local network. I even changed the conf file to run Mosquitto as root. No difference.

@ralight
Copy link
Contributor

ralight commented Feb 25, 2021

@Stokestack Starting from version 2.0, Mosquitto doesn't allow connections from external computers unless you explicitly configure it to do so using a listener directive. You will also need to decide whether you use password authentication, plugin authentication, or no authentication at all. Some details are here: https://mosquitto.org/documentation/authentication-methods/

@ralight
Copy link
Contributor

ralight commented Feb 25, 2021

I'm closing this issue because it's a mix of lots of different people from a long time ago. If you have the same or similar problem, please open a new issue.

@ralight ralight closed this as completed Feb 25, 2021
@Stokestack
Copy link

Stokestack commented Feb 25, 2021 •
edited

@ralight Thanks for the follow-up and the info. There are tons of tutorials out there that don't work because of this limitation. I'm not complaining about the limitation, of course. It's too bad so many people's time is wasted by incorrect tutorials, and oddly if you search on the problem you don't find that explanation prominently.

@ralight
Copy link
Contributor

ralight commented Feb 25, 2021

@Stokestack Yes, it's a difficult situation. If you make breaking changes to try and improve things it does also break tutorials. It's also difficult to get the information out there.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Aug 11, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
Component: mosquitto-broker Status: Blocked Another issue needs to be resolved first Type: Bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests