pahoMqttExt 1.0.15 - Fin-Framework Crashed due to buffer pool Overloading

Umer shah11th Oct 2022

Invalid annotation [] [fandoc:39] - "Dec 10 22:21:54 PC java[22147]: java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached"

Invalid annotation [] [fandoc:71] - "Dec 10 22:23:14 PC java[3720]: [2021-12-10 22:23:14] <pahoMqttExt> {} [info] subscribing to topic [get/mqtt/readS]"

Hello Hope you are fine. we have integrated this MQTT Extension in our system.

It's Working well.
We can Send/Receive Message But... Unfortunately, each time i call AXON function and send MQTT message it adds new threads in Fin Process. here are the details of our Setup.

a. AXON Function (I'm using the same ClientID as Extension Configuration)

() => do

tags:{}
tags = tags.set("msg", "PoolTest")
tags = tags.set("url", "tcp://192.168.6.6:1884")
tags = tags.set("topic", "mqtt/pool/test")
tags = tags.set("username", "admin")
tags = tags.set("password", "public")
tags = tags.set("clientId", "SkySpark[p:testMqttExt:r:2ad7d83c-11058e21]")
tags = tags.set("cleanSession", true)
tags = tags.set("qos", 0)
pahoMqttPublishMsg(tags)

end

Fin Framework on Crash Error Message:

==================On Run Error Status

● sycracc.service - FIN Framework

Loaded: loaded (/etc/systemd/system/sycracc.service; enabled; vendor preset: enabled)
Active: active (running) since Fri 2021-12-10 19:41:39 CST; 2h 40min ago

Main PID: 22147 (java)

Tasks: 4557 (limit: 4557)

CGroup: /system.slice/sycracc.service
        ├─22147 /usr/bin/java -Xmx512M -cp /opt/sycracc/lib/java/sys.jar -Dfan.home=/opt/sycracc fanx.tools.Fan finStackHost
        └─22290 python3 aci_runner.py -d /dev/ttyBT

Dec 10 22:21:54 PC java[22147]: [9615.475s][warning][os,thread] Failed to start the native thread for java.lang.Thread "SysMod-Worker-366" Dec 10 22:21:54 PC java[22147]: java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached Dec 10 22:21:54 PC java[22147]: at java.base/java.lang.Thread.start0(Native Method) Dec 10 22:21:54 PC java[22147]: at java.base/java.lang.Thread.start(Thread.java:798) Dec 10 22:21:54 PC java[22147]: at fan.concurrent.ThreadPool.submit(ThreadPool.java:158) Dec 10 22:21:54 PC java[22147]: at fan.concurrent.ActorPool.submit(ActorPool.java:136) Dec 10 22:21:54 PC java[22147]: at fan.concurrent.Actor._enqueue(Actor.java:204) Dec 10 22:21:54 PC java[22147]: at fan.concurrent.ActorPool$ScheduledWork.work(ActorPool.java:173) Dec 10 22:21:54 PC java[22147]: at fan.concurrent.Scheduler.run(Scheduler.java:166) Dec 10 22:21:54 PC java[22147]: at java.base/java.lang.Thread.run(Thread.java:829)

================= On Run Normal Status

● sycracc.service - FIN Framework

Loaded: loaded (/etc/systemd/system/sycracc.service; enabled; vendor preset: enabled)
Active: active (running) since Fri 2021-12-10 22:22:36 CST; 40s ago

Main PID: 3720 (java)

Tasks: 114 (limit: 4557)

CGroup: /system.slice/sycracc.service
        ├─3720 /usr/bin/java -Xmx512M -cp /opt/sycracc/lib/java/sys.jar -Dfan.home=/opt/sycracc fanx.tools.Fan finStackHost
        └─3890 python3 aci_runner.py -d /dev/ttyBT

Dec 10 22:23:13 PC java[3720]: java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) Dec 10 22:23:13 PC java[3720]: java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) Dec 10 22:23:13 PC java[3720]: java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) Dec 10 22:23:13 PC java[3720]: java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) Dec 10 22:23:13 PC java[3720]: java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) Dec 10 22:23:13 PC java[3720]: java.base/java.lang.Thread.run(Thread.java:829) Dec 10 22:23:14 PC java[3720]: [2021-12-10 22:23:14] <pahoMqtt.testoffice> {connRef:@p:testoffice:r:2945fd66-1fc61377 "PahoMqtt Conn"} [info] Connection Complete. Dec 10 22:23:14 PC java[3720]: [2021-12-10 22:23:14] <pahoMqttExt> {} [info] subscribing to topic [get/mqtt/readS] Dec 10 22:23:14 PC java[3720]: [2021-12-10 22:23:14] <pahoMqttExt> {} [info] subscribing to topic [WaToj2/cmd] Dec 10 22:23:14 PC java[3720]: [2021-12-10 22:23:14] <pahoMqttExt> {} [info] subscribing to topic [get/mqtt/read]

Here are the ps list on threads under Fin Process:

root@PC:~# ps -T -p 3720

PID  SPID TTY          TIME CMD

3720 3720 ? 00:00:00 java 3720 3754 ? 00:00:07 java 3720 3758 ? 00:00:53 GC Thread#0 3720 3759 ? 00:00:00 G1 Main Marker 3720 3760 ? 00:00:03 G1 Conc#0 3720 3761 ? 00:00:00 G1 Refine#0 3720 3762 ? 00:00:01 G1 Young RemSet 3720 3763 ? 00:00:47 VM Thread 3720 3764 ? 00:00:00 Reference Handl 3720 3765 ? 00:00:00 Finalizer 3720 3766 ? 00:00:00 Signal Dispatch 3720 3767 ? 00:00:00 Service Thread 3720 3768 ? 00:01:13 C2 CompilerThre 3720 3769 ? 00:00:12 C1 CompilerThre 3720 3770 ? 00:00:00 Sweeper thread 3720 3771 ? 00:00:08 VM Periodic Tas 3720 3772 ? 00:00:00 Common-Cleaner 3720 3777 ? 00:00:53 GC Thread#1 3720 3778 ? 00:00:00 G1 Refine#1 3720 3779 ? 00:00:00 G1 Refine#2 3720 3780 ? 00:00:00 G1 Refine#3 3720 3786 ? 00:00:52 GC Thread#2 3720 3787 ? 00:00:52 GC Thread#3 3720 3823 ? 00:00:06 SysMod-Schedule 3720 3827 ? 00:00:00 qtp1812821481-4 3720 3830 ? 00:00:00 qtp1812821481-4 3720 3833 ? 00:00:00 Session-HouseKe 3720 3838 ? 00:00:00 testoffice-Alar 3720 3839 ? 00:00:00 Proj-testoffice 3720 3841 ? 00:00:00 testoffice-ExtP 3720 3845 ? 00:00:06 testoffice-Cont 3720 3847 ? 00:01:12 testoffice-Bacn 3720 3849 ? 00:01:35 testoffice-Bacn 3720 3853 ? 00:00:00 ActorPool-Sched 3720 3869 ? 00:00:00 testoffice-Paho 3720 3874 ? 00:00:10 testoffice-Poin 3720 3879 ? 00:00:59 testoffice-Sycr 3720 3880 ? 00:01:35 testoffice-Hays 3720 3881 ? 00:01:12 testoffice-Hays 3720 3882 ? 00:00:00 process reaper 3720 3884 ? 00:00:00 testoffice-Paho 3720 3896 ? 00:00:00 testoffice-ExtP 3720 3897 ? 00:00:44 testoffice-ExtP 3720 3899 ? 00:00:00 testoffice-ExtP 3720 3900 ? 00:00:00 Process.out 3720 3901 ? 00:00:20 Process.in 3720 3902 ? 00:00:00 testoffice-ExtP 3720 3903 ? 00:00:00 testoffice-ExtP 3720 3904 ? 00:00:00 testoffice-ExtP 3720 3905 ? 00:00:00 testoffice-ExtP 3720 3907 ? 00:00:00 ActorPool-Worke 3720 3911 ? 00:00:00 ActorPool-Sched 3720 3912 ? 00:00:00 MQTT Rec: SkySp 3720 3913 ? 00:00:02 WispServiceList 3720 3914 ? 00:00:00 WispServiceSess 3720 3915 ? 00:00:00 MQTT Snd: SkySp 3720 3916 ? 00:00:00 MQTT Call: SkyS 3720 3917 ? 00:00:00 MQTT Snd: SkySp 3720 3986 ? 00:00:02 ActorPool-Sched 3720 3988 ? 00:00:00 MQTT Call: SkyS 3720 3989 ? 00:00:00 MQTT Rec: SkySp 3720 3990 ? 00:00:00 MQTT Snd: SkySp 3720 3991 ? 00:00:00 pool-2-thread-4 3720 3995 ? 00:00:00 MQTT Rec: SkySp 3720 3996 ? 00:00:00 MQTT Call: SkyS 3720 3997 ? 00:00:00 MQTT Call: SkyS 3720 3998 ? 00:00:00 MQTT Rec: SkySp 3720 4002 ? 00:00:00 MQTT Call: SkyS 3720 4003 ? 00:00:00 MQTT Rec: SkySp 3720 4004 ? 00:00:00 MQTT Snd: SkySp 3720 4005 ? 00:00:00 pool-3-thread-4 3720 4009 ? 00:00:00 MQTT Snd: SkySp 3720 4010 ? 00:00:00 MQTT Call: SkyS 3720 4012 ? 00:00:00 Connector-Sched 3720 4016 ? 00:00:00 HttpClient@18b6 3720 4023 ? 00:00:00 MQTT Call: SkyS 3720 4024 ? 00:00:00 MQTT Rec: SkySp 3720 4025 ? 00:00:00 MQTT Snd: SkySp 3720 4026 ? 00:00:00 pool-4-thread-4 3720 4043 ? 00:00:00 MQTT Call: SkyS 3720 4044 ? 00:00:00 MQTT Rec: SkySp 3720 4045 ? 00:00:00 MQTT Snd: SkySp 3720 4046 ? 00:00:00 pool-5-thread-4 3720 4063 ? 00:00:00 MQTT Call: SkyS 3720 4064 ? 00:00:00 MQTT Rec: SkySp 3720 4065 ? 00:00:00 MQTT Snd: SkySp 3720 4066 ? 00:00:00 pool-6-thread-4 3720 4073 ? 00:00:00 MQTT Call: SkyS 3720 4074 ? 00:00:00 MQTT Rec: SkySp 3720 4075 ? 00:00:00 MQTT Snd: SkySp 3720 4076 ? 00:00:00 pool-7-thread-4 3720 4083 ? 00:00:00 MQTT Call: SkyS 3720 4084 ? 00:00:00 MQTT Rec: SkySp 3720 4085 ? 00:00:00 MQTT Snd: SkySp 3720 4086 ? 00:00:00 pool-8-thread-4 3720 4093 ? 00:00:00 MQTT Call: SkyS 3720 4094 ? 00:00:00 MQTT Rec: SkySp 3720 4095 ? 00:00:00 MQTT Snd: SkySp 3720 4096 ? 00:00:00 pool-9-thread-4 3720 4102 ? 00:00:00 MQTT Snd: SkySp 3720 4103 ? 00:00:00 MQTT Rec: SkySp 3720 4104 ? 00:00:00 MQTT Call: SkyS 3720 4105 ? 00:00:00 pool-10-thread- 3720 4110 ? 00:00:00 MQTT Call: SkyS 3720 4111 ? 00:00:00 MQTT Rec: SkySp 3720 4112 ? 00:00:00 MQTT Snd: SkySp 3720 4113 ? 00:00:00 pool-11-thread- 3720 4132 ? 00:00:00 MQTT Call: SkyS 3720 4133 ? 00:00:00 MQTT Rec: SkySp 3720 4134 ? 00:00:00 MQTT Snd: SkySp 3720 4135 ? 00:00:00 pool-12-thread- 3720 4146 ? 00:00:00 MQTT Call: SkyS 3720 4147 ? 00:00:00 MQTT Rec: SkySp 3720 4148 ? 00:00:00 MQTT Snd: SkySp 3720 4149 ? 00:00:00 pool-13-thread- 3720 4156 ? 00:00:00 MQTT Call: SkyS 3720 4157 ? 00:00:00 MQTT Rec: SkySp 3720 4158 ? 00:00:00 MQTT Snd: SkySp 3720 4159 ? 00:00:00 pool-14-thread- 3720 4165 ? 00:00:00 MQTT Call: SkyS 3720 4166 ? 00:00:00 MQTT Rec: SkySp 3720 4167 ? 00:00:00 MQTT Snd: SkySp 3720 4168 ? 00:00:00 pool-15-thread- 3720 4175 ? 00:00:00 MQTT Snd: SkySp 3720 4176 ? 00:00:00 MQTT Rec: SkySp 3720 4177 ? 00:00:00 MQTT Call: SkyS 3720 4178 ? 00:00:00 pool-16-thread- 3720 4185 ? 00:00:00 MQTT Call: SkyS 3720 4186 ? 00:00:00 MQTT Rec: SkySp 3720 4187 ? 00:00:00 MQTT Snd: SkySp 3720 4188 ? 00:00:00 pool-17-thread- 3720 4197 ? 00:00:00 MQTT Call: SkyS 3720 4198 ? 00:00:00 MQTT Rec: SkySp 3720 4199 ? 00:00:00 MQTT Snd: SkySp 3720 4200 ? 00:00:00 pool-18-thread- 3720 4208 ? 00:00:00 MQTT Call: SkyS 3720 4209 ? 00:00:00 MQTT Rec: SkySp 3720 4210 ? 00:00:00 MQTT Snd: SkySp 3720 4211 ? 00:00:00 pool-19-thread- 3720 4219 ? 00:00:00 MQTT Call: SkyS 3720 4220 ? 00:00:00 MQTT Rec: SkySp 3720 4221 ? 00:00:00 MQTT Snd: SkySp 3720 4222 ? 00:00:00 pool-20-thread- 3720 4228 ? 00:00:00 MQTT Call: SkyS 3720 4229 ? 00:00:00 MQTT Rec: SkySp 3720 4230 ? 00:00:00 MQTT Snd: SkySp 3720 4231 ? 00:00:00 pool-21-thread- 3720 4237 ? 00:00:00 MQTT Con: SkySp 3720 4238 ? 00:00:00 MQTT Rec: SkySp 3720 4239 ? 00:00:00 MQTT Snd: SkySp 3720 4240 ? 00:00:00 MQTT Call: SkyS 3720 4247 ? 00:00:00 MQTT Call: SkyS 3720 4248 ? 00:00:00 MQTT Rec: SkySp 3720 4249 ? 00:00:00 MQTT Snd: SkySp 3720 4250 ? 00:00:00 pool-23-thread- 3720 4262 ? 00:00:00 MQTT Call: SkyS 3720 4263 ? 00:00:00 MQTT Rec: SkySp 3720 4264 ? 00:00:00 MQTT Snd: SkySp 3720 4265 ? 00:00:00 pool-24-thread- 3720 4271 ? 00:00:00 MQTT Call: SkyS 3720 4272 ? 00:00:00 MQTT Rec: SkySp 3720 4273 ? 00:00:00 MQTT Snd: SkySp 3720 4274 ? 00:00:00 pool-25-thread- 3720 4281 ? 00:00:00 MQTT Call: SkyS 3720 4282 ? 00:00:00 MQTT Rec: SkySp 3720 4283 ? 00:00:00 MQTT Snd: SkySp 3720 4284 ? 00:00:00 pool-26-thread- 3720 4292 ? 00:00:00 MQTT Call: SkyS 3720 4293 ? 00:00:00 MQTT Rec: SkySp 3720 4294 ? 00:00:00 MQTT Snd: SkySp 3720 4295 ? 00:00:00 pool-27-thread- 3720 4304 ? 00:00:00 MQTT Call: SkyS 3720 4305 ? 00:00:00 MQTT Rec: SkySp 3720 4306 ? 00:00:00 MQTT Snd: SkySp 3720 4307 ? 00:00:00 pool-28-thread- 3720 4315 ? 00:00:00 MQTT Call: SkyS 3720 4316 ? 00:00:00 MQTT Rec: SkySp 3720 4317 ? 00:00:00 MQTT Snd: SkySp 3720 4318 ? 00:00:00 pool-29-thread- 3720 4327 ? 00:00:00 MQTT Call: SkyS 3720 4328 ? 00:00:00 MQTT Rec: SkySp 3720 4329 ? 00:00:00 MQTT Snd: SkySp 3720 4330 ? 00:00:00 pool-30-thread- 3720 4337 ? 00:00:00 MQTT Call: SkyS 3720 4338 ? 00:00:00 MQTT Rec: SkySp 3720 4339 ? 00:00:00 MQTT Snd: SkySp 3720 4340 ? 00:00:00 pool-31-thread- 3720 4347 ? 00:00:00 MQTT Call: SkyS 3720 4348 ? 00:00:00 MQTT Rec: SkySp 3720 4349 ? 00:00:00 MQTT Snd: SkySp 3720 4350 ? 00:00:00 pool-32-thread- 3720 4356 ? 00:00:00 MQTT Call: SkyS 3720 4357 ? 00:00:00 MQTT Rec: SkySp 3720 4358 ? 00:00:00 MQTT Snd: SkySp 3720 4359 ? 00:00:00 pool-33-thread- 3720 4366 ? 00:00:00 MQTT Call: SkyS 3720 4367 ? 00:00:00 MQTT Rec: SkySp 3720 4368 ? 00:00:00 MQTT Snd: SkySp 3720 4369 ? 00:00:00 pool-34-thread- 3720 4376 ? 00:00:00 MQTT Call: SkyS 3720 4377 ? 00:00:00 MQTT Rec: SkySp 3720 4378 ? 00:00:00 MQTT Snd: SkySp 3720 4379 ? 00:00:00 pool-35-thread- 3720 4390 ? 00:00:00 MQTT Call: SkyS 3720 4391 ? 00:00:00 MQTT Rec: SkySp 3720 4392 ? 00:00:00 MQTT Snd: SkySp 3720 4393 ? 00:00:00 pool-36-thread- 3720 4401 ? 00:00:00 MQTT Call: SkyS 3720 4402 ? 00:00:00 MQTT Rec: SkySp 3720 4403 ? 00:00:00 MQTT Snd: SkySp 3720 4404 ? 00:00:00 pool-37-thread- 3720 4411 ? 00:00:00 MQTT Call: SkyS 3720 4412 ? 00:00:00 MQTT Rec: SkySp 3720 4413 ? 00:00:00 MQTT Snd: SkySp 3720 4414 ? 00:00:00 pool-38-thread- 3720 4420 ? 00:00:00 MQTT Snd: SkySp 3720 4421 ? 00:00:00 MQTT Rec: SkySp 3720 4422 ? 00:00:00 MQTT Call: SkyS 3720 4423 ? 00:00:00 pool-39-thread- 3720 4430 ? 00:00:00 MQTT Call: SkyS 3720 4431 ? 00:00:00 MQTT Rec: SkySp 3720 4432 ? 00:00:00 MQTT Snd: SkySp 3720 4433 ? 00:00:00 pool-40-thread- 3720 4442 ? 00:00:00 MQTT Call: SkyS 3720 4443 ? 00:00:00 MQTT Rec: SkySp 3720 4444 ? 00:00:00 MQTT Snd: SkySp 3720 4445 ? 00:00:00 pool-41-thread- 3720 4454 ? 00:00:00 MQTT Call: SkyS 3720 4455 ? 00:00:00 MQTT Rec: SkySp 3720 4456 ? 00:00:00 MQTT Snd: SkySp 3720 4457 ? 00:00:00 pool-42-thread- 3720 4465 ? 00:00:00 MQTT Call: SkyS 3720 4466 ? 00:00:00 MQTT Rec: SkySp 3720 4467 ? 00:00:00 MQTT Snd: SkySp 3720 4468 ? 00:00:00 pool-43-thread- 3720 4476 ? 00:00:00 MQTT Call: SkyS 3720 4477 ? 00:00:00 MQTT Rec: SkySp 3720 4478 ? 00:00:00 MQTT Snd: SkySp 3720 4479 ? 00:00:00 pool-44-thread- 3720 4485 ? 00:00:00 MQTT Call: SkyS 3720 4486 ? 00:00:00 MQTT Rec: SkySp 3720 4487 ? 00:00:00 MQTT Snd: SkySp 3720 4488 ? 00:00:00 pool-45-thread- 3720 4495 ? 00:00:00 MQTT Call: SkyS 3720 4496 ? 00:00:00 MQTT Rec: SkySp 3720 4497 ? 00:00:00 MQTT Snd: SkySp 3720 4498 ? 00:00:00 pool-46-thread- 3720 4504 ? 00:00:00 MQTT Call: SkyS 3720 4505 ? 00:00:00 MQTT Rec: SkySp 3720 4506 ? 00:00:00 MQTT Snd: SkySp 3720 4507 ? 00:00:00 pool-47-thread- 3720 4520 ? 00:00:00 MQTT Call: SkyS 3720 4521 ? 00:00:00 MQTT Rec: SkySp 3720 4522 ? 00:00:00 MQTT Snd: SkySp 3720 4523 ? 00:00:00 pool-48-thread- 3720 4531 ? 00:00:00 MQTT Snd: SkySp 3720 4532 ? 00:00:00 MQTT Rec: SkySp 3720 4533 ? 00:00:00 MQTT Call: SkyS 3720 4534 ? 00:00:00 pool-49-thread- 3720 4542 ? 00:00:00 MQTT Snd: SkySp 3720 4543 ? 00:00:00 MQTT Rec: SkySp 3720 4544 ? 00:00:00 pool-50-thread- 3720 4545 ? 00:00:00 MQTT Call: SkyS 3720 4550 ? 00:00:00 MQTT Call: SkyS 3720 4551 ? 00:00:00 MQTT Rec: SkySp 3720 4552 ? 00:00:00 MQTT Snd: SkySp 3720 4553 ? 00:00:00 pool-51-thread- 3720 4560 ? 00:00:00 MQTT Call: SkyS 3720 4561 ? 00:00:00 MQTT Rec: SkySp 3720 4562 ? 00:00:00 MQTT Snd: SkySp 3720 4563 ? 00:00:00 pool-52-thread- 3720 4571 ? 00:00:00 MQTT Call: SkyS 3720 4572 ? 00:00:00 MQTT Rec: SkySp 3720 4573 ? 00:00:00 MQTT Snd: SkySp 3720 4574 ? 00:00:00 pool-53-thread- 3720 4583 ? 00:00:00 MQTT Call: SkyS 3720 4584 ? 00:00:00 MQTT Rec: SkySp 3720 4585 ? 00:00:00 MQTT Snd: SkySp 3720 4586 ? 00:00:00 pool-54-thread- 3720 4593 ? 00:00:00 MQTT Call: SkyS 3720 4594 ? 00:00:00 MQTT Rec: SkySp 3720 4595 ? 00:00:00 MQTT Snd: SkySp 3720 4596 ? 00:00:00 pool-55-thread- 3720 4603 ? 00:00:00 MQTT Call: SkyS 3720 4604 ? 00:00:00 MQTT Rec: SkySp 3720 4605 ? 00:00:00 MQTT Snd: SkySp 3720 4606 ? 00:00:00 pool-56-thread- 3720 4613 ? 00:00:00 MQTT Call: SkyS 3720 4614 ? 00:00:00 MQTT Rec: SkySp 3720 4615 ? 00:00:00 MQTT Snd: SkySp 3720 4616 ? 00:00:00 pool-57-thread- 3720 4622 ? 00:00:00 MQTT Call: SkyS 3720 4623 ? 00:00:00 MQTT Rec: SkySp 3720 4624 ? 00:00:00 MQTT Snd: SkySp 3720 4625 ? 00:00:00 pool-58-thread- 3720 4631 ? 00:00:00 MQTT Call: SkyS 3720 4632 ? 00:00:00 MQTT Rec: SkySp 3720 4633 ? 00:00:00 MQTT Snd: SkySp 3720 4634 ? 00:00:00 pool-59-thread- 3720 4646 ? 00:00:00 MQTT Snd: SkySp 3720 4647 ? 00:00:00 MQTT Rec: SkySp 3720 4648 ? 00:00:00 MQTT Call: SkyS 3720 4649 ? 00:00:00 pool-60-thread- 3720 4655 ? 00:00:00 MQTT Snd: SkySp 3720 4656 ? 00:00:00 MQTT Rec: SkySp 3720 4657 ? 00:00:00 MQTT Call: SkyS 3720 4658 ? 00:00:00 pool-61-thread- 3720 4665 ? 00:00:00 MQTT Call: SkyS 3720 4666 ? 00:00:00 MQTT Rec: SkySp 3720 4667 ? 00:00:00 MQTT Snd: SkySp 3720 4668 ? 00:00:00 pool-62-thread- 3720 4673 ? 00:00:00 MQTT Call: SkyS 3720 4674 ? 00:00:00 MQTT Rec: SkySp 3720 4675 ? 00:00:00 MQTT Snd: SkySp 3720 4676 ? 00:00:00 pool-63-thread- 3720 4683 ? 00:00:00 MQTT Call: SkyS 3720 4684 ? 00:00:00 MQTT Rec: SkySp 3720 4685 ? 00:00:00 MQTT Snd: SkySp 3720 4686 ? 00:00:00 pool-64-thread- 3720 4693 ? 00:00:00 MQTT Call: SkyS 3720 4694 ? 00:00:00 MQTT Rec: SkySp 3720 4695 ? 00:00:00 MQTT Snd: SkySp 3720 4696 ? 00:00:00 pool-65-thread- 3720 4728 ? 00:00:00 MQTT Snd: SkySp 3720 4729 ? 00:00:00 MQTT Rec: SkySp 3720 4730 ? 00:00:00 MQTT Call: SkyS 3720 4731 ? 00:00:00 pool-66-thread- 3720 4742 ? 00:00:00 MQTT Call: SkyS 3720 4743 ? 00:00:00 MQTT Rec: SkySp 3720 4744 ? 00:00:00 MQTT Snd: SkySp 3720 4745 ? 00:00:00 pool-67-thread- 3720 4755 ? 00:00:00 MQTT Call: SkyS 3720 4756 ? 00:00:00 MQTT Rec: SkySp 3720 4757 ? 00:00:00 MQTT Snd: SkySp 3720 4758 ? 00:00:00 pool-68-thread- 3720 4767 ? 00:00:00 MQTT Call: SkyS 3720 4768 ? 00:00:00 MQTT Rec: SkySp 3720 4769 ? 00:00:00 MQTT Snd: SkySp 3720 4770 ? 00:00:00 pool-69-thread- 3720 4776 ? 00:00:00 MQTT Call: SkyS 3720 4777 ? 00:00:00 MQTT Rec: SkySp 3720 4778 ? 00:00:00 MQTT Snd: SkySp 3720 4779 ? 00:00:00 pool-70-thread- 3720 4784 ? 00:00:00 MQTT Call: SkyS 3720 4785 ? 00:00:00 MQTT Rec: SkySp 3720 4786 ? 00:00:00 MQTT Snd: SkySp 3720 4787 ? 00:00:00 pool-71-thread- 3720 4799 ? 00:00:00 MQTT Call: SkyS 3720 4800 ? 00:00:00 MQTT Rec: SkySp 3720 4801 ? 00:00:00 MQTT Snd: SkySp 3720 4802 ? 00:00:00 pool-72-thread- 3720 4808 ? 00:00:00 MQTT Call: SkyS 3720 4809 ? 00:00:00 MQTT Rec: SkySp 3720 4810 ? 00:00:00 MQTT Snd: SkySp 3720 4811 ? 00:00:00 pool-73-thread- 3720 4817 ? 00:00:00 MQTT Call: SkyS 3720 4818 ? 00:00:00 MQTT Rec: SkySp 3720 4819 ? 00:00:00 MQTT Snd: SkySp 3720 4820 ? 00:00:00 pool-74-thread- 3720 4825 ? 00:00:00 MQTT Call: SkyS 3720 4826 ? 00:00:00 MQTT Rec: SkySp 3720 4827 ? 00:00:00 MQTT Snd: SkySp 3720 4828 ? 00:00:00 pool-75-thread- 3720 4836 ? 00:00:00 MQTT Call: SkyS 3720 4837 ? 00:00:00 MQTT Rec: SkySp 3720 4838 ? 00:00:00 MQTT Snd: SkySp 3720 4839 ? 00:00:00 pool-76-thread- 3720 4846 ? 00:00:00 MQTT Call: SkyS 3720 4847 ? 00:00:00 MQTT Rec: SkySp 3720 4848 ? 00:00:00 MQTT Snd: SkySp 3720 4849 ? 00:00:00 pool-77-thread- 3720 4861 ? 00:00:00 MQTT Call: SkyS 3720 4862 ? 00:00:00 MQTT Rec: SkySp 3720 4863 ? 00:00:00 MQTT Snd: SkySp 3720 4864 ? 00:00:00 pool-78-thread- 3720 4871 ? 00:00:00 MQTT Call: SkyS 3720 4872 ? 00:00:00 MQTT Rec: SkySp 3720 4873 ? 00:00:00 MQTT Snd: SkySp 3720 4874 ? 00:00:00 pool-79-thread- 3720 4889 ? 00:00:00 MQTT Snd: SkySp 3720 4890 ? 00:00:00 MQTT Rec: SkySp 3720 4891 ? 00:00:00 MQTT Call: SkyS 3720 4892 ? 00:00:00 pool-80-thread- 3720 4898 ? 00:00:00 MQTT Call: SkyS 3720 4899 ? 00:00:00 MQTT Rec: SkySp 3720 4900 ? 00:00:00 MQTT Snd: SkySp 3720 4901 ? 00:00:00 pool-81-thread- 3720 4907 ? 00:00:00 MQTT Snd: SkySp 3720 4908 ? 00:00:00 MQTT Rec: SkySp 3720 4909 ? 00:00:00 MQTT Call: SkyS 3720 4910 ? 00:00:00 pool-82-thread- 3720 4922 ? 00:00:00 MQTT Snd: SkySp 3720 4923 ? 00:00:00 MQTT Rec: SkySp 3720 4924 ? 00:00:00 MQTT Call: SkyS 3720 4925 ? 00:00:00 pool-83-thread- 3720 4938 ? 00:00:00 MQTT Call: SkyS 3720 4939 ? 00:00:00 MQTT Rec: SkySp 3720 4940 ? 00:00:00 MQTT Snd: SkySp 3720 4941 ? 00:00:00 pool-84-thread- 3720 4955 ? 00:00:00 MQTT Snd: SkySp 3720 4956 ? 00:00:00 MQTT Rec: SkySp 3720 4957 ? 00:00:00 MQTT Call: SkyS 3720 4958 ? 00:00:00 pool-85-thread- 3720 4968 ? 00:00:00 MQTT Snd: SkySp 3720 4969 ? 00:00:00 MQTT Rec: SkySp 3720 4970 ? 00:00:00 pool-86-thread- 3720 4971 ? 00:00:00 MQTT Call: SkyS 3720 4979 ? 00:00:00 MQTT Snd: SkySp 3720 4980 ? 00:00:00 MQTT Rec: SkySp 3720 4981 ? 00:00:00 MQTT Call: SkyS 3720 4982 ? 00:00:00 pool-87-thread- 3720 4991 ? 00:00:00 MQTT Snd: SkySp 3720 4992 ? 00:00:00 MQTT Rec: SkySp 3720 4993 ? 00:00:00 MQTT Call: SkyS 3720 4994 ? 00:00:00 pool-88-thread- 3720 5002 ? 00:00:00 MQTT Call: SkyS 3720 5003 ? 00:00:00 MQTT Rec: SkySp 3720 5004 ? 00:00:00 MQTT Snd: SkySp 3720 5005 ? 00:00:00 pool-89-thread- 3720 5013 ? 00:00:00 MQTT Call: SkyS 3720 5014 ? 00:00:00 MQTT Rec: SkySp 3720 5015 ? 00:00:00 MQTT Snd: SkySp 3720 5016 ? 00:00:00 pool-90-thread- 3720 5027 ? 00:00:00 MQTT Snd: SkySp 3720 5028 ? 00:00:00 MQTT Rec: SkySp 3720 5029 ? 00:00:00 MQTT Call: SkyS 3720 5030 ? 00:00:00 pool-91-thread- 3720 5038 ? 00:00:00 MQTT Call: SkyS 3720 5039 ? 00:00:00 MQTT Rec: SkySp 3720 5040 ? 00:00:00 MQTT Snd: SkySp 3720 5041 ? 00:00:00 pool-92-thread- 3720 5048 ? 00:00:00 MQTT Snd: SkySp 3720 5049 ? 00:00:00 MQTT Rec: SkySp 3720 5050 ? 00:00:00 MQTT Call: SkyS 3720 5051 ? 00:00:00 pool-93-thread- 3720 5062 ? 00:00:00 MQTT Call: SkyS

============================================== This list goes on with the AXON function calls

=============================================

Please, Guide us how to Debug it, is it a limitation of this extension or we are using wrong way to use mqtt extension session in AXON function?

John MacEnri11th Oct 2022

Hi Umer. It's hard to know for sure, but how are you calling this Axon function? Is it being called in a very tight loop for 100s or 1000s of messages?

The pahoMqttPublishMsg function was really only meant as a convenience for publishing occasional messages. What I think is really needed is a means of creating an instance of the MQTT Client and re-using it as many times as you want, until you decide you're finished with it and you close it.

I'll make a change to the extension to allow for that use case and see if that makes a difference for you.

Regards, John.

John MacEnri11th Oct 2022

Hi Umer.

I think you will need to migrate to using the cpMqttExt extension which is a direct port of the Paho MQTT extension, but with the underlying MQTT transport layer switch to the native Fantom based MQTT extension that SkyFoundry released earlier this year.

I have added the functionality I mentioned in the previous reply, so you can now use cpMqttClientConnect which returns an instance of MqttClient, which you can then pass to cpMqttClientPublish and finally to cpMqttClientClose when you're finished with it.

The other function cpMqttPublishMsg is still there, and acts just like pahoMqttPublishMsg in that is creates the MqttClient connection, publishes the message and disconnects again, all in the one function.

So I'd recommend the move to cpMqttExt and to using the cpMqttClientConnect, cpMqttClientPublish and cpMqttClientClose functions if you are looking to keep the connection open and publish a lot of messages.

NB. A migration function cpMqttMigrateFromPaho has been provided to convert any existing Paho based connectors and points to CP based.

The latest version of cpMqttExt now is 2.1.3

Regards, John

Umer shah12th Oct 2022

Yes, you are right. I'm using tight loop because we need to update the data points in mobile application frequently. The required send message interval is less than 5 seconds or it could be around 10 seconds.