Pairing not enabling RFDL-ZB-MS motion sensing, did before just fine

[Ltek]

I turns on ALL debug items since I have no idea what is needed.

When I look at all the sensors I’m seeing that even some of the ‘working’ ones dont have all the data read populated in Basic… and they have been working for 6+ months.

Hypothesis #1… Deconz is reading all cluster data on initial pairing. Even though these Bosch devices stay awake for 5mins. I’ve tested this on both Bosch and Aqara (Lumi) devices by simply clicking ‘read’ button on each Cluster after initial pairing and all the devices populate the cluster, even the not-so-easy Aqara sensors. Event the two recently added Bosch devices populate all clusters except for IAS Zone … so I suspect this is a different problem specific newer Deconz code as the other Bosch devices were added with Conbee1 and much older Deconz code (6+ months ago)

Hypothesis #2… I suspect Deconz is missing code to queue a device inspection upon next wake to gather missing data.

properly populated Basic Cluster from a not working Bosch…

properly populated Basic Cluster from a working Bosch…

not properly populated Basic Cluster from a working Bosch…

re Log Files…
Logging to file should simply be a checkbox (like 99% of all apps in the world - even poorly written ones like I make) people should not need to start/stop any app, ever, to log to a file… its literally 1 line of code to write to a file what you are writing on screen.
Same goes for Clusters… we should have a button that says, ‘Save Cluster data to file’. In Deconz you cant screenshot the entire set of cluster info in Basic (its too large); and you cant select and manually copy the tables either. I’m a crappy coder and I could write this code. Seriously, 5 mins (at most) for a good coder to put this in.

[Mimiix]

@Ltek

When I look at all the sensors I’m seeing that even some of the ‘working’ ones dont have all the data read populated in Basic… and they have been working for 6+ months.

You can read them by clicking the button on the device and click “read” in the basic cluster.

@Ltek

Logging to file should simply be a checkbox (like 99% of all apps in the world - even poorly written ones like I make) people should not need to start/stop any app, ever, to log to a file… its literally 1 line of code to write to a file what you are writing on screen.

In Linux, its quite normal to do it like this. Feel free to create a Pull request or feature request. Be the solution

On topic:

Looks like your Not working bosch sensors have a different version on Application Version.

Working one:

You need to Update them i suppose.

[Swoop]

@Ltek What’s the deconz version, please?

The device is supported by legacy code only and apparently gets stuck in a loop to read attribute 0x0006 of the basic cluster upon discovery and doesn’t continue. Based on the debug log, the response seems to be a NULL byte.

I’d recommend taking the DDF drafted by deconz, share and fine tune it here and use that one from there on. That should eliminate quite some culprits, including any queries of the date code attribute.

[Ltek]

I was on 2.6.3 and just installed 2.70… same problem. I thought everything was being moved to DDF?

What “DDF drafted by Deconz” are you referring to? I dont see it Supported Devices - deCONZ REST-API

I’ve never created a DDF so this is 100% new territory for me. Seems like they could have Deconz automatically create the base DDF for a given device after reading its attributes during pairing… that would save a TON of time for everyone.

[Ltek]

@Ltek

When I force Deconz to ‘read’ the clusters they all readon quickly and correctly.

… as I mentioned in the first post, ‘read’ doesnt help.

I dont know what ‘Application Version’ means?
These are all the same model sensor, and they all read full/properly on pairing with Z2M and work great (for a while)

so you are asking, I’m sure… “why leave Z2M if they work on it”… yeah, BUT a few hours to a few days on Z2M and newly added devices will not stay connected. All kinds (Osram, Aqara, Lumi, Bosch), when the network is larger than around 10 devices, even devices on mains (not just battery) … they work great then fall off even when LQI is over 200.

[Smanar]

Hello, can try this DDF

{
  "schema": "devcap1.schema.json",
  "manufacturername": "$MF_BOSCH",
  "modelid": "RFDL-ZB-MS",
  "vendor": "Bosch",
  "product": "Motion sensor",
  "sleeper": true,
  "status": "Gold",
  "subdevices": [
    {
      "type": "$TYPE_PRESENCE_SENSOR",
      "restapi": "/sensors",
      "uuid": [
        "$address.ext",
        "0x01",
        "0x0500"
      ],
      "fingerprint": {
        "profile": "0x0104",
        "device": "0x0402",
        "endpoint": "0x01",
        "in": [
          "0x0000",
          "0x0001",
          "0x0500"
        ]
      },
      "items": [
        {
          "name": "attr/id"
        },
        {
          "name": "attr/lastannounced"
        },
        {
          "name": "attr/lastseen"
        },
        {
          "name": "attr/manufacturername"
        },
        {
          "name": "attr/modelid"
        },
        {
          "name": "attr/name"
        },
        {
          "name": "attr/swversion"
        },
        {
          "name": "attr/type"
        },
        {
          "name": "attr/uniqueid"
        },
        {
          "name": "config/battery",
          "parse": {
            "at": "0x0021",
            "cl": "0x0001",
            "ep": 1,
            "eval": "Item.val = Attr.val / 2",
            "fn": "zcl:attr"
          }
        },
        {
          "name": "config/enrolled",
          "public": false
        },
        {
          "name": "config/on"
        },
        {
          "name": "config/pending"
        },
        {
          "name": "config/reachable"
        },
        {
          "name": "state/presence",
          "awake": true
        },
        {
          "name": "state/lastupdated"
        },
        {
          "name": "state/lowbattery"
        }
      ]
    }
  ],
  "bindings": [
    {
      "bind": "unicast",
      "src.ep": 1,
      "cl": "0x0001",
      "report": [
        {
          "at": "0x0021",
          "dt": "0x20",
          "min": 600,
          "max": 43200,
          "change": "0x00000001"
        }
      ]
    },
    {
      "bind": "unicast",
      "src.ep": 1,
      "cl": "0x0500"
    }
  ]
}

To use them you can try the next deconz feature, the " DDF Bundle Support" Release v2.27.0-beta · dresden-elektronik/deconz-rest-plugin · GitHub if you are on version 27

[Ltek]

@Smanar I uploaded the DDF using Phoscon but its not being used by Deconz. I even restarted Deconz, same issue. Then I tried using Deconz ‘Edit DDF’ on a few of the devices… nothing shows loaded (I suspect because its still using legacy code)… and the tab doesn’t allow me to copy the JSON into the tab. How can I load that DDF and get it to auto-activate like the docs show?

[Mimiix]

You need to upload a bundle, not the json itself. that needs to be generated from a PR in github (as i’m told). @manup can explain a bit better here.

[Smanar]

@Mimiix

You need to upload a bundle, not the json itself

Ha yes, right, I m trying unsuccessfuly on my side, so it mean it’s not possible to try a personnal DDF ?

But someone have succeded Tuya Scene Switch TS0044 TZ3000_a4xycprs · Issue #7619 · dresden-elektronik/deconz-rest-plugin · GitHub

Edit:
I have confirmation from Zorimyll, not possible without PR.
What is your OS @Ltek ? if you haven’t docker just create a text file in a “devices” folder with the DDF contain, and call the file waht_you_want.json, then restart deconz.

All DDF provided directly with deCONZ typically reside in /usr/share/deCONZ/devices/on a Linux system and are loaded first. However, files residing in the home directory of the user running deCONZ (e.g./home//.local/share/dresden-elektronik/deCONZ/devices) will override the pre-packaged files to allow users to amend and keep their own files if desired.

[Mimiix]

@smanar I recommend you read the discord dev chat, I had a chat about it yesterday

[Swoop]

@Ltek

What “DDF drafted by Deconz” are you referring to? I dont see it Supported Devices - deCONZ REST-API

I’ve never created a DDF so this is 100% new territory for me. Seems like they could have Deconz automatically create the base DDF for a given device after reading its attributes during pairing… that would save a TON of time for everyone.

Usually, deconz is able to suggest or draft a DDF for legacy devices when you right click on a device and select “edit DDF”. This typically works best if deconz is already running for some time, let’s say 30-60 mins, as then the majority of the legacy defined bindings are also available. Please also refer to the DDF cheat sheet in the wiki of the repository. However, it seems that the DDF mechanism currently has a bug and that would explain why nothing shows up (if I understood correctly). This typically saved quite some time and is pretty easy and convenient to handle.

Please do take note that the proposed DDF here is missing quite some content. Temperature and light level wouldn’t work anymore in that state.

[Ltek]

@Swoop When I tried making a ‘draft ddf’ (right click on a device, “Edit DDF”) its 100% empty – I tried 5 Bosch sensors, even the ones that work / display all the properties in Deconz.

@Smanar running Windows 10 with Deconz installed in root of C drive
put the JSON (attached in ZIP) in 3 different places, DDF is not loading
C:\deCONZ\devices\bosch
C:\deCONZ\devices
C:\Users\LTek\AppData\Local\dresden-elektronik\deCONZ\devices

btw, uploading “Bundles” seems more work harder than simply having Deconz upload the ‘personal’ DDF… not sure why the UI doesnt just upload a DDF for us?

My hypothesis is some sort of bug in more recent versions of Deconz specific to cluster 055 IAS Zone (07)… the only diff between Bosch’s that have Motion attributes showing are some of the settings in this cluster.

[Mimiix]

@Ltek

not sure why the UI doesnt just upload a DDF for us?

Me neither…

[Smanar]

Will be probably the next step, still beta feature.

@Ltek sorry, was my fault, have made a typo on the DDF, have corrected the previous code (miss a “,”) Pairing not enabling RFDL-ZB-MS motion sensing, did before just fine - #8 by Smanar
Your used path seem good, I don’t see the “attached zip”, but you just need to use the DDF contain in a text file called what_you_want.json.

For information deconz just use the modelID/Manufacture name to choose a DDF (it don’t take care of clusters)
And I can’t make a test on my side ATM, but strange on your side the “draft” DDF don’t have them, and more if thoses values are known by deconz for somes of your sensors.

[Ltek]

I just created a DDF using a good-working RFDL-ZB-MS sensor and added it to the \devices folder.

Now Deconz has changed all the devices. Notice the little motion guy is now a siren? And the Master Bath is now a temp icon? Huh?

From this…

To this…

[Smanar]

Can you share the used DDF ?

[Ltek]

JSON…

{
  "schema": "devcap1.schema.json",
  "manufacturername": "Bosch",
  "modelid": "RFDL-ZB-MS",
  "vendor": "Bosch",
  "product": "Motion sensor",
  "sleeper": true,
  "status": "Gold",
  "subdevices": [
    {
      "type": "$TYPE_PRESENCE_SENSOR",
      "restapi": "/sensors",
      "uuid": [
        "$address.ext",
        "0x01",
        "0x0500"
      ],
      "fingerprint": {
        "profile": "0x0104",
        "device": "0x0402",
        "endpoint": "0x01",
        "in": [
          "0x0000",
          "0x0001",
          "0x0500"
        ]
      },
      "items": [
        {
          "name": "attr/id"
        },
        {
          "name": "attr/lastannounced"
        },
        {
          "name": "attr/lastseen"
        },
        {
          "name": "attr/manufacturername"
        },
        {
          "name": "attr/modelid"
        },
        {
          "name": "attr/name"
        },
        {
          "name": "attr/swversion"
        },
        {
          "name": "attr/type"
        },
        {
          "name": "attr/uniqueid"
        },
        {
          "name": "config/battery",
          "parse": {
            "at": "0x0021",
            "cl": "0x0001",
            "ep": 1,
            "eval": "Item.val = Attr.val / 2",
            "fn": "zcl:attr"
          }
        },
        {
          "name": "config/enrolled",
          "public": false
        },
        {
          "name": "config/on"
        },
        {
          "name": "config/pending"
        },
        {
          "name": "config/reachable"
        },
        {
          "name": "state/presence",
          "awake": true
        }
        {
          "name": "state/lastupdated"
        },
        {
          "name": "state/lowbattery"
        }
      ]
    }
  ],
  "bindings": [
    {
      "bind": "unicast",
      "src.ep": 1,
      "cl": "0x0001",
      "report": [
        {
          "at": "0x0021",
          "dt": "0x20",
          "min": 600,
          "max": 43200,
          "change": "0x00000001"
        }
      ]
    },
    {
      "bind": "unicast",
      "src.ep": 1,
      "cl": "0x0500"
    }
  ]
}

[Smanar]

So yes, IDK why Phoscon display this sensor, nothing in DDf can explain that.

But you can take a look direcly in the API using Phoscon/help/API Information/sensors

[Ltek]

@Smanar

{
  "schema": "devcap1.schema.json",
  "manufacturername": "$MF_BOSCH",
  "modelid": "RFDL-ZB-MS",
  "vendor": "Bosch",
  "product": "Motion sensor",
  "sleeper": true,
  "status": "Gold",
  "subdevices": [
    {
      "type": "$TYPE_PRESENCE_SENSOR",
      "restapi": "/sensors",
      "uuid": [
        "$address.ext",
        "0x01",
        "0x0500"
      ],
      "fingerprint": {
        "profile": "0x0104",
        "device": "0x0402",
        "endpoint": "0x01",
        "in": [
          "0x0000",
          "0x0001",
          "0x0500"
        ]
      },
      "items": [
        {
          "name": "attr/id"
        },
        {
          "name": "attr/lastannounced"
        },
        {
          "name": "attr/lastseen"
        },
        {
          "name": "attr/manufacturername"
        },
        {
          "name": "attr/modelid"
        },
        {
          "name": "attr/name"
        },
        {
          "name": "attr/swversion"
        },
        {
          "name": "attr/type"
        },
        {
          "name": "attr/uniqueid"
        },
        {
          "name": "config/battery",
          "parse": {
            "at": "0x0021",
            "cl": "0x0001",
            "ep": 1,
            "eval": "Item.val = Attr.val / 2",
            "fn": "zcl:attr"
          }
        },
        {
          "name": "config/enrolled",
          "public": false
        },
        {
          "name": "config/on"
        },
        {
          "name": "config/pending"
        },
        {
          "name": "config/reachable"
        },
        {
          "name": "state/presence",
          "awake": true
        },
        {
          "name": "state/lastupdated"
        },
        {
          "name": "state/lowbattery"
        }
      ]
    }
  ],
  "bindings": [
    {
      "bind": "unicast",
      "src.ep": 1,
      "cl": "0x0001",
      "report": [
        {
          "at": "0x0021",
          "dt": "0x20",
          "min": 600,
          "max": 43200,
          "change": "0x00000001"
        }
      ]
    },
    {
      "bind": "unicast",
      "src.ep": 1,
      "cl": "0x0500"
    }
  ]
}

I changed to the DDF you put higher in this thread and the motion icon is back (no longer the alarm icon)… and I think I know why.

Deconz built-in definition looks like it uses…
“type”: “$TYPE_ALARM_SENSOR”,
and not (like your supplied DDF)…
“type”: “$TYPE_PRESENCE_SENSOR”,

Your DDF is missing Temp and Lux, not sure how to integrate into you DDF.
I attached my exported’ DDF from the built-in definition. Would you be able to integrate them?

Please read

[Smanar]

Ha yes, but why ?
Do you want a TYPE_ALARM_SENSOR or a TYPE_PRESENCE_SENSOR ?

Can try this DDF (it use TYPE_ALARM_SENSOR )

{
  "schema": "devcap1.schema.json",
  "manufacturername": "BOSCH",
  "modelid": "RFDL-ZB-MS",
  "product": "Motion sensor",
  "vendor": "Bosch",
  "status": "Gold",
  "sleeper": true,
  "subdevices": [
    {
      "type": "$TYPE_LIGHT_LEVEL_SENSOR",
      "restapi": "/sensors",
      "uuid": [
        "$address.ext",
        "0x01",
        "0x0400"
      ],
      "items": [
        {
          "name": "attr/id"
        },
        {
          "name": "attr/lastannounced"
        },
        {
          "name": "attr/lastseen"
        },
        {
          "name": "attr/manufacturername"
        },
        {
          "name": "attr/modelid"
        },
        {
          "name": "attr/name"
        },
        {
          "name": "attr/swversion"
        },
        {
          "name": "attr/type"
        },
        {
          "name": "attr/uniqueid"
        },
        {
          "name": "config/battery"
        },
        {
          "name": "config/on"
        },
        {
          "name": "config/reachable"
        },
        {
          "name": "config/tholddark",
          "default": 12000
        },
        {
          "name": "config/tholdoffset",
          "default": 7000
        },
        {
          "name": "state/dark",
          "default": false
        },
        {
          "name": "state/daylight",
          "default": false
        },
        {
          "name": "state/lastupdated"
        },
        {
          "name": "state/lightlevel",
          "default": 0
        },
        {
          "name": "state/lux",
          "default": 0
        }
      ]
    },
    {
      "type": "$TYPE_TEMPERATURE_SENSOR",
      "restapi": "/sensors",
      "uuid": [
        "$address.ext",
        "0x01",
        "0x0402"
      ],
      "items": [
        {
          "name": "attr/id"
        },
        {
          "name": "attr/lastannounced"
        },
        {
          "name": "attr/lastseen"
        },
        {
          "name": "attr/manufacturername"
        },
        {
          "name": "attr/modelid"
        },
        {
          "name": "attr/name"
        },
        {
          "name": "attr/swversion"
        },
        {
          "name": "attr/type"
        },
        {
          "name": "attr/uniqueid"
        },
        {
          "name": "config/battery"
        },
        {
          "name": "config/offset",
          "default": 0
        },
        {
          "name": "config/on"
        },
        {
          "name": "config/reachable"
        },
        {
          "name": "state/lastupdated"
        },
        {
          "name": "state/temperature",
          "default": 0
        }
      ]
    },
    {
      "type": "$TYPE_ALARM_SENSOR",
      "restapi": "/sensors",
      "uuid": [
        "$address.ext",
        "0x01",
        "0x0500"
      ],
      "fingerprint": {
        "profile": "0x0104",
        "device": "0x0402",
        "endpoint": "0x01",
        "in": [
          "0x0000",
          "0x0001",
          "0x0500"
        ]
      },
      "items": [
        {
          "name": "attr/id"
        },
        {
          "name": "attr/lastannounced"
        },
        {
          "name": "attr/lastseen"
        },
        {
          "name": "attr/manufacturername"
        },
        {
          "name": "attr/modelid"
        },
        {
          "name": "attr/name"
        },
        {
          "name": "attr/swversion"
        },
        {
          "name": "attr/type"
        },
        {
          "name": "attr/uniqueid"
        },
        {
          "name": "config/battery"
        },
        {
          "name": "config/enrolled"
        },
        {
          "name": "config/on"
        },
        {
          "name": "config/pending"
        },
        {
          "name": "config/reachable"
        },
        {
          "name": "state/alarm"
        },
        {
          "name": "state/lastupdated"
        },
        {
          "name": "state/lowbattery"
        },
        {
          "name": "state/tampered"
        }
      ]
    }
  ],
  "bindings": [
    {
      "bind": "unicast",
      "src.ep": 1,
      "cl": "0x0001",
      "report": [
        {
          "at": "0x0021",
          "dt": "0x20",
          "min": 600,
          "max": 43200,
          "change": "0x00000001"
        }
      ]
    },
    {
      "bind": "unicast",
      "src.ep": 1,
      "cl": "0x0402",
      "report": [
        {
          "at": "0x0000",
          "dt": "0x29",
          "min": 5,
          "max": 300,
          "change": "0x0000000A"
        }
      ]
    },
    {
      "bind": "unicast",
      "src.ep": 1,
      "cl": "0x0400",
      "report": [
        {
          "at": "0x0000",
          "dt": "0x21",
          "min": 5,
          "max": 300,
          "change": "0x07d0"
        }
      ]
    },
    {
      "bind": "unicast",
      "src.ep": 1,
      "cl": "0x0500"
    }
  ]
}

Lot of field are using defaut value, wait a little and tell me wich one are not working.