ESP8266 based OTGW-firmware for Nodoshop hardware

OpenTherm Nodoshop OTGW hardware - an ESP8266 firmware

This project is an firmware for the Nodoshop OTGW hardware, based on ESP8266 devkits.

Starting with version 2.3 of the Nodoshop hardware the devkit has changed from NodeMCU to a Wemos D1mini. This is fully supported by the hardware and this firmware.

Supporting hardware version are:

Version	Hardware supported
1.x-2.0	NodoMCU ESP8266 devkit
2.3	Wemos D1mini ESP8266 devkit

It can be found here: https://www.nodo-shop.nl/nl/opentherm-gateway/188-opentherm-gateway.html
More information on this gateway can be read here: http://otgw.tclcode.com/ (also location of the OTGW PIC firmware)

The goal of this project is to become a fully functioning ESP8266 based OTGW-firmware that operates the OTGW as a standalone application. Providing:

• a WebUI
• bidirection MQTT support
• a REST API
• automatic integration with Home Assistant (Home Assistant Core v2021.2.0+)
• and a TCP socket for serial connection

Breaking change: With version 0.8.0 MQTT Discovery topic naming convention has changed significantly, this will break MQTT based applications. Breaking change: With version 0.7.2 (and up) the LitteFS filesystem is used. This means you need to reflash your device using a usb cable, all settings are lost in the process.

The features of this Nodosop OpenTherm Gateware ESP8266 based firmware are:

• configuration via the webUI on port 80: flash your ESP8266 and edit settings via the webUI
• userfriendly file handling using LittleFS (breaking change v0.7.2+)
• parsing the OT protocol on the ESP8266
• parsing all known OT protocol message ID's (OpenTherm v2.2+2.3b), including Heating/Ventilation and Remeha specific msgid's
• wide range of connection and data sharing options:
  • telnet (interpreted data and debugging)
  • MQTT (publishing every parsed OT message, publish commands to this topic OTGW/set/<node id>/command)
  • simple REST API (http://<ip>/api/v0/otgw/{id})
  • simple REST API (http://<ip>/api/v1/otgw/id/{id} or http://<ip>/api/v1/otgw/label/{textlabel eg. Tr or Toutside}, commands on /api/v1/otgw/command/{any command})
  • serial interface on port 25238 for original OTmonitor application (bi-directional)
  • OTmonitor Web UI (standalone interface)
• automatic integration with Home Assistant using Home Assistant Discovery (Home Assistant Core v2021.2.0+)
• integration with any MQTT based Home Automation solution, like Domoticz (plugin available) & OpenHAB
• reliable OTGW PIC upgrades (v0.6.0+), to the latest firmware available at http://otgw.tclcode.com/download.html
• cleaner RestAPI's for Telegraf OTmonitor integration
• readout Dallas-type temperture sensors (eg. DS18B20) connected to GPIO

Warning: Never flash your OTGW PIC firmware through wifi using OTmonitor application, you can brick your OTGW PIC. Instead use the buildin PIC firmware upgrade feature (based on code by Schelte Bron)

To do:

• InfluxDB client to do direct logging
• Instant update of webUI using websockets
• Showing log of OT messages using websockets

Looking for the documentation, go here (work in progress):
https://github.com/rvdbreemen/OTGW-firmware/wiki/Documentation-of-OTGW-firmware

Version	Release notes
0.9.1	New feature: Added new set commands topics for most OTGW features, read more on the wiki New feature: Reset bootlog to filesystem, for debug purposes Improved: Stability, due to removal of ESP based auto-wifi-reconnect Improved: the OT decoding algoritm, so values on MQTT, REST and WebUI now should be more reliable Added: Override decoding of B and T when followed by A and R of the same MsgID, because this means OTGW overrides messages Improved: No messages on versions when not connected to internet Added: Proper msgid 100: remote override room setpoint flags decoding Added: Missing some msgids to OT decoding
0.9.0	New: Adding time setup commands for Thermostat Fixed: Improved OT status (incl. VH and Solar) message decoding Fixed: Statusbit decoding in webUI Improved: Better wifi auto-reconnect (ESP based) Improved: Wifi reconnection logic, reboot if 15 min not connected New: NTP hostname setting in webUI Changed: removed ezTime NTP library, moved to ConfigTime NTP and AceTime
0.8.6	Improving wifi reconnect (without reboot) Fix: Double definition to a HA sensor Adding: OEMDiagnosticCode topic to HA Discovery Bugfix: UI now labels OEM DiagnosticCode correctly, and added the real OEM Fault code
0.8.5	Bugfix: Queue bug never sending the command (reporter: @jvinckers) Small improvement to status parsing, only resturned status from slave gets parsed now.
0.8.4	Adding MsgID for Solar Storage Verbose Status parsing for Ventlation / Heatrecovery Adding msgid 113/114 unsuccessful burnerstart / flame too low Added smartpower configruation detection Added 2.3 spec status bits for (summer/winter time, dhw blocking, service indicator, electric production) Adding PS=1 detection (WebUI notification) Fix: restore settings issue
0.8.3	New feature: Unique ID is configurable (thanks to @RobR) New feature: GPIO pins follow status bits (master/slave) (thanks to @sjorsjuhmaniac) Improved: Detecting online status of thermostat and boiler Improved: MQTT Debug error logging Fixed bug: reconnect MQTT timer and changed wait for reconnect to 42 seconds Added: Rest API command now uses queues for sending commands Fixed bug: msgid 32/33 type switch around Changed: Solar Storage and Collector now proper names (breaking change)
0.8.2	Added: Command Queue to MQTT command topic Bugfix: Values not updating in WebUI fixed Added: verbose debug modes Added check for littlefs githash Added: Interval setting for sensor readout Adding: Send OTGW commands on boot Bugfix: Hostname now actually changes if needed.
0.8.1	Improved ot msg processing MQTT: added otgw-firmware/version, otgw-firmware/reboot_count, otgw-firmware/version and otgw-firmware/uptime (seconds) Bugfix: typoo in topic name master_low_off_pomp_control_function -> master_low_off_pump_control_function Bugfix: Home Assistant thermostat operation mode (flame icon) template Feature: Add support for Dallas temperature sensors, defaults GPIO10, pushes data to otgw-firmware/sensors/<Dallas-sensor-ID>
0.8.0	Breaking Change: MQTT topic naming convention has changed from <mqqt top prefix>/<sensor> to <mqtt top prefix>/value/<node id>/<sensor> for data publshed and <mqtt top prefix>/set/<node id>/<command> for subscriptions Update Homeasssistant Discovery: add OTGW as a device and group all exposed entities as childs Update Homeasssistant Discovery: add climate (thermostat) enity, uses temporary temperature override (OTGW TT command) (Home Assistant Core v2021.2.0+) Bugfix #14: reduce MQTT connect timeout < the watchdog timeout to prevent reboot on a timout Adding LLMNR responder (http://otgw/ will work now too) New restapi: Telegraf endpoint (/api/v1/otgw/telegraf) Fixing bugs in core OTGW msg processor for ASF flas
0.7.8	Update Home Assistant Discovery Flexible Home Assistant prefix Bugfix: Removed hardcoded OTGW topic Bugfix: NTP timezone discovery removed
0.7.7	UI improved: Only show updates values in web UI Bugifx: Serial not found error when sending commands thru MQTT fixed
0.7.6	PIC firmware integration done. New setting: NTP configurable New setting: heartbeat led on/off Update to REST API to include epoch of last update to message
0.7.5	Complete set of status bits in UI and Central Heating 2 information
0.7.4	Integration of the otgw-pic firmware upgrade code - upgrade to pic firmware version 5.0 (by Schelte Bron)
0.7.3	Adding MQTT disable/enable option Adding MQTT long password (max. 100 chars) Adding executeCommand API (verify and return response for commands) Added uptime and otgw fwversion in devinfo UI
0.7.2	Breaking change: Moving over to LittleFS. This means you need to reflash your device using a USB cable.
0.7.1	Adding reset gateway to enter self-programming mode more reliable. Changed to port 25238 for serial TCP connections (default of OTmonitor application by Schelte Bron) Bugfix: Settings UI works even with "browserplugins". Thanks @STemplar
0.7.0	Added all Ventilation/Heat Recovery msgids (2.3b OT spec). Plus Remeha msgids. Thanks @STemplar Added OTGW pic reset on bootup. Translate dutch to english. Bugfix: Serial flushing & writebuffer checking to prevent overflow during flashing.
0.6.1	Bugfix: setting page did not always work correctly, now it does.
0.6.0	Standalone UI for simple OT monitor purposes and deviceinformation, moved index.html to SPIFF OTA is possible after flashing 0.6.0 (Hardware watchdog is fed, during flash uploads now)
0.5.1	REST APIs, v1, for OTmonitor values, GetByLabel, GetByID, POST otgw/command/{command}
0.5.0	Implemented the UI for settings (restapi, read/write file in json)
0.4.2	Bi-directional serial communication on port 25238 (aka ser2net) for use with OTmonitor application
0.4.0	RestAPI implemented - as simple as <ip>/api/v0/otgw/{id} to get the latest values
0.3.1	Bug: Open AP after configuration, change ESP to STA mode on StartWifi No more default Debug to Serial, only to port 23 telnet
0.3.0	Read only Serial stream implementend on port 25238 (debug port remains on port 23 - telnet)
0.2.0	Auto-discovery through MQTT implemented for integration with Home Assistant
0.1.0	MQTT messaging implemented
0.0.1	parsing of OT protocol implemented (use telnet to see) Watchdog feeding implemented

Credits

Shoutout to early adopters helping me out testing and discussing the firmware in development. For pushing features, testing and living on the edge.

So shoutout to the following people for the collaboration on development:

• @sjorsjuhmaniac for improving the MQTT naming convention and HA integration, adding climate entity and otgw device
• @vampywiz17 early adopter and tester
• @Stemplar reporting issues realy on
• @proditaki for creating Domiticz plugin for OTGW-firmware
• @tjfsteele for endless hours of testing

A big thank should goto Schelte Bron @hvlx for amazing work on the OpenTherm Gateway project and for providing access to the upgrade routines of the PIC. Enabling this custom firmware a reliable way to upgrade you PIC firmware.

If you want to thank Schelte Bron for his work on the OpenTherm Gateway project, just head over to his homepage and donate to him: https://otgw.tclcode.com/

Buy me a coffee

In case you want to buy me a coffee, head over here: