Start of funding 01.07.2018

Data Analytics of Soil Health Data

Prof. Dr. Markus U. Mock
University of applied sciences Landshut
Fakultät Informatik

Prof. Chandra Krintz
University of California, Santa Barbara
Department of Computer Science



Agricultural production is facing tremendous pressure to increase crop production to keep pace with world population growth while at the same time operate in sustainable fashion. This implies that soil quality has to be maintained despite intensive farming use. In this project we extend an existing Seekur robotic platform (FARMBA) to autonomously and continuously take soil quality metrics via instrumentation. In addition, the platform also includes weather data sensors. The platform will generate a lot of continuous sensor data that has to be stored and processed for analytics. We plan on leveraging our existing data processing pipeline and machine learning techniques and extend them to make them applicable to a completely new problem domain.?We have two main goals for our project: (1) leverage the Docker-based processing pipeline for the FARMBA acquired soil sensor data to develop a scalable and flexible storage and analysis backend for the robot data, and (2) develop machine learning models that enable the automatic detection of impending soil quality degradation and the identification of contributing factors.?

Final report:
The originally proposed research focus of providing data analytics for soil health turned out to be infeasible. Unfortunately, the robotic platform that was supposed to generate the soil-related data at UCSB did not become available in time (in fact, as of 9/2019 it is still not available). However, we were able to pivot our efforts in the same area (IoT and data analytics for smart farming) to another focus, which turned out be very successful and resulted in two directly related publications in two top-rated conferences.

The work consequently concentrated on two related efforts: sensor synthesis and edge computing (not only) for smart farms. One problem that popular IoT computation platforms such as the Raspberry Pi or Arduino microcontroller face consists of the limited (port) space for sensors. Therefore, if one desired measurement, e.g., the outdoor temperature can be derived (= synthesized) from other values, the saved space can be used for other sensors or reduce the instrumentation energy cost.

In our ICIOT paper, we were able to successfully synthesize the outdoor temperature based on the Raspberry Pi's CPU temperature combined with an Internet weather service temperature for the farm location to a precision of 1 degree Fahrenheit.

A second significant problem for smart farming is the provision of a durable computing platform at the farm site, i.e., providing an edge computing platform. Edge computing is necessary because Internet connectivity if often inadequate or even unavailable at farm locations, which is the case for the UCSB smart farm. Also, since the farm is at a significant distance to where the computer-savvy personnel is located (UCSB's main campus), the computing platform has to be robust, and selfhealing as any crash would result in a long time to repair and consequently low system availability.

In our Edge Computing paper, we demonstrated techniques on how to implement a durable edge cloud by creating a system (named Mandrake) that enables the hosting of a Hadoop Cluster using Intel NUC devices. Mandrake is very robust and self-healing and keeps running as long as no failure eliminates 50% or more of all computing nodes at the same time. In the case of a node failure, Mandrake gracefully scales down to the remaining compute nodes and re-integrates nodes that have been repaired (e.g., by power-cycling, something that can be performed even by local farm personnel) into the edge computing cluster. This process does not affect actual workloads except for a performance degradation that is commensurate with the amount of lost computing power.