How to manage your unstructured drone-collected data

How to manage your unstructured drone-collected data


Drones are superb for accumulating data from previously mentioned. But acquiring a way to store that info is much more of a obstacle.

Picture: valio84sl, Getty Pictures/iStockphoto

When a Danish organization desired to carry out underwater surveys of numerous shallow ponds distribute throughout the region, it shortly discovered that the thickness of the seaweed in the ponds rendered it extremely hard to perform the underwater surveys with common submersible echo sounding tools that bounces sonar waves off seabed sand and underwater objects.

SEE: Tableau business analytics system: A cheat sheet (cost-free PDF download) (TechRepublic)

The remedy was a drone, which emitted floor penetrating radar (GPR) that was ready to do the exact same task without having the issue of having to be submerged by way of seaweed.

Use cases like this for drones and significant info collection are surfacing in practically every business sector—from traffic monitoring and incident documentation to agricultural inspections and forest wildfire fighting. 

In every case, details is most normally collected in the kind of shots and video clips. The information can be stored on the drone and then relayed back to a ground-based mostly knowledge repository exactly where it can be analyzed and analyzed.

The course of action appears to be clear-cut sufficient, but for IT and end-company departments managing drones, new protocols, small business processes, and data techniques require to be in put.

SEE: Inside of UPS: The logistics company’s by no means-ending electronic transformation (cost-free PDF) (TechRepublic)

If you are charged with collecting major data from drones, here are 6 thoughts that you should really request your self:

1. Where’s the info?

Mainly because of bandwidth and site constraints, few sites want to be downloading their drone knowledge to a distant central repository in authentic time, or even in batch immediately following flight occasions. The storage architecture most generally deployed is distant storage in the cloud, or at a protected industry place of work proximate to drone activities. Information can be transferred to a central data repository later on. What IT must do is to define this drone info architecture and how it will work in progress of any drone action. 

2. Is the information safe?

Drones acquire information in the area, and the details is commonly housed in distant offices. In these remote offices, it is more than probable that a non-IT person will be in demand. Regular IT protection and custodial techniques will need to be set in location and experienced to these non-IT staff members so data and knowledge storage keep on being physically and logically secure.

3. How a great deal data do you want?

“If you happen to be traveling 3 to 5 periods a week and averaging 500 photographs per flight, you’re amassing tens of gigabytes every single week and you need to make a approach about what is actually heading to take place with all this data, and specific choices in this spot rely on what you need to have to do,” stated Benjamin Van der Jagt, co-founder of UMAP Systems, a 3D mapping startup.

The facts is the stage. Early on, IT and enterprise buyers really should determine which facts they want to retain and which they will discard. If you fail to make these determinations, the data will overrun your storage ability and you are going to afterwards obtain it even more complicated to form via all of the info to find the facts you genuinely want.

4. What is the impact on storage?

Storage can be comparatively low cost, but having to manage rows of servers and storage drives with knowledge that is under no circumstances or seldom employed is not what you want. That’s why early on in the preparing of a drone challenge, you want to establish which information you want to hold from drone missions and how considerably storage you’re going to have to deploy or fund to retailer all of that information.

5. What happens if details is shed?

Drones have restricted flight situations for the reason that their batteries have limitations. These flight instances can be even further lowered if unpredicted headwinds are encountered. Then, too, a drone could just fail—or it could be intercepted. Organizations deciding on to operate drones must have a system of motion for recovering lost drones (and possibly delicate information) or for locking drone knowledge down if the device won’t be able to be recovered.

6. Can drone info be integrated with information from other systems for superior analytics?

Drone-gathered info is practically always in some unstructured video clip or photographic structure. This does not make it simple to combine with info from other company units that are character-based mostly and in the variety of fixed-length information.

A excellent system that effectively integrates with drone-gathered facts is a geographic details process (GIS). GIS systems are generally utilised for mapping. They can support and combine non-textual details with GPS and other kinds of info, and are an perfect integration system for drone-gathered details. 

SEE: Census tech: How to rely each individual person (TechRepublic)

However, drone and GIS knowledge data just isn’t conveniently integrated with information from other company programs. In some cases, IT may possibly select to commit in a GIS system if it doesn’t now have just one. In other circumstances, IT may well select to go after more wide ranging—and difficult—data integration if business scenarios and analytics warrant it.

Also see



Supply connection