Follow

Uploading Drone Captures to DataHub for Processing

DataHub Processing

After you’ve completed your drone data capture missions, it’s time to upload for processing. Once you submit your upload, the proprietary Skycatch data engine will automatically process your data into high-resolution 2D and 3D outputs.  

Before you start the uploading process, we recommend reviewing this pre-upload checklist to ensure optimal results:

Pre-upload Checklist

  • Verify that your images are geotagged.
    Non-geotagged photos are not supported for processing since photos cannot be accurately processed without geotags.
  • Use the latest version of the Google Chrome browser.
    While the web uploader is compatible with any web browser (Mozilla Firefox, Internet Explorer, Safari, etc.), we recommend using the latest version of Google Chrome. 
  • Use a stable internet or WiFi connection.
    A poor connection can interfere with or stop the upload process.
  • Disable the sleep mode or power save mode on your computer.
    Entering a power-saving or sleep mode will disrupt your internet connection and, consequently, your upload.
  • Disable the lock screen/screen-saver on your computer. The uploader screen should be displayed in order to minimize interruptions.

Once the "pre-upload checklist" listed above has been set and completed, you’ll be able to upload your data for processing by following these simple steps:

  1. Upload Mission Folder
  2. Select the Site
  3. Add Precision Files & Run Validation (if applicable)
  4. Set Output Quality
  5. Add Control points
  6. Upload for Processing

Log into your Skycatch DataHub account and click the ADD DATASET button located at the upper right-hand corner of the screen.

If the button is not available, we recommend you log out of your account, perform a hard refresh of your browser to clear the cache, and log back in.

For a tutorial on how to upload Phantom 4 RTK datasets into DataHub, go please see "Uploading Phantom 4 RTK Datasets For Processing Into DataHub".

Step 1. Upload the Mission Folder

Drag and drop the entire mission folder containing the images and observation logs as directed below.

mceclip0.png

The DataHub Uploader will automatically perform a dataset validation. 

image21.png

Any unsupported files will automatically be deleted and will not be included in the data upload.

Note: If validation fails, please double-check that your images meet the following conditions:

  1. All images should be in a JPG format
  2. All images should be geotagged
  3. All images should be at least 50 KB in size

The images will be displayed in a preview layout where you can view each photo position overlayed on a satellite map for reference:

image16.png

Click on Photos added in the left corner of the display to view more details such as image resolution, drone altitude, and the area covered.

image10.png

Each white dot on the satellite map represents one photo. You can click on a white dot to preview the actual photo, file name, and coordinates on the screen.

image6.png

To delete a photo from the dataset, click on the trash can icon in the bottom right corner of the coordinates of the image. 

 

Step 2. Choose your Site

A. Existing Sites

If you have existing sites on your account, you can select which site from a dropdown list by clicking on the site dropdown button.

image8.png

You can select a site by scrolling through the list or by typing it in the search bar.

image4.png

B. New Site Creation

Click Create new site under the Location section to create a new site for your dataset.

image23.png

Click Edit site info to edit the site name and coordinate system.

image15.png

Step 3. Add Precision Data

If the high accuracy mode toggle is blue, your PPK files have been successfully uploaded and you can proceed to upload your base observations.

image24.png

In some cases, your uploaded PPK files might not be included for processing. The High accuracy mode toggle will remain grey. This indicates low processing accuracy. 

You can manually upload your PPK files by clicking the high accuracy mode toggle.

image11.png

For RTK processing and a brief introduction to Explore1 RTK files, visit FAQ: What Are Explore1 RTK Files (GNSS Logs)? . Your RTK files must also be accompanied by base observations. 

  • Uploading Drone Log Files:
    •  click Edit next to Drone log.

image14.png

    • Drag and drop the RTK file and wait until it has been uploaded. Once you see the blue check mark next to the file, click the Done.

image7.png

  • Uploading Base logs
    • click the Select source of base log dropdown arrow and select Local base station or NTRIP.

image3.png

Local Base Station Base Log Upload

You can upload observations collected from a local base station to generate high-accuracy outputs. You will need the RINEX file and the base station antenna position from the local base station at the time the observations were collected. Please make sure that the base log observation duration covers the mission duration.

  1. Click Select files under Base Station Log to add your local base (RINEX) file. Supported file extensions are currently .obs, .18o or .19o.
    Note: You can learn more about RINEX files by visiting PPK Processing Using A Local RTK Base
  2. Drag and drop the base station logs then click DONE.
    Note: You can only upload one RINEX file per upload and the observations from your RINEX file must span the entirety of all flights uploaded.image18.png
  3. Enter the base coordinates. Click Add position and enter the details of your base station antenna position.
    • Base station - choose the model base station you are using. This will automatically add the phase center height and add it to the pole height. If you do not see your model, please select “Custom base station” from the drop-down and manually enter the phase center height.
    • Pole height - the height of the pole that the base station is mounted on
    • Units - the unit of measurement your dataset is in
    • Coordinate system - the coordinate system used to measure the location of the base station antenna height. You can select from either:
      • WGS 84 / UTM Zone 10N - submitted in Easting, Northing, Height
      • WGS84 - submitted in Latitude, Longitude, and Height above the ellipsoid in meters.

image2__2_.png

Once all information has been entered, click DONE.

NTRIP Logger Base Station

Network RTK observations must be previously collected using the Skycatch NTRIP logger following the instructions here. Only the photos and drone logs from txplore1 are required in your upload, the observations collected via the NTRIP logger will already be available in the cloud.

image13.png

Precision Files Validation Check

Run the validation check by clicking on Check validity of precision files” to validate your files. If this button is grey, please review your precision files and verify that they have all been added and are in the correct format. The PPK validation process may take about a few minutes depending on the data.

image9.png

If you receive an error message in the validation check, please review this support center article to ensure all the criteria are met and retry the upload.

Step 4. Set Processing Qualitymceclip1.png

You can see your estimated time to data at the bottom of the screen.

For more information above DataHub's Processing Quality, please visit this FAQ article - FAQ: What Do The DataHub Quality Settings Mean?

Step 5. Mark GCPs + Checkpoints (if applicable)

Note: If you are not adding any control points, please skip this step and proceed to step 6 to start processing.

There are two types of control points: GCPs and checkpoints. Checkpoints are currently only used for verification purposes if the user reports an issue with the accuracy of their dataset. You will not automatically receive an accuracy report if you choose to upload checkpoints with a dataset.

To Add Control Points, please follow the steps in these articles and in order from 1-3:

  1. Control Points File Format for Data Processing
  2. How to Upload Control Points
  3. How to Manually Mark Control Points

image17.png

Step 6. Upload for Processing

Once you’ve reviewed your upload and are ready to start processing your data, click the Start process button to initiate the upload and submit your data for processing. You will see a status bar at the top right-hand corner of your screen indicating the progress of your upload.

image22.png

NOTE: Please keep your browser window open, disable any power saving or sleep modes on your computer, and ensure that it has a constant internet connection. If the network connection is interrupted for any reason, your upload will stop and will not be completed until a network connection is re-established.

The white dots on the satellite map will start to turn green as each photo is uploaded.

image1__4_.png

Check the status of your upload by hovering your mouse on the UPLOAD IN PROGRESS message to see the progress percentage.

If you would like to pause your upload for any reason, click the Pause button at the bottom right corner of the status bar. This will pause your upload and you can resume it at any time within the next 18 hours by clicking Resume.

It is recommended to pause the upload process if you encounter any of the following:

  1. Poor internet connection
  2. Low computer battery

 image5.png

Once the upload has been completed, the status will change from UPLOAD IN PROGRESS to PROCESSING IN PROGRESS. The site name and date and time the upload was started will be displayed, as well as the processing stage your data is in.

image12.png

To upload another dataset while your processing job is in progress, click Add Another DatasetYou will be able to check the status of all of the processing jobs in your queue in the same progress bar.

You will receive two emails as your dataset completes the two stages of processing. One notification will be sent when the processed 2D ortho map is available in the viewer and another will be sent when your data products have been uploaded to your account and are available for download.

For any questions or assistance in uploading, please contact Skycatch Support by clicking Help in the upper right-hand corner of your screen and choosing from the three available support options.

Was this article helpful?
5 out of 7 found this helpful
Have more questions? Submit a request

Comments

Powered by Zendesk