Data Lens Developer's Guide

Uploading Data from a URL

As an alternative to uploading a dataset directly from a file via HTTP, you can use the Data Lens REST API to ingest a file which is available through a URL. This can be useful if the file is very big.

To ingest a file via a URL, do the following:

  1. Create an empty dataset with a POST including the following content as the request body:
      "name": "Name of your new dataset",
      "description": "Description of your new dataset, can be empty"
    to this resource:{YOUR_APP_ID}&app_code={YOUR_APP_CODE}
    You will receive a response body that contains the new dataset ID.
  2. POST the following request body:
        "source": {"url":"[URL of your file (or folder for SFTP)]"}
    to this resource:[dataset_id]?app_id={YOUR_APP_ID}&app_code={YOUR_APP_CODE}
    where [dataset_id] is the dataset ID received in the previous step. For example:
    {"source": {"url":""}}
  3. Optionally, you can check the progress of the data ingestion by sending a GET to the following resource:[job_id]?app_id={YOUR_APP_ID}&app_code={YOUR_APP_CODE}
    where [job_id] is the job ID included in the response of the previous step.

The supported protocols for the URL are HTTP, HTTPS and SFTP. For SFTP, the URL must point to a directory instead of a file. All csv, csv.gz or zip files in that directory are downloaded and added to the dataset. The dataset must have a predefined schema and all files in the directory must conform to it.

You cannot use this account to purchase a commercial plan on Developer Portal, as it is already associated to plans with different payment methods.

To purchase a commercial plan on Developer Portal, please register for or sign in with a different HERE Account.

Something took longer than expected.

The project should be available soon under your projects page.

Sorry, our services are not available in this region.

Something seems to have gone wrong. Please try again later.

We've detected that your account is set to Australian Dollars (AUD).
Unfortunately, we do not offer checkouts in AUD anymore.
You can continue using your current plan as normal, but to subscribe to one of our new plans,
please register for a new HERE account or contact us for billing questions on