The Hosted GET connector lets you expose Data Source rows from your own systems, for direct access by your app.
The key advantage of the HostedGET connector is that you can control the data rows being exposed to the app, letting you filter rows down to the individual app user level as desired.
For ERP, CRM and other enterprise systems this is important as the security/permissions around "who gets to see what" is critical.
A secondary benefit is that your data does not need to be pushed our platform, so any data sovereignty concerns you may have are resolved by this connector.
One final benefit is that Data Sources that run off of Hosted GET connectors are not subject to the standard 50,000 row limit, since the rows are delivered directly to the device.
NOTE: There are still performance limits on the app side when the rows become large - this varies across Android and IOS, and also depends heavily on the device specifications.
A rule of thumb, performance is affected by the overall file size of the data source more than the number of rows.
For example, 5,000 rows containing say 100k of text data per row can be expected to run slower than 50,000 rows which have a total of 1k of data per row (e.g. columns containing say just numbers and a few short text strings).
Additionally, use of "heavy" data sources in many screens that can be navigated sequentially by the user will result in a compounding performance decrease, as those big data sources can get progressively accumulated in device memory.
So, with Hosted GET, you really need to test on the app to find out what the best row count and screen mix are for your specific data set.
It is assumed that you have software development resources to create the web service needed by the Hosted GET connector.
If not, contact our professional services team to give you a hand.
Setting Up a GET Connector
- Create a Data Source as normal or select an existing Data Source for use.
- On the Rows page of your Data Source, manually define and organize your Data Source's columns to match the output of your web service.
The order of the columns must match up with what your web service returns in order for any column references to work.
If you change column orders on your web service response at any stage, you will need to update the columns on the Rows page to match. - On the Settings page of your Data Source, make sure that you set the External Id field with some value for identifying this Data Source.
Remember this External Id value, since you will need to it for when you work through the GET web service details later in this document. - Also on the Settings page, add a Hosted GET connector via the "Add Connector" button.
Specify the web address of your web service endpoint in the provided URL field.
You can also set a global DataSource GET URL on your organization and specify that the connector use it - this allows reuse of the same service endpoint across multiple Data Sources.
How the GET Connector Works
When the app discovers that a Data Source has a HostedGET connector, it performs a HTTP GET request against the target web service URL.
The GET request contains the External Ids of the Data Source's being requested along with other identifying information.
Included in the request is your account Integration Key (useful for authenticating the request), along with the logged in app user's email address (useful for filtering the rows based on the user's access).
The app will issue GETs to your service whenever it attempts a data synchronization.
Requests are issued by the app in a batch manner per unique target URL.
So for example if Data Source 1 and Data Source 2 both have the same GET connector URL, then the app makes a single GET request with the request containing the External Ids of both Data Sources.
This minimizes "chattiness" when many Data Sources are being sourced from the same endpoint.
IMPORTANT: We strongly recommend that you expose your web service endpoint as SSL secured HTTPS to ensure that app requests to your service are protected.
NOTE: Attached to the bottom of this document is a C# file that outlines the request and response structures as simple classes.
Even if you are not using C#, reviewing the properties and structure in code form can be very helpful in getting started with your own Hosted GET service.
GET Request
GET requests are issued by the app to your service, passing the values below as query string parameters.
The parameters passed on the request are as follows:
Input Name | Data Type | Required | Description |
Ids | String | Yes | Comma separated list of External Ids for each Data Source that the app wants to synchronize. |
ProviderId | Integer | Yes | Your unique Provider Id found on your Organization Setup page (My Account > Organization Setup) |
IntegrationKey | String | Yes | Your unique integration key found on your Organization Setup page (My Account -> Organization Setup). |
String | Yes | Email address of the logged in app user making the request. | |
DeviceId | GUID | Yes | The unique identifier of this user's device as registered on our platform. |
LastUpdated | DateTime | Yes | The last time that the app checked for Data Source updates. |
GET Response
IMPORTANT:
Your web service MUST return a response in the following structure.
Failure to comply with this format will result in failure to download rows on your app.
Your response MUST be in JSON format.
We also support compression on responses.
This is recommended for large data sets, since text data compresses very well and thus will conserve mobile data allocations and massively reduce download time.
Rows Response (<DRowsResponse>)
Input Name | Data Type | Required | Description |
DataSources | Collection of DataSource | No | Collection containing the DataSources that have been requested. If nothing has changed since the LastUpdated received from the app request, then you can simply return a response with no DataSources property defined or, if returning multiple data sources, then no Rows, NewRows and DeletedRows properties set on those you do not wish to update. |
LastUpdated | DateTime | Yes | The last time that the rows for these Data Sources were updated. Generally, we recommend that this should be the current date and time on your host server at the time of processing the request. |
Data Source (<DataSource>)
Input Name | Data Type | Required | Description |
Id | String | Yes | The External Idof the DataSource for which the associated Row data applies. |
Rows | Collection of Row | No | A collection of Rows that will completely replace all current Data Source rows on app. |
NewRows | Collection of Row | No | A collection of Rows that should be added/updated onto the existing Data Source rows on the app. |
DeletedRows | Collection of Row | No | A collection of Row Items that should be deleted from the existing Data Source rows on the app. |
Row (<Row>)
Each Row is a collection of Val (<Val>) items, which are the individual column values for that Row.
Every Row must contain at least two Vals and must have as many Vals as there are Headers (columns).
The first Val should be the unique identifier or key that will be used as the answer value should this Data Source row be selected in a Form. The first Val is also critical as the key for performing incremental deletes through the DeletedRows field mentioned above.
The second Val should be the default displayable label text of the row. You can override this default by configuring the Display Options field in the Data Source "Settings" page.
Input Name | Data Type | Required | Description |
Val | String | Yes | A column value for this row, can contain any string value. |
If the GET is unsuccessful, your web service should return a 400 level HTTP status.
API Usage Example
Given that this connector is REST based, you can test your web service directly via your web browser using a REST plugin like the Postman plugin for Google Chrome.
In this example, we assume you have set the "Target GET URL" on your Hosted GET Connector to be https://yourdomain.com/xx/rowsearch
We also assume that the Data Source has an External Id of "JOBS"
GET Request (made by the app, with user@somewhere.com as the logged in user)
1 | GET https://yourdomain.com/xx/rowsearch?email=user@somewhere.com&integrationkey=xxxxxxxxxxxx&providerid=1&ids=JOBS,JOBS-DISS&lastupdated=2013-02-12T14:24:09 |
GET Response
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 | { "DataSources":[ { "Id":"JOBS", "Rows":[ [ "10011", "10011 - Test Generic Project", "TEST", "12345AA", "19 Nov 2013", "12 Somewhere Road" ], [ "ZDS654", "ZDS654 - Maintenance Costs to Excavator", "TEST", "", "27 Nov 2013", "24 Somewhere Else Road" ], [ "ZDF662", "ZDF662 - Maintenance Costs for Hitachi Excavator", "TEST2", "", "28 Nov 2013", "182 Another Place, Somewhere" ] ], "NewRows":[
], "DeletedRows":[
] }, { "Id":"JOB-DISS", "Rows":[ [ "10011-0201", "Project Management", "10011", "Y" ], [ "10011-0202", "Quality Control", "10011", "Y" ], [ "10011-0251", "Electrical Design", "10011", "Y" ] ], "NewRows":[
], "DeletedRows":[
] } ], "LastUpdated":"2014-03-11T15:45:50.4818098+10:00" } |
Example Code
Attached to the bottom of this document is a C# file that outlines the request and response structures as simple classes.
Even if you are not using C#, reviewing the properties and structure in code form can be very helpful in getting started with your own Hosted GET service.
Troubleshooting / Testing
Once you have set up a Hosted GET connector on your Data Source, the Rows page for that Data Source will automatically attempt to pull back rows from the given GET URL.
The Rows page makes the same request as the app would, using your current logged in user as part of the request.
This is a quick and easy way to see if your Hosted GET web service is understanding the GET request and is returning rows in the correct format.
What to do when a Hosted GET works on my IOS app, but not on Android?
This is almost certainly due to the way that Android treats SSL certificates - essentially Android is stricter about SSL certificate chains.
SSL certificate chains involve the primary SSL certificate for your web service endpoint domain, along with any intermediate certificates issued by your Certificate Authority.
If you attempt to connect to a web address that features an incomplete SSL chain, then Android will fail the connection.
This is likely what is happening with requests by your Android devices to your Hosted GET web domain.
To test what we mean, attempt to browse to your Hosted GET service URL from your default Android web browser.
You will likely get a connection error with text such as "the certificate authority is invalid".
You can further verify your SSL configuration using a testing service like SSL Labs:
https://www.ssllabs.com/ssltest/
If your SSL installation has issues, you will see warnings such as "chain incomplete" on the SSL Labs test results.
To resolve the issue, you need to ensure that the server running the Hosted GET web service has the intermediate certificates from your Certificate Authority installed.
For example, if you use GoDaddy, the best place to start would be here:
https://support.godaddy.com/help/article/868/what-is-an-intermediate-certificate?countrysite=au
Once you have the correct certificate chain in place, the Hosted GET data sources will sync to your Android devices since they can now connect to your web service.
You can confirm the certificate chain by simply checking the Hosted GET URL in your Android web browser - it should no longer show certificate errors when resolved.
- HostedGET.txt (2 KB)