How to retrieve beyond 1000 items using OData
- Stratawise Support
Owned by Stratawise Support
In some instances, specialized power query is required to retrieve beyond the first 1000 items from the Stratawise OData endpoint.
Instructions
Copy the script below, updating the Tenant ID and Module Name. (Lines 5 & 13)
let
EntitiesPerPage = 1000,
GetEntityCount = () =>
let Json = Json.Document(Web.Contents("https://core.stratawise.com/odata/350/MA@POU", [Query=[#"$count"="true"]])),
Count = Json[#"value"]
in Count,
GetPage = (Index) =>
let Skip = Text.From(Index * EntitiesPerPage),
Top = Text.From(EntitiesPerPage),
Json = Json.Document(Web.Contents("https://core.stratawise.com/odata/350/MA@POU", [Query=[#"$skip"=Skip, #"$top"=Top]])),
Value = Json[#"value"]
in Value,
EntityCount = List.Max({ EntitiesPerPage, GetEntityCount() }),
PageCount = Number.RoundUp(EntityCount / EntitiesPerPage), //1,
PageIndices = { 0 .. PageCount - 1 },
Pages = List.Transform(PageIndices, each GetPage(_)),
Entities = List.Union(Pages),
Table = Table.FromList(Entities, Splitter.SplitByNothing(), null, null, ExtraValues.Error)
in
Table
Connect to through the existing Odata connection provided through the export prompt in the module grid.
Select Transform Data.
Select Advanced Editor.
Paste the updated script from above and select Done.
Select the icon at the top of the data set to expand.
Then OK.
Select Advanced Editor again.
Copy the resulting script to a text editor and replace “column1.“ with ““ (nothing).
Paste the updated script in and validate the resulting columns appear correct.
