We are having performance issues for event retrieval whenever there are more events even below 500.
Can you help me to understand how partitioning can be done or pagination, as we need to perform operation for each event after retrieval and send it as a api response.
I tried below:
for unstructre_insight in client.events(type="Insight", limit=None,partitions=10):
(“do something with unstructre_insight in each partition in parallel to reduce response time”)
I observed that if there are 64 events, then all 64 events are retrieved in one execution, how we can get one partition at a time and perform something for first partition in parallel while retrieving second partition to reduce time.