I’m trying to leverage the API to fetch all matches without duplicates but I can't seem to identify which documentation covers the pagination. I know responses include next_page_token and previous_page_token but is there any official documentation on how these work?
- Does the last page have a
next_page_tokenlooping to the first page, requiring us to perform loop detection? - Are these tokens/pages to be consumed immediately or can we consume these several minutes/hours apart? For example, if Censys gets new hits while we are processing the pages, are new results appended, ignored, or do they get inserted and potentially cause duplicates by shifting the pagination?
I was unable to find pagination examples in the Go SDK which would have implied the correct usage, nor could I find other community topics explaining next_page_token beyond mentioning their existence.
I would appreciate any insights or references to the docs,
Thanks!

