Skip to main content
Solved

Issue with API Query Results - Only First Page Saved in JSON

C

I recently upgraded my account to use the API after the recent platform update.

I am using Windows CMD to run queries and successfully download the results as a JSON file.

However I noticed that the JSON file only contains the first page of results, while the full query results are available when I run the same query on the website

 

I would like to download the entire set of results as a JSON file. Could you please guide me on how to achieve this uising the API?

 

curl -X "POST" "https://api.platform.censys.io/v3/global/search/query?organization_id=secret" --header "X-Organization-ID: secret" --header "Accept: application/json" --header "Authorization: secret" --header "Content-Type: application/json" -d "{\"query\":\"1.1.0.0\"}" > 1.1.json

 

 

Best answer by MattK_Censys

You need to input the next page token in your API call to obtain the next page of results. So, for example, when I run the following curl:

curl --request POST \
     --url 'https://api.platform.censys.io/v3/global/search/query?organization_id=abcdef’ \
     --header 'accept: application/json' \
     --header 'authorization: abcdef’ \
     --header 'content-type: application/json' \
     --data '
{
  "query": "host.ip: \"1.1.0.0/16\""
}
'

The first few lines of the response includes next_page_token, as shown in the abbreviated example below:

{
  "result": {
    "total_hits": 20716,
    "next_page_token": "1234567890",
    "previous_page_token": "",
    "query_duration_millis": 28,
    "hits": [!!snip

To obtain the next page of results, I add the page_token parameter in a subsequent curl:

curl --request POST \
     --url 'https://api.platform.censys.io/v3/global/search/query?organization_id=abcdef’ \
     --header 'accept: application/json' \
     --header 'authorization: abcdef’ \
     --header 'content-type: application/json' \
     --data '
{
  "page_token": "1234567890",
  "query": "host.ip: \"1.1.0.0/16\""
}
'

Let me know if you have any follow-up questions.

View original
Did this topic help you find an answer to your question?

MattK_Censys
Forum|alt.badge.img+2
  • MattK_Censys
  • Censys Community Manager
  • March 31, 2025

Hi there! Could you please provide the example output that you receive, and if possible a query that is more reflective of what you’re searching? Thanks!

C

Sorry for not providing detailed query and query result (json)

In the query I uploaded, after changing the IP (1.1.0.0/16) myself, the total hits are about 360 in the output result, but only 100 host IPs are in the json file

In the past, all results were output with a simple API call in censys.io, but now only 100 are output. Is there any way to solve this?
I want about 360 results (total results) to be output as a json file.

For reference, the next_page_token value is in the json file.

MattK_Censys
Forum|alt.badge.img+2
  • MattK_Censys
  • Censys Community Manager
  • April 2, 2025

I checked with the team and unfortunately there is not a built-in way to do this in the Platform API currently. You will need to specify the next page token in your API calls to obtain each page of results.

We will release some additional developer resources for Platform shortly that should make this easier.

C

Thank you for your kind reply.

I think it is an unavoidable situation.

Then, if there is a CMD command that can output about 360 results at once using the next page token, please let me know.

 

EX)

curl -X "POST" "https://api.platform.censys.io/v3/global/search/query?organization_id=secret" --header "X-Organization-ID: secret" --header "Accept: application/json" --header "Authorization: secret" --header "Content-Type: application/json" -d "{\"query\":\"1.1.0.0\"}" > 1.1.json

 

It would be nice if you could guide me on the query that should be added to this command.
I always appreciate your hard work.

MattK_Censys
Forum|alt.badge.img+2
  • MattK_Censys
  • Censys Community Manager
  • April 3, 2025

You need to input the next page token in your API call to obtain the next page of results. So, for example, when I run the following curl:

curl --request POST \
     --url 'https://api.platform.censys.io/v3/global/search/query?organization_id=abcdef’ \
     --header 'accept: application/json' \
     --header 'authorization: abcdef’ \
     --header 'content-type: application/json' \
     --data '
{
  "query": "host.ip: \"1.1.0.0/16\""
}
'

The first few lines of the response includes next_page_token, as shown in the abbreviated example below:

{
  "result": {
    "total_hits": 20716,
    "next_page_token": "1234567890",
    "previous_page_token": "",
    "query_duration_millis": 28,
    "hits": [!!snip

To obtain the next page of results, I add the page_token parameter in a subsequent curl:

curl --request POST \
     --url 'https://api.platform.censys.io/v3/global/search/query?organization_id=abcdef’ \
     --header 'accept: application/json' \
     --header 'authorization: abcdef’ \
     --header 'content-type: application/json' \
     --data '
{
  "page_token": "1234567890",
  "query": "host.ip: \"1.1.0.0/16\""
}
'

Let me know if you have any follow-up questions.

MattK_Censys
Forum|alt.badge.img+2
  • MattK_Censys
  • Censys Community Manager
  • April 8, 2025

Hey ​@Censys_Power , just wanted to check in and see if this worked for you. Let me know!

Reply


Most helpful members this week

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
Censys logo

censys.com | Knowledge Base | Censys Search | Contact Us