Skip to main content
Question

Request for Access to Censys Google Cloud BigQuery Integration


Hi Censys Team,

I am writing to request access to the Google Cloud BigQuery integration for our enterprise account.

Currently, we ingest the daily IPv4 host dataset by downloading raw JSON files and processing them via AWS Lambda pipelines. We believe this workflow introduces unnecessary complexity and computational overhead. To streamline this process, we intend to shift the workload to BigQuery, allowing us to process the data natively within GCP using standard SQL and transfer only the refined results to our environment.

Could you please advise on the next steps to get this provisioned?
Specifically, let us know if you require our GCP Project ID or a dedicated Service Account email to grant the necessary read permissions.

Looking forward to your response.
Best regards,

3 replies

LauraP_Censys
Forum|alt.badge.img

Hi Lior,

I sent you a follow-up email with more details on next steps, but received a blank automated response back. Could you please confirm you received it on your end?

Best,
Laura


  • Author
  • New Participant
  • October 6, 2026

Thank you for your response.

I would appreciate it if you could share the new data download schema. This will allow us to review the differences, prepare for the upcoming changes, and be fully ready for the meeting.

Additionally, what is the best practice for bulk downloading data from your API?
We are currently using pagination via the "next_page" field.
Is there a more efficient method you would recommend?


LauraP_Censys
Forum|alt.badge.img

Hi ​@lior4242,

Thanks for your follow-up. I'll send you the details on the new data download schema and bulk download best practices by email shortly. I've also sent a short note to check that my messages are reaching you. Could you confirm when you see it?

Thanks,
Laura