/programmable-search/community?hl=en
This content is likely not relevant anymore. Try searching or browse recent questions.
-
Нow can I get 2500 results in one request in Google Search API? 0 Recommended Answers 8 Replies 3 Upvotes
1 Recommended Answer
$0 Recommended Answers
1 Relevant Answer
$0 Relevant Answers
I use Google Custom Search API to get google search results. But from json you can get only 100 results. I need to get 2500 results in one request. How can I do this?
Details
Most Relevant Answer Most Relevant Answers (0)
All Replies (8)
Most Relevant Answer
Hi Irina,

Google Programmable Search Engine and Custom Search API (Key enabled from Cloud Developer Console) are different product. Since there is no built-in API with Programmable Search Engine, if users want to retrieve results using JSON API, they will need to use the API key (enabled from Cloud Developer Console) alone with the Programmable Search engine ID and query. The results will be served as per the Programmable Search Engine configuration.

The result number in Programmable Search Engine that shows up initially is just an estimated number. This estimate may not be accurate. This is done to serve the results faster. As you navigate to the next results set you will start seeing the exact result number. 

Programmable Search Engine will only serve 10 pages (100 results). Since the estimated results are more than 100 you see the results navigation link 1 2 3 4 5 6 7 8 9 10 at the bottom of the 1st results set. As you navigate to next results set i.e by clicking on pagination 2 3 etc you will start seeing the exact result number. Now, if you directly click on 9 or 10 links or the last result page link, it may so happen that there are no results and therefore you get the message "no results found". This is how Programmable Search Engine works.

In the case of JSON API, the total count of results displayed in "totalResults" in JSON API is an estimate count for the first set of results for any given queries and not the exact count of results. This is done to serve results faster. Once you navigate to the next pages, you will get closer to the actual number of results. Once the first set of results is served, if you click on pagination link or use a start value to proceed to the next set of results, you will start getting a more accurate results count. 

Thanks
marked this as an answer
Most relevant based on info available
-
Most Relevant Answer
Hello Deepak,

2,500 results are 250 pages. When using the Custom Search API, the maximum value is start = 100. But I need to get all 250 pages. How can I do this programmatically?
marked this as an answer
Most relevant based on info available
Most Relevant Answer
Hi Irina,

Since the results are served from Programmable Search Engine configuration, even if you use CS JSON API, you cannot retrieve more than 100 results (10 pages) for a query.

Thanks
marked this as an answer
Most relevant based on info available
Most Relevant Answer
Hi Irina,

Since the results are served from Programmable Search Engine configuration, even if you use CS JSON API, you cannot retrieve more than 100 results (10 pages) for a query.

Thanks
marked this as an answer
Most relevant based on info available
Most Relevant Answer
There is no way to get all 2500 responses (more than 100 links) for the single request via any Google search API?
marked this as an answer
Most relevant based on info available
Most Relevant Answer
Hi Andrey,

1. I suppose we have some misunderstanding of my question. When I use Google search without API (any API: JSON or XML) via browser and make a single request I can see about 2500 response links. Yes, I see only 10 pages in pagination below each page, but when I click last page (e.g. #10) I got other pages (#11, #12, #13 and so on) and after clicking on the last one I can get more and more pages until the end of the response (2500).  So, I have the possibility to get all 2500 links for my single search request. 

A. The observation which you have mentioned is for Google.com results and not Programmable Search Engine. With Programmable Search Engine only 100 results (10 pages) are served for a query.

2. In case of using Google API (any ones as far as I understand)  I can get only 100 responses for my single search request. I would like to understand either exist some way to get all 2500 responses for the single request using any Google Search API, or it's impossible to get more than 100 responses for the request at all?

A. Since the results are served from Programmable Search Engine configuration, even if you use CS JSON API, you cannot retrieve more than 100 results (10 pages) for a query.

Thanks
marked this as an answer
Most relevant based on info available
Most Relevant Answer
Is it possible to change "Programmable Search Engine configuration" to get more than 100 responses for the single request? Maybe XML API or some other search API can return more responses?
marked this as an answer
Most relevant based on info available
Most Relevant Answer
Hi Andrey,

Q) Is it possible to change "Programmable Search Engine configuration" to get more than 100 responses for the single request? Maybe XML API or some other search API can return more responses?

A) No. It's not possible with CS JSON API. Will not be able to comment on other API's.

Thanks
marked this as an answer
Most relevant based on info available
This question is locked and replying has been disabled.
Discard post? You will lose what you have written so far.
Write a reply
10 characters required
Failed to attach file, click here to try again.
Discard post?
You will lose what you have written so far.
Personal information found

We found the following personal information in your message:

This information will be visible to anyone who visits or subscribes to notifications for this post. Are you sure you want to continue?

A problem occurred. Please try again.
Create Reply
Edit Reply
Delete post?
This will remove the reply from the Answers section.
Notifications are off
Your notifications are currently off and you won't receive subscription updates. To turn them on, go to Notifications preferences on your Profile page.
Report abuse
Google takes abuse of its services very seriously. We're committed to dealing with such abuse according to the laws in your country of residence. When you submit a report, we'll investigate it and take the appropriate action. We'll get back to you only if we require additional details or have more information to share.

Go to the Legal Help page to request content changes for legal reasons.

Reported post for abuse
Unable to send report.
Report post
What type of post are you reporting?
Google takes abuse of its services very seriously. We're committed to dealing with such abuse according to the laws in your country of residence. When you submit a report, we'll investigate it and take the appropriate action. We'll get back to you only if we require additional details or have more information to share.

Go to the Legal Help page to request content changes for legal reasons.

Reported post for abuse
Unable to send report.
This reply is no longer available.
/programmable-search/threads
//accounts.google.com/ServiceLogin
You'll receive email notifications for new posts at
Unable to delete question.
Unable to update vote.
Unable to update subscription.
You have been unsubscribed
Deleted
Unable to delete reply.
Removed from Answers
Marked as Recommended Answer
Removed recommendation
Undo
Unable to update reply.
Unable to update vote.
Thank you. Your response was recorded.
Unable to undo vote.
Thank you. This reply will now display in the answers section.
Link copied
Locked
Unlocked
Unable to lock
Unable to unlock
Pinned
Unpinned
Unable to pin
Unable to unpin
Marked
Unmarked
Unable to mark
Reported as off topic
/programmable-search/profile/0?hl=en