The goal of SEO is to get your website to the top of the search engine. One excellent way of tracking SEO progress is by checking the Search engine result pages (SERPs) of a website. In this tutorial, we are going to learn how to perform free SERP searches with a web-based tool, and also build a free SERP checker tool using Python. First, you will need to register an account to perform Google searches programmatically. Head over to to register with a free plan which gives you 50 free searches a day. Google Search API Manually (With API Console) To perform manual searches. Head over to the . Google Search API console To search for a particular keyword or set of keywords. Change the q parameter. To get search results for a different country change the country parameter it is defaulted to the United States. To change search results for a different language, change the language parameter. Click to perform the search. This API by default will return the top 100 results for that particular set of keywords. test-endpoint Although this method works for a small list of keywords. However, if you have a large list of websites or keywords to search the manual process can be tedious. Programically (With Python) We will be using Python3 to build our SERP tool. So first make sure you have Python3 installed. Next, we need a Python module urllib to call the Google Search API service. urllib urllib.parse urllib.request json import import import import Update the script once you have subscribed to the Google Search API service and received an access key. The API service expects the x-rapidapi-key in the headers of the request. ACCESS_KEY = KEYWORD = WEBSITE = # change this "gf4ak6ynirrqyfk5lox7yldzhf9z98cp4ffk9fkk5h5di0lugl" # change to keywords of interest "how to rank instagram" # change this to the website of interest "http://website.to.find" # change this The API requires at least the q parameter. That is where we will input the keywords we want to search for. country = language = data = { : KEYWORD, : country, : language } urlencoded = urllib.parse.urlencode(data) "US" "lang_en" "q" "country" "language" # build the url to make request We will make the request using urllib request. The API service will return the results in a JSON format. url = + urlencoded headers = { : , : ACCESS_KEY } req = urllib.request.Request(url, headers=headers) resp = urllib.request.urlopen(req) content = resp.read() results = json.loads(content) "https://google-search3.p.rapidapi.com/api/v1/search?" 'x-rapidapi-host' "google-search3.p.rapidapi.com" 'x-rapidapi-key' # create a GET request with the url and headers # read the results and parse the JSON Now to find out what rank the website is within the results. Just loop through the results and compare if the website is inside the link. found_in_results = rank, result enumerate(results): title = result[ ] link = result[ ] WEBSITE link: print( + str(rank)) found_in_results = found_in_results: print( ) False # keep track if we found the website for in 'title' 'link' if in "Found website at rank: " True if not "Could not find the website in search results." That is it. Make sure to change the API key, keyword, and website before running the script. To run the script simply run the following command. python3 serp_tool.py This script is pretty simple and error-prone. But should get you started with writing your own SERP tool. You can clone or download the entire script over at the . git repo With the basic plan, you are able to perform 50 free searches a day. If you have a large list of websites or keywords, I highly suggest upgrading to the pro plan which offers unlimited search. Previously published at https://blog.goog.io/web/scraping/2019/12/30/creating-a-serp-checker.html
