Domain Level Data

This document will outline each different option under the selections menu 'Domain Level Data'.

  • Majestic (free or paid)
    Pulls back Majestic domain metrics such as Citation Flow and Trust Flow. This works via the Majestic API, and there is a free version as well as the lighnting fast paid API.

    How to: Add Majestic API details

  • Mozscape
    Pulls back Moz URL domain metrics such as Domain Authority, MozRank and MozTrust.

    How to: Add Mozscape API details
     
  • Ahrefs
    Pulls back Ahrefs domain metrics such as Ahrefs Domain Rank, backlinks and referring domains.

    How to: Add Ahrefs API details 
  • PageRank
    Pulls back Toolbar PageRank for the homepage of each URL (-1 indicates no Toolbar PageRank).

    How to:Add My-addr details for PageRank

  • Alexa Data
    Pulls back Alexa Traffic, Alexa Rank and Alexa Links for the domain.

    How to:  Add My-addr details for Alexa Data

  • Social Shares
    Pulls back social share counts for the homepage of each URL. The share counts are taken by directly querying the public API for each social network.

    How to:Select social networks for social share counts

  • Social Accounts
    Scrapes social account links from the homepage of each URL.

    How to:Select social networks for social profile accounts

  • Email Addresses
    Attempts to find and extract email addresses across the domain. This is done by identifying common pages such as About, Contact and Write For Us, then harvesting email addresses from these pages. The page URLs are also listed, as well as a 'All Email Addresses' column which combines all email addresses found.

  • WHOIS Emails
    Performs a WHOIS query on the domain and lists all email addresses found.

  • WHOIS Information
    Performs a WHOIS query on the domain and lists information such as Contact Name, Email Addresses (as above), Expiry Data, Created Date, Nameservers, Registar and the full WHOIS record.

  • Site Type
    Looks for common footprints in each website that identify the type of CMS/software used and the type of site (e.g. a blog, using WordPress)

  • IP Address
    Identifies the IP address and C Block of each domain, and how many other domains share that IP and C Block.
     
  • Bing Outbound LInks
    Uses Bing's linkfromdomain command the retrieve the number of links each domain is linking out to. It also checks how many pages are indexed in Bing and uses these two measures to work out the average (outbound) links per page. 

    If you are profiling anything more than a few URLs, we highly recommend the use of proxies for Google index checks.

    How to:
     Add proxies for checking Bing Outbound Links

  • Indexed in Google
    Checks to see if the homepage of each URL is indexed in Google, returning a binomial yes/no response. If you are profiling anything more than a few URLs, we highly recommend the use of proxies for Google index checks.

    How to: Add proxies for checking Domain Homepage Indexed in Google 
     
  • Malware Check
    Checks the root domain of each URL against Google's constantly updated blacklist of suspected phishing and malware pages. Uses the Google Safe Browsing API which you will need a free API key in order to use.

    How to: Add Google Safe Browsing API for Malware Checks

  • Wayback Machine
    Checks the homepage of each URL against archive.org's database, returning the number of Wayback Machine entries, the first date of entry and the last date of entry.
     
  • Drop History
    Checks the domain against whoisrequest.org records to retrieve the number of domain name drops and domain name server changes.

    How to: Add proxies for checking Domain Drop History 
     
  • SEMRush Rank
    Using the SEMRush (paid) API, pulls back SEMRush organic and paid domain data, such as Organic Traffic and Adwords Keyword (Number of).

    How to: Add SEMRush API details